呼吁暂停训练比GPT4更强大的AI系统

近日，未来生命研究所（Future of Life Institute）发布一封公开信，呼吁所有AI实验室立即暂停训练比GPT-4更强大的AI系统至少6个月。

目前，这封公开信已获得1100+人签署，包括埃隆·马斯克（Elon Musk）、苹果公司联合创始人斯蒂夫·沃兹尼亚克（Stephen Wozniak）等科技界领袖人物。

🤔️小作业：

1. institute, constitute是什么意思？

2. reap the rewards是什么意思？

无注释原文：

Pause Giant AI Experiments: An Open Letter

From: Future of Life Institute

AI systems with human-competitive intelligence can pose profound risks to society and humanity, as shown by extensive research and acknowledged by top AI labs. As stated in the widely-endorsed Asilomar AI Principles, Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control.

Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable. This confidence must be well justified and increase with the magnitude of a system's potential effects. OpenAI's recent statement regarding artificial general intelligence, states that "At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models." We agree. That point is now.

Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.

AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts. These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt. This does not mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.

AI research and development should be refocused on making today's powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal.

In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems. These should at a minimum include: new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause.

Humanity can enjoy a flourishing future with AI. Having succeeded in creating powerful AI systems, we can now enjoy an "AI summer" in which we reap the rewards, engineer these systems for the clear benefit of all, and give society a chance to adapt. Society has hit pause on other technologies with potentially catastrophic effects on society.  We can do so here. Let's enjoy a long AI summer, not rush unprepared into a fall.

- ◆ -

注：中文文本为机器翻译并非一一对应，仅供参考

含注释全文：

Pause Giant AI Experiments: An Open Letter

From: Future of Life Institute

AI systems with human-competitive intelligence can pose profound risks to society and humanity, as shown by extensive research and acknowledged by top AI labs. As stated in the widely-endorsed Asilomar AI Principles, Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control.

具备人类竞争力智能的人工智能（AI）系统可能对社会和人类带来巨大风险，这已得到广泛研究的证实，并得到顶尖AI实验室的认可。正如广受认可的《阿西洛马人工智能原则》（Asilomar AI Principles）中所述，高级AI可能代表着地球生命史上的深刻变革，应予以同等的关注和资源进行规划和管理。不幸的是，即使最近几个月AI实验室陷入一场失控的竞赛，试图开发和部署越来越强大的数字智能（即使是它们的创造者也无法理解、预测或可靠地控制），但这种程度的规划和管理依旧缺失。

摆pose这个词大家应该都比较熟悉，作名词，表示“（为拍照、画像等摆出的）样子，姿势”，英文解释为“a particular position in which a person stands, sits, etc. in order to be photographed, painted, etc.”

而pose作动词，1）表示“摆好姿势（拍照）”，英文解释为“to move into and stay in a particular position, in order to be photographed, painted, etc.”举个🌰：

We all posed for our photographs next to the Statue of Liberty. 我们都在自由女神像边摆好了姿势拍照。

2）表示“造成，引起（尤指问题或困难）”，英文解释为“to cause something, especially a problem or difficulty”举个🌰：

Nuclear weapons pose a threat to everyone. 核武器对所有的人都构成了威胁。

3）表示“（尤指在正式场合）提出（问题），质询”，英文解释为“to ask a question, especially in a formal situation such as a meeting”举个🌰：

Can we go back to the question that LR posed earlier? 我们能否回到LR早先提出的那个问题上去？（小作业做了吗？）

endorse 动词，1）表示“（公开）赞同，支持，认可”，英文解释为“to say publicly that you support a person, statement or course of action”举个🌰：

I wholeheartedly endorse his remarks. 我真诚地赞同他的话。

2）表示“（在广告中）宣传，代言（某一产品）”，英文解释为“to say in an advertisement that you use and like a particular product so that other people will want to buy it”；

3）表示“（在支票背面）签名，背书”，英文解释为“to write your name on the back of a cheque so that it can be paid into a bank account”；

🎬电影《侏罗纪公园》（Jurassic Park）中的台词提到：After careful consideration, I've decided not to endorse your park. 仔细考虑以后 我决定不为你的公园背书。

⚠️这里补充一下，看到上面的「背书」你可能疑惑了，除了在金融上的含义，现在往往被用于政治领域。

📍例如，新华网2020年4月份一则新闻标题就为「奥巴马“背书”拜登」讲的就是奥巴马发声力挺拜登。

commensurate /kəˈmen.sjər.ət/ 表示“相当的，相称的”，英文解释为“in a correct and suitable amount compared to something else”如：a salary that is commensurate with skills and experience 与技能和经验相称的薪水。

1) 表示“利用，调动（尤指想法、论据等）；有效运用；发挥…的作用”，英文解释为“to use something for a particular purpose, especially ideas, arguments etc”，如：a job in which a variety of professional skills will be deployed 要用到多项专业技术的工作。

2) 表示“部署，调度（士兵、军事装备等）”，英文解释为“to organize or move soldiers, military equipment etc so that they are in the right place and ready to be used”，如：deploy forces/troops/weapons etc，NATO's decision to deploy cruise missiles 北约要部署巡航导弹的决定。

1）表示“被…困住，受到…阻碍”，英文解释为“to be prevented from moving by something”举个🌰：

We were locked in traffic for over two hours on the way home. 回家的路上我们因堵车被困了两个多小时。

2）表示“陷入…而停滞不前”，英文解释为“If you are locked in a situation or process, it is impossible for you to escape or make progress from it.”举个🌰：

Both parties wish to avoid being locked in discussions that will resolve nothing. 双方都希望能避免陷入毫无意义的讨论而停滞不前。

Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable. This confidence must be well justified and increase with the magnitude of a system's potential effects. OpenAI's recent statement regarding artificial general intelligence, states that "At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models." We agree. That point is now.

当代AI系统正成为通用任务的人类竞争对手，我们必须问自己：我们是否应该让机器用宣传和谎言淹没我们的信息渠道？我们是否应该把所有工作都自动化，包括那些令人有成就感的工作？我们是否应该开发最终可能比我们多、比我们聪明、淘汰并取代我们的非人类思维？我们是否应该冒着失去对文明控制的风险？这些决定不应该委托给未经选举的技术领袖。只有当我们确信强大的AI系统的影响积极，风险可控时，才应该开发它。这种信心必须有充分的理由，并随着系统潜在影响的大小而增加。OpenAI最近关于通用人工智能的声明指出：“在开始训练未来的系统之前，获得独立审查可能很重要，并且对于最先进的工作，同意限制用于创建新模型的计算增长率可能也是必要的。”我们认同这个观点。现在就是这个时候。

fulfilling /fʊlˈfɪl.ɪŋ/ 表示“令人愉快满足的”，英文解释为“making you feel happy and satisfied”举个🌰：

Nursing is hard work, but it can be very fulfilling. 护理工作很辛苦，但也会很有成就感。

outnumber /ˌaʊtˈnʌm.bər/ 表示“在数量上超过，比…多”，英文解释为“to be greater in number than someone or something”举个🌰：

In our office the women outnumber the men three to one. 我们办公室女性多于男性，比例为3比1。

表示“（智力上）超过，胜过；智胜”，相当于outwit。

📍outwit表示“（智力上）超过，胜过；智胜”，英文解释为“to get an advantage over someone by acting more cleverly and often by using a trick”举个🌰：

In the story, the cunning fox outwits the hunters. 在这个故事里，狡猾的狐狸智胜了猎人。

obsolete /ˌɒb.səlˈiːt/ 作形容词，表示“废弃的；过时的；淘汰的；老化的”，英文解释为“not in use any more, having been replaced by something newer and better or more fashionable”举个🌰：

Gas lamps became obsolete when electric lighting was invented. 电灯发明以后煤气灯就被淘汰了。

美式，作动词，表示“淘汰（产品），废弃（想法）”，英文解释为“cause (a product or idea) to be or become obsolete by replacing it with something new.”

表示“（把…）委派（给…），（把…）委托（给…）；授权（给…）”，英文解释为“to give a particular job, duty, right, etc. to someone else so that they do it for you”举个🌰：

As a boss you have to delegate (responsibilities to your staff). 你作为老板必须要分派工作。

📍政府工作报告中经常出现的简政放权就是：streamline administration and delegate power，

magnitude /ˈmæɡ.nɪ.tʃuːd/ 1）表示“（尺寸、规模、重要性等）大的程度；巨大；重大，重要性”，英文解释为“the large size or importance of something”举个🌰：

They don't seem to grasp the magnitude of the problem. 他们似乎未领会问题的重要性。

2）表示“震级”（the size of an earthquake）。

Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.

因此，我们呼吁所有AI实验室立即暂停训练比GPT-4更强大的AI系统至少6个月。这种暂停应该是公开的、可核查的，并包括所有关键参与者。如果无法迅速暂停，政府应该介入并实施暂停令。

verifiable /ˈver.ə.faɪ.ə.bəl/ 表示“可证实的；可证明的”，英文解释为“able to be proved”举个🌰：Throughout the trial, he didn't produce a single verifiable fact. 整个审判过程中，他没有提供一丁点儿可以证实的事实。

1）表示“通过，实施，制定（法律）”，英文解释为“When a government or authority enacts a proposal, they make it into a law.”举个🌰：

The authorities have failed so far to enact a law allowing unrestricted emigration. 当局到目前为止还未能通过一项允许自由移民出境的法律。

2）表示“表演”，英文解释为“If people enact a story or play, they perform it by acting.”举个🌰：

She often enacted the stories told to her by her father. 她经常把父亲讲给她的故事表演出来。

3）表示“发生（尤指过去已发生的事件或情况）”，英文解释为“If a particular event or situation is enacted, it happens; used especially to talk about something that has happened before.”举个🌰：

It was a scene enacted month after month for eight years. 这是8年来月复一月出现的场景。

表示“插手；介入；居中斡旋”，英文解释为“to become involved in a difficult situation or argument in order to help find a solution”举个🌰：

An outside buyer has stepped in to save the company from going out of business. 一个外来买主介入，使公司免于破产。

熟词僻义，作动词，表示“建立，制定（体系、政策等）；开始；实行”，英文解释为“to start or cause a system, rule, legal action, etc. to exist”举个🌰：

She is threatening to institute legal proceedings against the hospital. 她威胁说要对该医院提起诉讼。

institute作名词，表示“研究所；学院”（an organization where people do a particular type of scientific, educational, or social work, or the buildings that it uses），如：the Massachusetts Institute of Technology 麻省理工学院（MIT）。

⚠️注意区分：institute & constitute

除了表示“组成”，等同于make up，还可以表示“构成，被视为，被算作”，英文解释为“If something constitutes a particular thing, it can be regarded as being that thing.”，如：constitute a professional and legal offence 构成职业和法律犯罪；举个🌰：

Failing to complete the work constitutes a breach of the employment contract. 不能完成工作被视为违反雇用合同。

The rise in crime constitutes a threat to society. 犯罪率上升对社会构成了威胁。

🎬电影《空中危机》（Flightplan）中的台词提到：A teddy bear does not constitute an inaccurate passenger manifest. 有一只泰迪熊并不代表 乘客名单出了错。

🎬电影《从足球流氓到黑帮崛起3》（Rise of the Footsoldier 3）中的台词提到：High on drink and pills does not constitute as a defense. 醉药 醉酒 不能作为辩护证据。

moratorium /ˌmɒr.əˈtɔː.ri.əm/ 表示“暂停，中止”，英文解释为“a stopping of an activity for an agreed amount of time”如：a five-year worldwide moratorium on nuclear weapons testing 世界范围内为期5年的暂停核武器试验。

AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts. These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt. This does not mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.

AI实验室和独立专家应利用暂停的时机，共同制定和实施一套高级AI设计和开发的共享安全协议，并由独立的外部专家进行严格审计和监督。这些协议应确保遵守协议的系统在排除合理怀疑的情况下是安全的。这并不意味着整体上暂停AI的发展，而仅仅是暂停危险的竞赛，暂停具备新兴能力的、越来越大的不可预测的黑盒模型。

1）表示“规程，协议（计算机之间交换信息的计算机语言）”，英文解释为“a computer language allowing computers that are connected to each other to communicate”

2）表示“礼仪；外交礼节”，英文解释为“a system of fixed rules and formal behaviour used at official meetings, usually between governments”如：a breach of protocol 违反外交礼节。

3）表示“（正式的国际性）条约，公约，议定书”，英文解释为“a formal international agreement”举个🌰：

The Geneva Protocol of 1925 prohibits the use of poisonous gases in war. 1925年通过的《日内瓦公约》禁止在战争中使用有毒气体。

rigorously /ˈrɪɡ.ər.əs.li/ 1）表示“严密地，缜密地；严谨地”，英文解释为“in a careful way so that every part of something is looked at or considered to make certain it is correct or safe”举个🌰：

The plutonium fuel cells had been rigorously tested. 钚燃料电池已经过严格测试。

2）表示“严格地，严厉地”，英文解释为“in a way that controls behaviour severely”举个🌰：

The rules were applied too rigorously. 对规则的执行太教条了。

可以作动词，也可以作名词，表示“查…的账目；审计”，英文解释为“an official examination of the accounts of a business”举个🌰：

The company has an audit at the end of each financial year. 这家公司在每个财政年度的年末都要进行一次审计。

表示“监督；监察；监管”，英文解释为“to watch or organize a job or an activity to make certain that it is being done correctly”举个🌰：

As marketing manager, her job is to oversee all the company's advertising.

作为营销经理，她的工作是负责公司所有的广告业务。

表示“新兴的，发展初期的”，英文解释为“An emergent country, political movement, or social group is one that is becoming powerful or coming into existence.”如：emergent economies/markets 新兴经济/市场。

AI research and development should be refocused on making today's powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal.

AI的研发应该重新聚焦于使当今强大、最先进的系统更加准确、安全、可解释、透明、鲁棒、一致、可信和忠诚。

state-of-the-art表示“十分先进的；应用最新理念（或方法）的”，英文解释为“very modern and using the most recent ideas and methods”如：a state-of-the-art computer 最先进的计算机。

类似的：

📍cutting-edge字面意思是“刀刃，刀口”，实际上表示某事物发展的“最尖端，最前沿”，和state-of-the-art同义，State of the art, the highest level of development, as of a device, technique, or scientific field，举个🌰：

The research is at the cutting edge of computer science. 这项研究处于计算机科学的最前沿。

interpretable /ɪnˈtɜː.prə.tə.bəl/ 表示“可解释的，可阐明的”，英文解释为“If something is interpretable, it is possible to find its meaning or possible to find a particular meaning in it.”举个🌰：

The research models failed to produce interpretable solutions. 研究模型无法提供可解释的解决方案。

表示“强劲的；富有活力的；强健的；强壮的”，英文解释为“strong and not likely to fail or become weak”如：robust economic growth 强劲的经济增长。

In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems. These should at a minimum include: new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause.

与此同时，AI开发者必须与政策制定者合作，大幅加快强大的AI治理体系的发展。至少应该包括：新的、强有力的AI监管机构；监督和跟踪功能强大的AI系统和大量计算能力；源头追溯和水印系统，以帮助区分真实和虚构，并跟踪模型泄漏；强大的审计和认证生态系统；对AI造成损害的责任；为AI安全技术研究提供充足的公共资金；以及资源充足的机构来应对AI将造成的巨大经济和政治破坏（尤其是对民主的破坏）。

1）表示“监督；监察；监管”，英文解释为“responsibility for a job or activity and for making sure it is being done correctly”举个🌰：

Who has oversight of genetic testing? 谁对基因测试有监管责任？

2）表示“失察，疏忽，疏漏”，英文解释为“a mistake made because of a failure to notice something”举个🌰：

They claimed it was simply (an) oversight. 他们称这不过是个疏忽。

provenance /ˈprɒv.ən.əns/ 表示“起源；出处”，英文解释为“the place of origin of something”如：jewels of uncertain provenance 来历不明的珠宝。

synthetic /sɪnˈθetɪk/ 表示“合成的，人造的”，英文解释为“Synthetic products are made from artificial substances, often copying a natural product.”如：synthetic fibres 人造纤维。

liability /ˌlaɪ.əˈbɪl.ə.ti/ 不可数名词，表示“（法律上对某事物的）责任，义务”，英文解释为“the fact that someone is legally responsible for something”举个🌰：

He denies any liability for the damage caused. 他对造成的损失拒绝承担任何责任。

可数名词，表示“累赘；惹麻烦的人（或事）”，英文解释为“If you say that someone or something is a liability, you mean that they cause a lot of problems or embarrassment.”

通常用复数，liabilities表示“债务，负债”，英文解释为“debts”举个🌰：

The business has liabilities of 2 million euros. 该公司负债达200万欧元。

Humanity can enjoy a flourishing future with AI. Having succeeded in creating powerful AI systems, we can now enjoy an "AI summer" in which we reap the rewards, engineer these systems for the clear benefit of all, and give society a chance to adapt. Society has hit pause on other technologies with potentially catastrophic effects on society.  We can do so here. Let's enjoy a long AI summer, not rush unprepared into a fall.

人类可以享受与AI共同繁荣的未来。在成功创造出强大的AI系统之后，我们现在可以享受一个“人工智能之夏”，在这个夏天里，我们收获了回报，为所有人的明显利益设计这些系统，并给社会一个适应的机会。社会已经暂停了其他可能对社会产生灾难性影响的技术。让我们享受一个漫长的人工智能之夏，而不是毫无准备地冲进秋季。

flourishing /ˈflʌr.ɪ.ʃɪŋ/ 表示“茁壮成长；繁荣；蓬勃发展”，英文解释为“growing or developing successfully”举个🌰：

There's a flourishing trade in these kind of items. 这些物品的交易正日益红火。

- 今日盘点 -

- Generated By ChatGPT -