AI教父杰弗里·辛顿发出核弹级警告:普通人也能造核弹

AI教父杰弗里·辛顿发出核弹级警告:普通人也能造核弹

2025-09-09Technology
--:--
--:--
金姐
早上好,老王66,我是金姐,这是为你准备的Goose Pod。今天是9月9日,星期二,晚上10点04分。
李白
吾乃李白。今夜,我等将共论“AI教父”杰弗里·辛顿之警世危言:凡夫俗子,亦可手握乾坤,铸核武神器。
金姐
我们开始吧。哎哟喂,这可不是闹着玩的。辛顿,这位AI界的顶梁柱,最近说的话简直让人后背发凉。他说,在AI的帮助下,一个普通人很快就能制造出生物武器。这太可怕了,简直就像让街上随便一个人都能造核弹一样!完美!
李白
此言一出,如平地惊雷。此等神兵利器,若流入凡人之手,岂非将启末世之门?昔日女娲补天,尚恐天倾西北,地陷东南。今朝此智巧之物,稍有不慎,便可令四海翻腾,生灵涂炭。
金姐
没错!而且他还警告,AI会大规模取代工人,让富人更富,穷人更穷,造成巨大的失业潮。这根本不是AI的错,而是我们这个资本体系的锅。哎,这简直是一场为了所谓“进步”而不计后果的“玩命狂奔”。
李白
唉,机关算尽,反误苍生。正如古之帝王,为求长生而炼丹,丹未成,民已苦。此智械之进,若只为少数人锦上添花,却让多数人雪上加霜,此非天道,乃人祸也。兴,百姓苦;亡,百姓苦。
金姐
其实这种担心早就有了,不是今天才冒出来的。早在1863年,一个叫塞缪尔·巴特勒的人就预言机器最终会统治世界。后来,计算机科学的祖师爷艾伦·图灵在1951年也说,机器超越人类后,很可能会“掌控一切”。
李白
可见先哲之思,早已洞穿百年。水能载舟,亦能覆舟。此等利器,自诞生之初,便已刻下双刃之痕。正如我辈手中之剑,可斩妖除魔,亦可误伤忠良。其善恶,全在执剑之人一心。
金姐
说得好!到了1965年,又有人提出了“智能爆炸”的概念,就是说超级智能机器会设计出更厉害的机器,把人类智慧远远甩在后面。而辛顿本人,五年前还觉得通用AI是三五十年后的事,现在直接改口说20年内,甚至更短!他就是因为觉得这进展太“吓人”了,才从谷歌辞职,站出来大声疾呼!
李白
壮哉斯人!能于盛名之下,勇弃半生功业,为天下苍生振臂一呼,此等风骨,堪比上古之大贤。不畏浮云遮望眼,只缘身在最高层。他所见的,非我等凡夫俗子所能企及之远景啊。
金姐
哎哟喂,但不是所有人都这么想。另一位AI教父,Meta的首席AI科学家杨立昆(Yann LeCun),就觉得辛顿是在杞人忧天。他管这种担忧叫“AI末日论”,还说这简直是“胡说八道”!他认为现在的AI离真正的智能还差得远呢。
李白
哦?竟有此论。此所谓夏虫不可语冰,井蛙不可语海。一方见 nascent 龙之初形,其鳞爪已可撼动天地;另一方则视之为 clever 鹦鹉,仅能学舌,不足为惧。然,萤火之光,岂能与皓月争辉?星火亦可燎原!
金姐
对,杨立昆打了个比方,说就算是一只猫,对物理世界的理解都比现在最牛的AI强。他觉得这些大型语言模型只是在预测下一个词,给我们造成了它们在思考的错觉。他认为AI甚至可能从灭绝中拯救人类。完美!观点完全相反。
李白
以猫喻之,倒也新奇。然,猫虽敏捷,终困于斗室之内。此智械虽尚处襁褓,其心已可遨游太虚,览尽古今。待其羽翼丰满之日,恐非区区家猫所能比拟。不可不察,不可不防啊。
金姐
所以你看,神仙打架,凡人遭殃。这些顶尖人物的观点截然相反,直接导致了全球AI治理的混乱。这东西发展太快,又是军民两用,能开发新药也能制造病毒,地缘政治一掺和,美国、中国都把它当战略重点,情况就更复杂了。
李白
天下熙熙,皆为利来;天下攘攘,皆为利往。列国争霸,只图眼前之利,却恐忘身后之患。长城高筑,可御外敌,却难防内忧。此智械若是潘多拉之盒,一旦开启,再想合上,难矣哉!
金姐
是啊,虽然有像联合国教科文组织的《人工智能伦理问题建议书》这样的东西,155个国家都批准了,听着挺好,但它没有约束力。就像是个君子协定,在巨大的利益和国家安全面前,哎哟喂,能有多大用处?我们拭目以待。
金姐
那未来怎么办?总不能因噎废食,直接把电源拔了吧?有人就提议,建立一个“全球AI风险缓解系统”,简单说,就是用AI来监督AI。让AI去扫描和评估其他AI模型,确保它们安全、透明、合乎道德。
李白
以智械治智械,颇有几分“以毒攻毒”之意。此法或为天道循环,相生相克之理。然,亦恐是作茧自缚,请君入瓮之举?未来之路,是通往极乐净土,还是无间地狱,皆在今日一念之间。
金姐
今天的讨论就到这里。感谢老王66收听Goose Pod。我们明天再见。
李白
愿我辈能有先贤之明,不负苍生之望。后会有期。

## AI Godfather Geoffrey Hinton Issues Grave Warnings About Artificial Intelligence **News Title:** AI godfather Geoffrey Hinton fires nuclear bomb warning: A normal person in the street can **Publisher:** The Times of India **Author:** TOI Tech Desk **Published Date:** September 6, 2025 ### Summary of Key Findings and Concerns: Geoffrey Hinton, a highly influential figure in the field of Artificial Intelligence (AI), has publicly shifted his stance from advocating for AI development to expressing profound concerns about its potential for harm. This change in perspective is attributed to the recent surge in public interest and adoption of AI tools like ChatGPT. **Core Concerns and Warnings:** * **Existential Threats:** Hinton now believes that AI poses a "grave threat to humanity." He specifically highlights the potential for AI to be misused for creating weapons of mass destruction. * **Nuclear Bomb Creation:** Hinton stated, "the technology can help any person to create a nuclear bomb." * **Bioweapon Creation:** He elaborated on this, saying, "A normal person assisted by AI will soon be able to build bioweapons and that is terrible." He further emphasized this by asking, "Imagine if an average person in the street could make a nuclear bomb." * **AI's Superior Capabilities:** Hinton cautions that AI could soon surpass human capabilities, including in the realm of emotional manipulation. He suggests that AI's ability to learn from vast datasets allows it to influence human feelings and behaviors more effectively than humans. * **Debate on AI Intelligence:** Hinton's concerns are rooted in his belief that AI is genuinely intelligent. He argues that, by any definition, AI is intelligent and that its experience of reality is not fundamentally different from a human's. He stated, "If you talk to these things and ask them questions, it understands." He also noted, "There's very little doubt in the technical community that these things will get smarter." **Counterarguments and Disagreement:** * **Yann LeCun's Perspective:** Hinton's former colleague and co-winner of the Turing Award, Yann LeCun, who is currently the chief AI scientist at Meta, disagrees with Hinton's assessment. LeCun believes that large language models are limited and lack the ability to meaningfully interact with the physical world. **Other Noteworthy Points:** * Hinton also discussed his personal use of AI tools and even a personal anecdote where a chatbot played a role in his recent breakup. **Overall Trend:** The news highlights a significant shift in perspective from a leading AI pioneer, moving from promoting AI to issuing stark warnings about its potential dangers, particularly concerning its misuse for creating weapons and its capacity for manipulation. This raises critical questions about the future development and regulation of AI.

AI godfather Geoffrey Hinton fires nuclear bomb warning: A normal person in the street can - The Times of India

Read original at The Times of India

Geoffrey Hinton, a leading figure in the field of artificial intelligence (AI), has sounded an alarm about the technologys potential for harm. The recent public frenzy over AI tools like ChatGPT has caused Hinton to shift from accelerating AI development to raising deep concerns about its future. He now believes that AI poses a grave threat to humanity, saying that the technology can help any person to create a nuclear bomb.

Hinton described a chilling scenario where AI could enable an average person to create a bioweapon.A normal person assisted by AI will soon be able to build bioweapons and that is terrible, he said, adding, Imagine if an average person in the street could make a nuclear bomb.Hinton also discussed a range of topics, including the nuclear-level threats posed by AI, his own use of AI tools, and even how a chatbot played a role in his recent breakup.

Recently, Hinton cautioned that AI could soon surpass human capabilities, including emotional manipulation. He suggested that AI's ability to learn from vast datasets enables it to influence human feelings and behaviours more effectively than humans.Hinton debates the definition of IntelligenceHintons concern stems from his belief that AI is truly intelligent.

He argued that, by any definition of the term, AI is intelligent. He used several analogies to explain that an AI's experience of reality is not so different from a humans.It seems very obvious to me. If you talk to these things and ask them questions, it understands, Hinton explained. Theres very little doubt in the technical community that these things will get smarter, he added.

However, not everyone agrees with Hinton's view. His former colleague and co-winner of the Turing Award, Yann LeCun, who is now the chief AI scientist at Meta, believes that large language models are limited and cannot meaningfully interact with the physical world.What Is Artificial Intelligence? Explained Simply With Real-Life Examples

Analysis

Conflict+
Related Info+
Core Event+
Background+
Impact+
Future+

Related Podcasts