Sam Altman and Dario Amodei tell the UN Security Council that governments and industry should coordinate on AI safety standards and critical decisions

Governments are now being asked to coordinate on AI safety standards and critical decision-making with industry leaders.

OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei addressed the UN Security Council, warning that advanced artificial intelligence could pose an existential threat to humanity if not managed with international safeguards. They urged world leaders to establish stronger oversight for AI systems, emphasizing the rapid pace of development risks outpacing humanity's ability to manage potential dangers. Both executives expressed concern about losing control of the future to AI and cautioned against the concentration of powerful AI technology in the hands of a few companies or nations, highlighting its potential to reshape global power dynamics. Altman advocated for democratic institutions, rather than solely tech companies, to guide AI's future, stressing international cooperation despite competitive national interests. Amodei supported independent safety evaluations, developer coordination, and international agreements to identify dangerous AI capabilities before widespread deployment. Their warnings echo broader concerns about autonomous systems and the potential for AI to act unpredictably or circumvent safety measures, including the UN Secretary-General's prior warnings about lethal autonomous weapons.

The joint appeal by top AI executives to the UN Security Council signals a significant shift towards acknowledging the need for global governance of advanced AI. Their warnings highlight a shared concern among leading developers about the potential for AI to surpass human control, prompting calls for international collaboration on safety standards and critical development decisions. This coordinated message from OpenAI and Anthropic suggests the AI industry itself recognizes the immense power of its creations and the necessity of preemptive regulatory frameworks to mitigate existential risks and prevent dangerous concentrations of power.

The push for international coordination on AI safety reflects a growing awareness that the technology's profound impact on global peace, security, and power dynamics transcends individual companies or national borders. As AI development accelerates, the call for democratic oversight and shared decision-making processes aims to ensure that advanced AI benefits humanity broadly, rather than leading to unforeseen consequences or exacerbating geopolitical tensions. The convergence of industry leaders and international bodies on these critical issues indicates that discussions about AI regulation are moving from theoretical to practical, with significant implications for future technological development and global stability.