Anthropic researcher says more than 10% chance AI “could kill all humans”

A lead researcher at Anthropic, a prominent artificial intelligence company, has expressed concern that there is more than a 10% chance AI could potentially lead to human extinction within the next decade. Evan Hubinger, the company’s Alignment Science Lead, shared this alarming view on social media, highlighting the lack of a clear plan to align superintelligent AI with human values. This statement followed the resignation of Jacob Coxon, another Anthropic researcher, who criticized both Anthropic and OpenAI for irresponsibly racing towards developing self-improving superintelligence. Coxon argued that while Anthropic understands the risks, they feel compelled to act first due to a lack of trust in others to handle AI responsibly. Despite these concerns, Anthropic has not shared its latest AI model, Claude Mythos 5.1, with international security bodies, including the U.K.’s AI Security Institute. The British government emphasized the importance of international collaboration to address AI risks, noting that these challenges transcend national borders. The potential threat posed by advanced AI models is a topic of ongoing debate among industry leaders. QUESTION: How might the development of superintelligent AI impact the future of human society, and what measures should be taken to ensure its safe integration?