Dario Amodei · Sam Altman · Anthropic · OpenAI · China · GPT · Center for AI Safety
AISN #81: Anthropic Researcher’s Resignation Propels AI Risk into the Public Eye
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
Welcome to the AI Safety Newsletter by the Center for AI Safety.
Key facts
- It achieves 74.2 compared to the next-best score of 56.6 (by Anthropic’s model Claude Fable 5.1)
- On September 3, OpenAI made its new AI model, GPT-6 Astra, available for public use
- The Institute for Progress (IFP) published a list of “23 low-regret policy recommendations” that could help the US prepare for increasing AI R&D automation
- On September 9, in a viral X post, an AI researcher called Jacob Coxon announced that he had resigned from Anthropic over concerns that AI could cause human extinction
Summary
In this edition, they look at the public conversation surrounding an Anthropic researcher’s resignation over extinction risks and the recent calls for a development slowdown from AI company CEOs. Listen to the AI Safety Newsletter for free on Spotify or Apple Podcasts. On September 9, in a viral X post, an AI researcher called Jacob Coxon announced that he had resigned from Anthropic over concerns that AI could cause human extinction. Extinction fears hinge largely on the potential for recursive self-improvement (RSI).