Anthropic · San Francisco · OpenAI · The Guardian Technology
Evan Hubinger, alignment science lead at Anthropic, posted the comment after Jacob Coxon
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
Coxon said the risks at Anthropic were well understood but they were “locked in a race to get there first”.
Key facts
- Despite being an early investor in Anthropic and Google DeepMind, two of the leading AI labs, Tallinn estimates that 10-15% of AI employees believe the technology will be a worthy successor
- Beatrice Fihn, who won the 2017 Nobel peace prize for leading the International Campaign to Abolish Nuclear Weapons, told parliamentarians: “It is not the first time they're confronted with abilities that could end up killing them all
- Evan Hubinger, alignment science lead at Anthropic, posted the comment after Jacob Coxon, a 28-year-old researcher at the San Francisco company and previously at OpenAI, resigned, claiming “neither
- Only a few US organisations have had access to Mythos 5.1, the Cabinet Office confirmed
Summary
D oes artificial superintelligence pose a risk greater than nuclear weapons? These warnings were issued over the past 48 hours on both sides of the Atlantic about the potential impact of a technology that most people still think of as a more talkative search engine. Some of the threats were raised in the UK as MPs and peers began to wrestle with the danger of AI outperforming human capabilities. Beatrice Fihn, who won the 2017 Nobel peace prize for leading the International Campaign to Abolish Nuclear Weapons, told parliamentarians: “It is not the first time we’re confronted with abilities that could end up killing us all.” The session on Monday was convened by Control AI, a lobbying group pushing for international regulation of the technology.