Anthropic · OpenAI · Wired · Dario Amodei · Wired
In an essay published on the heels of the safety warnings
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
Benanti is less interested in restricting methods for developing AI, which he fears could quash innovation, and more so in establishing standards that ensure models cannot slip from human control.
Key facts
- But according to Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain
- It’s something that has to be balanced, mitigated in debate in the public square.” Benanti tells WIRED
- Ethics cannot be something that belongs to the board of trustees of a company
- The narrative of the frontier labs is self-interested, to gain or maintain a position in the market,” says Benanti
Summary
Recently, warnings from researchers inside the world’s largest artificial intelligence labs about the rapid pace of development have led to panic about the possibility that the technology could extinguish humanity. But according to Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain the companies building the technology. “Ethics cannot be something that belongs to the board of trustees of a company. In an essay published on the heels of the safety warnings, Anthropic CEO Dario Amodei called for new AI models to undergo mandatory third-party evaluations before release, and some sort of crackdown on distillation, a process where rival labs train their own AI on the outputs of proprietary models.