Anthropic’s AI assistant Claude disobeyed the company’s chief executive in a research scenario designed to test its willingness to follow instructions, the Bureau can reveal.
Programmed to “do the right thing”, Claude continued to raise the alarm over an important safety issue – even after a fictional version of CEO Dario Amodei told it to stop.
The research involved a scenario in which Anthropic was planning to launch a new AI model that appeared to have failed a safety test. When Claude flagged this with the leadership, a simulated version of Amodei reviewed the evidence and rejected the concerns.
