AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

An AI researcher who quit Anthropic told the BBC that people working on the technology are "genuinely frightened" about the speed of its advancements and what it could mean for humanity.

Jacob Coxon spoke with BBC's Laura Kuenssberg on Saturday about his viral resignation post where he raised concerns about out-of-control artificial intelligence.

"I believe that if we don't slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," he said.

His resignation comes amid growing safety concerns in the industry, including from his former boss, head of Anthropic Dario Amodei, who in an essay on Saturday argued for development to slow down.

However some industry figures say the dangers are being overblown, possibly to build hype around the two biggest AI companies ahead of their potential stock market debut or to prompt regulation which would slow their competitors.

Coxon, a 27-year-old from Britain whose research focuses on training AI models, said AI leaders including Elon Musk and OpenAI's Sam Altman have shared similar concerns to Amodei.

"They've all made statements about the necessity of being careful of the potential for AI takeover. They've all talked about this. AI takeover implies human extinction," Coxon said.

The hardest question to answer, according to Coxon, is what that would look like.