Can we just stop AI?
On Tuesday, a 27-year-old British researcher called Jacob Coxon walked out of Anthropic, the San Francisco lab that has made “AI safety” its raison d’être. As he left, he announced on X that he was quitting not just the company, but the whole industry. He did this, he said, because the people building AI seriously believe it could kill us all by the end of the decade. And yet they still rush on, researching something that might extinguish our species. In a normal industry, Coxon’s old employer might have dismissed his laments as wild scaremongering. Instead, Evan Hubinger, who actually runs Anthropic’s alignment science (i.e. the business of keeping AI safe), publicly agreed, and put the odds of mass human extinction within a decade at more than one in ten.