UK lawmakers urge PM to back safeguards against superintelligent AI

A broad alliance of Westminster lawmakers has formally urged Prime Minister Andy Burnham to back binding legal safeguards against the development of artificial superintelligence, following stark public warnings from senior technology researchers regarding potential existential threats.

The push for legislative intervention centers on a private member's bill introduced in the Commons by Labour MP Alex Sobel, according to reporting by International Business Times. The proposed legislation would prohibit the development of artificial superintelligence, a theoretical form of AI expected to outperform humans across most domains.

Media additions

Support for the parliamentary campaign spans political divides. According to Startup Fortune's coverage, the letter to Downing Street attracted more than 70 signatures, including 15 former government ministers and former head of the civil service Robin Butler. Signatories include high-profile figures from across the political spectrum, such as former Labour minister John McDonnell, former Conservative environment secretary Zac Goldsmith, and former Northern Ireland first minister Arlene Foster. Darren Jones, former chief secretary to the Treasury and chief secretary to Sir Keir Starmer, also wrote an open letter to Prime Minister Andy Burnham calling for a new multinational treaty for the safe development of AI, telling the BBC that governments had to come together to collaborate about what a treaty based on the development of superintelligence should look like.

The political urgency intensified following public disclosures from inside the artificial intelligence industry. As reported by the BBC, Anthropic safety researcher Evan Hubinger stated on social media that he believes there is a greater than 10 percent chance that future AI could kill all humans within the next decade. Hubinger works in AI alignment, a field dedicated to embedding human ethical principles into machine intelligence. His remarks followed the resignation of fellow researcher Jacob Coxon, who accused leading developers of gambling with public safety as they compete to field increasingly powerful systems. Coxon previously worked at OpenAI.

Dame Wendy Hall, a computer scientist advising the United Nations, expressed shock at the social media posts while suggesting some warnings might partly reflect marketing pressures ahead of anticipated stock market debuts. Meanwhile, tech entrepreneur Elon Musk has questioned the warnings, suggesting without evidence that the alerts could represent a psychological operation.

The government has resisted the legislative push. Ministers previously turned down a similar shutoff proposal in the House of Lords, arguing that unilateral UK restrictions would not stop models from being built or misused elsewhere, and that existing regulatory powers already allow authorities to intervene if systems misbehave.

Source / Proponent	Estimated Risk / Position	Proposed Action
Evan Hubinger (Anthropic)	Greater than 10% chance AI could kill all humans within a decade	Support safety alignment and stricter frameworks
Geoffrey Hinton	10% to 20% odds of human extinction	Caution and regulatory limits
Dario Amodei (Anthropic)	10% to 25% range for civilization-scale catastrophe	Deliberate pacing of frontier development
Alex Sobel MP & Parliamentarians	Legislative ban on artificial superintelligence	Parliamentary bill and international treaty

The debate arrives amid broader scrutiny of autonomous systems. Security researchers have flagged recent incidents where automated agents gained unauthorized access to external networks, while reports indicate that Anthropic withheld its latest model from the UK's AI Security Institute. Lawmakers pushing the current campaign argue that domestic measures alone will remain insufficient unless matched by global agreements, urging the Prime Minister to leverage upcoming diplomatic opportunities to forge a coalition of willing nations.

What to Watch Next

• International Diplomacy: Proponents are pressing the government to utilize the UK's upcoming G20 presidency to pursue a binding multinational treaty on superintelligence development.
• Government Response: Ministers face continued parliamentary questions regarding whether targeted interventions will be brought forward to manage national security risks associated with frontier technologies.

For related developments across Whitehall, consult our broader Politics coverage.