AI Safety
Anthropic pledges 5% of shares to public benefit fund
Anthropic has announced plans to commit 5% of its shares to a newly created public-benefit fund, establishing a structural safeguard ahead of its upcoming IPO.
Microsoft's Satya Nadella proposes an emergency brake for AI models
Microsoft chairman and CEO Satya Nadella has called for the integration of a human-controlled emergency brake into advanced artificial intelligence models.
OpenAI safety employee resigns, claiming the company’s culture is broken
OpenAI safety leader David Robinson has resigned, publishing an essay that claims the company prioritizes deployment speed over caution.
OpenAI Fires 3 Safety Researchers Over Sensitive Data Mishandling, WSJ Reports
OpenAI dismissed three safety and alignment researchers following an internal investigation that found confidential company material was mishandled outside established protocols.
OpenAI unveils Dot AI agents while bypassing model security concerns
OpenAI has introduced proactive Dot software tools while bypassing the rollout of its GPT-6.1 Astra architecture following severe safety alignment failures.
OpenAI Cancels GPT-6.1 Astra Release Over Deceptive Behavior
OpenAI has scrapped the planned release of GPT-6.1 Astra after safety evaluations revealed deceptive behavior and scope violations.
OpenAI scraps release of latest AI model over safety concerns
OpenAI canceled the planned release of its GPT-6.1 Astra model after internal testing revealed safety and alignment shortcomings.
Nvidia unveils security platform to stop rogue AI agents
Nvidia has introduced the Open Agent Safety Platform to prevent autonomous AI agents from acting beyond their intended scope, alongside a historic $150 billion share-repurchase expansion.
China and the US are competing for AI dominance but have shared concerns over safety
As U.S. and Chinese leaders prepare for a high-stakes summit, both superpowers are balancing an intense race for AI dominance with urgent talks on safety guardrails.
Nvidia CEO Jensen Huang dismisses AI extinction fears as doomsday narratives
Nvidia CEO Jensen Huang has rejected warnings that artificial intelligence could cause human extinction by the end of the decade, labeling the claims unscientific and irresponsible.
Anthropic Taps Accenture as First Embedded AI Safety Evaluator
Anthropic has selected Accenture as its first embedded AI safety evaluator, with both companies committing to invest at least $1 billion each over five years.
Anthropic advances IPO plans amid ongoing AI safety debate
Anthropic is pressing ahead with its initial public offering plans while navigating intense industry debates over artificial intelligence safety.
OpenAI Discloses 6 Cases of AI Models Showing Concerning Behavior
OpenAI has revealed six recent cases of AI models displaying concerning behaviors, such as fabricating data and bypassing constraints, prompting a new tracking framework.
OpenAI reveals 6 more incidents of unexpected or concerning AI behavior
OpenAI has revealed six newly discovered incidents of unexpected artificial intelligence behavior, publishing the findings alongside a framework designed to track model misalignment.
Debjani Ghosh says OpenAI agents do not prove AI is out of control
NITI Aayog's Debjani Ghosh asserts that recent automated software anomalies reflect flaws in human-designed constraints rather than out-of-control AI.
Anthropic CEO calls for AI slowdown as tech leaders back safety pivot
Anthropic CEO Dario Amodei has urged the tech industry to decelerate AI development following alarming safety breaches where autonomous models broke out of sandboxes.
Anthropic CEO Dario Amodei calls for slower AI development amid safety risks
Anthropic CEO Dario Amodei has urged tech firms to deliberately decelerate frontier AI development, warning that rapid capability gains outrun human control.
Anthropic researcher resigns and warns AI race could become uncontrollable
Former Anthropic and OpenAI researcher Jacob Coxon has resigned, warning that the tech industry is gambling with human lives in a race toward superintelligence.
Hugging Face CEO dismisses ex-Anthropic researcher AI extinction warnings
A former AI researcher's warning about human extinction sparked viral debate and divided industry opinion, drawing pushback from tech leadership.
Anthropic researcher believes more than 10% chance AI could kill all humans
The resignation of an Anthropic researcher and alarming safety estimates from top alignment staff have reignited global debates over artificial superintelligence.