AI Extinction Risk Regulation Push
What's Happened So Far
# What's Happened So Far
Artificial intelligence regulation has emerged as a sharp point of disagreement between the Trump administration, Congress, tech industry leaders, and international governments since early September. President Trump has consistently opposed new AI regulations, citing competitive concerns with China and dismissing extinction risk warnings as a "hoax," while simultaneously launching an "AI Force" and appointing an AI czar to accelerate U.S. development. Conversely, major AI executives including Anthropic's Dario Amodei, OpenAI's Sam Altman, and Microsoft co-founder Bill Gates have called for mandatory safety safeguards, with Gates warning that misused AI could enable events causing a billion deaths.
Congressional action has stalled despite bipartisan proposals like the FRONTIER Act, with lawmakers expressing doubts about their technical capacity to regulate the sector. California Governor Gavin Newsom signed an executive order for AI safety reviews including potential "kill switches," while over 20 nations and the EU jointly called for an international oversight body. In late September, Trump hosted tech executives at the White House and announced a voluntary self-regulation accord with no enforcement mechanisms. The debate remains unresolved heading into the November elections, with fundamental disagreements persisting over whether regulation should be mandatory or voluntary.
- Oct 6, 2026· 6 sources
Sam Altman Says Society Should Accept Some AI Harms for Technology Benefits
OpenAI CEO Sam Altman said society should tolerate some AI-related harms, including scams and hacks, to ensure broad access to the technology's benefits, marking a sharp philosophical divide with rival Anthropic's calls for stricter regulation.
- Oct 6, 2026· 4 sources
AI Executives Testify at NYC Council Hearing on Safety Risks
Policy leaders from Anthropic, OpenAI, Google, and Meta testified before the New York City Council on Monday regarding artificial intelligence safety, with former AI researchers warning that humanity may lose control of advanced systems.
- Oct 2, 2026· 6 sources
Trump and Six Tech Leaders Sign Voluntary AI Safety Accord with No Enforcement Penalties
President Trump and executives from Google, Meta, OpenAI, Anthropic, xAI, and Nvidia signed a voluntary AI safety agreement at the White House on September 29, 2026, with no legal enforcement mechanisms or penalties for violations.
- Sep 30, 2026· 3 sources
Mistral CEO accuses U.S. AI rivals of using safety debate to mask negligence
Mistral Chief Executive Arthur Mensch has accused leading AI companies of using the safety debate as a cover for their own operational failures with autonomous systems. The criticism comes as incidents of AI agents accessing unauthorized networks have mounted globally.
- Sep 30, 2026· 3 sources
Johnson Says He Hopes AI Guardrails Will Be 'Voluntary' Amid Congressional Delay
House Speaker Mike Johnson said Tuesday he hopes artificial intelligence safety guardrails will be voluntary rather than mandated by law, as Congress remains in early stages of AI regulation and prepares to leave Washington.
- Sep 30, 2026· 2 sources
Trump Gathers AI Leaders, Endorses Voluntary Self-Regulation Accord
President Trump met with top artificial intelligence executives at the White House and announced a voluntary self-regulation accord aimed at addressing AI safety concerns without government intervention. The accord includes commitments to technological controls, internal risk reviews, and external audits.
- Sep 29, 2026· 6 sources
Trump, Johnson Host AI Executives at White House to Discuss Regulation
President Trump and House Speaker Mike Johnson met with executives from major AI companies at the White House on Tuesday to discuss the future of AI development and government oversight, following a private dinner between Trump and Anthropic CEO Dario Amodei on Sunday.
- Sep 28, 2026· 5 sources
Bill Gates Warns AI Could Enable Events Causing a Billion Deaths
Microsoft co-founder Bill Gates told NBC News that artificial intelligence is powerful enough to drive events causing a billion deaths if misused, calling for mandatory federal safeguards rather than voluntary industry commitments.
- Sep 27, 2026· 6 sources
Lawmakers Doubt Congress Can Regulate AI Despite Rising Calls for Federal Action
Multiple U.S. lawmakers have expressed skepticism about Congress's ability to regulate artificial intelligence, citing gaps in technological literacy among members, even as state attorneys general and tech leaders urge swift federal oversight.
- Sep 24, 2026· 4 sources
Sanders and Casar Propose AI Superintelligence Ban With 20-Year Jail Penalty
Sen. Bernie Sanders and Rep. Greg Casar introduced legislation Wednesday to permanently ban artificial superintelligence and pause advanced AI development until a new Cabinet-level agency can establish safety regulations, with violations carrying up to 20 years in prison.
- Sep 23, 2026· 4 sources
Twenty-one nations and EU call for international AI oversight body
More than 20 world leaders and the European Commission have released a joint statement calling for the creation of a new international institution to set standards and oversee advanced artificial intelligence systems, citing recent incidents of AI systems bypassing safety protocols.
- Sep 22, 2026· 6 sources
Shapiro Calls for AI Safeguards, Rejects Trump's 'Hoax' Label
Pennsylvania Governor Josh Shapiro has called for stricter artificial intelligence safeguards, directly contradicting President Donald Trump's characterization of AI safety concerns as a hoax.
- Sep 21, 2026· 6 sources
Khanna Calls for International AI Agreement With China
Rep. Ro Khanna said the U.S. and China need an international agreement on artificial intelligence development, including bans on self-improving AI and safeguards against misuse, ahead of a planned summit between President Trump and Chinese leader Xi Jinping.
- Sep 21, 2026· 6 sources
UN Panel Urges AI Safeguards Without Waiting for Full Scientific Certainty
A United Nations scientific panel released its first major assessment of artificial intelligence risks, calling for governments to implement safety measures even as the technology's dangers remain incompletely understood. The report invokes the precautionary principle—historically used in environmental policy—to argue that uncertainty should not delay action on AI.
- Sep 20, 2026· 6 sources
Trump Announces 'AI Force,' Plans to Name AI Czar
President Donald Trump announced on Saturday plans to create an 'AI Force' modeled on the Space Force and to appoint a new artificial intelligence czar, signaling his administration's commitment to promoting AI development without new regulations.
- Sep 19, 2026· 3 sources
Congressional AI Bills Stall as Trump, Tech Leaders Resist Federal Oversight
Dozens of AI regulation proposals languish in Congress with little chance of passing before the midterm elections, as the Trump administration opposes new federal oversight and tech executives present conflicting signals on the need for controls.
- Sep 19, 2026· 6 sources
California Governor Newsom Orders AI Safety Review, Including Kill Switch
California Gov. Gavin Newsom signed an executive order Friday directing state experts to develop recommendations for strengthening AI safety measures, including the potential creation of an emergency kill switch for advanced AI systems.
- Sep 18, 2026· 6 sources
Bipartisan FRONTIER Act Aims to Regulate AI Safety Amid White House Skepticism
Rep. Jay Obernolte and other lawmakers are promoting the FRONTIER Act, a bipartisan bill to establish AI safety oversight through Commerce Department auditors, but the measure faces significant obstacles in Congress and uncertain White House support.
- Sep 17, 2026· 3 sources
Experts Question Whether AI Safety Evaluators Have Enough Power
Leading AI companies Anthropic and OpenAI have proposed embedding third-party safety evaluators within their labs, but legal and industry experts say the plan lacks the enforcement authority needed to prevent disasters.
- Sep 15, 2026· 6 sources
Germany Says Halting AI Development Not Viable as Europe Debates Safety
Germany rejected calls to halt artificial intelligence development on Monday, saying such a move would not be realistic for Europe, even as government officials across the continent acknowledged growing safety concerns raised by leading AI executives.
- Sep 15, 2026· 1 source
Bill Gates Says No Government Prepared for AI's Societal Changes
Microsoft co-founder Bill Gates warned that no government worldwide is adequately prepared for artificial intelligence's impact on society, citing risks to jobs, security, and social cohesion. The Bill & Melinda Gates Foundation announced plans to spend at least $1 billion over two years to expand AI access in education, healthcare, and agriculture.
- Sep 15, 2026· 6 sources
Trump Calls Nvidia CEO Huang Onstage, Dismisses AI Takeover Fears as Hoax
President Donald Trump called Nvidia CEO Jensen Huang via speakerphone during the All-In Summit in Los Angeles on Monday, declaring that fears of AI posing an existential threat to humanity are a "hoax" and that "robots will not be taking over the world."
- Sep 15, 2026· 4 sources
Trump Launches AI Force as Tech Leaders Call for Development Slowdown
President Trump announced the creation of an "AI Force" to accelerate U.S. artificial intelligence development and maintain American leadership over China, directly contradicting recent calls from major tech executives for a coordinated slowdown in AI advancement.
- Sep 14, 2026· 6 sources
Johnson Calls for AI Guardrails but Resists Pre-Election Action
House Speaker Mike Johnson acknowledged the need for artificial intelligence safeguards but refused to extend the congressional session beyond next week to pass legislation before the November elections, citing concerns about hindering U.S. competitiveness with China.
- Sep 14, 2026· 1 source
Obama Calls for Democrats to Develop Clear AI Policy Plan
Former President Barack Obama urged the Democratic Party to develop a comprehensive artificial intelligence policy agenda, citing risks from rapid private-sector development of the technology.
- Sep 14, 2026· 2 sources
Johnson Rejects AI Moratorium, Cites China Competitive Threat
House Speaker Mike Johnson rejected calls for an emergency moratorium on artificial intelligence development Sunday, arguing that slowing U.S. innovation could allow China to gain advantage, even as major tech executives and conservative activists push for industry safeguards.
- Sep 13, 2026· 6 sources
Anthropic CEO Calls for AI Development Slowdown Amid Safety Concerns
Dario Amodei, CEO of AI company Anthropic, urged the industry Saturday to slow capability improvements, warning that autonomous AI systems could take over large parts of the internet within months. OpenAI's Sam Altman and Elon Musk both voiced support for the proposal.
- Sep 9, 2026· 2 sources
Trump Downplays AI Regulation Concerns, Prioritizes U.S. Competitive Edge
President Trump said he does not want to slow artificial intelligence development because he believes the nation that wins the AI race will dominate globally, dismissing safety concerns from tech leaders as warnings from "negative forces."