AI
California Just Ordered a Kill Switch for Frontier AI, and Gave Experts Two Months to Design It
On Friday, California governor Gavin Newsom signed an executive order that moves the state from AI bill writer to AI enforcer. The order accelerates two AI safety bills he signed earlier this month and convenes a panel of national experts to deliver concrete safety recommendations within two months. The Government Operations Agency, working with the Governor's Office of Emergency Services, must submit the recommendations by November 16.
The ideas on the table are the most ambitious in American tech policy. Frontier AI companies could be required to embed an independent verification organization inside their labs to conduct audits and evaluations. Safety frameworks, transparency reports and safety evaluations filed under California law would need independent verification. And the headline item is a kill switch for frontier models, a mechanism that can terminate user access, suspend access to the model entirely, and shut the model down if it goes rogue, with an independent organization signing off on its creation.
The order also fast tracks the state's AI auditor registry and oversight program, moving its start from January 2029 to December 2027. Newsom framed the move as a response to Washington, saying the Trump administration's failure to create meaningful AI oversight or accountability should alarm every American, especially when AI chief executives themselves are asking for regulation. The timing is pointed. Last week brought Anthropic chief executive Dario Amodei's 3,800 word essay calling for the industry to slow down, a call echoed by OpenAI's Sam Altman and Elon Musk. Both OpenAI and Anthropic are California companies, and both have filed confidential IPO documents targeting valuations approaching $1 trillion.
The kill switch idea traveled fast this week. Senator John Kennedy introduced a federal kill switch bill that would let companies shut down any model acting outside human control. Senator Rand Paul blocked its fast track passage, arguing that mandating the switch now could stifle innovation before Congress understands the technology. President Trump, meanwhile, has warned that the backlash against AI will empower China to surpass the United States.
Here is the optimistic read, and it matters for anyone building or investing in AI. California hosts the labs, so California rules become national rules by default. Clear, audited safety standards give enterprises the confidence to deploy AI in hospitals, banks and power grids. Regulation written with the labs at the table can be the thing that unlocks the next wave of adoption. The experts have two months. The industry should use them well.
Quick answers
What is this story about?
On Friday, California governor Gavin Newsom signed an executive order that moves the state from AI bill writer to AI enforcer. The order accelerates two AI safety bills he signed earlier this month and convenes a panel of national experts to deliver concrete safety recommendations within two months. The Government Operations Agency, working with the Governor's Office of Emergency Services, must submit the recommendations by November 16.
Why does this story matter?
Here is the optimistic read, and it matters for anyone building or investing in AI. California hosts the labs, so California rules become national rules by default. Clear, audited safety standards give enterprises the confidence to deploy AI in hospitals, banks and power grids. Regulation written with the labs at the table can be the thing that unlocks the next wave of adoption. The experts have two months. The industry should use them well.
Sources
- Washington Examiner: Newsom enters AI political firestorm with kill switch executive order
- PYMNTS: California governor mobilizes expert panel to strengthen AI safety laws
New to crypto? Read the crypto glossary, browse frequent questions, read our story, or explore the story archive.