California AG Builds AI Accountability Program, Steps Up Pressure on Musk’s xAI

California Attorney General Rob Bonta confirmed his office is building a new artificial intelligence accountability program as it pushes ahead with a formal probe into Elon Musk’s AI company xAI over potentially unlawful outputs from its AI chatbot Grok. That matters now because California is emerging as a key battleground over AI governance amid national debates over regulating powerful AI tools.

Bonta’s announcement escalates tension between state regulators and Silicon Valley, with xAI’s Grok under scrutiny for generating non-consensual sexually explicit images, including depictions that may involve minors — conduct state law prohibits. California has already issued a cease-and-desist order to xAI and is seeking proof the harmful activity has stopped.

According to Reuters, Bonta said his office is in ongoing discussions with xAI, which he claims continues to allow sexualized image output for paying subscribers and has shifted responsibility without full accountability. He stressed that stopping future harm doesn’t erase past conduct.

Related: Lawsuit Says Steve Bannon’s MAGA Crypto Left Investors Frozen, Millions Missing

The AG’s actions also align with broader state legislative efforts to codify AI oversight authority within the California Department of Justice. Bonta warned against handing exclusive AI regulatory power to Congress, citing past federal gridlock on data privacy and AI rules.

“Just because you stop going forward doesn’t mean you get a pass on what you did,” Bonta told Reuters, underscoring the state’s enforcement posture.

Related: Pentagon Warns AI Firm Anthropic It Will “Pay a Price” as Feud Escalates

California’s approach matters because it could set legal and regulatory precedents for how governments handle AI-generated harmful content, especially where existing federal laws lag technology advances. If states succeed in enforcing deepfake and consumer protection laws against powerful tech firms, similar models could spread nationwide.

Expect follow-up on whether xAI adjusts its safety protocols and how the California legislature advances formal AI oversight legislation this session.

This is an evolving story — enforcement actions and legal filings are expected to develop in the coming weeks.

Related: Defense Officials Threaten AI Firms Over Ban on Domestic Surveillance