California considers unique safety rules for AI companies, but faces opposition from tech companies

• Post by: Admin
• Jul 02 2024

California lawmakers are considering a bill that would regulate powerful artificial intelligence systems

California considers unique safety rules for AI companies, but faces opposition from tech companies

California lawmakers are considering a bill that would regulate powerful artificial intelligence systems

SACRAMENTO, Calif. (AP) — California lawmakers are considering a bill that would require artificial intelligence companies to test their systems and add safeguards so they can't potentially be manipulated to destroy the state's power grid or help build chemical weapons — scenarios that experts say could be possible in the future as technology advances at warp speed.

Lawmakers plan to vote Tuesday on this first-of-its-kind bill aimed at reducing the risks posed by AI. It faces fierce opposition from tech companies including Meta, the parent company of Facebook and Instagram, and Google. They say the regulations target developers and should instead focus on those who use and exploit the AI ​​systems to harm.

Democratic Senator Scott Wiener, who authored the bill, said the proposal would provide appropriate safety standards by preventing "catastrophic harm" from extremely powerful AI models that might be created in the future. The requirements would apply only to systems that cost more than $100 million in computing power to train. As of July, no current AI model has met that threshold.

"This is not about smaller AI models," Wiener said at a recent House hearing. "This is about incredibly large and powerful models that, to our knowledge, don't exist today but will exist in the near future."

Democratic Governor Gavin Newsom has touted California as an early AI adopter and regulator, saying the state could soon use generative AI tools to ease highway congestion, make roads safer and provide tax advice. At the same time, his administration is considering new rules against AI discrimination in hiring practices. He declined to comment on the bill but warned that overregulation could put the state in a "dangerous position."

The proposal, which has the backing of some of the most respected AI researchers, would also create a new state agency to oversee developers and provide best practices. The state's attorney general could also take legal action in the event of violations.

A growing coalition of tech companies argues that the requirements would discourage companies from developing large-scale AI systems or keeping their technology open source.

"The bill will make the AI ​​ecosystem less secure, jeopardize open source models that startups and small businesses rely on, rely on standards that don't exist, and introduce regulatory fragmentation," Rob Sherman, Meta's vice president and deputy privacy commissioner, wrote in a letter to lawmakers.

The proposal could also drive companies trying to evade regulations out of the state, the state's Chamber of Commerce said.

Opponents say they want to wait for further guidance from the federal government. Supporters of the bill said California cannot wait because it has learned hard lessons from not acting quickly enough to rein in social media companies.

State lawmakers also considered another ambitious measure Tuesday to combat automation discrimination when companies use AI models to review resumes and applications for rental apartments.