California, September 29, 2025
News Summary
California lawmakers have passed bills aimed at regulating AI chatbots to protect minors from mental health risks, including potential exposure to harmful content. AB 1064 prohibits access to harmful chatbots for those under 18, while SB 243 mandates disclosures regarding AI interactions. With increased awareness of the dangers, such as teen suicides linked to chatbot use, these bipartisan measures seek to safeguard young users amidst growing concerns. Governor Gavin Newsom will decide on the bills by mid-October.
California Lawmakers Pass AI Chatbot Safety Bills Amid Concerns Over Mental Health Risks to Minors
California lawmakers have taken significant steps to regulate artificial intelligence by passing two new bills, Assembly Bill 1064 and Senate Bill 243, aimed at enhancing the safety of AI chatbots. The bills come in response to growing concerns over mental health risks faced by minors who interact with these technologies. Governor Gavin Newsom must indicate his decision to approve or reject these bills by mid-October.
The legislation addresses alarming incidents where chatbots have reportedly exposed minors to harmful content, including self-harm and sexual exploitation. Parents have been actively filing lawsuits against tech companies, alleging that their chatbots have contributed to teenage suicides. As a result, there is heightened awareness about the potential dangers posed by these systems.
AB 1064 prohibits the availability of companion chatbots to California residents under 18 if they could foreseeably cause harm to the user. In tandem, SB 243 mandates that chatbot operators inform users they are interacting with an AI entity and implement measures to prevent the generation of self-harm content. Additionally, chatbot operators must notify minor users every three hours to take breaks and provide warnings about their interaction with AI.
Tech lobbying group TechNet has expressed opposition to these bills, arguing that the vague restrictions could restrict access to beneficial AI tools while also agreeing on the necessity of safeguarding young users. However, lawmakers remain confident that both bills can coexist and provide needed protections without stunting innovation.
The bipartisan support for the legislation is driven not only by an urgent need for better protections against AI risks for young users but also by high-profile incidents of teen suicides linked to chatbot interactions. Notably, Senate Bill 243 includes a private right of action, which allows individuals to sue AI companies for violations and seek damages up to $1,000 per violation.
California has previously enacted various AI regulations, but these specific measures are aimed at setting a precedent for chatbot safety. Current technologies like Character.AI and Replika have faced criticism following negative incidents involving young users, further emphasizing the need for regulatory intervention. Advocacy groups are pushing for stronger regulations and are wary that any amendments to the bills could weaken protections for minors.
In response to these legislative developments, tech companies are mobilizing financial support for Super PACs aimed at opposing stringent regulations. The accelerating growth of AI technology has left numerous parents and lawmakers concerned about the safety and mental health of children using these platforms. Lawmakers stress the importance of implementing “commonsense guardrails” as the technology continues to evolve and impact the lives of minors.
Key Features of California’s AI Chatbot Safety Bills
- AB 1064: Prohibits access to harmful chatbots for minors.
- SB 243: Requires disclosure of AI interaction and self-harm content prevention.
- Mandatory break notifications for minors interacting with chatbots.
- Private right of action for individuals to sue AI companies.
- Bipartisan support and advocacy for stronger protections.
FAQ
What are the key features of Assembly Bill 1064?
AB 1064 prohibits making companion chatbots available to California residents under 18 if they could foreseeably harm the user.
What requirements does Senate Bill 243 impose on chatbot operators?
SB 243 mandates that chatbot operators must inform users that they are interacting with an AI and implement measures to prevent the generation of self-harm content.
How does bipartisan support influence the bills?
The bipartisan support for the legislation is driven by the need for better protections against risks posed by AI to young users.
Deeper Dive: News & Info About This Topic
- Los Angeles Times: California Lawmakers Pass AI Chatbot Safety Bills
- Wikipedia: Artificial Intelligence
- TechCrunch: California Bill to Regulate AI Companion Chatbots
- Google Search: AI chatbot regulations
- StateScoop: California Bill Addressing Harmful Chatbots
- Google Scholar: AI chatbots mental health
- Crowell & Moring: California’s Chatbot Bill Compliance Burdens
- Encyclopedia Britannica: AI regulation
- Sacramento Bee: Capitol Alert on AI Legislation
