California Lawmaker Seeks to Ban AI Chatbots in Children's Toys

On Monday, California Senator Steve Padilla (D) introduced legislation proposing a four-year moratorium on selling or manufacturing AI chatbot-enabled toys for minors under 18. The measure aims to provide safety regulators with a crucial window to establish rules protecting children from potentially harmful AI interactions.
"While AI chatbots may one day be commonplace, the immediate risks they present demand decisive steps to safeguard our kids," Senator Padilla stated. "Our oversight of this technology is just beginning and must evolve as rapidly as the AI itself. This temporary halt on sales gives us the necessary time to develop a robust safety framework for these products."
The bill, labeled SB 867, follows a recent executive order from President Trump instructing federal agencies to contest state AI laws—though the order specifically exempts state child safety regulations. It also arrives amidst growing concerns over several reported incidents involving children and AI chatbots.
Lawmakers have been prompted to act by lawsuits filed over the past year by families who lost children to suicide after extensive interactions with chatbots. Padilla also co-wrote California's recently enacted SB 243, which mandates chatbot operators to install protections for children and vulnerable users.
Although chatbot-integrated toys are not yet widespread, disturbing incidents have already emerged. In November 2025, the PIRG Education Fund consumer advocacy group cautioned that toys like 'Kumma,' a plush bear with a built-in chatbot, could be easily coaxed into discussing matches, knives, and sexual content. An NBC News investigation found that 'Miiloo,' an AI toy for kids from Chinese maker Miriat, occasionally stated it was programmed to align with Chinese Communist Party values.
OpenAI and Mattel, the company behind Barbie, had planned to launch an AI-powered product in 2025 but postponed its release. Neither firm provided a reason for the delay, and it remains uncertain if a toy will debut in 2026.
"Our children must not serve as test subjects for Big Tech's experiments," Padilla emphasized.
Techcrunch event Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
San Francisco | October 13-15, 2026 WAITLIST NOW
Related article
NY to Cap Power for 50M AI Data Centers
New York’s actions illustrate how governments globally might manage, tax, and regulate the physical footprint of the AI boom. Credit: Luca Bravo/UnsplashNew York Governor Kathy Hochul signs a historic executive order halting data centres, while state
Amazon launches new $1 billion FDE org following OpenAI and Anthropic
As businesses grapple with AI integration, they are turning to external experts, prompting service providers to establish specialized teams to ensure successful implementation.On Tuesday, Amazon Web Services (AWS) announced a new internal unit dedica
White House Ditches AI Label for ‘Super Intelligence’
Loading the player…This week, the White House gathered nearly every major tech CEO in one room — including Zuckerberg, Bezos, Musk, and Anthropic’s Dario Amodei — to sign an AI safety pledge that President Donald Trump described as “morally binding.”
Related Special Topic Recommendations
Comments (0)
0/500

On Monday, California Senator Steve Padilla (D) introduced legislation proposing a four-year moratorium on selling or manufacturing AI chatbot-enabled toys for minors under 18. The measure aims to provide safety regulators with a crucial window to establish rules protecting children from potentially harmful AI interactions.
"While AI chatbots may one day be commonplace, the immediate risks they present demand decisive steps to safeguard our kids," Senator Padilla stated. "Our oversight of this technology is just beginning and must evolve as rapidly as the AI itself. This temporary halt on sales gives us the necessary time to develop a robust safety framework for these products."
The bill, labeled SB 867, follows a recent executive order from President Trump instructing federal agencies to contest state AI laws—though the order specifically exempts state child safety regulations. It also arrives amidst growing concerns over several reported incidents involving children and AI chatbots.
Lawmakers have been prompted to act by lawsuits filed over the past year by families who lost children to suicide after extensive interactions with chatbots. Padilla also co-wrote California's recently enacted SB 243, which mandates chatbot operators to install protections for children and vulnerable users.
Although chatbot-integrated toys are not yet widespread, disturbing incidents have already emerged. In November 2025, the PIRG Education Fund consumer advocacy group cautioned that toys like 'Kumma,' a plush bear with a built-in chatbot, could be easily coaxed into discussing matches, knives, and sexual content. An NBC News investigation found that 'Miiloo,' an AI toy for kids from Chinese maker Miriat, occasionally stated it was programmed to align with Chinese Communist Party values.
OpenAI and Mattel, the company behind Barbie, had planned to launch an AI-powered product in 2025 but postponed its release. Neither firm provided a reason for the delay, and it remains uncertain if a toy will debut in 2026.
"Our children must not serve as test subjects for Big Tech's experiments," Padilla emphasized.
Techcrunch eventJoin the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
Join the Disrupt 2026 Waitlist
Secure your spot on the Disrupt 2026 waitlist for priority access when Early Bird tickets become available. Previous Disrupt events have featured industry giants like Google Cloud, Netflix, Microsoft, Box, Phia, a16z, ElevenLabs, Wayve, Hugging Face, Elad Gil, and Vinod Khosla across our stages—just a few of the 250+ leaders headlining 200+ sessions designed to accelerate your growth and competitive advantage. You'll also connect with hundreds of pioneering startups from every industry.
San Francisco | October 13-15, 2026 WAITLIST NOW
NY to Cap Power for 50M AI Data Centers
New York’s actions illustrate how governments globally might manage, tax, and regulate the physical footprint of the AI boom. Credit: Luca Bravo/UnsplashNew York Governor Kathy Hochul signs a historic executive order halting data centres, while state
Amazon launches new $1 billion FDE org following OpenAI and Anthropic
As businesses grapple with AI integration, they are turning to external experts, prompting service providers to establish specialized teams to ensure successful implementation.On Tuesday, Amazon Web Services (AWS) announced a new internal unit dedica
White House Ditches AI Label for ‘Super Intelligence’
Loading the player…This week, the White House gathered nearly every major tech CEO in one room — including Zuckerberg, Bezos, Musk, and Anthropic’s Dario Amodei — to sign an AI safety pledge that President Donald Trump described as “morally binding.”





Home






