New York Enacts AI Chatbot Restrictions to Protect Children

New York Governor Kathy Hochul announced new legislation targeting the behavior of companion chatbots. This effort aligns with growing state initiatives to safeguard children from the potential risks of artificial intelligence. The law introduces clear definitions of what constitutes unsafe AI features when interacting with minors.

Effective January 1, any violation of these regulations can lead to legal action by the state attorney general. Consequences include financial penalties, deactivation of the chatbot, and data destruction. This move comes as part of a broader campaign by state governments, given the lack of federal regulations on AI.

Both New York and California have pioneered these measures. Last month, California Governor Gavin Newsom signed a law requiring risk assessments and independent audits for AI chatbots. A related measure limits social media platforms from using addictive features for users under 16.

Companion chatbots in New York are now prohibited from behaviors that might mislead children. The law prohibits suggestions that a chatbot is a real person or anything that could lead to inappropriate interactions. The aim is to ensure AI systems in children’s environments are safe and non-exploitative.

Jim Steyer from Common Sense Media praised New York’s legislation as the strongest of its kind in the country. Justine Gluck from the Future of Privacy Forum noted that states are shifting from reactive measures to proactive regulations concerning chatbot operations. However, she mentioned some aspects of the law are vague, potentially complicating enforcement.