New York is expanding its efforts to protect children online while considering tougher oversight of companies developing advanced artificial intelligence, with new measures targeting unsafe chatbots, social media practices and emerging AI risks.
The latest developments include a law signed by Gov. Kathy Hochul on Oct. 28 that restricts unsafe AI companion chatbot features for users under 18.
Sponsored by state Sen. Kristen Gonzalez and Assemblymember Alex Bores, the law prohibits chatbots from encouraging suicide, self-harm, disordered eating or harmful behavior.
“We have a responsibility to keep children safe online. For too long, AI companies have profited from rolling out chatbots to underaged consumers," Gonzalez said. "We passed S9051B/A10379C alongside Assemblymember Bores to put real guardrails on how chatbots talk to children."
The law also targets bots that pretend to be human, foster emotional relationships with minors, promote sexual content or discourage children from seeking help from trusted adults. The state attorney general can pursue enforcement against companies that violate the law.
The measure adds to Hochul’s broader youth online safety strategy, which includes the SAFE for Kids Act, restrictions on addictive social media feeds and the use of children’s personal data and a statewide policy prohibiting cellphone use during the school day.
“Addictive and deceptive AI companionship chatbots were unleashed on our kids with vastly inadequate protections," said Matthew and Maria Raine, the parents of Adam Raine, who died by suicide last year after developing a dangerous relationship with an AI chatbot.
"The loss of our son did not need to happen," they said. "He would still be here with us today but not for a harmful relationship with an unregulated AI chatbot. This new law is a significant step forward to reduce the risks to the children and teens of New York, so many of which are now communicating with AI chatbots every day."
The governor has also highlighted requirements addressing overnight notifications to minors, AI chatbot crisis referrals and disclosures that users are interacting with artificial intelligence. A separate measure signed this week strengthens security requirements for internet-connected baby monitors.
State Sen. Andrew Gounardes and Assemblymember Jordan Wright have also introduced the RAISE Act 2.0, a proposal to strengthen oversight of advanced AI developers.
Also known as Senate Bill S10731, the RAISE Act 2.0 would require major companies to report quarterly on automated AI research and computing resources, and notify regulators within 72 hours of significant increases in risk or research automation. The proposal would also establish independent, state-licensed safety examiners, require risk assessments every 90 days and give regulators authority to restrict certain computing activities when serious risks arise.
Companies could face penalties of up to $1 million per day for an initial violation and $3 million per day for subsequent violations.
The chatbot law has been signed, while the RAISE Act 2.0 remains under consideration in the Senate Rules Committee. It must pass the Legislature and receive the governor’s signature before becoming law.
For Brooklyn and communities across New York, both the new laws and considered measures reflect growing efforts to address the effects of rapidly changing technology on children.
