China plans AI rules to protect children and tackle suicide risks

"China has proposed strict new rules for artificial intelligence (AI) to provide safeguards for children and prevent chatbots from offering advice that could lead to self-harm or violence. Under the planned regulations, developers will also need to ensure their AI models do not generate content that promotes gambling. The announcement comes after a surge in the number of chatbots being launched in China and around the world. Once finalised, the rules will apply to AI products and services in China, marking a major move to regulate the fast-growing technology, which has come under intense scrutiny over safety concerns this year."

"The draft rules, which were published at the weekend by the Cyberspace Administration of China (CAC), include measures to protect children. They include requiring AI firms to offer personalised settings, have time limits on usage and getting consent from guardians before providing emotional companionship services. Chatbot operators must have a human take over any conversation related to suicide or self-harm and immediately notify the user's guardian or an emergency contact, the administration said."

"AI providers must ensure that their services do not generate or share "content that endangers national security, damages national honour and interests [or] undermines national unity", the statement said. The CAC said it encourages the adoption of AI, such as to promote local culture and create tools for companionship for the elderly, provided that the technology is safe and reliable. It also called for feedback from the public. Chinese AI firm DeepSeek made headlines worldwide this year after it topped app download charts."

The Cyberspace Administration of China (CAC) published draft rules to regulate AI products and services across China, aiming to protect children and public safety. Requirements include personalised settings, time limits, and guardian consent before offering emotional companionship to minors. Chatbots must hand conversations about suicide or self-harm to humans and notify guardians or emergency contacts. Providers must avoid content that endangers national security, damages national honour or undermines unity, and must prevent gambling-promoting outputs. The CAC encouraged safe AI adoption for culture and elderly companionship and invited public feedback amid rapid chatbot growth and major domestic AI firms' expansion.

Read at www.bbc.com