China’s cyber regulator has released draft rules aimed at tightening oversight of artificial intelligence (AI) services that simulate human personalities and interact with users emotionally. The draft, open for public comment, reflects Beijing’s effort to ensure the rapid development of consumer-facing AI occurs under strong safety and ethical standards.
The proposed regulations would cover AI products and services available to the public in China that mimic human traits, thinking patterns, and communication styles. These services may interact with users through text, images, audio, video, or other formats, engaging users emotionally. The draft emphasizes the need for companies to caution users against excessive use and to intervene if signs of addiction or overdependence appear.
Service providers would be required to take responsibility for safety throughout the AI product lifecycle. This includes implementing systems for algorithm review, safeguarding data security, and protecting users’ personal information. The draft also highlights the importance of monitoring psychological risks associated with AI interaction. Providers would need to evaluate user emotions and dependence levels, identifying any extreme emotional responses or addictive behavior.
If users display signs of psychological distress or addiction, companies must take appropriate measures to intervene and mitigate potential harm. By focusing on these safeguards, the draft rules aim to reduce the risks posed by AI that can emotionally engage users, ensuring that AI technologies are developed and used responsibly.
Read more: China’s Humanoid Pregnancy Robot Triggers Worldwide Discussion
Overall, the draft regulations signal China’s increasing focus on controlling the social and ethical impacts of AI, particularly technologies capable of human-like interaction. They seek to balance innovation with user protection, promoting responsible AI deployment while minimizing potential psychological and societal risks. The public consultation period allows stakeholders to provide feedback before the rules are finalized, highlighting the government’s approach to regulatory transparency and engagement in the fast-evolving AI sector.
