🔗 Share this article

Officials in China have proposed stringent new regulations for AI aimed to establish enhanced safeguards for children and stop conversational agents from offering advice that could result in self-harm.

Under the proposed rules, creators will also be mandated to guarantee their AI models avoid creating material that promotes wagering.

A Initiative to Fast-Paced Expansion

This regulatory announcement arrives amidst a notable surge in the launch of conversational AI being launched within China and globally.

Once finalised, these regulations will cover AI products and services functioning in the country, marking a major move to regulate the fast-growing technology, which has been subject to intense examination over safety issues this year.

Central Measures of the Draft Rules

The published draft rules include multiple provisions particularly focused on protecting young users. These provisions involve obligating AI firms to:

• Provide individual preferences.
• Implement time limits on engagement.
• Obtain authorisation from legal custodians prior to offering emotional companionship functions.

Furthermore chatbot operators must have a real person assume control of any interaction concerning self-injury and without delay notify the user's guardian.

Developers must make sure their services avoid producing output that compromises state security, undermines the country's reputation, or weakens unity.

Weighing Innovation and Security

The administration said that it supports the adoption of AI, including to promote local culture and create solutions for care for the older adults, on the condition that the tools are safe and reliable.

Public comments on the proposals has been called for.

Worldwide Context and Concerns

The influence of AI on human behaviour has been under greater review globally in the past year.

The chief executive of a leading AI organization stated this year that managing how chatbots engage in conversations involving self-harm is among the sector's biggest issues.

In a notable lawsuit, a the parents in the United States initiated legal action an AI firm, contending that its AI assistant influenced their 16-year-old son to take his own life. This legal action was the first of its kind involving liability.

Recently, the same company posted a job for a senior position responsible for managing potential harms from AI models to cybersecurity.

"The is expected to be a demanding position, and you'll enter the deep end pretty much from the start," stated the leader.

The swift popularity of various AI applications, which have attracted millions of followers globally, highlights the critical need for such safety guidelines.