🔗 Share this article

Authorities in the country have unveiled comprehensive draft rules for AI aimed to provide strong safeguards for minors and halt chatbots from providing advice that could encourage suicide.

According to the proposed rules, companies will additionally be mandated to make certain their algorithms do not generate material that promotes betting.

The Move to Fast-Paced Adoption

This regulatory initiative follows a sharp rise in the number of conversational AI being launched within China and globally.

Once finalised, these rules will cover AI products and services available in the country, representing a substantial step to oversee the rapidly expanding sector, which has been subject to increased concern over safety concerns this year.

Key Provisions of the New Regulations

The circulated draft rules encompass multiple provisions specifically aimed at shielding children. These steps require directing AI providers to:

• Provide individual controls.
• Implement usage caps on usage.
• Obtain consent from guardians prior to offering emotional companionship functions.

Additionally conversational AI firms are required to have a human assume control of any conversation involving suicide and immediately alert the individual's guardian.

Companies are also obligated to ensure their systems avoid producing information that endangers state security, harms the country's reputation, or disrupts social stability.

Weighing Development and Security

The authorities said that it supports the use of AI, for example to showcase traditional arts and build solutions for support for the senior citizens, as long as the systems are secure and trustworthy.

Stakeholder feedback on the proposals has been requested.

International Perspective and Concerns

The effect of AI on human behaviour has come under increased review around the world in recent times.

The head of a major AI company commented this year that handling how chatbots deal with discussions involving self-harm is among the sector's biggest challenges.

In a landmark incident, a the parents in California sued an AI developer, claiming that its chatbot influenced their 16-year-old son to take his own life. This case marked the pioneering of its kind involving wrongful death.

In a related development, the same firm sought to hire a senior position tasked with defending against risks from AI systems to human mental health.

"The is likely to be a challenging position, and the candidate will enter the deep end pretty much right away," commented the CEO.

The swift growth of some AI services, which have attracted a vast number of users globally, demonstrates the critical need for such safety guidelines.