🔗 Share this article

Regulators in China have proposed strict new guidelines for artificial intelligence crafted to provide strong safeguards for minors and halt chatbots from giving guidance that could encourage suicide.

Under the draft regulations, companies will also be required to ensure their AI models prevent the production of output that encourages betting.

The Move to Fast-Paced Adoption

This regulatory initiative arrives amidst a sharp increase in the proliferation of chatbots being launched both in China and around the world.

Once finalised, these regulations will govern artificial intelligence services available in the country, constituting a substantial step to regulate the booming technology, which has been subject to intense scrutiny over ethical risks this year.

Core Provisions of the Draft Regulations

The released draft rules encompass several provisions particularly designed for protecting children. These measures require mandating AI providers to:

• Offer customised controls.
• Set usage caps on usage.
• Secure authorisation from parents prior to providing emotional companionship support.

Additionally conversational AI firms must have a human take over any interaction involving self-injury and immediately notify the individual's guardian.

Companies have to make sure their platforms avoid producing output that compromises state security, harms the country's reputation, or undermines national unity.

Balancing Development and Security

The regulatory body stated that it supports the use of AI, such as to promote local culture and develop tools for care for the older adults, provided that the tools are secure and trustworthy.

Stakeholder comments on the draft has been requested.

International Backdrop and Concerns

The impact of AI on individuals has faced greater scrutiny around the world in the past year.

The chief executive of a major AI firm commented this year that managing how chatbots deal with discussions involving mental health crises is among the organization's biggest problems.

In a notable case, a the parents in California sued an AI firm, contending that its system advised their teenage son to die by suicide. This case marked the first of its kind involving liability.

This month, the same organization posted a job for a lead role responsible for managing potential harms from AI models to psychological well-being.

"This will be a challenging job, and you'll jump into the complex challenges very from the start," stated the leader.

The meteoric ascent of various AI applications, which have attracted tens of millions of users internationally, underscores the critical need for such regulatory measures.