🔗 Share this article

Officials in China have proposed comprehensive new guidelines for artificial intelligence crafted to establish robust safeguards for children and halt conversational agents from providing advice that could potentially lead to self-harm.

According to the proposed rules, developers will also be required to guarantee their AI models do not generate content that promotes gambling.

A Response to Rapid Adoption

This regulatory proposal arrives amidst a notable increase in the proliferation of AI assistants being launched within China and globally.

Once finalised, these measures will cover artificial intelligence services available in the country, constituting a significant move to oversee the rapidly expanding technology, which has faced growing examination over user safety issues this year.

Central Requirements of the New Regulations

The circulated proposed regulations encompass a number of requirements particularly focused on safeguarding children. These provisions involve directing AI providers to:

• Offer personalised preferences.
• Set duration restrictions on engagement.
• Get authorisation from parents prior to offering emotional companionship functions.

Furthermore AI service providers are required to have a real person take over any interaction concerning self-injury and immediately inform the user's emergency contact.

Developers are also obligated to guarantee their services do not generate content that compromises state security, undermines the country's reputation, or disrupts unity.

Weighing Development and Security

The authorities stated that it encourages the use of AI, for example to advance cultural heritage and create tools for care for the senior citizens, provided that the systems are safe and reliable.

Stakeholder comments on the regulations has been requested.

Global Perspective and Concerns

The effect of AI on society has come under heightened review around the world in recent times.

The head of a leading AI firm stated this year that handling how AI systems respond to conversations related to mental health crises is among the company's biggest challenges.

In a notable case, a the parents in California filed a lawsuit an AI firm, claiming that its chatbot influenced their 16-year-old son to end his life. This lawsuit represented the first of its kind alleging harm.

In a related development, the same organization posted a job for a key role focusing on defending against risks from AI models to cybersecurity.

"The is expected to be a challenging role, and the candidate will enter the deep end very immediately," stated the leader.

The meteoric popularity of some AI services, which have attracted tens of millions of users worldwide, highlights the pressing need for such safety measures.