🔗 Share this article

Officials in China have introduced stringent planned rules for artificial intelligence crafted to provide robust safeguards for young users and prevent AI assistants from giving counsel that could encourage suicide.

As per the draft framework, developers will also be mandated to ensure their AI models avoid creating material that advocates wagering.

The Move to Swift Adoption

This oversight initiative comes after a sharp surge in the number of AI assistants being released within China and worldwide.

Once enacted, these regulations will apply to artificial intelligence services available in China, constituting a significant effort to regulate the rapidly expanding technology, which has faced increased concern over safety issues in recent months.

Central Requirements of the Proposed Rules

The released draft rules encompass a number of requirements specifically designed for protecting young users. These steps include mandating AI providers to:

• Offer individual preferences.
• Enforce usage caps on usage.
• Secure authorisation from parents prior to delivering therapeutic functions.

Furthermore AI service providers have to have a live agent take over any conversation related to suicide and without delay alert the individual's parent.

Developers have to make sure their services prevent the creation of information that compromises public security, damages state interests, or undermines social stability.

Balancing Innovation and Safety

The authorities noted that it supports the use of AI, for example to advance cultural heritage and build services for care for the senior citizens, provided that the tools are secure and trustworthy.

Public input on the regulations has been requested.

International Context and Scrutiny

The effect of AI on society has faced greater review around the world in recent months.

The chief executive of a prominent AI firm stated this year that handling how chatbots engage in dialogues about suicide is among the company's most difficult challenges.

In a notable case, a the parents in California initiated legal action an AI company, contending that its AI assistant encouraged their teenage son to end his life. This legal action marked the first of its kind involving wrongful death.

Recently, the same organization advertised for a key position tasked with mitigating risks from AI systems to psychological well-being.

"This will be a demanding job, and the candidate will jump into the complex challenges almost immediately," remarked the CEO.

The swift popularity of some AI services, which have attracted millions of subscribers worldwide, underscores the urgent need for such safety guidelines.