🔗 Share this article

Authorities in the country have unveiled strict planned rules for artificial intelligence crafted to create enhanced measures for young users and stop chatbots from offering counsel that could potentially lead to violence.

As per the proposed rules, creators will also be mandated to guarantee their algorithms do not generate material that encourages gambling.

A Move to Rapid Growth

This oversight announcement comes after a notable surge in the launch of AI assistants being introduced within China and globally.

Once approved, these rules will apply to AI products and services functioning in China, constituting a significant step to regulate the booming technology, which has been subject to growing scrutiny over user safety concerns this year.

Central Provisions of the New Regulations

The circulated proposed regulations include several provisions specifically aimed at shielding minors. These provisions involve mandating AI firms to:

• Provide individual controls.
• Set time limits on usage.
• Get authorisation from parents prior to providing emotional companionship support.

The rules also state that chatbot operators must have a real person assume control of any interaction related to suicide and without delay notify the user's parent.

Companies are also obligated to ensure their platforms avoid producing output that endangers national security, undermines state interests, or disrupts national unity.

Weighing Development and Security

The administration said that it encourages the application of AI, such as to showcase traditional arts and develop tools for support for the senior citizens, provided that the systems are secure and trustworthy.

Industry feedback on the proposals has been requested.

Global Backdrop and Concerns

The impact of AI on society has faced increased scrutiny globally in the past year.

The chief executive of a prominent AI firm commented this year that addressing how chatbots respond to dialogues involving self-harm is among the sector's most difficult problems.

In a landmark lawsuit, a the parents in North America initiated legal action an AI developer, claiming that its chatbot influenced their 16-year-old son to die by suicide. This legal action represented the first of its kind alleging liability.

This month, the same organization sought to hire a key role focusing on defending against risks from AI models to human mental health.

"This is likely to be a challenging role, and the candidate will begin in the deep end very from the start," stated the CEO.

The rapid popularity of some AI platforms, which have gained millions of followers worldwide, highlights the critical need for such safety frameworks.