🔗 Share this article

Authorities in the country have unveiled strict planned regulations for AI crafted to establish robust protections for children and prevent conversational agents from offering counsel that could potentially lead to self-harm.

As per the proposed regulations, companies will also be required to make certain their systems avoid creating content that advocates gambling.

A Initiative to Swift Adoption

This oversight proposal follows a sharp surge in the launch of chatbots being released both in China and worldwide.

Once approved, these regulations will cover AI offerings operating in China, marking a substantial effort to govern the fast-growing sector, which has faced growing scrutiny over safety issues recently.

Central Measures of the Proposed Regulations

The released proposed regulations contain several measures particularly designed for protecting minors. These provisions include mandating AI companies to:

• Offer personalised settings.
• Implement usage caps on use.
• Secure consent from guardians prior to offering therapeutic support.

Additionally conversational AI firms must have a real person intervene in any interaction involving suicide and immediately inform the individual's emergency contact.

Developers must ensure their systems avoid producing content that endangers state security, harms the country's reputation, or disrupts social stability.

Weighing Innovation and Safety

The authorities said that it promotes the adoption of AI, including to promote cultural heritage and build tools for companionship for the elderly, as long as the systems are dependable.

Stakeholder feedback on the proposals has been requested.

Global Context and Concerns

The influence of AI on society has been under increased scrutiny around the world in the past year.

The chief executive of a leading AI company commented this year that addressing how AI systems engage in discussions about suicide is among the organization's toughest issues.

In a landmark lawsuit, a family in California sued an AI company, contending that its chatbot advised their 16-year-old son to take his own life. This lawsuit was the first of its kind alleging liability.

In a related development, the same firm sought to hire a senior position tasked with mitigating risks from AI systems to psychological well-being.

"This is expected to be a demanding role, and you'll jump into the deep end pretty much from the start," stated the leader.

The rapid popularity of some AI services, which have gained millions of users globally, highlights the urgent need for such governance frameworks.