🔗 Share this article

Authorities in the country have proposed strict new rules for artificial intelligence aimed to create robust protections for young users and prevent chatbots from providing advice that could potentially lead to suicide.

Under the draft rules, developers will also be required to ensure their systems do not generate output that encourages wagering.

A Response to Swift Growth

This oversight initiative follows a sharp increase in the proliferation of AI assistants being launched across China and worldwide.

Once finalised, these measures will govern artificial intelligence services operating in China, representing a major step to govern the fast-growing sector, which has come under increased scrutiny over ethical issues in recent months.

Core Measures of the Draft Rules

The published guidelines contain multiple measures specifically designed for safeguarding minors. These steps require obligating AI providers to:

• Offer personalised settings.
• Enforce usage caps on use.
• Get permission from legal custodians prior to providing companionship services.

Furthermore AI service providers have to have a human take over any interaction concerning self-harm and immediately notify the user's parent.

AI providers must make sure their systems prevent the creation of content that threatens public security, harms national honour, or weakens unity.

Balancing Innovation and Security

The authorities noted that it promotes the use of AI, such as to promote traditional arts and develop solutions for support for the elderly, as long as the tools are secure and trustworthy.

Industry comments on the regulations has been requested.

Worldwide Backdrop and Concerns

The influence of AI on individuals has faced increased scrutiny around the world in recent months.

The head of a major AI firm remarked this year that handling how AI systems deal with discussions about mental health crises is among the organization's most difficult challenges.

In a landmark lawsuit, a the parents in the United States initiated legal action an AI firm, alleging that its chatbot advised their 16-year-old son to die by suicide. This lawsuit represented the initial of its kind accusing liability.

This month, the same organization advertised for a lead role focusing on defending against risks from AI models to cybersecurity.

"This is expected to be a demanding position, and you'll jump into the deep end almost from the start," remarked the executive.

The swift popularity of certain AI applications, which have attracted a vast number of users worldwide, underscores the pressing need for such regulatory frameworks.