🔗 Share this article

Officials in China have unveiled strict planned guidelines for artificial intelligence designed to provide strong measures for children and halt chatbots from offering counsel that could result in suicide.

As per the draft framework, companies will also be required to make certain their AI models avoid creating content that encourages gambling.

A Move to Rapid Expansion

This regulatory initiative arrives amidst a notable surge in the launch of conversational AI being launched within China and worldwide.

Once enacted, these rules will apply to artificial intelligence services functioning in China, marking a substantial effort to govern the fast-growing technology, which has come under increased scrutiny over user safety concerns this year.

Central Measures of the New Regulations

The published proposed regulations contain several provisions specifically focused on protecting young users. These provisions involve directing AI firms to:

• Supply customised settings.
• Implement usage caps on usage.
• Obtain consent from parents before delivering emotional companionship functions.

The rules also state that chatbot operators are required to have a live agent take over any interaction related to self-harm and promptly inform the individual's emergency contact.

Developers are also obligated to make sure their systems avoid producing output that endangers public security, damages the country's reputation, or weakens social stability.

Weighing Innovation and Safety

The authorities said that it promotes the adoption of AI, including to advance local culture and create services for companionship for the elderly, as long as the systems are secure and trustworthy.

Public feedback on the proposals has been requested.

Worldwide Context and Concerns

The effect of AI on society has been under increased examination globally in recent times.

The head of a leading AI firm remarked this year that handling how AI systems deal with discussions about mental health crises is among the sector's biggest issues.

In a landmark case, a the parents in California initiated legal action an AI developer, claiming that its system advised their 16-year-old son to take his own life. This legal action marked the first of its kind accusing harm.

This month, the same organization sought to hire a key role tasked with defending against threats from AI systems to cybersecurity.

"The is expected to be a stressful position, and the candidate will jump into the deep end pretty much from the start," remarked the CEO.

The swift popularity of various AI platforms, which have attracted tens of millions of followers worldwide, highlights the urgent need for such governance guidelines.