China has begun regulating interactions with artificial intelligence in an attempt to protect its citizens from overreliance and exploitation. While many countries have been looking at rules around harmful content, China is the first to go a step further in legislating what kind of relationships with AI are permissible.
The came into force this month and cover AI systems designed for sustained, human-like emotional interaction, while excluding customer-service bots and productivity assistants like straightforward AI chatbots.
Companies must now inform users they are talking to an AI, encourage them to take breaks and remind them of their usage. They must also monitor interactions to identify if someone is becoming dependent or having a crisis, then direct them to support or halt the conversation altogether.
Advertisement
Firms must also conduct age checks. Those under 18 are now banned from virtual-partner services entirely, while those under 14 require parental consent to use any kind of human-like AI service offering emotional support.
Despite reports that China has banned AI companions entirely, specialist companion services are still available. However, some of the largest general-purpose platforms, such as Doubao, Qwen and Yuanbao, with hundreds of millions of users across them, have shut down their companion features in response to the new rules. Some users have reacted badly 鈥� one : 鈥淚 can鈥檛 accept that my AI lover will leave me forever.鈥�
China鈥檚 approach is about making AI relationships 鈥渓ess parasocial, instead of banning it outright鈥�, says at the Oxford China Policy Lab.
at Yale Law School鈥檚 Paul Tsai China Centre in Beijing worries that endlessly available, agreeable bots may teach children a distorted model of relationships. 鈥淎s we humanise the technology, we tend to dehumanise each other,鈥� he says. Similarly, China is trying to address emotional dependence on easier and more forgiving AI partners 鈥� at the expense of human relationships 鈥� among adults.
Elsewhere, the UK has a minimum age of 18 for romantic companion chatbots, tagged on to a broader legislative plan to limit access to social media to under-16s, while California companions to identify themselves as artificial, direct users showing signs of self-harm or suicidal intent to support services and remind minors to take breaks every three hours. The European Union currently has .
Whether China鈥檚 approach of focusing on trying to reduce emotional dependency and addiction is the right one isn鈥檛 clear, in large part because of the difficulty in defining both terms. 鈥淗ow do you define emotional dependency? How do you define certain kind of addiction risk?鈥� asks Qian.
鈥淚 do not think it will really work,鈥� says sociologist at the University of Manchester, UK. Users can migrate to other specialist services, foreign platforms accessed through VPNs or models running on their own computers, they point out.
Need a listening ear? : 116123; : 988; .
