Bringing back deceased beloved ones through AI technology becomes a new, controversial business in China as ‘era of digital humans’ approaches

Editor's Note:

Big models, robots, intelligent manufacturing, autonomous driving… In recent years, AI (artificial intelligence) has frequently made headlines around the world, becoming a hot topic of discussion. The emergence of generative AI programs has also caused unemployment anxiety.

The development of technology has indeed brought challenges in various aspects such as ethics and law. But at the same time, many experts advocate that human should see technology as a tool, with the ultimate purpose of serving humanity, making human life and work more efficient and comfortable.

In real life, AI has already permeated all aspects of human society, helping with scientific research in laboratories, assisting in the restoration of mysterious ancient scrolls at archaeological sites, and helping to find abducted children in the vast sea of people.

In light of this, the Global Times has launched the "AI empowers industry, improves people's livelihoods" series, showcasing the tremendous energy and broad prospects that AI brings to various industries.

This is the first installment in this series. In this story, we explore how AI helps people reconnect with their loved ones from beyond the grave, make up for lost time, and continue family ties in the virtual world.

"Mom, I want to eat Moo Shu Pork."

"Okay, let me prepare the meat. I'm going to tell you when I'm done."

Zhu Rui's mother replies with a smile. Wearing a rosy pajama with a big Mickey Mouse caricature on it, the lady in her 60s sits in a chair with her hands naturally folded. She looks at her son with tender eyes - from the computer screen.

This is a small conversation between Zhu and his "digital mom," an interactive virtual role that Zhu recently made with AI technology. The virtual mother looks so lifelike that it looks as if Zhu is having a video call with his real mother, instead of a program built based on numerous AI algorithms.

After suffering from cancer for five years, Zhu's mother's diagnosis sadly took a turn for the worse this year. His deep love for his ailing mother pushed Zhu to make a digital doppelganger of her, which can help carry his memory of his mother in the near future.

Zhu is among a growing number of Chinese people who try to make digital doppelgangers of their deceased or elderly family members. With the rapid development of AI technology, the"digital resurrection" of deceased loved ones is practically becoming an industry in the country, with controversies following close by, of course.

'Digital mom'
The so-called "digital resurrection" is based on historical data such as photos and videos, using AI technology to reproduce the voice, image, and behavior of deceased individuals, generating similar outputs.

The first time Zhu heard of "digital resurrection" was in the spring of 2023. He watched various "digitally resurrected relatives" online, thinking about making a digital doppelganger of his mother, who, in his words, probably doesn't have much time left.

"While taking care of my mom, I hoped that I could make a digital version of her, as a special memory that she can leave for her loved ones," Zhu told the Global Times. "I'm in a race against time. I want to get the thing done while she is still here."

Zhu said he was perhaps the first-ever person in China to make a digital doppelganger of a family member who is still alive. Unlike creating a digital doppelganger of the departed loved one based on limited materials, Zhu could take as many photos and videos of his mother as possible to make his "digital mom" more realistic.

It, nonetheless, took Zhu some time to convince his mother. "The older generation knows very little about AI technology. My mom had no idea what a 'digital doppelganger' was; she felt it a bit strange [about the concept], but anyway, she trusted me unconditionally," Zhu said. "We are closest to each other in this world."

As the co-founder of a tech company, however, Zhu was not as familiar with AI himself at the very beginning. Step by step, he taught himself a series of AI models and tools that helped create his "digital mother," from Kimi and GPT-4 to popular applications including Midjourney and Heygen. Within some 20 days, this fast learner successfully created a preliminary version of his "digital mother" with the help of his AI industry friends.

Zhu clearly remembers the first time his "digital mother" eventually appeared on screen and smiled at him. It was around 5 am, after he had stayed up all night making some final adjustments. He was impressed but actually "not very excited." "This version was not yet perfect due to my limited time and skill," said Zhu. "I thought I could do better."

In February, a video telling Zhu's story about making a "digital mother" went viral online, drawing people's attention to this new way of cherishing the memory of their loved ones. Zhu said that he is thinking about making a miniseries based on the ordinary Chinese people who try to create their "digital families." It will be a nonprofit project aiming to discuss topics like life, death, family, and love under the context of AI technology, he added.

For those who would like to be a part of the project, Zhu said he may help them create a "digital family" for free. "I hope that a digital doppelganger can help relieve the pain of those who lost their loved ones," he told the Global Times. "This is the meaning of AI technology."

Emerging business

As early as 2016, HereAfter founder James Vlahos built a chatbot that responds like his dead father, or Dadbot, based on data left by his father. People quickly got in touch with Vlahos after the creation of Dadbot, asking if he could make them bots of their own.

In China, "digital resurrection" caught the public's attention during the Qingming Festival in 2023 when an influencer on Bilibili uploaded a clip of his AI-revived grandma.

The business was cast in the spotlight again recently after Chinese renowned musician Tino Bao (Bao Xiaobo) unveiled to the public his "revived" daughter with AI technology.

Zhang Zewei, founder of AI company Super Brain in Nanjing, East China's Jiangsu Province, told the Shanghai Observer that his team has completed more than 1,000 "resurrection" orders. With the Qingming Festival approaching, they receive four to five dozen related inquiries every day, the Shangguan Observer reported on Wednesday.

Most of Zhang's users have a similar starting point to Zhu. They all have a strong desire to "see their loved ones again"; some families have lost their only child in middle age, and the parents are unable to overcome the pain of losing their child; and some people have lost their partners of many years, and are hoping to see the person they miss day and night again, even if it's just a brief glimpse on the screen.

However, the innovation also comes along with controversies.

Recently, a video blogger "resurrected" late stars through AI without obtaining permission from the stars' families. The father of late Chinese singer-actor Qiao Renliang has required the video blogger to remove the video and said that the move reopened his old emotional wounds.

Many netizens and law experts also characterized the move as offensive to family members of the deceased and violated portrait rights and privacy, calling for more complete and detailed regulations and management to catch up with the impact of the market of the rapid development of AI technology.

A search on Taobao with the keywords "AI, digital life, resurrection" on Wednesday yielded hundreds of results. According to these results, customers can get an audio clip of their late relatives by paying 99 yuan ($13.6), get a video clip of late relatives talking by paying 198 yuan, and interact with "resurrected relatives" via a certain app if they pay 498 yuan.

One of the stores also claimed to provide a service that teaches customers to create a digital life. Customer service representatives at the store told the Global Times that the app was developed by themselves and "it was very easy to learn." Tuition and the app jointly cost only 1,000 yuan, according to the customer service representative.

A more important problem may be the overly realistic interaction of the digital doppelganger, as Zhu said. "It is a double-edged sword that offers users a very good immersive experience, but may also bring huge hidden troubles."

Smooth, natural conversations are supported by the strong computing power of the AI models, which is very expensive. What if one day, the customers cannot afford the money and have to turn "the digital relative off?" Zhu questioned.

Moreover, overly realistic and natural interaction may make people addicted to the virtual world. Especially for those who lose their loved ones,"they may feel it is harder to move on," Zhu said.

Era of 'digital humans'

But Zhang still expresses full optimism about the business. He believes that with technological progress, the concept of "AI resurrection" will continue to evolve. In the future, there will be more AI digital human products such as digital immortality and digital companionship, in addition to a short video or a chatbot.

Some other observers echoed Zhang's sentiment. They pointed out that "digital resurrection" is an emerging subdivision of digital humans while the industry is moving toward a new stage of AI-driven, tool-based, and low-cost with the empowerment of large models.

At present, digital humans mainly appear as intelligent customer service representatives on e-commerce platforms and public service portals, and they are also showing huge application potential in the consumer market, such as in the field of education. But as technology advances and demand evolves, the application market for digital humans will further broaden. It is a trend for more middle and small teams flooding into the industry to provide human solutions for small merchants and individuals, according to industry insiders and observers.

In the future, virtual digital humans will become more intelligent. They will gradually possess the ability to see, understand, and express themselves, allowing AI-generated and driven virtual digital humans to more comprehensively and deeply integrate into various fields such as film and television, finance, and cultural tourism.

Zhang Rui, founder and executive director of the Art Robot company in Beijing, told the Global Times that an AI product may be able to understand and express human feelings in 5 to 10 years.

According to data from iMedia Research, in 2022, the market size of this industry reached 12.08 billion yuan, while also driving the surrounding market size to reach 186.61 billion yuan. It is estimated that by 2025, the core market size of virtual digital humans will reach 48.06 billion yuan, and the surrounding market size driven by such growth may be close to 640.27 billion yuan.

Regulations are also on the way. In 2019, China issued principles of next-generation AI governance. In 2021, the country published the "Ethical Norms for the New Generation Artificial Intelligence," aiming to guide activities in the entire lifecycle. In 2023, China further released its regulations on deep synthesis Internet information services and Interim Measures for the Management of Generative Artificial Intelligence Services to boost AI development while safeguarding cybersecurity.

Chinese social media platforms have also enacted specific measures for users in terms of producing AI-generated content, vowing strict punishment for those who violate the rules by using AI to generate virtual characters to publish content that goes against scientific knowledge, fabricates information and spreads rumors.

The era of one "digital human" per person is coming, industry insiders said.