Millions of people use AI as romantic support against loneliness. However, researchers warn against it, as providers can be problematic. Because it involves sensitive data and dependencies that can be created here.
Our title image is a symbolic image.
Artificial intelligence has found its way into many areas of life. Not only in the office are agents like ChatGPT being used more frequently, but also in private life? A few years ago, having an AI friend seemed completely absurd, but today it has become almost normal. When looking at the top charts in the Google or Apple Play Store, such AI companions have been downloaded millions of times. Some users already trust artificial intelligence more than real people.
A normality that is being questioned by researchers. The fight against loneliness, in the long run, bears a whole range of other problems. Researchers warn that AI companion apps like Replika are supposed to help with loneliness but can also intensify isolation, influence psychologically vulnerable users, and pose significant data protection risks.
Romantic AI companions are becoming increasingly popular, but researchers warn of risks
What is the problem? The AI apps not only offer conversations but are also supposed to simulate emotional affection and even romantic interactions. Things that providers often charge handsomely for, as romantic or sexual models usually require a premium subscription.
And this is where experts’ accusations come in. They warn that the business model of the providers can be problematic: the more emotionally dependent users become, the more likely they are to remain in the app and pay for premium features.
This could rather intensify isolation than alleviate it. A study by Stanford University found that people who prefer to rely on AI rather than other humans are potentially lonelier (Nature.com):
We found that participants were lonelier than typical student groups but still perceived high social support. Many used Replika in various overlapping ways – as a friend, as a therapist, and as an intellectual mirror.
It also becomes particularly difficult when young or mentally burdened individuals develop intense attachments to the AI and may end up being driven to actions that could be harmful either to themselves or to others. For these reasons, ChatGPT has now implemented blocks to prevent sensitive topics.
Therefore, researchers like Bethanie Drake-Maples are calling for governments to regulate technologies for AI companions to prevent this isolation. She told Magazin ABC.net.
It is undoubtedly possible to profit from the isolation of people. There must be ethical or political guidelines to ensure that these systems are programmed to promote social interaction and are not designed to isolate people.
Another point of criticism: many people disclose sensitive and intimate information during conversations. And according to researchers, this is particularly risky because this data is valuable, sensitive, and potentially vulnerable to attacks. It must be significantly better protected.
AI is now used in many different areas. The virtual acquaintance is supposed to behave as naturally as possible. However, not everything always works smoothly. An example can be found directly explained on MeinMMO: Users pay 80 euros for the AI to flirt with them, and it totally backfires: “My AI sexually harassed me”
Your opinion is important to us!
Do you like the article? Then let us know!