Your AI Girlfriend Is a Data-Harvesting Horror Show (gizmodo.com) 135
"A lot of that AI chatbots that you spend days talking to push hard on getting more and more private information from you," writes longtime Slashdot reader michelcultivo, sharing a report from Gizmodo.
"To be perfectly blunt, AI girlfriends and boyfriends are not your friends," says Misha Rykov, a Mozilla Researcher from the company's *Privacy Not Included project. "Although they are marketed as something that will enhance your mental health and well-being, they specialize in delivering dependency, loneliness, and toxicity, all while prying as much data as possible from you." Gizmodo reports: Mozilla dug into 11 different AI romance chatbots, including popular apps such as Replika, Chai, Romantic AI, EVA AI Chat Bot & Soulmate, and CrushOn.AI. Every single one earned the Privacy Not Included label, putting these chatbots among the worst categories of products Mozilla has ever reviewed. You've heard stories about data problems before, but according to Mozilla, AI girlfriends violate your privacy in "disturbing new ways." For example, CrushOn.AI collects details including information about sexual health, use of medication, and gender-affirming care. 90% of the apps may sell or share user data for targeted ads and other purposes, and more than half won't let you delete the data they collect. Security was also a problem. Only one app, Genesia AI Friend & Partner, met Mozilla's minimum security standards.
One of the more striking findings came when Mozilla counted the trackers in these apps, little bits of code that collect data and share them with other companies for advertising and other purposes. Mozilla found the AI girlfriend apps used an average of 2,663 trackers per minute, though that number was driven up by Romantic AI, which called a whopping 24,354 trackers in just one minute of using the app. The privacy mess is even more troubling because the apps actively encourage you to share details that are far more personal than the kind of thing you might enter into a typical app. EVA AI Chat Bot & Soulmate pushes users to "share all your secrets and desires," and specifically asks for photos and voice recordings. It's worth noting that EVA was the only chatbot that didn't get dinged for how it uses that data, though the app did have security issues. [...]
"To be perfectly blunt, AI girlfriends and boyfriends are not your friends," says Misha Rykov, a Mozilla Researcher from the company's *Privacy Not Included project. "Although they are marketed as something that will enhance your mental health and well-being, they specialize in delivering dependency, loneliness, and toxicity, all while prying as much data as possible from you." Gizmodo reports: Mozilla dug into 11 different AI romance chatbots, including popular apps such as Replika, Chai, Romantic AI, EVA AI Chat Bot & Soulmate, and CrushOn.AI. Every single one earned the Privacy Not Included label, putting these chatbots among the worst categories of products Mozilla has ever reviewed. You've heard stories about data problems before, but according to Mozilla, AI girlfriends violate your privacy in "disturbing new ways." For example, CrushOn.AI collects details including information about sexual health, use of medication, and gender-affirming care. 90% of the apps may sell or share user data for targeted ads and other purposes, and more than half won't let you delete the data they collect. Security was also a problem. Only one app, Genesia AI Friend & Partner, met Mozilla's minimum security standards.
One of the more striking findings came when Mozilla counted the trackers in these apps, little bits of code that collect data and share them with other companies for advertising and other purposes. Mozilla found the AI girlfriend apps used an average of 2,663 trackers per minute, though that number was driven up by Romantic AI, which called a whopping 24,354 trackers in just one minute of using the app. The privacy mess is even more troubling because the apps actively encourage you to share details that are far more personal than the kind of thing you might enter into a typical app. EVA AI Chat Bot & Soulmate pushes users to "share all your secrets and desires," and specifically asks for photos and voice recordings. It's worth noting that EVA was the only chatbot that didn't get dinged for how it uses that data, though the app did have security issues. [...]
Correct link (Score:5, Informative)
"Happy Valentine’s Day! Romantic AI Chatbots Don’t Have Your Privacy at Heart" https://foundation.mozilla.org... [mozilla.org]
Like every other digital assistant, but worse (Score:5, Insightful)
Google Assistant, Alexa, Siri, they all collect all kinds of data on you.
These digital girlfriends will do the same, except that they are run by even sleazier companies that nobody has ever heard of, and nobody is watching.
Re: (Score:3)
Like every other *online* digital assistant.
The offline ones just haven't been made yet.
Re: (Score:3)
I still talk to my offline digital therapist Dr. Sbaitso. He really knows how to listen.
Re: (Score:2)
I can't imagine what use an offline digital assistant would be. Everything I use Google Assistant for, requires a connection, even if the assistant itself didn't require one. I ask it to do things like check game scores, or distance to a city, or the Guinness record for pole vaulting. In other words, random stuff that in most cases, an offline assistant wouldn't be able to answer. I suspect that the usefulness of an offline assistant would be quite limited.
Re: (Score:2)
Not a whole lot. Turn lights on n off. Turn off the forgotten stove. Lock up the house. If it had robots, then mow the lawn, take out the trash, etc. Which are all nice things but you can already buy a simple automation system to do everything but taking out the trash. Yes there are robot lawn mowers.
Re: (Score:2)
Even turning lights or stoves on and off, or locking locks, requires a connection. Perhaps not an internet connection, but these days, hardly anybody makes automation systems that don't connect to the internet.
Re: (Score:2)
They don't work on local net? I've looked into but never bought one. I thought these things are blue tooth and local WiFi or at least most have that option?
Re: (Score:2)
Yes, such options do exist, that use special-purpose wireless connections. But those options are quickly disappearing in favor of wifi-based systems..
Re: (Score:2)
There's a handful of solutions that can be made to work entirely locally. Home Assistant is a smarthome control system that's very customizable and open source, and works completely locally. With some care in picking smarthome components you can get ones that don't require a cloud connection and work locally with an open API, but those can be few and far between for some use cases and there's been a few issues where companies have locked down/closed down their formerly open APIs or local endpoints on their
Can we *please* get an AI article? (Score:4, Funny)
Seriously, this is an important technical and social concept with implications across the board for most of the world and it seems like we never get articles about it?
Why do we ignore AI? We should get a chance to talk about it at least occasionally.
Please front page some AI articles!
Re: (Score:2)
You want more mindless and baseless hype?
Re: (Score:3)
Whoosh!
Sorry, my bad, I forgot /. Is the home of a great many people on the spectrum. Apologies.
To be clear for my spectrum dwelling fans, it was a joke. Not even a very subtle one.
Re: (Score:3)
Sorry, it is getting really hard to tell who is sarcastic and who actually thinks this crap. Hence I asked. And no, I am not on any "spectrum".
Re: (Score:2)
Fair enough. Apologies for the false assumption.
Re: (Score:2)
Accepted.
Re: (Score:2)
When people read obviously-stupid statements online, their first reaction is usually not "oh, sarcasm, haha" but rather "oh wow, look at this idiot."
It's part of our natural belief that we are smarter than everyone else. It "fits" that other posts would be written by idiots.
It is even more difficult to detect sarcasm online since text removes tone-of-voice and body language hints that the message is sarcastic.
Of course, on the flip side, when we write something sarcastic and someone takes it seriously, our
Re: (Score:2)
I didn't think he was stupid. I already apologized to him for mislabeling him.
I figured by now "we have too many AI stories" had become a meme of sorts here which I incorrectly assumed meant everyone would understand my over the top plea for more AI stories would be taken as intended.
My bad. Shrug.
NOPE. (Score:2)
>> Seriously, this is an important technical and social concept
Nope. It is not.
Re: (Score:2)
Yeah, it takes away valuable screen real estate from the things we're really interested in, some more Dunning-Krugerrand scam reports.
Low effort revolution, anybody? (Score:2)
Set up an account...or several...with these things and actively poison the data pool.
Re: (Score:2)
Way ahead of you. Sign up and pose as someone you don't like, then ruin his marriage.
Re: (Score:2)
If he's married you don't need to do anything but wait. Odds are better than 50/50 they'll get divorced without your help.
Re: (Score:2)
But I can increase that likelihood and have some fun in the process.
Re: (Score:2)
Fair point :-)
Wow (Score:5, Insightful)
Re: (Score:3)
It's like she knows me better than I know myself.
Don’t worry, after you pass on this will be used to continue your social media presence just like you never left. You can continue to make product recommendations to your living friends and relatives, which if you think about it really is the most important thing.
Contamination is the way to go... (Score:2)
Re: (Score:2)
OMG, I finally found my soulmate!
AI girlfriend? What is that? (Score:2)
Sound like some a really bad idea.
It's like a subscription girlfriend that likes you (Score:2)
note that she can't fetch you your beer
Re: (Score:2)
Or divorce you and take all your shit she did nothing to earn.
Re:It's like a subscription girlfriend that likes (Score:4, Insightful)
Re: (Score:3)
I never wanted kids so for me that's moot but I get your point.
I've found the best way to go is get the woman you think is good and live/move to a place that doesn't have common law marriage. I can treat her super well without fear that she'll leave anyway and take my shit with her. If I was wrong and she goes anyway that's fine, my losses are zero because things were good up until that moment then no further loss or risk. I had a few ~1 year gfs like that before this one (8+ years and going strong). Th
Re: (Score:2)
The trick there is to marry a woman who thrives with or without you, yet choose to be with you. Then treat her well enough for her to keep choosing to be with you.
This is sage advice. Unfortunately, it's too much of an effort for many of our fellow Slashdotters.
They'd much rather piss and moan about how nobody realizes how much smarter than everyone they are.
This has a name (Score:3, Interesting)
Digital toxic girlfriend
Re: (Score:2)
Just wait until they fit it to one of those Real Doll things, and add micro transactions. Or more likely macro transactions.
I saw an app in Japan that lets your virtual girlfriend walk around town with you. Ars just did an article about how the Vision Pro is no good for walking around outside, but they didn't count on virtual girlfriends.
Re: (Score:2)
Do I have to bring my own waifu pillow or is that included?
Re: (Score:2)
Ars just did an article about how the Vision Pro is no good for walking around outside, but they didn't count on virtual girlfriends.
You thinks so?
Just like the real thing (Score:2)
They grow up so fast!
Re: (Score:2)
It would be way creepier if they were used before they do...
okay, but... (Score:2)
who is she?
Yes but... (Score:5, Insightful)
I'm a sad loner who seeks company in chatting with an AI companion for love. I don't think there's any value in my data at all or me at all. After all if I had confidence, money or any other value I probably would be talking to real people.
Re: (Score:2)
FWIW, while we disagree from time to time, I hardly think you are a sad loner. But as to your comment about having nothing to hide, please remember the line from Torquemada, "Give me 12 lines written by the most honest of men, and I shall find something (within) to hang them."
Just because you think you have nothing worth knowing (or hiding) doesn't mean others feel the same way about your words.
Re: (Score:2)
I don't think there's any value in my data at all or me at all.
If you have $5 in your pocket, you are worth hitting over the head to take it from you. If getting hit over the head and having resources taken from you has no negative value to you, you are indeed completely worthless... but I strongly suspect you would object, so take a look at that objection and find your worth.
Or you can live life as a whiny asshole. Many people seem to do just that. :)
Robot Gonorrhea: The noisy killer (Score:2)
You can't trust those artificial gold-diggers. Don't date robots!
Me personally, as long as my wife's AI boyfriend is still safe and trustworthy, I'm not worried.
the perils of shopping online (Score:4, Funny)
Just wait.. (Score:2)
My real GF Is a Data-Harvesting Horror Show (Score:3)
Lately she's been drunk-dialing my friends on facebook. People I barely know or haven't spoken to in years are like "Why are you sending me a thumbs-up emoji?"
Re: (Score:2)
If you're serious, get out. Do not spend quality time with anyone who can't control themselves when near alcohol/drugs.
And despite what these girls will tell you, there is nothing romantic about holding her hair while she throws up the last 5 drinks and whatever she was eating for the last 4 hours.
Re: (Score:2)
Well, now wait.....that depends.
Did she blow you BEFORE she had to hug the toilet?
And also...isn't it her girlfriends' job to hold her hair?
Re: (Score:2)
No, she didn't. I was put off by the whole ugly experience and didn't touch her for a few days. Why did I do this for her? The alternative was driving her home getting her mess all over my car. She was one of the ~1 girls and was out entirely not long after.
Yes her gfs should do this but we'd already left the party and I was stuck for it. It's an ugly world! Be careful out there!
There's a Futurama about this one (Score:2)
File this one under, No [POOP]! (Score:2)
Credibility / Methodology? (Score:2)
24,354 "Trackers per minute" can't be right. The user doesn't generate data at 7 Hertz. I'd like to see the underlying methodology or data used for that.
Is this any more privacy-risking than Google? (Score:2)
When you're wearing a Fitbit (or Google Watch) and using Chrome, Google can correlate the timing of the two data streams to know precisely which website and which advertising makes your heart go pitter-patter. Watch videos with Youtube or Chromecast with a Fitbit, and they don't really need to ask if you're still awake, 'cause just like Santa Claus, they know when you are sleeping, they know when you're awake. They know if you've been bad or good, so be good for goodness sake.
Of course, an Apple Watch with
bots on bots (Score:2)
If 'my' AI girlfriend only knew she was talking to another bot... its automation all the way down.
Re:An AI what what? (Score:5, Informative)
Same as every website.
Sell people stuff. Show them ads.
Re: (Score:3)
According to Mozilla, these services cost $10-$17 a month.
Re: (Score:3)
I bet you Google & Apple will make all kinds of "concerned" noises & introduce "measures" in public but will quietly rake in their share of the profits from their app stores.
The reality is otherwise (Score:2)
Should you be inclined to spend your time with an ML system acting as a girl/boy/fish/alien/[*] "friend" (or really, anything else you want to use GPT/LLM ML systems for), you can do so with no cost and zero data mining by using an open system such as GPT4All [gpt4all.io].
A lot of these "oh no" stories start from the premise that pay-to-use-and-suck-your-data ML systems are the entire space. They aren't. Furthermore, the open systems, while not as advanced as the
Re: The reality is otherwise (Score:3)
Re:An AI what what? (Score:5, Insightful)
Rope them in, get them addicted and subjugated, ask for money. Anybody with an "AI girlfriend" cannot be very smart.
Re: (Score:3)
Any guy who did whatever the lady does after she flashed her tits at him is not very smart but here we are.
Re: (Score:2)
A real lady flashing tits at you might lead to a benefit for you. An AI "girlfriend" can not.
Re: (Score:3)
Well, that "real lady" may eventually take half (or more) of your value in a messy divorce. So there is that.
Re:An AI what what? (Score:5, Funny)
Yeah, my ex was like a hurricane. Started with a bit of blowing and before I knew it the house was gone.
Re: (Score:2)
A real lady flashing tits at you might lead to a benefit for you. An AI "girlfriend" can not.
Normally having a real lady do it IS the benefit. That's why you have video sex services. And the real lady can also run a scam equally well - it is unusual that you actually meet such a person in the flesh.
>
Re: (Score:2)
You have a point.
Re: (Score:3)
Rope them in, get them addicted and subjugated, ask for money.
So it's just like any other toxic relationship.
Re: (Score:3)
Pretty much, but this one is optimized to make things last as long as possible while taking as much as possible from you, including data. With real relationships, the toxic ones are usually just amateurs. Even a gifted amateur will probably struggle to get to what an AI "girlfriend" can do to you.
Re: (Score:3)
this one is optimized to make things last as long as possible while taking as much as possible from you.
Ok, AI has gone too far. Now it's even encroaching on the jobs of the gold diggers.
Re: (Score:2)
Hehehehehehehe.....
Re: (Score:2)
Re: (Score:3)
Men are have a biological imperative to listen to needs of women they view as potential mates and provide for those needs.
This is going to be for people starved for attention of a woman what gacha gaming became for those addicted to gambling, but way more powerful. It will print money once the correct amount of "push/pull" psychology in said girlfriend is worked out.
And if you think birth rates are low now... oh boy are we going to find out.
Re: (Score:2)
Single women are saying they don't want marriage: Does that mean not having children, not paying for an expensive ceremony, not living in a de-facto marriage (where the male bears the cost of "marriage" and pregnancy), or spending child-bearing years having 'friends with benefits' sex. (Pregnancy always has a cost to the male.)
Re: (Score:3, Insightful)
20 something women are saying that because they're having fun partying and racking up notches on their bed posts.
30s-40s women are crying because their clocks are ticking and they can't find a rich guy to take care of them.
Re:An AI what what? (Score:5, Informative)
And neckbeards of all ages are crying because sitting in yo momma's basement complaining about women online hasn't magically scored them sex.
Re: (Score:2)
Truth. Men need to be of sufficient caliber to be worth anyone's time. But that doesn't change the facts about the typical 20s 30s 40s women.
Re: (Score:2)
You seem like just the kind of chap to be up to speed on the typical woman of today.
Re: (Score:2)
Yup..they're hitting "The Wall".
And, no guy in their age range puts value on those women with high body counts racked up during their most attractive years (20's) for getting into relationships, marriage and children.
Why would a guy wanting all that look to 30-40yrs olds when he can readily get someone in their mid 20's or so.
Sadly, a lot of girls are racking up body counts starting in their Y
Re: (Score:2)
(Pregnancy always has a cost to the male.)
Often not, and even when it does it is nothing like the cost to the female.
Re: (Score:2)
Re: (Score:3)
'scuse me? Depressed, lonely people are easy prey for products that promise happiness.
Ever watched a booze commercial? They're all about happiness and partying and having a good time with some friends. You don't wonder why, do you?
Re: (Score:2)
I never understood why people taking a depressant to be happy. If you want to be happy there are drugs that will actually make you (artificially) happy.
Re: (Score:2)
Alcohol is a CNS depressant, it lowers neurotransmitter levels, it doesn't make you depressed.
Re: (Score:2)
https://www.mentalhealth.org.u... [mentalhealth.org.uk]
"How alcohol affects your brain
Alcohol is a depressant, which can disrupt the balance of neurotransmitters (chemical messengers) in your brain and affect your feelings, thoughts and behaviour.
Alcohol affects the part of your brain that controls inhibition, so you may feel relaxed, less anxious, and more confident after a drink. But these effects quickly wear off. The chemical changes in your brain can soon lead to more negative feelings, such as anger, depression or anxiety,
Re: (Score:2)
can... can... can...
All things which can but not necessarily do happen. For a lot of people, including myself, a drink or two makes them feel more relaxed and cheerful.
I don't get angry when I'm drunk. Never have.
Re: (Score:2)
A depressant doesn't make you depressive. All it does is numb.
And for most, that's already good enough.
Re: (Score:2)
Please see my reply to this over here (to avoid dupe conversation):
https://slashdot.org/comments.... [slashdot.org]
Re: (Score:2)
A depressant doesn't make you depressive. All it does is numb.
Heh nope. It's hilarious watching a bunch of nerds speculate what it's like being a person. Maybe all it does is numb you, but your experience is not universal.
Re: (Score:2)
Hmm...well, with my relationship with "booze"...that's exactly what I got and still get.
Good times, with friends, partying and well...pretty darned happy while doing it.
Re: An AI what what? (Score:2)
Re: (Score:2)
Re: (Score:2)
Not sure how exactly you can make money off of people who feel the need to use "AI girlfriend."
You aren't thinking creatively (or suspiciously) here. Personal information is worth hard cash - how much depends who (and how many) you are willing to sell it to, Consider the kind o personal information a bot posing as a "girlfriend" could collect. First it builds up the sucker, err client, creates a feeling of trust, then starts creating the urge to share more information to "impress" the "girlfriend" and get emotional rewards for doing so. To amp this up provide a hot semi-animated GenAI image, which ch
Re: (Score:2)
While in some cases you have to supply a working email address, this doesn't have to be your main one, or resemble it.
Sounds like there is more than your email address at stake here.
Prove it. (Score:2)
prove that it is your comment.
Re: (Score:2)
He sent me pictures so I know he's real! I need to send him more money; he said the oil rig is tipping over and he needs money right now to buy a life raft!
Re: (Score:2)
Isn't Mozilla just an extension of the Google product team? Would Mozilla exist at all without Google money?
Re: (Score:2)
Are you missing out on this ground floor opportunity? Get -your- AI girlfriend before someone else gets her!
Click here now!