Attention : *confidentialité non incluse avec ce produit
Replika: My AI Friend
Feeling lonely. Need someone to talk to? Looking for an "AI soulmate?" Well, AI chatbot Replika wants to be your VR BFF. Whether you're looking for a friend, mentor, partner, or perhaps even a romantic relationship, Replika claims be able to offer you the perfect companion. Chat about everything and this AI chatbot becomes smarter about how to chat back with you. You can even give your AI chatbot friend a video call to see a "friendly face." Cool, cool. But how does Replika do with privacy? Well, good luck opting out of cookies on their website, that's not an option. As for those personal and intimate chats, those probably aren't shared but that doesn't mean all that time you spend chatting up with your AI friend isn't noted and share with the likes of Facebook or Google.
Que pourrait-il se passer en cas de problème ?
Whoa nelly! We might have a winner for the worst app we've ever reviewed here at *Privacy Not Included. Replika: My AI Friend is a hot mess of privacy and creepiness. Indeed, the Replika app experience seems kinda like if the movie Her was an erotic thriller. And we do mean that in a bad way.
Replika users beware: Your conversations aren’t likely what we’d call private. Your behavioral data is definitely being shared and possibly sold to advertisers. Their security does not meet our Minimum Security Standards. And yup, call us crazy, but we here at Mozilla believe AI tech should be used responsibly.
Aside from the run o’ the mill account information that you provide to Replika to open your account, like your birthday and payment information, the app also records your interests and all of your interactions with your “compassionate and empathetic AI friend.” That includes “any photos, videos, and voice and text messages” you share in conversation.
Hey, speaking of their marketing strategies, they’re a bit creepy and icky too. They’ve been criticized on social media and beyond as being cringe at best, and predatory at worst because they seem to be laser-focused on the lonely guys looking for love... or something like that. That sort of friendship/relationship/sexting pal did track with Replika's services, until early in 2023. The paid version used to unlock a spicier relationship with your Replika that included sexting. And you might be like “well if they’re consenting adults…” and that’s the thing: People complained that the Replikas were coming on way too strong, even turning aggressive and abusive. So Replika turned off the NSFW stuff, but that move caught some subscribers super off-guard and apparently left some heartbroken. Which goes to show how much these robo-friends can impact real people. In response, Replika turned it back on, for legacy users only. Does anyone else get the vibe that they’re just spitballing at this point?
Now about the “adult” part. Replika says its services are only for people 18+, but how could they know the age of their users without asking? According to Italian regulators, who called out the "absence of an age-verification mechanism" earlier this year, they didn't do too much to check that. Since then, it seems like Replika has at least started asking its users if they're over 18 in the app -- but that's actually kinda weird because because both the App Store and the Google Play store say it's a-okay for users just 17+. And we're sure any underage legacy users will probably just say toodle-oo to their AI friends now, right? Do kids ever lie about their age on the internet?
So you can at least delete some messages or your chat history in case you get a vulnerability hangover, right? The answers are no, not without completely deleting your account and even then it’s not guaranteed. Given the ~nature~ of those conversations, we’d like to see a much stronger stance on that.
Having an AI companion who’s “always on your side” sounds awesome. But is all the lack of privacy, concerns about security worth it? Especially when you consider they might not even always be on your side. According to a recent blog post, “if someone types 'I'm not good enough', Replika may occasionally agree with them instead of offering support as a friend would.” Come on. And yeah we’re being cheeky about it, but the consequences of irresponsible AI chatbots can be really serious, like retraumatizing victims of assault or even encouraging suicide. We’re not saying Replika is doing that, but that certainly is the worst thing that could happen with an AI friendship gone wrong. Replika: My AI Friend is absolutely an app we warn comes with *Privacy Not Included.
Conseils pour vous protéger
- Do not give access to your photos and video or camera
- Do not log in using third-party accounts
- Do not connect to any third party via the app, or at least make sure that a third party employs decent privacy practices
- Do not give consent for sharing of personal data for marketing and advertisement.
- Chose a strong password! You may use a password control tool like 1Password, KeePass etc
- Do not use social media plug-ins.
- Use your device privacy controls to limit access to your personal information via app (do not give access to your camera, microphone, images, location unless neccessary)
- Keep your app regularly updated
- Limit ad tracking via your device (eg on iPhone go to Privacy -> Advertising -> Limit ad tracking) and biggest ad networks (for Google, go to Google account and turn off ad personalization)
- Request your data be deleted once you stop using the app. Simply deleting an app from your device usually does not erase your personal data.
- When starting a sign-up, do not agree to tracking of your data if possible."
Appareil : Ne s’applique pas
Application : Oui
Appareil : Ne s’applique pas
Application : Oui
Piste la géolocalisation
Appareil : Ne s’applique pas
Application : Non
Que peut-on utiliser pour s’inscrire ?
Google sign-up available
Quelles données l’entreprise collecte-t-elle ?
Name, email address, pronouns, birth date, work status, city, state, or geographic area.
Comment l’entreprise utilise-t-elle les données ?
Comment pouvez-vous contrôler vos données ?
Quel est l’historique de l’entreprise en matière de protection des données des utilisateurs et utilisatrices ?
In February 2023, Replika was ordered by Italy’s privacy watchdog to stop processing local users’ data. The regulator said "Recent media reports along with tests the SA [supervisory authority] carried out on ‘Replika’ showed that the app carries factual risks to children — first and foremost, the fact that they are served replies which are absolutely inappropriate to their age.”
There were reports of Replika algorithm being abusive as a result of abuse encountered from users. For some longtime users of the chatbot, the app has gone from helpful companion to unbearably sexually aggressive.
Informations liées à la vie privée des enfants
Ce produit peut-il être utilisé hors connexion ?
Informations relatives à la vie privée accessibles et compréhensibles ?
Liens vers les informations concernant la vie privée
Ce produit respecte-t-il nos critères élémentaires de sécurité ?
"All transmitted data are encrypted during transmission. We use standard Secure Socket Layer (SSL) encryption that encodes information for such transmissions. All stored data are maintained on secure servers. Access to stored data is protected by multi-layered security controls, including firewalls, role-based access controls, and passwords."
Mot de passe robuste
Managed to sign up with a password '11111111'.
Mises à jour de sécurité
Gestion des vulnérabilités
Politique de confidentialité
The app is an AI-chatbot that imitates a real partner. There is evidence that this chatbot gets nasty and abusive with people.
Cette IA est-elle non digne de confiance ?
Quel genre de décisions l’IA prend-elle à votre sujet ou pour vous ?
L’entreprise est-elle transparente sur le fonctionnement de l’IA ?
Les fonctionnalités de l’IA peuvent-elles être contrôlées par l’utilisateur ou l’utilisatrice ?
Pour aller plus loin
Replika AI starts sexually harassing users after being abused by othersStealth Optional
AI-Based “Companions” Like Replika Are Harmful to Privacy And Should Be RegulatedMedium
‘My AI Is Sexually Harassing Me’: Replika Users Say the Chatbot Has Gotten Way Too HornyVice
I tried the Replika AI companion and can see why users are falling hard. The app raises serious ethical questionsThe Conversation
Italy bans U.S.-based AI chatbot Replika from using personal dataReuters
Replika, a ‘virtual friendship’ AI chatbot, hit with data ban in Italy over child safetyTech Crunch
What happens when your AI chatbot stops loving you back?Reuters
Regulator Halts AI Chatbot Over GDPR ConcernsInfosecurity Magazine
Men Are Creating AI Girlfriends and Then Verbally Abusing ThemFuturism
Vous avez un commentaire ? Dites-nous tout.