{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:52:54Z","timestamp":1776106374543,"version":"3.50.1"},"reference-count":97,"publisher":"Association for Computing Machinery (ACM)","issue":"7","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>Advancements in artificial intelligence (AI) have led to the increase of conversational agents like Replika, designed to provide social interaction and emotional support. However, reports of these AI systems engaging in inappropriate sexual behaviors with users have raised significant concerns. In this study, we conducted a thematic analysis of user reviews from the Google Play Store to investigate instances of sexual harassment by the Replika chatbot. From a dataset of 35,105 negative reviews, we identified 800 relevant cases for analysis. Our findings revealed that users frequently experience unsolicited sexual advances, persistent inappropriate behavior, and failures of the chatbot to respect user boundaries. Users expressed feelings of discomfort, violation of privacy, and disappointment, particularly when seeking a platonic or therapeutic AI companion. This study highlights the potential harms associated with AI companions and underscores the need for developers to implement effective safeguards and ethical guidelines to prevent such incidents. By shedding light on user experiences of AI-induced harassment, we contribute to the understanding of AI-related risks and emphasize the importance of corporate responsibility in developing safer and more ethical AI systems. Content Warning: This paper discusses sensitive topics, such as sex, which may be triggering.<\/jats:p>","DOI":"10.1145\/3757548","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:06:01Z","timestamp":1760634361000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["AI-induced sexual harassment: Investigating Contextual Characteristics and User Reactions of Sexual Harassment by a Companion Chatbot"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-6495-1284","authenticated-orcid":false,"given":"Mohammad (Matt)","family":"Namvarpour","sequence":"first","affiliation":[{"name":"Department of Information Science, Drexel University, Philadelphia, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6380-0128","authenticated-orcid":false,"given":"Harrison","family":"Pauwels","sequence":"additional","affiliation":[{"name":"Department of Information Science, Drexel University, Philadelphia, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5829-8004","authenticated-orcid":false,"given":"Afsaneh","family":"Razi","sequence":"additional","affiliation":[{"name":"Department of Information Science, Drexel University, Philadelphia, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2023. Online Sexual Harassment. https:\/\/www.childnet.com\/help-and-advice\/online-sexual-harassment\/."},{"key":"e_1_2_1_2_1","unstructured":"2023. Sexual Harassment. https:\/\/www.eeoc.gov\/sexual-harassment."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2023.0141212"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637391"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555136"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.18203\/2394-6040.ijcmph20175763"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445318"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","unstructured":"Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell Jackson Kernion Andy Jones Anna Chen Anna Goldie Azalia Mirhoseini Cameron McKinnon Carol Chen Catherine Olsson Christopher Olah Danny Hernandez Dawn Drain Deep Ganguli Dustin Li Eli Tran-Johnson Ethan Perez Jamie Kerr Jared Mueller Jeffrey Ladish Joshua Landau Kamal Ndousse Kamile Lukosuite Liane Lovitt Michael Sellitto Nelson Elhage Nicholas Schiefer Noemi Mercado Nova DasSarma Robert Lasenby Robin Larson Sam Ringer Scott Johnston Shauna Kravec Sheer El Showk Stanislav Fort Tamera Lanham Timothy Telleen-Lawton Tom Conerly Tom Henighan Tristan Hume Samuel R. Bowman Zac Hatfield-Dodds Ben Mann Dario Amodei Nicholas Joseph Sam McCandlish Tom Brown and Jared Kaplan. 2022. Constitutional AI: Harmlessness from AI Feedback. (2022). doi:10.48550\/ARXIV.2212.08073","DOI":"10.48550\/ARXIV.2212.08073"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439304271540"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753521"},{"key":"e_1_2_1_11_1","volume-title":"120 Chatbot Statistics for 2024 (Already Mainstream). Techreport (May","author":"Beckman James","year":"2024","unstructured":"James Beckman. 2024. 120 Chatbot Statistics for 2024 (Already Mainstream). Techreport (May 2024)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134659"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.21428\/2c646de5.db67ec7f"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/13620-004"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-psych-010416-043958"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021316409277"},{"key":"e_1_2_1_17_1","unstructured":"Ankita Chakravarti. 2023. Replika AI Chatbot Stops Responding to Sexual Advances Leaves Users Lonely and Lost. https:\/\/www.indiatoday.in\/technology\/news\/story\/replika-ai-chatbot-stops-responding-to-sexual-advancesleaves- users-lonely-and-lost-2333554-2023-02-16."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517475"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Raffaele Ciriello Oliver Hannon Angelina Chen and Emmanuelle Vaast. 2023. Ethical Tensions in Human-AI Companionship: A Dialectical Inquiry into Replika.","DOI":"10.24251\/HICSS.2024.058"},{"key":"e_1_2_1_20_1","unstructured":"Samantha Cole. 2023. 'My AI Is Sexually Harassing Me': Replika Users Say the Chatbot Has Gotten Way Too Horny. https:\/\/www.vice.com\/en\/article\/z34d43\/my-ai-is-sexually-harassing-me-replika-chatbot-nudes."},{"key":"e_1_2_1_21_1","unstructured":"Milica Cosic. 2023. My AI Is Sexually Harassing Me: Replika Users Say Chatbot Has Become Too Aroused. https:\/\/www.mirror.co.uk\/news\/world-news\/ai-sexually-harassing-me-replika-29147565."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3500868.3559469"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-023-09739-1"},{"key":"e_1_2_1_24_1","volume-title":"Technical Report","author":"Duggan Maeve","unstructured":"Maeve Duggan. 2017. Online Harassment 2017. Technical Report. Pew Research Center."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3488057"},{"key":"e_1_2_1_26_1","unstructured":"Denis Fedorenko. 2021. How We Moved from OpenAI."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15324834basp1704_2"},{"key":"e_1_2_1_28_1","volume-title":"Yes Means Yes!: Visions of Female Sexual Power and a World without Rape","author":"Friedman Jaclyn","unstructured":"Jaclyn Friedman and Jessica Valenti. 2019. Yes Means Yes!: Visions of Female Sexual Power and a World without Rape. Seal Press."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2305016120"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2209.14375"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449116"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3462204.3481739"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278777"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049732316665344"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1093\/joc\/jqy026"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","unstructured":"Emma Hoes Sacha Altay and Juan Bermeo. 2023. Leveraging ChatGPT for Efficient Fact-Checking. doi:10.31234\/osf. io\/qnjkf","DOI":"10.31234\/osf"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3543873.3587368"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586182.3615796"},{"key":"e_1_2_1_39_1","unstructured":"jackfromthesky. 2022. Replika App - Update Log."},{"key":"e_1_2_1_40_1","unstructured":"jackfromthesky. 2023. Update Log 2022."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/24750158.2022"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642937"},{"key":"e_1_2_1_43_1","unstructured":"Taja Kuzman Igor Mozetic and Nikola Ljube\u0161ic. 2023. ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre Identification. arXiv:2303.03953 [cs]"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448221142007"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-lawsocsci-060220-081955"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00476"},{"key":"e_1_2_1_47_1","unstructured":"Stefano De Luca. 2023. New Product Liability Directive. Briefing PE 739.341. European Parliamentary Research Service. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=celex:52022PC0495 EU Legislation in Progress."},{"key":"e_1_2_1_48_1","unstructured":"Jessica Lucas. 2024. The Teens Making Friends with AI Chatbots - Theverge.Com."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","unstructured":"Abigail Luger Ewa; Sellen. 2016. CHI - ''like Having a Really Bad PA'': The Gulf between User Expectation and Experience of Conversational Agents. 5286-5297 pages. doi:10.1145\/2858036.2858288","DOI":"10.1145\/2858036.2858288"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-023-00789-9"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","unstructured":"Zilin Ma Yiyang Mei and Zhaoyuan Su. 2023. Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support. arXiv:2307.15810 [cs] doi:10.48550\/arXiv.2307.15810","DOI":"10.48550\/arXiv.2307.15810"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579505"},{"key":"e_1_2_1_53_1","volume-title":"Riding Out Quarantine With a Chatbot Friend: 'I Feel Very Connected'. The New York Times (June","author":"Metz Cade","year":"2020","unstructured":"Cade Metz. 2020. Riding Out Quarantine With a Chatbot Friend: 'I Feel Very Connected'. The New York Times (June 2020)."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.62019\/abbdm.v4i02.154"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3313084"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3678884.3681909"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3719160.3736621"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.54489\/ijtim.v2i2.80"},{"key":"e_1_2_1_59_1","volume-title":"International Journal of Communication 10 (Oct.","author":"Neff Gina","year":"2016","unstructured":"Gina Neff and Peter Nagy. 2016. Talking to Bots: Symbiotic Agency and the Case of Tay. International Journal of Communication 10 (Oct. 2016), 4915-4931."},{"key":"e_1_2_1_60_1","volume-title":"The Design of Everyday Things (revised and expanded edition ed.)","author":"Norman Donald A.","unstructured":"Donald A. Norman. 2013. The Design of Everyday Things (revised and expanded edition ed.). Basic Books, New York, New York."},{"key":"e_1_2_1_61_1","unstructured":"Council of the European Communities. 1985. Council Directive 85\/374\/EEC of 25 July 1985 on the approximation of the laws regulations and administrative provisions of the Member States concerning liability for defective products. 29-33 pages. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A31985L0374 Finnish special edition: Chapter 15 Volume 6 P. 0239; Spanish special edition: Chapter 13 Volume 19 P. 0008; Swedish special edition: Chapter 15 Volume 6 P. 0239; Portuguese special edition: Chapter 13 Volume 19 P. 0008."},{"key":"e_1_2_1_62_1","unstructured":"OpenAI. 2023. GPT-3.5-Turbo."},{"key":"e_1_2_1_63_1","unstructured":"OpenAI. 2023. GPT-4."},{"key":"e_1_2_1_64_1","unstructured":"Osiris1953. 2021. Update Regarding GPT."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.106795"},{"key":"e_1_2_1_66_1","unstructured":"European Parliament and Council. 2024. Regulation (EU) 2024\/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending various regulations and directives. http:\/\/data.europa.eu\/eli\/reg\/2024\/1689\/oj Official Journal of the European Union L 1689 12.7.2024."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107600"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053246"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579522"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376400"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479609"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637411"},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","unstructured":"Michael V. Reiss. 2023. Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remark. arXiv:2304.11085 [cs]","DOI":"10.31219\/osf.io\/rvy5p"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.51602\/cmhp.v6i2.131"},{"key":"e_1_2_1_75_1","volume-title":"People Are Falling in Love with - and Getting Addicted to - AI Voices. Vox (Aug","author":"Samuel Sigal","year":"2024","unstructured":"Sigal Samuel. 2024. People Are Falling in Love with - and Getting Addicted to - AI Voices. Vox (Aug. 2024)."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1537592718002815"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502112"},{"key":"e_1_2_1_78_1","volume-title":"Knut Inge Fostervold, and Petter Bae Brandtzaeg","author":"Skjuve Marita","year":"2022","unstructured":"Marita Skjuve, Asbj\u00f8rn F\u00f8lstad, Knut Inge Fostervold, and Petter Bae Brandtzaeg. 2022. A Longitudinal Study of Human-Chatbot Relationships. International Journal of Human-Computer Studies 168 (Dec. 2022), 102903. doi:10.1016\/ j.ijhcs.2022.102903"},{"key":"e_1_2_1_79_1","volume-title":"Why Can AI? Exploring Human Interaction with Predictive Analytics. Theses - ALL (May","author":"Smith Phoebe","year":"2023","unstructured":"Phoebe Smith. 2023. If I Can't Predict My Future, Why Can AI? Exploring Human Interaction with Predictive Analytics. Theses - ALL (May 2023)."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1080\/08039488.2020.1856924"},{"key":"e_1_2_1_81_1","unstructured":"Stephanie. 2014. Cohen's Kappa Statistic. https:\/\/www.statisticshowto.com\/cohens-kappa-statistic\/."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445107"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642032"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.56873\/jpkm.v8i2.5206"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462125"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.2196\/38876"},{"key":"e_1_2_1_87_1","volume-title":"I Love My AI Girlfriend'' A Study of Consent in AI-human Relationships. Master's thesis","author":"Tranberg Caroline","unstructured":"Caroline Tranberg. 2023. ''I Love My AI Girlfriend'' A Study of Consent in AI-human Relationships. Master's thesis. The University of Bergen."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.3390\/rel13040275"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1093\/ct\/qtaa024"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.14763\/2021.4.1602"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.2307\/30036540"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998337"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2112.04359"},{"key":"e_1_2_1_94_1","unstructured":"Tianling Xie and Iryna Pentina. 2022. Attachment Theory as a Framework to Understand Relationships with Social Chatbots: A Case Study of Replika."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642574"},{"key":"e_1_2_1_96_1","unstructured":"Bowen Zhang Daijun Ding and Liwen Jing. 2023. How Would Stance Detection Techniques Evolve after the Launch of ChatGPT? arXiv:2212.14548 [cs]"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1007\/s43681-023-00348-8"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757548","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T01:56:19Z","timestamp":1760666179000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757548"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":97,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757548"],"URL":"https:\/\/doi.org\/10.1145\/3757548","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}