{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T13:13:53Z","timestamp":1783430033024,"version":"3.54.6"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T00:00:00Z","timestamp":1720742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100017052","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972359, 62132014"],"award-info":[{"award-number":["61972359, 62132014"]}],"id":[{"id":"10.13039\/100017052","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Zhejiang Provincial Key Research and Development Program of China","award":["2022C01045"],"award-info":[{"award-number":["2022C01045"]}]},{"name":"Zhejiang Provincial Natural Science Foundation of China","award":["LQ23F020020"],"award-info":[{"award-number":["LQ23F020020"]}]},{"DOI":"10.13039\/100009377","name":"Education Department of Hunan Province","doi-asserted-by":"publisher","award":["21B0313"],"award-info":[{"award-number":["21B0313"]}],"id":[{"id":"10.13039\/100009377","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2024,7,12]]},"abstract":"<jats:p>\n                    As digital interfaces become increasingly prevalent, a series of ethical issues have surfaced, with dark patterns emerging as a key research focus. These manipulative design strategies are widely employed in User Interfaces (UI) with the primary aim of steering user behavior in favor of service providers, often at the expense of the users themselves. This paper aims to address three main challenges in the study of dark patterns: inconsistencies and incompleteness in classification, limitations of detection tools, and inadequacies in data comprehensiveness. In this paper, we introduce a comprehensive framework, called the Dark Pattern Analysis Framework (DPAF). Using this framework, we construct a comprehensive taxonomy of dark patterns, encompassing 64 types, each labeled with its impact on users and the likely scenarios in which it appears, validated through an industry survey. When assessing the capabilities of the detection tools and the completeness of the dataset, we find that of all dark patterns, the five detection tools can only identify 32, yielding a coverage rate of merely\n                    <jats:inline-formula>\n                      <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\">\n                        <mml:mn>50<\/mml:mn>\n                        <mml:mo>%<\/mml:mo>\n                      <\/mml:math>\n                    <\/jats:inline-formula>\n                    . Although the four existing datasets collectively contain 5,566 instances, they cover only 32 of all types of dark patterns, also resulting in a total coverage rate of\n                    <jats:inline-formula>\n                      <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\">\n                        <mml:mn>50<\/mml:mn>\n                        <mml:mo>%<\/mml:mo>\n                      <\/mml:math>\n                    <\/jats:inline-formula>\n                    . The results discussed above suggest that there is still significant room for advancement in the field of dark pattern detection. Through this research, we not only deepen our understanding of dark pattern classification and detection tools, but also offer valuable insights for future research and practice in this field.\n                  <\/jats:p>","DOI":"10.1145\/3643736","type":"journal-article","created":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T10:22:09Z","timestamp":1720779729000},"page":"204-225","source":"Crossref","is-referenced-by-count":24,"title":["Shadows in the Interface: A Comprehensive Study on Dark Patterns"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6058-1586","authenticated-orcid":false,"given":"Liming","family":"Nie","sequence":"first","affiliation":[{"name":"Shenzhen Technology University, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5824-9162","authenticated-orcid":false,"given":"Yangyang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Zhejiang Sci-Tech University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5615-5282","authenticated-orcid":false,"given":"Chenglin","family":"Li","sequence":"additional","affiliation":[{"name":"Zhejiang Sci-Tech University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3547-4586","authenticated-orcid":false,"given":"Xuqiong","family":"Luo","sequence":"additional","affiliation":[{"name":"Changsha University of Science and Technology, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7300-9215","authenticated-orcid":false,"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,7,12]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2017. Dataset:Rico. Retrieved Sept. 28 2023 from https:\/\/www.interactionmining.org\/"},{"key":"e_1_3_1_3_2","unstructured":"2019. Dataset:AGM. Retrieved Sept. 28 2023 from https:\/\/darkpatterns.cs.princeton.edu\/data\/"},{"key":"e_1_3_1_4_2","unstructured":"2019. Tool:AGM. Retrieved Sept. 28 2023 from https:\/\/github.com\/aruneshmathur\/dark-patterns"},{"key":"e_1_3_1_5_2","unstructured":"2020. Dataset:LLE. Retrieved Sept. 28 2023 from https:\/\/zenodo.org\/deposit\/3601501"},{"key":"e_1_3_1_6_2","unstructured":"2023. Dataset:ContextDP. Retrieved Sept. 28 2023 from https:\/\/github.com\/SageSELab\/AidUI\/"},{"key":"e_1_3_1_7_2","unstructured":"2023. Tool:AidUI. Retrieved Sept. 28 2023 from https:\/\/github.com\/SageSELab\/AidUI\/"},{"key":"e_1_3_1_8_2","unstructured":"2023. websit:darkpatternsok. Retrieved Sept. 28 2023 from https:\/\/sites.google.com\/view\/darkpattern"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","unstructured":"Jacob Aagaard Miria Emma Clausen Knudsen Per B\u00e6kgaard and Kevin Doherty. 2022. A Game of Dark Patterns: Designing Healthy Highly-Engaging Mobile Games. 438:1\u2013438:8 pages. https:\/\/doi.org\/10.1145\/3491101.3519837 10.1145\/3491101.3519837","DOI":"10.1145\/3491101.3519837"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1177\/147078539703900202"},{"key":"e_1_3_1_11_2","unstructured":"Competition Market Authorities. 2022. Evidence Review of Online Choice Architecture and Consumer and Competition Harm."},{"key":"e_1_3_1_12_2","unstructured":"European Data Protection Board. 2022. Guidelines 3\/2022 on Dark patterns in social media platform interfaces: How to recognise and avoid them. https:\/\/edpb.europa.eu\/system\/files\/2022-03\/edpb_03-2022_guidelines_on_dark_patterns_in_social_media_platform_interfaces_en.pdf Technical Report Version 1.0."},{"key":"e_1_3_1_13_2","unstructured":"Niall Bolger Gertraud Stadler and Jean-Philippe Laurenceau. 2012. Power analysis for intensive longitudinal studies. (2012)."},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2014.223"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2016-0038"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2016-0038"},{"key":"e_1_3_1_17_2","unstructured":"Harry Brignull. 2010. Twitter: Deceptive Design@darkpatterns. Twitter (2010)."},{"key":"e_1_3_1_18_2","unstructured":"Harry Brignull. 2010. Types of deceptive design. (2010).https:\/\/www.deceptive.design\/types"},{"key":"e_1_3_1_19_2","first-page":"2","article-title":"Dark Patterns: Deception vs. Honesty in UI Design","volume":"338","author":"Brignull Harry","year":"2011","unstructured":"Harry Brignull. 2011. Dark Patterns: Deception vs. Honesty in UI Design. Interaction Design, Usability 338 (2011), 2\u20134.","journal-title":"Interaction Design, Usability"},{"key":"e_1_3_1_20_2","unstructured":"Harry Brignull Marc Miquel Jeremy Rosenberg and James Offer. 2015. Dark patterns-user interfaces designed to trick people. In Proceedings of the Poster Presentation Australian Psychological Society Congress Sydney NSW Australia. 21\u201323."},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Jieshan Chen Jiamou Sun Sidong Feng Zhenchang Xing Qinghua Lu Xiwei Xu and Chunyang Chen. 2023. Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST). 1\u201320.","DOI":"10.1145\/3586183.3606783"},{"key":"e_1_3_1_22_2","unstructured":"Federal Trade Commission. 2022. Bringing Dark Patterns to Light Staff Report. https:\/\/www.ftc.gov\/system\/files\/ftc_gov\/pdf\/P214800%20Dark%20Patterns%20Report%209.14.2022%20-%20FINAL.pdf Technical Report Version."},{"key":"e_1_3_1_23_2","unstructured":"Andrea Curley Dympna O\u2019Sullivan Damian Gordon Brendan Tierney and Ioannis Stavrakakis. 2021. The design of a framework for the detection of web-based dark patterns. (2021)."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","unstructured":"Linda Di Geronimo Larissa Braz Enrico Fregnan Fabio Palomba and Alberto Bacchelli. 2020. UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User Perception. 14 pages. https:\/\/doi.org\/10.1145\/3313831.3376600 10.1145\/3313831.3376600","DOI":"10.1145\/3313831.3376600"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Linda Di Geronimo Larissa Braz Enrico Fregnan Fabio Palomba and Alberto Bacchelli. 2020. UI dark patterns and where to find them: a study on mobile applications and user perception. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1\u201314.","DOI":"10.1145\/3313831.3376600"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","unstructured":"Gregory M. Dickinson. 2023. Privately Policing Dark Patterns. https:\/\/doi.org\/10.2139\/ssrn.4389572 10.2139\/ssrn.4389572","DOI":"10.2139\/ssrn.4389572"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","unstructured":"Madison Fansher Shruthi Sai Chivukula and Colin M Gray. 2018. # Darkpatterns: UX practitioner conversations about ethical design. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u20136. https:\/\/doi.org\/10.1145\/3170427.3188553 10.1145\/3170427.3188553","DOI":"10.1145\/3170427.3188553"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","unstructured":"Liza Gak Seyi Olojo and Niloufar Salehi. 2022. The distressing ads that persist: Uncovering the harms of targeted weight-loss ads among users with histories of disordered eating. Proceedings of the ACM on Human-Computer Interaction 6 CSCW2 (2022) 1\u201323. https:\/\/doi.org\/10.1145\/3555102 10.1145\/3555102","DOI":"10.1145\/3555102"},{"key":"e_1_3_1_29_2","doi-asserted-by":"crossref","unstructured":"Leo A Goodman. 1961. Snowball sampling. The annals of mathematical statistics (1961) 148\u2013170.","DOI":"10.1214\/aoms\/1177705148"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","unstructured":"Colin M Gray Lorena S\u00e1nchez Chamorro Ike Obi and Ja-Nae Duane. 2023. Mapping the Landscape of Dark Patterns Scholarship: A Systematic Literature Review. 188\u2013193 pages. https:\/\/doi.org\/10.1145\/3563703.3596635 10.1145\/3563703.3596635","DOI":"10.1145\/3563703.3596635"},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Colin M Gray Shruthi Sai Chivukula and Ahreum Lee. 2020. What Kind of Work Do\" Asshole Designers\" Create? Describing Properties of Ethical Concern on Reddit. In Proceedings of the 2020 acm designing interactive systems conference. 61\u201373.","DOI":"10.1145\/3357236.3395486"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","unstructured":"Colin M Gray Yubo Kou Bryan Battles Joseph Hoggatt and Austin L Toombs. 2018. The dark (patterns) side of UX design. In Proceedings of the 2018 CHI conference on human factors in computing systems. https:\/\/doi.org\/10.1145\/3173574.3174108 10.1145\/3173574.3174108","DOI":"10.1145\/3173574.3174108"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","unstructured":"Colin M Gray Cristiana Santos and Nataliia Bielova. 2023. Towards a Preliminary Ontology of Dark Patterns Knowledge. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1\u20139. https:\/\/doi.org\/10.1145\/3544549.3585676 10.1145\/3544549.3585676","DOI":"10.1145\/3544549.3585676"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","unstructured":"Colin M Gray Cristiana Santos Nataliia Bielova Michael Toth and Damian Clifford. 2021. Dark patterns and the legal requirements of consent banners: An interaction criticism perspective. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1\u201318. https:\/\/doi.org\/10.1145\/3411764.3445779 10.1145\/3411764.3445779","DOI":"10.1145\/3411764.3445779"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","unstructured":"Colin M. Gray Cristiana Teixeira Santos Nicole Tong Thomas Mildner Arianna Rossi Johanna T. Gunawan and Caroline Sinders. 2023. Dark Patterns and the Emerging Threats of Deceptive Design Practices. (2023) 510:1\u2013510:4. https:\/\/doi.org\/10.1145\/3544549.3583173 10.1145\/3544549.3583173","DOI":"10.1145\/3544549.3583173"},{"key":"e_1_3_1_36_2","first-page":"377","article-title":"A Comparative Study of Dark Patterns Across Web and Mobile Modalities","volume":"5","author":"Gunawan Johanna","year":"2021","unstructured":"Johanna Gunawan, Amogh Pradeep, David Choffnes, Woodrow Hartzog, and Christo Wilson. 2021. A Comparative Study of Dark Patterns Across Web and Mobile Modalities. Proc. ACM Hum.-Comput. Interact. 5, Article 377 (oct 2021), 29 pages.","journal-title":"Proc. ACM Hum.-Comput. Interact"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","unstructured":"Hana Habib Sarah Pearman Ellie Young Ishika Saxena Robert Zhang and Lorrie FaIth Cranor. 2022. Identifying user needs for advertising controls on Facebook. Proceedings of the ACM on Human-Computer Interaction 6 CSCW1 (2022) 1\u201342. https:\/\/doi.org\/10.1145\/3512906 10.1145\/3512906","DOI":"10.1145\/3512906"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","unstructured":"Shun Hidaka Sota Kobuki Mizuki Watanabe and Katie Seaborn. 2023. Linguistic Dead-Ends and Alphabet Soup: Finding Dark Patterns in Japanese Apps. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1\u201313. https:\/\/doi.org\/10.1145\/3544548.3580942 10.1145\/3544548.3580942","DOI":"10.1145\/3544548.3580942"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","unstructured":"Daniel Kirkman Kami Vaniea and Daniel W. Woods. 2023. DarkDialogs: Automated detection of 10 dark patterns on cookie dialogs. 847\u2013867 pages. https:\/\/doi.org\/10.1109\/EuroSP57164.2023.00055 10.1109\/EuroSP57164.2023.00055","DOI":"10.1109\/EuroSP57164.2023.00055"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.09.009"},{"key":"e_1_3_1_41_2","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/978-3-031-28643-8_9","article-title":"The Hows and Whys of Dark Patterns: Categorizations and Privacy","author":"Kitkowska Agnieszka","year":"2023","unstructured":"Agnieszka Kitkowska. 2023. The Hows and Whys of Dark Patterns: Categorizations and Privacy. Human Factors in Privacy Research (2023), 173\u2013198.","journal-title":"Human Factors in Privacy Research"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-022-00783-7"},{"key":"e_1_3_1_43_2","unstructured":"Tim Kollmer and Andreas Eckhardt. 2023. Insights on Attention Capture Dark Patterns in Social Networking Sites. BT - 29th Americas Conference on Information Systems AMCIS 2023 Panama City Panama August 10-12 2023. https:\/\/aisel.aisnet.org\/amcis2023\/social_comput\/social_comput\/14"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","unstructured":"Monica Kowalczyk Johanna T Gunawan David Choffnes Daniel J Dubois Woodrow Hartzog and Christo Wilson. 2023. Understanding Dark Patterns in Home IoT Devices. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1\u201327. https:\/\/doi.org\/10.1145\/3544548.3581432 10.1145\/3544548.3581432","DOI":"10.1145\/3544548.3581432"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2019.8673274"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP46215.2023.10179304"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1093\/jla\/laaa006"},{"key":"e_1_3_1_48_2","volume-title":"Behavioural study on unfair commercial practices in the digital environment: dark patterns and manipulative personalisation","author":"Lupi\u00e1\u00f1ez-Villanueva Francisco","year":"2022","unstructured":"Francisco Lupi\u00e1\u00f1ez-Villanueva, Alba Boluda, Francesco Bogliacino, Giovanni Liva, Lucie Lechardoy, and Teresa Rodr\u00edguez de las Heras Ballell. 2022. Behavioural study on unfair commercial practices in the digital environment: dark patterns and manipulative personalisation. Publications Office of the European Union."},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00166"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion58688.2023.00079"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359183"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580695"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.3390\/math10183219"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","unstructured":"Trung Tin Nguyen Michael Backes and Ben Stock. 2022. Freely given consent? Studying consent notice of third-party tracking and its violations of GDPR in android apps. In Proceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security. 2369\u20132383. https:\/\/doi.org\/10.1145\/3548606.3560564 10.1145\/3548606.3560564","DOI":"10.1145\/3548606.3560564"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1049\/sfw2.12123"},{"key":"e_1_3_1_56_2","unstructured":"OECD. 2022. Dark commercial patterns."},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1002\/acp.1178"},{"key":"e_1_3_1_58_2","doi-asserted-by":"crossref","unstructured":"Lorenzo Porcelli Massimo Ficco and Francesco Palmieri. 2023. Mitigating User Exposure to Dark Patterns in Cookie Banners Through Automated Consent. 145\u2013159 pages.","DOI":"10.1007\/978-3-031-37108-0_10"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-5157-1_72"},{"key":"e_1_3_1_60_2","first-page":"1","article-title":"Understanding account deletion and relevant dark patterns on social media","author":"Schaffner Brennan","year":"2022","unstructured":"Brennan Schaffner, Neha A Lingareddy, and Marshini Chetty. 2022. Understanding account deletion and relevant dark patterns on social media. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1\u201343.","journal-title":"Proceedings of the ACM on Human-Computer Interaction 6, CSCW2"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2204.11836"},{"key":"e_1_3_1_62_2","unstructured":"Jos\u00e9 P Zagal Staffan Bj\u00f6rk and Chris Lewis. 2013. Dark patterns in the design of games. In Foundations of Digital Games 2013."}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643736","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3643736","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T07:52:31Z","timestamp":1770191551000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643736"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,12]]},"references-count":61,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2024,7,12]]}},"alternative-id":["10.1145\/3643736"],"URL":"https:\/\/doi.org\/10.1145\/3643736","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,12]]}}}