{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T04:12:15Z","timestamp":1790741535876,"version":"4.1.0"},"reference-count":94,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Oxford Martin School: The Ethical Web and Data Architecture in the Age of AI"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Mobile apps used by children often make use of harmful techniques, such as data tracking and targeted advertising. Previous research has suggested that developers face several systemic challenges in designing apps that prioritise children's best interests. To understand how developers can be better supported, we used a Research through Design (RtD) method to explore what the future of privacy-friendly app development could look like. We performed an elicitation study with 20 children's app developers to understand their needs and requirements. We found a number of specific technical requirements from the participants about how they would like to be supported, such as having actionable transnational design guidelines and easy-to-use development libraries. However, participants were reluctant to adopt these design ideas in their development practices due to perceived financial risks associated with increased privacy in apps. To overcome this critical gap, participants formulated socio-technical requirements that extend to other stakeholders in the mobile industry, including parents and marketplaces. Our findings provide important immediate and long-term design opportunities for the HCI community, and indicate that support for changing app developers' practices must be designed in the context of their relationship with other stakeholders.<\/jats:p>","DOI":"10.1145\/3610066","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T15:54:10Z","timestamp":1696434850000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["How Can We Design Privacy-Friendly Apps for Children? Using a Research through Design Process to Understand Developers' Needs and Challenges"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1795-0400","authenticated-orcid":false,"given":"Anirudh","family":"Ekambaranathan","sequence":"first","affiliation":[{"name":"University of Oxford, Oxford, Oxfordshire, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6935-9028","authenticated-orcid":false,"given":"Jun","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Oxford, Oxford, Oxfordshire, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3873-6366","authenticated-orcid":false,"given":"Max","family":"Van Kleek","sequence":"additional","affiliation":[{"name":"University of Oxford, Oxford, Oxfordshire, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"[n. d.]. https:\/\/play.google.com\/about\/play-pass\/"},{"key":"e_1_2_2_2_1","unstructured":"[n. d.]. https:\/\/www.fairtrade.net\/"},{"key":"e_1_2_2_3_1","unstructured":"[n. d.]. https:\/\/www.bcorporation.net\/"},{"key":"e_1_2_2_4_1","unstructured":"[n. d.]. https:\/\/developer.apple.com\/app-store\/review\/guidelines\/"},{"key":"e_1_2_2_5_1","unstructured":"[n. d.]. https:\/\/www.apple.com\/privacy\/labels\/"},{"key":"e_1_2_2_6_1","unstructured":"[n. d.]. Apple Arcade. https:\/\/www.apple.com\/apple-arcade\/"},{"key":"e_1_2_2_7_1","unstructured":"[n. d.]. Certification schemes. https:\/\/ico.org.uk\/for-organisations\/guide-to-data-protection\/guide-to-the-general-data-protection-regulation-gdpr\/certification-schemes-detailed-guidance\/"},{"key":"e_1_2_2_8_1","unstructured":"[n. d.]. Create data privacy moments maps. https:\/\/ico.org.uk\/for-organisations\/childrens-code-design-guidance\/create-data-privacy-moments-maps\/"},{"key":"e_1_2_2_9_1","unstructured":"2020. Age appropriate design: a code of practice for online services. https:\/\/ico.org.uk\/media\/for-organisations\/guide-to-data-protection\/key-data-protection-themes\/age-appropriate-design-a-code-of-practice-for-online-services-2--1.pdf"},{"key":"e_1_2_2_10_1","unstructured":"2022. https:\/\/standards.ieee.org\/"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Amelia Acker and Leanne Bowler. 2018. Youth data literacy: teen perspectives on data created with social media and mobile devices. (2018).","DOI":"10.24251\/HICSS.2018.243"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3054926"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1257\/jel.54.2.442"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702210"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300519"},{"key":"e_1_2_2_16_1","unstructured":"California State Assembly. 2022. California Age appropriate design. https:\/\/californiaaadc.com"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-020-09501-6"},{"key":"e_1_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Rebecca Balebako Abigail Marsh Jialiu Lin Jason I Hong and Lorrie Cranor. 2014. The privacy and security behaviors of smartphone app developers. (2014).","DOI":"10.14722\/usec.2014.23006"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/0163443716679033"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1080\/01972243.2019.1583296"},{"key":"e_1_2_2_21_1","unstructured":"Tim Berners-Lee. 2021. Protecting People From States. https:\/\/securingourdigitalfuture.com\/2021\/09\/19\/protecting-people-from-states\/"},{"key":"e_1_2_2_22_1","volume-title":"Growing up with the internet: 2nd Report of Session 2016--17. (2017)","author":"Best Richard Stuart","unstructured":"Richard Stuart Best. 2017. Growing up with the internet: 2nd Report of Session 2016--17. (2017)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3201064.3201089"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173807"},{"key":"e_1_2_2_25_1","volume-title":"Longitudinal analysis of android ad library permissions. arXiv preprint arXiv:1303.0857","author":"Book Theodore","year":"2013","unstructured":"Theodore Book, Adam Pridgen, and Dan S Wallach. 2013. Longitudinal analysis of android ad library permissions. arXiv preprint arXiv:1303.0857 (2013)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/pra2.2017.14505401004"},{"key":"e_1_2_2_27_1","volume-title":"Using thematic analysis in psychology. Qualitative research in psychology 3, 2","author":"Braun Virginia","year":"2006","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101."},{"key":"e_1_2_2_28_1","volume-title":"Children and parents: Media use and attitudes report","author":"Britain Great","year":"2022","unstructured":"Great Britain. 2022. Children and parents: Media use and attitudes report 2022. Ofcom."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.05.017"},{"key":"e_1_2_2_30_1","unstructured":"Interactive Advertising Bureau. 2015. IAB Internet Advertising Revenue Report: 2015 Full Year Results."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445359"},{"key":"e_1_2_2_32_1","unstructured":"Sean Coughlan. 2018. ?Sharenting'puts young at risk of online fraud. BBC News 21 (2018)."},{"key":"e_1_2_2_33_1","volume-title":"Anind K Dey, and John Zimmerman.","author":"Davidoff Scott","year":"2007","unstructured":"Scott Davidoff, Min Kyung Lee, Anind K Dey, and John Zimmerman. 2007. Rapidly exploring application design through speed dating. In Int'l Conf. on ubiquitous computing. Springer, 429--446."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376342"},{"key":"e_1_2_2_35_1","unstructured":"V Dignum M Penagos K Pigmans and S Vosloo. 2020. Policy guidance on AI for children."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3383064"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445599"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2593968.2593984"},{"key":"e_1_2_2_39_1","unstructured":"ENISA. 2018. Privacy and data protection in mobile applications: A study on the app development ecosystem and the technical implementation of GDPR."},{"key":"e_1_2_2_40_1","volume-title":"Proc. of the 2005 Conf. on Designing for User eXperience. 31--es.","author":"Forlizzi Jodi","year":"2005","unstructured":"Jodi Forlizzi, Carl DiSalvo, John Zimmerman, Bilge Mutlu, and Amy Hurst. 2005. The SenseChair: The lounge chair as an intelligent assistive device for elders. In Proc. of the 2005 Conf. on Designing for User eXperience. 31--es."},{"key":"e_1_2_2_41_1","volume-title":"Research in art and design","author":"Frayling Christopher","year":"1993","unstructured":"Christopher Frayling. 1993. Research in art and design. Royal College of Art research papers 1 (1993), 1--5."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979169"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185448.2185464"},{"key":"e_1_2_2_44_1","unstructured":"ICO. 2021. Age appropriate design: a code of practice for online services. https:\/\/ico.org.uk\/for-organisations\/guide-to-data-protection\/ico-codes-of-practice\/age-appropriate-design-a-code-of-practice-for-online-services\/"},{"key":"e_1_2_2_45_1","volume-title":"Muhammad Ali Babar, and Awais Rashid","author":"Iwaya Leonardo Horn","year":"2022","unstructured":"Leonardo Horn Iwaya, Muhammad Ali Babar, and Awais Rashid. 2022. Privacy Engineering in the Wild: Understanding the Practitioners' Mindset, Organisational Culture, and Current Practices. arXiv preprint arXiv:2211.08916 (2022)."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1572532.1572538"},{"key":"e_1_2_2_47_1","volume-title":"Developers Raise Alarm Over Their Cut of Google Play Pass' Subscription Money. IGN (Sep","author":"Kim Matt","year":"2019","unstructured":"Matt Kim. 2019. Developers Raise Alarm Over Their Cut of Google Play Pass' Subscription Money. IGN (Sep 2019). https:\/\/www.ign.com\/articles\/2019\/09\/24\/developers-raise-alarm-over-their-cut-of-google-play-pass-subscription-money"},{"key":"e_1_2_2_48_1","volume-title":"Sprint: How to solve big problems and test new ideas in just five days","author":"Knapp Jake","year":"2016","unstructured":"Jake Knapp, John Zeratsky, and Braden Kowitz. 2016. Sprint: How to solve big problems and test new ideas in just five days. Simon and Schuster."},{"key":"e_1_2_2_49_1","volume-title":"Surveillance state: Fingerprinting pupils raises safety and privacy concerns. The Guardian","author":"Kobie N","year":"2016","unstructured":"N Kobie. 2016. Surveillance state: Fingerprinting pupils raises safety and privacy concerns. The Guardian (2016)."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134699"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300537"},{"key":"e_1_2_2_52_1","volume-title":"privacy and online media: Framing the right to privacy in public policy-making. First Monday","author":"Lapenta Gry Hasselbalch","year":"2015","unstructured":"Gry Hasselbalch Lapenta and Rikke Frank J\u00f8rgensen. 2015. Youth, privacy and online media: Framing the right to privacy in public policy-making. First Monday (2015)."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2162081.2162084"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432919"},{"key":"e_1_2_2_55_1","unstructured":"Jialiu Lin. 2013. Understanding and capturing people's mobile app privacy preferences. Technical Report. CARNEGIE-MELLON UNIV PITTSBURGH PA SCHOOL OF COMPUTER SCIENCE."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.2014.995564"},{"key":"e_1_2_2_57_1","volume-title":"Parenting for a Digital Future. . . the book! Parenting for a Digital Future","author":"Livingstone Sonia","year":"2018","unstructured":"Sonia Livingstone and Alicia Blum-Ross. 2018. Parenting for a Digital Future. . . the book! Parenting for a Digital Future (2018)."},{"key":"e_1_2_2_58_1","unstructured":"Sonia Livingstone Julia Davidson Joanne Bryce Saqba Batool Ciaran Haughton and Anulekha Nandi. 2017. Children's online activities risks and safety: a literature review by the UKCCIS evidence group. (2017)."},{"key":"e_1_2_2_59_1","unstructured":"A Longfield. 2018. Who knows what about me."},{"key":"e_1_2_2_60_1","volume-title":"Design research: Methods and perspectives","author":"Lunenfeld Peter","unstructured":"Peter Lunenfeld. 2003. Design research: Methods and perspectives. MIT press."},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444816686328"},{"key":"e_1_2_2_62_1","volume-title":"Fifteenth Symp. on Usable Privacy and Security ({SOUPS}","author":"Mhaidli Abraham H","year":"2019","unstructured":"Abraham H Mhaidli, Yixin Zou, and Florian Schaub. 2019. \" We can't live without them!\" app developers' adoption of ad networks and their considerations of consumer risks. In Fifteenth Symp. on Usable Privacy and Security ({SOUPS} 2019)."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1177\/1103308814557395"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-6606.2006.00070.x"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771839.2771917"},{"key":"e_1_2_2_66_1","unstructured":"Carly Nyst Amaya Gorostiaga and Patrick Geary. 2018. Children's Online Privacy & Freedom of Expression: Industry Toolkit. https:\/\/www.unicef.org\/csr\/ict_tools.html Unicef.org."},{"key":"e_1_2_2_67_1","unstructured":"House of Lords House of Commons; Joint Committee on the Draft Online Safety Bill. 2021. Draft Online Safety Bill. https:\/\/www.gov.uk\/government\/publications\/draft-online-safety-bill"},{"key":"e_1_2_2_68_1","unstructured":"Ofcom. 2018. Children and Parents: Media Use and Attitudes."},{"key":"e_1_2_2_69_1","volume-title":"Proc. of the 8th Int'l Conf. on Social Media & Society. 1--5.","author":"Pangrazio Luci","year":"2017","unstructured":"Luci Pangrazio and Neil Selwyn. 2017. 'My Data, My Bad...' Young People's Personal Data Understandings and (Counter) Practices. In Proc. of the 8th Int'l Conf. on Social Media & Society. 1--5."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305118787808"},{"key":"e_1_2_2_71_1","volume-title":"Privacy online","author":"Peter Jochen","unstructured":"Jochen Peter and Patti M Valkenburg. 2011. Adolescents' online privacy: Toward a developmental perspective. In Privacy online. Springer, 221--234."},{"key":"e_1_2_2_72_1","unstructured":"Google Play. 2022. Expert approved apps. https:\/\/play.google.com\/intl\/en-GB_ALL\/console\/about\/programs\/teacherapproved."},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1177\/0971333615622911"},{"key":"e_1_2_2_74_1","volume-title":"Blockchain and web 3.0: social, economic, and technological challenges","author":"Ragnedda Massimo","unstructured":"Massimo Ragnedda and Giuseppe Destefanis. 2019. Blockchain and web 3.0: social, economic, and technological challenges. Routledge."},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.24908\/ss.v12i3.4958"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2018-0021"},{"key":"e_1_2_2_77_1","volume-title":"Dilemmas in a general theory of planning. Policy sciences 4, 2","author":"Rittel Horst WJ","year":"1973","unstructured":"Horst WJ Rittel and Melvin M Webber. 1973. Dilemmas in a general theory of planning. Policy sciences 4, 2 (1973), 155--169."},{"key":"e_1_2_2_78_1","unstructured":"Adi Robertson. 2021. Google bans tracking tool that sold users' location data. https:\/\/www.theverge.com\/2021\/8\/12\/22621685\/google-ban-safegraph-android-user-data-location-tracking"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3364224"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3091479"},{"key":"e_1_2_2_81_1","first-page":"215","article-title":"Epic Games v. Apple: Tech-Tying and the Future of Antitrust","volume":"41","author":"Smizer Emma C","year":"2021","unstructured":"Emma C Smizer. 2021. Epic Games v. Apple: Tech-Tying and the Future of Antitrust. Loy. LA Ent. L. Rev. 41 (2021), 215.","journal-title":"Loy. LA Ent. L. Rev."},{"key":"e_1_2_2_82_1","volume-title":"Design research now","author":"Stappers Pieter Jan","unstructured":"Pieter Jan Stappers. 2012. Doing design as a part of doing research. In Design research now. Birkh\u00e4user, 81--91."},{"key":"e_1_2_2_83_1","volume-title":"The encyclopedia of human-computer interaction","author":"Stappers Pieter Jan","unstructured":"Pieter Jan Stappers and Elisa Giaccardi. 2017. Research through design. In The encyclopedia of human-computer interaction. The Interaction Design Foundation, 1--94."},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445768"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451805"},{"key":"e_1_2_2_86_1","volume-title":"Proc. of the 2017 CHI Conf. on Human Factors in Computing Systems. ACM, 5208--5220","author":"Kleek Max Van","year":"2017","unstructured":"Max Van Kleek, Ilaria Liccardi, Reuben Binns, Jun Zhao, Daniel J Weitzner, and Nigel Shadbolt. 2017. Better the devil you know: Exposing the data sharing practices of smartphone apps. In Proc. of the 2017 CHI Conf. on Human Factors in Computing Systems. ACM, 5208--5220."},{"key":"e_1_2_2_87_1","volume-title":"Understanding third-party libraries in mobile app analysis. In 2017 IEEE\/ACM 39th Int'l Conf. on Software Engineering Companion (ICSE-C)","author":"Wang Haoyu","unstructured":"Haoyu Wang and Yao Guo. 2017. Understanding third-party libraries in mobile app analysis. In 2017 IEEE\/ACM 39th Int'l Conf. on Software Engineering Companion (ICSE-C). IEEE, 515--516."},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998352"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134746"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/2930674.2930716"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300336"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sheji.2017.08.003"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240704"},{"key":"e_1_2_2_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/1858171.1858228"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610066","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610066","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T04:27:09Z","timestamp":1755750429000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610066"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":94,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2023,9,28]]}},"alternative-id":["10.1145\/3610066"],"URL":"https:\/\/doi.org\/10.1145\/3610066","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2023-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}