{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T03:17:14Z","timestamp":1776827834193,"version":"3.51.2"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,8,31]],"date-time":"2024-08-31T00:00:00Z","timestamp":1725062400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2024,8,31]]},"abstract":"<jats:p>Many apps have basic accessibility issues, like missing labels or low contrast. To supplement manual testing, automated tools can help developers and QA testers find basic accessibility issues, but they can be laborious to use or require writing dedicated tests. To motivate our work, we interviewed eight accessibility QA professionals at a large technology company. From these interviews, we synthesized three design goals for accessibility report generation systems. Motivated by these goals, we developed a system to generate whole app accessibility reports by combining varied data collection methods (e.g., app crawling, manual recording) with an existing accessibility scanner. Many such scanners are based on single-screen scanning, and a key problem in whole app accessibility reporting is to effectively de-duplicate and summarize issues collected across an app. To this end, we developed a screen grouping model with 96.9% accuracy (88.8% F1-score) and UI element matching heuristics with 97% accuracy (98.2% F1-score). We combine these technologies in a system to report and summarize unique issues across an app, and enable a unique pixel-based ignore feature to help engineers and testers better manage reported issues across their app\u2019s lifetime. We conducted a user study where 19 accessibility engineers and testers used multiple tools to create lists of prioritized issues in the context of an accessibility audit. Our system helped them create lists they were more satisfied with while addressing key limitations of current accessibility scanning tools.<\/jats:p>","DOI":"10.1145\/3674967","type":"journal-article","created":{"date-parts":[[2024,7,2]],"date-time":"2024-07-02T13:27:43Z","timestamp":1719926863000},"page":"1-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Towards Automated Accessibility Report Generation for Mobile Apps"],"prefix":"10.1145","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-0935-4745","authenticated-orcid":false,"given":"Amanda","family":"Swearngin","sequence":"first","affiliation":[{"name":"Apple, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5101-0557","authenticated-orcid":false,"given":"Jason","family":"Wu","sequence":"additional","affiliation":[{"name":"Apple, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6591-7162","authenticated-orcid":false,"given":"Xiaoyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6079-8600","authenticated-orcid":false,"given":"Esteban","family":"Gomez","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9603-275X","authenticated-orcid":false,"given":"Jen","family":"Coughenour","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2053-9683","authenticated-orcid":false,"given":"Rachel","family":"Stukenborg","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2028-4994","authenticated-orcid":false,"given":"Bhavya","family":"Garg","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3627-6639","authenticated-orcid":false,"given":"Greg","family":"Hughes","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1405-4305","authenticated-orcid":false,"given":"Adriana","family":"Hilliard","sequence":"additional","affiliation":[{"name":"Apple, Cupertino, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2072-0625","authenticated-orcid":false,"given":"Jeffrey P.","family":"Bigham","sequence":"additional","affiliation":[{"name":"Apple, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6880-8546","authenticated-orcid":false,"given":"Jeffrey","family":"Nichols","sequence":"additional","affiliation":[{"name":"Apple, San Diego, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,9,19]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-7440-0_26"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-020-00785-w"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE51524.2021.9678625"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380392"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_3_3_7_2","unstructured":"Max Bachmann. 2024. RapidFuzz: Rapid Fuzzy String Matching in Python Using Various String Metrics. Retrieved from https:\/\/github.com\/maxbachmann\/RapidFuzz"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397871"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445762"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3019943.3019955"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359282"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380327"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2018.00049"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502073"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3108162"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610219"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09701-0"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2018.00021"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474784"},{"key":"e_1_3_3_21_2","unstructured":"Evinced. 2024. Evinced inc. Retrieved from https:\/\/www.evinced.com\/"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511109"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3608137"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502143"},{"key":"e_1_3_3_25_2","unstructured":"Google (Open Source Framework). 2022. Earl Grey: iOS UI Automation Test Framework. Retrieved from https:\/\/github.com\/google\/EarlGrey"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617023.3617028"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","unstructured":"Andrea Gianazza Federico Maggi Aristide Fattori Lorenzo Cavallaro and Stefano Zanero. 2014. PuppetDroid: A user-centric UI exerciser for automatic dynamic analysis of similar android applications. arXiv:1402.4826. Retrieved from 10.48550\/arXiv.1402.4826","DOI":"10.48550\/arXiv.1402.4826"},{"key":"e_1_3_3_28_2","unstructured":"Google. 2021. Espresso. Retrieved from https:\/\/developer.android.com\/training\/testing\/espresso"},{"key":"e_1_3_3_29_2","unstructured":"Google. 2022. Android Lint. Retrieved from https:\/\/support.google.com\/accessibility\/android\/answer\/6376570"},{"key":"e_1_3_3_30_2","unstructured":"Google. 2023. Get Started on Android with Talkback. Retrieved from https:\/\/support.google.com\/accessibility\/android\/answer\/6283677?hl=ens"},{"key":"e_1_3_3_31_2","unstructured":"Google. 2024a. Get Started with Accessibility Scanner\u2014Android Accessibility Help. Retrieved from https:\/\/support.google.com\/accessibility\/android\/answer\/6376570"},{"key":"e_1_3_3_32_2","unstructured":"Google. 2024b. Lighthouse\u2014Tools for Web Developers. Retrieved from https:\/\/developers.google.com\/web\/tools\/lighthouse"},{"key":"e_1_3_3_33_2","volume-title":"Applied Thematic Analysis","author":"Guest Greg","year":"2011","unstructured":"Greg Guest, Kathleen M. MacQueen, and Emily E. Namey. 2011. Applied Thematic Analysis. Sage Publications."},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300334"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581455"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3582515.3609549"},{"key":"e_1_3_3_37_2","unstructured":"Apple Inc. 2022. Accessibility Programming Guide for OS X: Testing for Accessibility on OS X. Retrieved from https:\/\/developer.apple.com\/library\/archive\/documentation\/Accessibility\/Conceptual\/AccessibilityMacOSX\/OSXAXTestingApps.html"},{"key":"e_1_3_3_38_2","unstructured":"Apple Inc. 2023. XCTest. Retrieved from https:\/\/developer.apple.com\/documentation\/xctest\/user_interface_tests"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2018.00037"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102609"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502042"},{"key":"e_1_3_3_42_2","first-page":"23","volume-title":"Proceedings of the IEEE\/ACM 39th International Conference on Software Engineering Companion (ICSE-C \u201917)","author":"Li Yuanchun","year":"2017","unstructured":"Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2017. DroidBot: A lightweight UI-guided test input generator for android. In Proceedings of the IEEE\/ACM 39th International Conference on Software Engineering Companion (ICSE-C \u201917). IEEE, 23\u201326."},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00104"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242650"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416547"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3556979"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1054979"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-022-00956-x"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3424953.3426633"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468604"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arxiv:2303.08774. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2303.08774","DOI":"10.48550\/arXiv.2303.08774"},{"key":"e_1_3_3_52_2","unstructured":"OpenCV. 2018. Template Matching. Retrieved from https:\/\/docs.opencv.org\/4.0.0\/de\/da9\/tutorial_template_matching.html"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.24818\/issn14531305\/24.1.2020.02"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58796-3_33"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207736"},{"key":"e_1_3_3_56_2","unstructured":"Roboelectric (Open Source Project). 2021. Roboelectric. Retrieved from http:\/\/robolectric.org\/"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3234695.3236364"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445455"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580679"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556905"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3218585.3218673"},{"key":"e_1_3_3_62_2","first-page":"482","volume-title":"Universal Design 2016: Learning from the Past, Designing for the Future (Proceedings of the 3rd International Conference on Universal Design, UD \u201916)","author":"Swallow David Mark","year":"2016","unstructured":"David Mark Swallow, Helen Petrie, and Christopher Douglas Power. 2016. Understanding and supporting web developers: Design and evaluation of a web accessibility information resource (WebAIR). In Universal Design 2016: Learning from the Past, Designing for the Future (Proceedings of the 3rd International Conference on Universal Design, UD \u201916). IOS Press, 482\u2013491."},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642777"},{"key":"e_1_3_3_64_2","unstructured":"Todd Veldhuizen. 1998. Retrieved from https:\/\/homepages.inf.ed.ac.uk\/rbf\/CVonline\/LOCAL_COPIES\/VELDHUIZEN\/node18.html"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2019.00014"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/2461121.2461124"},{"key":"e_1_3_3_67_2","volume-title":"Bility: Automated Accessibility Testing for Mobile Applications","author":"Vontell Aaron Richard","year":"2019","unstructured":"Aaron Richard Vontell. 2019. Bility: Automated Accessibility Testing for Mobile Applications. Ph.D. Dissertation. Massachusetts Institute of Technology, Cambridge, MA."},{"key":"e_1_3_3_68_2","unstructured":"W3C. 2015. Mobile Accessibility: How WCAG 2.0 and Other W3C\/WAI Guidelines Apply to Mobile. Retrieved from https:\/\/www.w3.org\/TR\/mobile-accessibility-mapping\/"},{"key":"e_1_3_3_69_2","unstructured":"W3C. 2023. Introduction to Understanding WCAG 2.0. Retrieved from https:\/\/www.w3.org\/TR\/UNDERSTANDING-WCAG20\/intro.html"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580895"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474765"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978963"},{"key":"e_1_3_3_73_2","first-page":"1","volume-title":"Proceedings of the ACM Symposium on User Interface Software and Technology (UIST)","author":"Wu Jason","year":"2024","unstructured":"Jason Wu, Rebecca Krosnick, Eldon Schoop, Amanda Swearngin, Jeffrey P. Bigham, and Jeffrey Nichols. 2024. Never-ending learning of user interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). ACM. 1\u201313."},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474763"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445186"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242616"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616329"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3674967","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3674967","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:56Z","timestamp":1750291556000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3674967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,31]]},"references-count":76,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,8,31]]}},"alternative-id":["10.1145\/3674967"],"URL":"https:\/\/doi.org\/10.1145\/3674967","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,31]]},"assertion":[{"value":"2024-02-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}