{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T17:23:31Z","timestamp":1778779411884,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,29]]},"DOI":"10.1145\/3491102.3502073","type":"proceedings-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T16:34:58Z","timestamp":1651163698000},"page":"1-14","source":"Crossref","is-referenced-by-count":28,"title":["Towards Complete Icon Labeling in Mobile Applications"],"prefix":"10.1145","author":[{"given":"Jieshan","family":"Chen","sequence":"first","affiliation":[{"name":"Australian National University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amanda","family":"Swearngin","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason","family":"Wu","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Titus","family":"Barik","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey","family":"Nichols","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Proc. 20th int. conf. very large data bases, VLDB, Vol.\u00a01215","author":"Agrawal Rakesh","year":"1994","unstructured":"Rakesh Agrawal , Ramakrishnan Srikant , 1994 . Fast Algorithms for Mining Association Rules . In Proc. 20th int. conf. very large data bases, VLDB, Vol.\u00a01215 . Citeseer, 487\u2013499. Rakesh Agrawal, Ramakrishnan Srikant, 1994. Fast Algorithms for Mining Association Rules. In Proc. 20th int. conf. very large data bases, VLDB, Vol.\u00a01215. Citeseer, 487\u2013499."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380392"},{"key":"e_1_3_2_2_3_1","unstructured":"Apple. 2021. Glyphs - Human Interface Guidelines. https:\/\/developer.apple.com\/design\/human-interface-guidelines\/glyphs\/overview. Accessed: 24\/08\/2021.  Apple. 2021. Glyphs - Human Interface Guidelines. https:\/\/developer.apple.com\/design\/human-interface-guidelines\/glyphs\/overview. Accessed: 24\/08\/2021."},{"key":"e_1_3_2_2_4_1","unstructured":"Apple. 2021. Recognizing Text in Images. https:\/\/developer.apple.com\/documentation\/vision\/recognizing_text_in_images. Accessed: 31\/08\/2021.  Apple. 2021. Recognizing Text in Images. https:\/\/developer.apple.com\/documentation\/vision\/recognizing_text_in_images. Accessed: 31\/08\/2021."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359282"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180240"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3391613","article-title":"Wireframe-Based UI Design Search through Image Autoencoder","volume":"29","author":"Chen Jieshan","year":"2020","unstructured":"Jieshan Chen , Chunyang Chen , Zhenchang Xing , Xin Xia , Liming Zhu , John Grundy , and Jinshui Wang . 2020 . Wireframe-Based UI Design Search through Image Autoencoder . ACM Transactions on Software Engineering and Methodology (TOSEM) 29 , 3(2020), 1 \u2013 31 . Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang. 2020. Wireframe-Based UI Design Search through Image Autoencoder. ACM Transactions on Software Engineering and Methodology (TOSEM) 29, 3(2020), 1\u201331.","journal-title":"ACM Transactions on Software Engineering and Methodology (TOSEM)"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380327"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_3_2_2_10_1","volume-title":"Auto-icon: An Automated Code Generation Tool for Icon Designs Assisting in UI Development. In 26th International Conference on Intelligent User Interfaces. 59\u201369","author":"Feng Sidong","year":"2021","unstructured":"Sidong Feng , Suyu Ma , Jinzhong Yu , Chunyang Chen , TingTing Zhou , and Yankun Zhen . 2021 . Auto-icon: An Automated Code Generation Tool for Icon Designs Assisting in UI Development. In 26th International Conference on Intelligent User Interfaces. 59\u201369 . Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, TingTing Zhou, and Yankun Zhen. 2021. Auto-icon: An Automated Code Generation Tool for Icon Designs Assisting in UI Development. In 26th International Conference on Intelligent User Interfaces. 59\u201369."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.1998.0391"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01901287"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00140"},{"key":"e_1_3_2_2_15_1","volume-title":"Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv preprint arXiv:1704.04861(2017).","author":"Howard G","year":"2017","unstructured":"Andrew\u00a0 G Howard , Menglong Zhu , Bo Chen , Dmitry Kalenichenko , Weijun Wang , Tobias Weyand , Marco Andreetto , and Hartwig Adam . 2017 . Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv preprint arXiv:1704.04861(2017). Andrew\u00a0G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv preprint arXiv:1704.04861(2017)."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Shachar Kaufman Saharon Rosset Claudia Perlich and Ori Stitelman. 2012. Leakage in Data Mining: Formulation Detection and Avoidance. ACM Transactions on Knowledge Discovery from Data (TKDD) 6 4(2012) 1\u201321.  Shachar Kaufman Saharon Rosset Claudia Perlich and Ori Stitelman. 2012. Leakage in Data Mining: Formulation Detection and Avoidance. ACM Transactions on Knowledge Discovery from Data (TKDD) 6 4(2012) 1\u201321.","DOI":"10.1145\/2382577.2382579"},{"key":"e_1_3_2_2_17_1","volume-title":"Adam: A Method for Stochastic Optimization. arXiv preprint arXiv:1412.6980(2014).","author":"Kingma P","year":"2014","unstructured":"Diederik\u00a0 P Kingma and Jimmy Ba . 2014 . Adam: A Method for Stochastic Optimization. arXiv preprint arXiv:1412.6980(2014). Diederik\u00a0P Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. arXiv preprint arXiv:1412.6980(2014)."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376327"},{"key":"e_1_3_2_2_19_1","volume-title":"Enrico: A Dataset for Topic Modeling of Mobile UI Designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1\u20134.","author":"Leiva A","year":"2020","unstructured":"Luis\u00a0 A Leiva , Asutosh Hota , and Antti Oulasvirta . 2020 . Enrico: A Dataset for Topic Modeling of Mobile UI Designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1\u20134. Luis\u00a0A Leiva, Asutosh Hota, and Antti Oulasvirta. 2020. Enrico: A Dataset for Topic Modeling of Mobile UI Designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1\u20134."},{"key":"e_1_3_2_2_20_1","volume-title":"2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC). IEEE, 105\u2013114","author":"Jia-Jun Li Toby","year":"2018","unstructured":"Toby Jia-Jun Li , Igor Labutov , Xiaohan\u00a0Nancy Li , Xiaoyi Zhang , Wenze Shi , Wanling Ding , Tom\u00a0 M Mitchell , and Brad\u00a0 A Myers . 2018 . APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions . In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC). IEEE, 105\u2013114 . Toby Jia-Jun Li, Igor Labutov, Xiaohan\u00a0Nancy Li, Xiaoyi Zhang, Wenze Shi, Wanling Ding, Tom\u00a0M Mitchell, and Brad\u00a0A Myers. 2018. APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions. In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC). IEEE, 105\u2013114."},{"key":"e_1_3_2_2_21_1","unstructured":"Yang Li Jiacong He Xin Zhou Yuan Zhang and Jason Baldridge. 2020. Mapping Natural Language Instructions to Mobile UI Action Sequences. arXiv preprint arXiv:2005.03776(2020).  Yang Li Jiacong He Xin Zhou Yuan Zhang and Jason Baldridge. 2020. Mapping Natural Language Instructions to Mobile UI Action Sequences. arXiv preprint arXiv:2005.03776(2020)."},{"key":"e_1_3_2_2_22_1","volume-title":"Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. arXiv preprint arXiv:2010.04295(2020).","author":"Li Yang","year":"2020","unstructured":"Yang Li , Gang Li , Luheng He , Jingjie Zheng , Hong Li , and Zhiwei Guan . 2020 . Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. arXiv preprint arXiv:2010.04295(2020). Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, and Zhiwei Guan. 2020. Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. arXiv preprint arXiv:2010.04295(2020)."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.106"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242650"},{"key":"e_1_3_2_2_26_1","volume-title":"SSD: Single Shot Multibox Detector. In European conference on computer vision. Springer, 21\u201337","author":"Liu Wei","year":"2016","unstructured":"Wei Liu , Dragomir Anguelov , Dumitru Erhan , Christian Szegedy , Scott Reed , Cheng-Yang Fu , and Alexander\u00a0 C Berg . 2016 . SSD: Single Shot Multibox Detector. In European conference on computer vision. Springer, 21\u201337 . Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander\u00a0C Berg. 2016. SSD: Single Shot Multibox Detector. In European conference on computer vision. Springer, 21\u201337."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468604"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234695.3236364"},{"key":"e_1_3_2_2_29_1","unstructured":"Jake Snell Kevin Swersky and Richard\u00a0S Zemel. 2017. Prototypical Networks for Few-Shot Learning. arXiv preprint arXiv:1703.05175(2017).  Jake Snell Kevin Swersky and Richard\u00a0S Zemel. 2017. Prototypical Networks for Few-Shot Learning. arXiv preprint arXiv:1703.05175(2017)."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330551"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319535.3363193"},{"key":"e_1_3_2_2_32_1","volume-title":"IconIntent: Automatic Identification of Sensitive UI Widgets Based on Icon Classification for Android Apps. In 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 257\u2013268","author":"Xiao Xusheng","year":"2019","unstructured":"Xusheng Xiao , Xiaoyin Wang , Zhihao Cao , Hanlin Wang , and Peng Gao . 2019 . IconIntent: Automatic Identification of Sensitive UI Widgets Based on Icon Classification for Android Apps. In 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 257\u2013268 . Xusheng Xiao, Xiaoyin Wang, Zhihao Cao, Hanlin Wang, and Peng Gao. 2019. IconIntent: Automatic Identification of Sensitive UI Widgets Based on Icon Classification for Android Apps. In 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 257\u2013268."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Xiaoxue Zang Ying Xu and Jindong Chen. 2021. Multimodal Icon Annotation for Mobile Applications. arXiv preprint arXiv:2107.04452(2021).  Xiaoxue Zang Ying Xu and Jindong Chen. 2021. Multimodal Icon Annotation for Mobile Applications. arXiv preprint arXiv:2107.04452(2021).","DOI":"10.1145\/3447526.3472064"},{"key":"e_1_3_2_2_34_1","volume-title":"Visualizing and Understanding Convolutional Networks. In European conference on computer vision. Springer, 818\u2013833","author":"Zeiler D","year":"2014","unstructured":"Matthew\u00a0 D Zeiler and Rob Fergus . 2014 . Visualizing and Understanding Convolutional Networks. In European conference on computer vision. Springer, 818\u2013833 . Matthew\u00a0D Zeiler and Rob Fergus. 2014. Visualizing and Understanding Convolutional Networks. In European conference on computer vision. Springer, 818\u2013833."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445186"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025846"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376618"}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","location":"New Orleans LA USA","acronym":"CHI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3502073","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491102.3502073","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:21Z","timestamp":1750188681000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3502073"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":37,"alternative-id":["10.1145\/3491102.3502073","10.1145\/3491102"],"URL":"https:\/\/doi.org\/10.1145\/3491102.3502073","relation":{},"subject":[],"published":{"date-parts":[[2022,4,29]]}}}