{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T11:34:03Z","timestamp":1777203243363,"version":"3.51.4"},"reference-count":107,"publisher":"Association for Computing Machinery (ACM)","issue":"EICS","license":[{"start":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T00:00:00Z","timestamp":1686700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fonds de la Recherche Scientifique-FRS","doi-asserted-by":"crossref","award":["40011629"],"award-info":[{"award-number":["40011629"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"crossref"}]},{"name":"EU EIC Pathfinder-Awareness Inside challenge","award":["101071147"],"award-info":[{"award-number":["101071147"]}]},{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","award":["40001931"],"award-info":[{"award-number":["40001931"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,6,14]]},"abstract":"<jats:p>The field of generative artificial intelligence has seen significant advancements in recent years with the advent of large language models, which have shown impressive results in software engineering tasks but not yet in engineering user interfaces. Thus, we raise a specific research question: would an LLM-based system be able to search for relevant GUI layouts? To address this question, we conducted a controlled study evaluating how Instigator, an LLM-based system for searching GUI layouts of web pages by generative pre-trained training, would return GUI layouts that are relevant to a given instruction and what would be the user experience of (N =34) practitioners interacting with Instigator. Our results identify a very high similarity and a moderate correlation between the rankings of the GUI layouts generated by Instigator and the rankings of the practitioners with respect to their relevance to a given design instruction. We highlight the results obtained through thirteen UEQ+ scales that characterize the user experience of the practitioner with Instigator, which we use to discuss perspectives for improving such future tools.<\/jats:p>","DOI":"10.1145\/3593230","type":"journal-article","created":{"date-parts":[[2023,6,19]],"date-time":"2023-06-19T18:10:41Z","timestamp":1687198241000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["Evaluating a Large Language Model on Searching for GUI Layouts"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0209-7411","authenticated-orcid":false,"given":"Paul","family":"Brie","sequence":"first","affiliation":[{"name":"TeleportHQ, Cluj-Napoca, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4994-9746","authenticated-orcid":false,"given":"Nicolas","family":"Burny","sequence":"additional","affiliation":[{"name":"Universit\u00e9 catholique de Louvain, Louvain-la-Neuve, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0804-0106","authenticated-orcid":false,"given":"Arthur","family":"Slu\u00ffters","sequence":"additional","affiliation":[{"name":"Universit\u00e9 catholique de Louvain, Louvain-la-Neuve, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3275-3333","authenticated-orcid":false,"given":"Jean","family":"Vanderdonckt","sequence":"additional","affiliation":[{"name":"Universit\u00e9 catholique de Louvain, Louvain-la-Neuve, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,6,19]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering","author":"Ahmed Toufique","year":"2023","unstructured":"Toufique Ahmed and Premkumar Devanbu . 2023 . Few-Shot Training LLMs for Project-Specific Code-Summarization . In Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering ( Rochester, MI, USA) (ASE '22). Association for Computing Machinery, New York, NY, USA, Article 177, 5 pages. https:\/\/doi.org\/10.1145\/ 3551349.3559555 Toufique Ahmed and Premkumar Devanbu. 2023. Few-Shot Training LLMs for Project-Specific Code-Summarization. In Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering (Rochester, MI, USA) (ASE '22). Association for Computing Machinery, New York, NY, USA, Article 177, 5 pages. https:\/\/doi.org\/10.1145\/ 3551349.3559555"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of IAS '04","author":"Aoki Kei","year":"2004","unstructured":"Kei Aoki , Hajime Kimura , and Shigenobu Kobayashi . 2004 . Distributed Reinforcement Learning using Bi-directional Decision Making for Multicriteria Control of Multi-Stage Flow Systems . In Proceedings of IAS '04 . http:\/\/sysplan. nams.kyushu-u.ac.jp\/gen\/papers\/klab2004\/IAS8AokiBDM.pdf Kei Aoki, Hajime Kimura, and Shigenobu Kobayashi. 2004. Distributed Reinforcement Learning using Bi-directional Decision Making for Multicriteria Control of Multi-Stage Flow Systems. In Proceedings of IAS '04. http:\/\/sysplan. nams.kyushu-u.ac.jp\/gen\/papers\/klab2004\/IAS8AokiBDM.pdf"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 16th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '89)","author":"Avrahami Gideon","unstructured":"Gideon Avrahami , Kenneth P. Brooks , and Marc H. Brown . 1989. A Two-View Approach to Constructing User Interfaces . In Proceedings of the 16th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '89) . Association for Computing Machinery, New York, NY, USA, 137--146. https:\/\/doi.org\/10.1145\/74333.74347 10.1145\/74333.74347 Gideon Avrahami, Kenneth P. Brooks, and Marc H. Brown. 1989. A Two-View Approach to Constructing User Interfaces. In Proceedings of the 16th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '89). Association for Computing Machinery, New York, NY, USA, 137--146. https:\/\/doi.org\/10.1145\/74333.74347"},{"key":"e_1_2_1_4_1","volume-title":"Proc. of 3rd International Conference on Learning Representations","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2015 . Neural Machine Translation by Jointly Learning to Align and Translate . In Proc. of 3rd International Conference on Learning Representations ( San Diego, CA, USA) (ICLR '15), Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1409.0473 Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural Machine Translation by Jointly Learning to Align and Translate. In Proc. of 3rd International Conference on Learning Representations (San Diego, CA, USA) (ICLR '15), Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1409.0473"},{"key":"e_1_2_1_5_1","volume-title":"2018 IEEE\/ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft). IEEE Computer Society","author":"Behrang F.","unstructured":"F. Behrang , S. P. Reiss , and A. Orso . 2018. GUIFetch: Supporting App Design and Development through GUI Search . In 2018 IEEE\/ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft). IEEE Computer Society , Los Alamitos, CA, USA, 236--246. https:\/\/doi.ieeecomputersociety.org\/ F. Behrang, S. P. Reiss, and A. Orso. 2018. GUIFetch: Supporting App Design and Development through GUI Search. In 2018 IEEE\/ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft). IEEE Computer Society, Los Alamitos, CA, USA, 236--246. https:\/\/doi.ieeecomputersociety.org\/"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of IEEE\/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion '19)","author":"Bernal-Cardenas C.","year":"2019","unstructured":"C. Bernal-Cardenas , K. Moran , M. Tufano , Z. Liu , L. Nan , Z. Shi , and D. Poshyvanyk . 2019. Guigle: A GUI Search Engine for Android Apps . In Proceedings of IEEE\/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion '19) . IEEE Computer Society, Los Alamitos, CA, USA, 71--74. https:\/\/doi.org\/10.1109\/ ICSE-Companion. 2019 .00041 C. Bernal-Cardenas, K. Moran, M. Tufano, Z. Liu, L. Nan, Z. Shi, and D. Poshyvanyk. 2019. Guigle: A GUI Search Engine for Android Apps. In Proceedings of IEEE\/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion '19). IEEE Computer Society, Los Alamitos, CA, USA, 71--74. https:\/\/doi.org\/10.1109\/ ICSE-Companion.2019.00041"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10798-019-09496-7"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3596454.3597184"},{"key":"e_1_2_1_9_1","unstructured":"Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. (2020). arXiv:2005.14165 http:\/\/arxiv.org\/abs\/2005.14165  Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. (2020). arXiv:2005.14165 http:\/\/arxiv.org\/abs\/2005.14165"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445762"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(03)00010-9"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409691"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3391613"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/3524938.3525096"},{"key":"e_1_2_1_15_1","volume-title":"Generative Pretraining from Pixels (v1). Icml","author":"Chen Mark","year":"2020","unstructured":"Mark Chen , Alec Radford , Rewon Child , Jeff Wu , Heewoo Jun , David Luan , and Ilya Sutskever . 2020. Generative Pretraining from Pixels (v1). Icml ( 2020 ). Mark Chen, Alec Radford, Rewon Child, Jeff Wu, Heewoo Jun, David Luan, and Ilya Sutskever. 2020. Generative Pretraining from Pixels (v1). Icml (2020)."},{"key":"e_1_2_1_16_1","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman Alex Ray Raul Puri Gretchen Krueger Michael Petrov Heidy Khlaaf Girish Sastry Pamela Mishkin Brooke Chan Scott Gray Nick Ryder Mikhail Pavlov Alethea Power Lukasz Kaiser Mohammad Bavarian Clemens Winter Philippe Tillet Felipe Petroski Such Dave Cummings Matthias Plappert Fotios Chantzis Elizabeth Barnes Ariel Herbert-Voss William Hebgen Guss Alex Nichol Alex Paino Nikolas Tezak  Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman Alex Ray Raul Puri Gretchen Krueger Michael Petrov Heidy Khlaaf Girish Sastry Pamela Mishkin Brooke Chan Scott Gray Nick Ryder Mikhail Pavlov Alethea Power Lukasz Kaiser Mohammad Bavarian Clemens Winter Philippe Tillet Felipe Petroski Such Dave Cummings Matthias Plappert Fotios Chantzis Elizabeth Barnes Ariel Herbert-Voss William Hebgen Guss Alex Nichol Alex Paino Nikolas Tezak"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370847.1370849"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74796-3_16"},{"key":"e_1_2_1_20_1","volume-title":"Interactive Layout Transfer. In 26th International Conference on Intelligent User Interfaces","author":"Dayama Niraj Ramesh","year":"2021","unstructured":"Niraj Ramesh Dayama , Simo Santala , Lukas Br\u00fcckner , Kashyap Todi , Jingzhou Du , and Antti Oulasvirta . 2021 . Interactive Layout Transfer. In 26th International Conference on Intelligent User Interfaces ( College Station, TX, USA) (IUI '21). Association for Computing Machinery, New York, NY, USA, 70--80. https:\/\/doi.org\/10.1145\/3397481.3450652 10.1145\/3397481.3450652 Niraj Ramesh Dayama, Simo Santala, Lukas Br\u00fcckner, Kashyap Todi, Jingzhou Du, and Antti Oulasvirta. 2021. Interactive Layout Transfer. In 26th International Conference on Intelligent User Interfaces (College Station, TX, USA) (IUI '21). Association for Computing Machinery, New York, NY, USA, 70--80. https:\/\/doi.org\/10.1145\/3397481.3450652"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984581"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10. 18653\/v1\/N19--1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10.18653\/v1\/N19--1423"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/359784.360122"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 9th International Conference on Intelligent User Interfaces (Funchal","author":"Gajos Krzysztof","unstructured":"Krzysztof Gajos and Daniel S. Weld . 2004. SUPPLE: Automatically Generating User Interfaces . In Proceedings of the 9th International Conference on Intelligent User Interfaces (Funchal , Madeira, Portugal) (IUI '04). Association for Computing Machinery, New York, NY, USA, 93--100. https:\/\/doi.org\/10.1145\/964442.964461 10.1145\/964442.964461 Krzysztof Gajos and Daniel S. Weld. 2004. SUPPLE: Automatically Generating User Interfaces. In Proceedings of the 9th International Conference on Intelligent User Interfaces (Funchal, Madeira, Portugal) (IUI '04). Association for Computing Machinery, New York, NY, USA, 93--100. https:\/\/doi.org\/10.1145\/964442.964461"},{"key":"e_1_2_1_26_1","volume-title":"Android GUI Search Using Hand-Drawn Sketches. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion '19)","author":"Ge X.","year":"2019","unstructured":"X. Ge . 2019 . Android GUI Search Using Hand-Drawn Sketches. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion '19) . IEEE Computer Society, Los Alamitos, CA, USA, 141--143. https:\/\/doi.org\/10.1109\/ICSE-Companion. 2019.00060 10.1109\/ICSE-Companion.2019.00060 X. Ge. 2019. Android GUI Search Using Hand-Drawn Sketches. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion '19). IEEE Computer Society, Los Alamitos, CA, USA, 141--143. https:\/\/doi.org\/10.1109\/ICSE-Companion.2019.00060"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2013.09.001"},{"key":"e_1_2_1_28_1","volume-title":"Deep Learning","author":"Goodfellow Ian","unstructured":"Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Deep Learning . MIT Press . http:\/\/www.deeplearningbook. org. Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press. http:\/\/www.deeplearningbook. org."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Herring Scarlett R.","year":"1870","unstructured":"Scarlett R. Herring , Chia-Chen Chang , Jesse Krantzler , and Brian P. Bailey . 2009. Getting Inspired! Understanding How and Why Examples Are Used in Creative Design Practice . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Boston, MA, USA) (CHI '09). Association for Computing Machinery, New York, NY, USA, 87--96. https:\/\/doi.org\/10.1145\/15 1870 1.1518717 10.1145\/1518701.1518717 Scarlett R. Herring, Chia-Chen Chang, Jesse Krantzler, and Brian P. Bailey. 2009. Getting Inspired! Understanding How and Why Examples Are Used in Creative Design Practice. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). Association for Computing Machinery, New York, NY, USA, 87--96. https:\/\/doi.org\/10.1145\/1518701.1518717"},{"key":"e_1_2_1_30_1","first-page":"243","article-title":"Applying Importance-Performance Analysis (IPA) to Interpret the Results of the User Experience Questionnaire (UEQ)","volume":"19","author":"Hinderks Andreas","year":"2020","unstructured":"Andreas Hinderks , Francisco Jos\u00e9 Dom\u00ednguez Mayo , Anna-Lena Meiners , and J\u00f6rg Thomaschewski . 2020 . Applying Importance-Performance Analysis (IPA) to Interpret the Results of the User Experience Questionnaire (UEQ) . J. Web Eng. 19 , 2 (2020), 243 -- 266 . https:\/\/doi.org\/10.13052\/jwe1540--9589.1926 10.13052\/jwe1540--9589.1926 Andreas Hinderks, Francisco Jos\u00e9 Dom\u00ednguez Mayo, Anna-Lena Meiners, and J\u00f6rg Thomaschewski. 2020. Applying Importance-Performance Analysis (IPA) to Interpret the Results of the User Experience Questionnaire (UEQ). J. Web Eng. 19, 2 (2020), 243--266. https:\/\/doi.org\/10.13052\/jwe1540--9589.1926","journal-title":"J. Web Eng."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csi.2019.01.007"},{"key":"e_1_2_1_32_1","first-page":"1717","article-title":"Applicability of User Experience and Usability Questionnaires","volume":"25","author":"Hinderks Andreas","year":"2019","unstructured":"Andreas Hinderks , Dominique Winter , Martin Schrepp , and J\u00f6rg Thomaschewski . 2019 . Applicability of User Experience and Usability Questionnaires . J. Univers. Comput. Sci. 25 , 13 (2019), 1717 -- 1735 . http:\/\/www.jucs.org\/jucs_ 25_13\/applicability_of_user_experience Andreas Hinderks, Dominique Winter, Martin Schrepp, and J\u00f6rg Thomaschewski. 2019. Applicability of User Experience and Usability Questionnaires. J. Univers. Comput. Sci. 25, 13 (2019), 1717--1735. http:\/\/www.jucs.org\/jucs_ 25_13\/applicability_of_user_experience","journal-title":"J. Univers. Comput. Sci."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300334"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377485"},{"key":"e_1_2_1_35_1","volume-title":"Lennart Heim and Pablo Villalobos","author":"Tamay Besiroglu Anson Ho Marius Hobbhahn","year":"2022","unstructured":"Marius Hobbhahn Tamay Besiroglu Anson Ho Jaime Sevilla , Lennart Heim and Pablo Villalobos . 2022 . Estimating Training Compute of Deep Learning Models. https:\/\/epochai.org\/blog\/estimating-training-compute Accessed : 2023-04-01. Marius Hobbhahn Tamay Besiroglu Anson Ho Jaime Sevilla, Lennart Heim and Pablo Villalobos. 2022. Estimating Training Compute of Deep Learning Models. https:\/\/epochai.org\/blog\/estimating-training-compute Accessed: 2023-04-01."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510203"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503564"},{"key":"e_1_2_1_38_1","volume-title":"Proc. of IEEE 18th International Working Conference on Source Code Analysis and Manipulation (SCAM '18)","author":"Jiang Renhe","year":"2018","unstructured":"Renhe Jiang , Zhengzhao Chen , Zejun Zhang , Yu Pei , Minxue Pan , and Tian Zhang . 2018 . Semantics-Based Code Search Using Input\/Output Examples . In Proc. of IEEE 18th International Working Conference on Source Code Analysis and Manipulation (SCAM '18) . 92--102. https:\/\/doi.org\/10.1109\/SCAM.2018.00018 10.1109\/SCAM.2018.00018 Renhe Jiang, Zhengzhao Chen, Zejun Zhang, Yu Pei, Minxue Pan, and Tian Zhang. 2018. Semantics-Based Code Search Using Input\/Output Examples. In Proc. of IEEE 18th International Working Conference on Source Code Analysis and Manipulation (SCAM '18). 92--102. https:\/\/doi.org\/10.1109\/SCAM.2018.00018"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2926720"},{"key":"e_1_2_1_40_1","volume-title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. CoRR abs\/1609.04836","author":"Keskar Nitish Shirish","year":"2016","unstructured":"Nitish Shirish Keskar , Dheevatsa Mudigere , Jorge Nocedal , Mikhail Smelyanskiy , and Ping Tak Peter Tang . 2016. On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. CoRR abs\/1609.04836 ( 2016 ). arXiv:1609.04836 http:\/\/arxiv.org\/abs\/1609.04836 Nitish Shirish Keskar, Dheevatsa Mudigere, Jorge Nocedal, Mikhail Smelyanskiy, and Ping Tak Peter Tang. 2016. On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. CoRR abs\/1609.04836 (2016). arXiv:1609.04836 http:\/\/arxiv.org\/abs\/1609.04836"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102"},{"key":"e_1_2_1_42_1","volume-title":"Kingma and Max Welling","author":"Diederik","year":"2019","unstructured":"Diederik P. Kingma and Max Welling . 2019 . An Introduction to Variational Autoencoders. Foundations and Trends\u00ae in Machine Learning 12, 4 (2019), 307--392. https:\/\/doi.org\/10.1561\/2200000056 10.1561\/2200000056 Diederik P. Kingma and Max Welling. 2019. An Introduction to Variational Autoencoders. Foundations and Trends\u00ae in Machine Learning 12, 4 (2019), 307--392. https:\/\/doi.org\/10.1561\/2200000056"},{"key":"e_1_2_1_43_1","volume-title":"Burnett","author":"Ko Andrew J.","year":"2015","unstructured":"Andrew J. Ko , Thomas D. LaToza , and Margaret M . Burnett . 2015 . A practical guide to controlled experiments of software engineering tools with human participants. Empirical Software Engineering 20, 1 (01 Feb 2015), 110--141. https:\/\/doi.org\/10.1007\/s10664-013--9279--3 10.1007\/s10664-013--9279--3 Andrew J. Ko, Thomas D. LaToza, and Margaret M. Burnett. 2015. A practical guide to controlled experiments of software engineering tools with human participants. Empirical Software Engineering 20, 1 (01 Feb 2015), 110--141. https:\/\/doi.org\/10.1007\/s10664-013--9279--3"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.21606\/drs.2018.352"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3415289"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-023-00377-x"},{"key":"e_1_2_1_47_1","volume-title":"UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5","author":"Kujala Sari","year":"2011","unstructured":"Sari Kujala , Virpi Roto , Kaisa V\u00e4\u00e4n\u00e4nen-Vainio-Mattila , Evangelos Karapanos , and Arto Sinnel\u00e4 . 2011. UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5 ( 2011 ), 473--483. https: \/\/doi.org\/10.1016\/j.intcom.2011.06.005 10.1016\/j.intcom.2011.06.005 Sari Kujala, Virpi Roto, Kaisa V\u00e4\u00e4n\u00e4nen-Vainio-Mattila, Evangelos Karapanos, and Arto Sinnel\u00e4. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5 (2011), 473--483. https: \/\/doi.org\/10.1016\/j.intcom.2011.06.005"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Kumar Ranjitha","unstructured":"Ranjitha Kumar , Arvind Satyanarayan , Cesar Torres , Maxine Lim , Salman Ahmad , Scott R. Klemmer , and Jerry O. Talton . 2013. Webzeitgeist: Design Mining the Web . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3083--3092. https:\/\/doi.org\/10.1145\/2470654.2466420 10.1145\/2470654.2466420 Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R. Klemmer, and Jerry O. Talton. 2013. Webzeitgeist: Design Mining the Web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3083--3092. https:\/\/doi.org\/10.1145\/2470654.2466420"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CITSM.2016.7577578"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89350-9_6"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2013.09.006"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Lee Brian","unstructured":"Brian Lee , Savil Srivastava , Ranjitha Kumar , Ronen Brafman , and Scott R. Klemmer . 2010. Designing with Interactive Example Galleries . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( Atlanta, Georgia, USA) (CHI '10). Association for Computing Machinery, New York, NY, USA, 2257--2266. https:\/\/doi.org\/10.1145\/ 1753326.1753667 Brian Lee, Savil Srivastava, Ranjitha Kumar, Ronen Brafman, and Scott R. Klemmer. 2010. Designing with Interactive Example Galleries. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). Association for Computing Machinery, New York, NY, USA, 2257--2266. https:\/\/doi.org\/10.1145\/ 1753326.1753667"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376327"},{"key":"e_1_2_1_54_1","unstructured":"Hsin-Ying Lee Weilong Yang Lu Jiang Madison Le Irfan Essa Haifeng Gong and Ming-Hsuan Yang. 2019. Neural Design Network: Graphic Layout Generation with Constraints. (2019). arXiv:1912.09421 http:\/\/arxiv.org\/abs\/1912. 09421  Hsin-Ying Lee Weilong Yang Lu Jiang Madison Le Irfan Essa Haifeng Gong and Ming-Hsuan Yang. 2019. Neural Design Network: Graphic Layout Generation with Constraints. (2019). arXiv:1912.09421 http:\/\/arxiv.org\/abs\/1912. 09421"},{"key":"e_1_2_1_55_1","volume-title":"Enrico: A Dataset for Topic Modeling of Mobile UI Designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services","author":"Leiva Luis A.","year":"2020","unstructured":"Luis A. Leiva , Asutosh Hota , and Antti Oulasvirta . 2020 . Enrico: A Dataset for Topic Modeling of Mobile UI Designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services ( Oldenburg, Germany) (MobileHCI '20). Association for Computing Machinery, New York, NY, USA, Article 9, 4 pages. https: \/\/doi.org\/10.1145\/3406324.3410710 10.1145\/3406324.3410710 Luis A. Leiva, Asutosh Hota, and Antti Oulasvirta. 2020. Enrico: A Dataset for Topic Modeling of Mobile UI Designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI '20). Association for Computing Machinery, New York, NY, USA, Article 9, 4 pages. https: \/\/doi.org\/10.1145\/3406324.3410710"},{"key":"e_1_2_1_56_1","first-page":"5","article-title":"Interactive Exploration of Large-Scale UI Datasets with Design Maps","volume":"32","author":"Leiva Luis A","year":"2021","unstructured":"Luis A Leiva , Asutosh Hota , and Antti Oulasvirta . 2021 . Interactive Exploration of Large-Scale UI Datasets with Design Maps . Interacting with Computers 32 , 5 -- 6 (03 2021), 490--509. https:\/\/doi.org\/10.1093\/iwcomp\/iwab006 arXiv:https:\/\/academic.oup.com\/iwc\/article-pdf\/32\/5--6\/490\/38856879\/iwab006.pdf 10.1093\/iwcomp Luis A Leiva, Asutosh Hota, and Antti Oulasvirta. 2021. Interactive Exploration of Large-Scale UI Datasets with Design Maps. Interacting with Computers 32, 5--6 (03 2021), 490--509. https:\/\/doi.org\/10.1093\/iwcomp\/iwab006 arXiv:https:\/\/academic.oup.com\/iwc\/article-pdf\/32\/5--6\/490\/38856879\/iwab006.pdf","journal-title":"Interacting with Computers"},{"key":"e_1_2_1_57_1","volume-title":"LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators. In 7th International Conference on Learning Representations, ICLR 2019","author":"Li Jianan","year":"2019","unstructured":"Jianan Li , Jimei Yang , Aaron Hertzmann , Jianming Zhang , and Tingfa Xu . 2019 . LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators. In 7th International Conference on Learning Representations, ICLR 2019 , New Orleans, LA, USA, May 6--9 , 2019. OpenReview.net. https:\/\/openreview.net\/forum?id=HJxB5sRcFQ Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, and Tingfa Xu. 2019. LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6--9, 2019. OpenReview.net. https:\/\/openreview.net\/forum?id=HJxB5sRcFQ"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501992"},{"key":"e_1_2_1_59_1","volume-title":"Learning Design Semantics for Mobile Apps. In The 31st Annual ACM Symposium on User Interface Software and Technology","author":"Liu Thomas F.","year":"2018","unstructured":"Thomas F. Liu , Mark Craft , Jason Situ , Ersin Yumer , Radomir Mech , and Ranjitha Kumar . 2018 . Learning Design Semantics for Mobile Apps. In The 31st Annual ACM Symposium on User Interface Software and Technology ( Berlin, Germany) (UIST '18). ACM, New York, NY, USA, 569--579. https:\/\/doi.org\/10.1145\/3242587.3242650 10.1145\/3242587.3242650 Thomas F. Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018. Learning Design Semantics for Mobile Apps. In The 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). ACM, New York, NY, USA, 569--579. https:\/\/doi.org\/10.1145\/3242587.3242650"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/964442.964462"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501709.3544280"},{"key":"e_1_2_1_62_1","volume-title":"What You Need To Know About Statistics","author":"Maxwell Katrina","unstructured":"Katrina Maxwell . 2006. What You Need To Know About Statistics . In Web Engineering, Emilia Mendes and Nile Mosley (Eds.). Springer , 365--408. https:\/\/doi.org\/10.1007\/3--540--28218--1_12 10.1007\/3--540--28218--1_12 Katrina Maxwell. 2006. What You Need To Know About Statistics. In Web Engineering, Emilia Mendes and Nile Mosley (Eds.). Springer, 365--408. https:\/\/doi.org\/10.1007\/3--540--28218--1_12"},{"key":"e_1_2_1_63_1","volume-title":"Applied Statistics for Software Managers","author":"Maxwell Katrina D.","unstructured":"Katrina D. Maxwell . 2002. Applied Statistics for Software Managers . Prentice Hall , Upper Saddle River, NJ, USA. https:\/\/cir.nii.ac.jp\/crid\/1573668924056253312 Katrina D. Maxwell. 2002. Applied Statistics for Software Managers. Prentice Hall, Upper Saddle River, NJ, USA. https:\/\/cir.nii.ac.jp\/crid\/1573668924056253312"},{"key":"e_1_2_1_64_1","volume-title":"The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol 7 (07","author":"McCarney Rob","year":"2007","unstructured":"Rob McCarney , James Warner , Steve Iliffe , Robbert van Haselen , Mark Griffin , and Peter Fisher . 2007. The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol 7 (07 2007 ), 119--142. Issue 30. https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/1471--2288--7--30 Rob McCarney, James Warner, Steve Iliffe, Robbert van Haselen, Mark Griffin, and Peter Fisher. 2007. The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol 7 (07 2007), 119--142. Issue 30. https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/1471--2288--7--30"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124959"},{"key":"e_1_2_1_66_1","volume-title":"Are Sixteen Heads Really Better than One? CoRR abs\/1905.10650","author":"Michel Paul","year":"2019","unstructured":"Paul Michel , Omer Levy , and Graham Neubig . 2019. Are Sixteen Heads Really Better than One? CoRR abs\/1905.10650 ( 2019 ). arXiv:1905.10650 http:\/\/arxiv.org\/abs\/1905.10650 Paul Michel, Omer Levy, and Graham Neubig. 2019. Are Sixteen Heads Really Better than One? CoRR abs\/1905.10650 (2019). arXiv:1905.10650 http:\/\/arxiv.org\/abs\/1905.10650"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2000.855856"},{"key":"e_1_2_1_68_1","unstructured":"Erik Nijkamp Bo Pang Hiroaki Hayashi Lifu Tu Huan Wang Yingbo Zhou Silvio Savarese and Caiming Xiong. 2022. CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis. https:\/\/doi.org\/10.  Erik Nijkamp Bo Pang Hiroaki Hayashi Lifu Tu Huan Wang Yingbo Zhou Silvio Savarese and Caiming Xiong. 2022. CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis. https:\/\/doi.org\/10."},{"key":"e_1_2_1_69_1","first-page":"7","article-title":"Psychometric theory-25 years ago and now","volume":"4","author":"Nunnally Jum C","year":"1975","unstructured":"Jum C Nunnally . 1975 . Psychometric theory-25 years ago and now . Educational Researcher 4 , 10 (1975), 7 -- 21 . Jum C Nunnally. 1975. Psychometric theory-25 years ago and now. Educational Researcher 4, 10 (1975), 7--21.","journal-title":"Educational Researcher"},{"key":"e_1_2_1_70_1","volume-title":"Ellen Jiang, Henryk Michalewski, Jacob Austin, Maarten Paul Bosma, Maxwell Nye, Michael Terry, and Quoc V. Le.","author":"Odena Augustus","year":"2021","unstructured":"Augustus Odena , Charles Sutton , David Martin Dohan , Ellen Jiang, Henryk Michalewski, Jacob Austin, Maarten Paul Bosma, Maxwell Nye, Michael Terry, and Quoc V. Le. 2021 . Program Synthesis with Large Language Models . https:\/\/research.google\/pubs\/pub50670\/ Augustus Odena, Charles Sutton, David Martin Dohan, Ellen Jiang, Henryk Michalewski, Jacob Austin, Maarten Paul Bosma, Maxwell Nye, Michael Terry, and Quoc V. Le. 2021. Program Synthesis with Large Language Models. https:\/\/research.google\/pubs\/pub50670\/"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3266037.3266087"},{"key":"e_1_2_1_72_1","volume-title":"Xiaojun Bi, and Andrew Howes.","author":"Oulasvirta Antti","year":"2018","unstructured":"Antti Oulasvirta , Per Ola Kristensson , Xiaojun Bi, and Andrew Howes. 2018 . Computational Interaction. Oxford University Press , Oxford, UK. https:\/\/doi.org\/10.1093\/oso\/9780198799603.001.0001 10.1093\/oso Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, and Andrew Howes. 2018. Computational Interaction. Oxford University Press, Oxford, UK. https:\/\/doi.org\/10.1093\/oso\/9780198799603.001.0001"},{"key":"e_1_2_1_73_1","volume-title":"PyTorch: An Imperative Style","author":"Paszke Adam","unstructured":"Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , Alban Desmaison , Andreas Kopf , Edward Yang , Zachary DeVito , Martin Raison , Alykhan Tejani , Sasank Chilamkurthy , Benoit Steiner , Lu Fang , Junjie Bai , and Soumith Chintala . 2019. PyTorch: An Imperative Style , High-Performance Deep Learning Library . In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024-- 8035. http:\/\/papers.neurips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024-- 8035. http:\/\/papers.neurips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf"},{"key":"e_1_2_1_74_1","volume-title":"Deep contextualized word representations. CoRR abs\/1802.05365","author":"Peters Matthew E.","year":"2018","unstructured":"Matthew E. Peters , Mark Neumann , Mohit Iyyer , Matt Gardner , Christopher Clark , Kenton Lee , and Luke Zettlemoyer . 2018. Deep contextualized word representations. CoRR abs\/1802.05365 ( 2018 ). arXiv:1802.05365 http:\/\/arxiv.org\/abs\/ 1802.05365 Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. CoRR abs\/1802.05365 (2018). arXiv:1802.05365 http:\/\/arxiv.org\/abs\/ 1802.05365"},{"key":"e_1_2_1_75_1","volume-title":"Generative Language Modeling for Automated Theorem Proving. arXiv preprint arXiv:2009.03393","author":"Polu Stanislas","year":"2020","unstructured":"Stanislas Polu and Ilya Sutskever . 2020. Generative Language Modeling for Automated Theorem Proving. arXiv preprint arXiv:2009.03393 ( 2020 ). Stanislas Polu and Ilya Sutskever. 2020. Generative Language Modeling for Automated Theorem Proving. arXiv preprint arXiv:2009.03393 (2020)."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1502650.1502698"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070525"},{"key":"e_1_2_1_78_1","volume-title":"Lessons Learned amp","author":"Rethmeier Nils","year":"2022","unstructured":"Nils Rethmeier and Isabelle Augenstein . 2022. A Primer on Contrastive Pretraining in Language Processing: Methods , Lessons Learned amp ; Perspectives. ACM Comput. Surv. (aug 2022 ). https:\/\/doi.org\/10.1145\/3561970 Just Accepted . 10.1145\/3561970 Nils Rethmeier and Isabelle Augenstein. 2022. A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned amp; Perspectives. ACM Comput. Surv. (aug 2022). https:\/\/doi.org\/10.1145\/3561970 Just Accepted."},{"key":"e_1_2_1_79_1","volume-title":"Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology","author":"Ritchie Daniel","year":"2047","unstructured":"Daniel Ritchie , Ankita Arvind Kejriwal , and Scott R. Klemmer . 2011. D.Tour: Style-Based Exploration of Design Example Galleries . In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology ( Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 165--174. https:\/\/doi.org\/10.1145\/ 2047 196.2047216 10.1145\/2047196.2047216 Daniel Ritchie, Ankita Arvind Kejriwal, and Scott R. Klemmer. 2011. D.Tour: Style-Based Exploration of Design Example Galleries. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 165--174. https:\/\/doi.org\/10.1145\/2047196.2047216"},{"key":"e_1_2_1_80_1","volume-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces","author":"Ross Steven I.","unstructured":"Steven I. Ross , Fernando Martinez , Stephanie Houde , Michael Muller , and Justin D. Weisz . 2023. The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Development . In Proceedings of the 28th International Conference on Intelligent User Interfaces ( Sydney, NSW, Australia) (IUI '23). Association for Computing Machinery, New York, NY, USA, 491--514. https:\/\/doi.org\/10.1145\/3581641.3584037 10.1145\/3581641.3584037 Steven I. Ross, Fernando Martinez, Stephanie Houde, Michael Muller, and Justin D. Weisz. 2023. The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Development. In Proceedings of the 28th International Conference on Intelligent User Interfaces (Sydney, NSW, Australia) (IUI '23). Association for Computing Machinery, New York, NY, USA, 491--514. https:\/\/doi.org\/10.1145\/3581641.3584037"},{"key":"e_1_2_1_81_1","volume-title":"Effects of Image Size on Deep Learning. Electronics 12, 4","author":"Rukundo Olivier","year":"2023","unstructured":"Olivier Rukundo . 2023. Effects of Image Size on Deep Learning. Electronics 12, 4 ( 2023 ). https:\/\/doi.org\/10.3390\/ electronics12040985 Olivier Rukundo. 2023. Effects of Image Size on Deep Learning. Electronics 12, 4 (2023). https:\/\/doi.org\/10.3390\/ electronics12040985"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318013"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501385.3543957"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502098"},{"key":"e_1_2_1_85_1","unstructured":"Martin Schrepp. 2018. User Experience mit Frageb\u00f6gen messen. Amazon CreateSpace. https:\/\/www.amazon.de\/User- Experience-mit-Frageb\u00f6gen-messen\/dp\/1986843769.  Martin Schrepp. 2018. User Experience mit Frageb\u00f6gen messen. Amazon CreateSpace. https:\/\/www.amazon.de\/User- Experience-mit-Frageb\u00f6gen-messen\/dp\/1986843769."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.9781\/ijimai.2017.445"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.9781\/ijimai.2019.06.006"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3498471"},{"key":"e_1_2_1_89_1","volume-title":"27th International Conference on Intelligent User Interfaces","author":"Sun Jiao","unstructured":"Jiao Sun , Q. Vera Liao , Michael Muller , Mayank Agarwal , Stephanie Houde , Kartik Talamadupula , and Justin D. Weisz . 2022. Investigating Explainability of Generative AI for Code through Scenario-Based Design . In 27th International Conference on Intelligent User Interfaces ( Helsinki, Finland) (IUI '22). Association for Computing Machinery, New York, NY, USA, 212--228. https:\/\/doi.org\/10.1145\/3490099.3511119 10.1145\/3490099.3511119 Jiao Sun, Q. Vera Liao, Michael Muller, Mayank Agarwal, Stephanie Houde, Kartik Talamadupula, and Justin D. Weisz. 2022. Investigating Explainability of Generative AI for Code through Scenario-Based Design. In 27th International Conference on Intelligent User Interfaces (Helsinki, Finland) (IUI '22). Association for Computing Machinery, New York, NY, USA, 212--228. https:\/\/doi.org\/10.1145\/3490099.3511119"},{"key":"e_1_2_1_91_1","volume-title":"Ko","author":"Swearngin Amanda","year":"2018","unstructured":"Amanda Swearngin , Mira Dontcheva , Wilmot Li , Joel Brandt , Morgan Dixon , and Andrew J . Ko . 2018 . Rewire : Interface Design Assistance from Examples. Association for Computing Machinery , New York, NY, USA, 1--12. https:\/\/doi.org\/10.1145\/3173574.3174078 10.1145\/3173574.3174078 Amanda Swearngin, Mira Dontcheva, Wilmot Li, Joel Brandt, Morgan Dixon, and Andrew J. Ko. 2018. Rewire: Interface Design Assistance from Examples. Association for Computing Machinery, New York, NY, USA, 1--12. https:\/\/doi.org\/10.1145\/3173574.3174078"},{"key":"e_1_2_1_92_1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Swearngin Amanda","unstructured":"Amanda Swearngin , ChenglongWang, Alannah Oleson , James Fogarty , and Amy J. Ko . 2020. Scout: Rapid Exploration of Interface Layout Alternatives through High-Level Design Constraints . In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems ( Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https:\/\/doi.org\/10.1145\/3313831.3376593 10.1145\/3313831.3376593 Amanda Swearngin, ChenglongWang, Alannah Oleson, James Fogarty, and Amy J. Ko. 2020. Scout: Rapid Exploration of Interface Layout Alternatives through High-Level Design Constraints. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https:\/\/doi.org\/10.1145\/3313831.3376593"},{"key":"e_1_2_1_93_1","volume-title":"Yuen","author":"Tan Yun Yi","year":"2015","unstructured":"Yun Yi Tan and Allan H. K . Yuen . 2015 . ?Destuckification\": Use of Social Media for Enhancing Design Practices. In New Media, Knowledge Practices and Multiliteracies, Will W.K. Ma, Allan H.K. Yuen, Jae Park, Wilfred W.F. Lau, and Liping Deng (Eds.). Springer Singapore , Singapore, 67--75. Yun Yi Tan and Allan H. K. Yuen. 2015. ?Destuckification\": Use of Social Media for Enhancing Design Practices. In New Media, Knowledge Practices and Multiliteracies, Will W.K. Ma, Allan H.K. Yuen, Jae Park, Wilfred W.F. Lau, and Liping Deng (Eds.). Springer Singapore, Singapore, 67--75."},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445497"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901817"},{"key":"e_1_2_1_96_1","volume-title":"Commerce Department and Statistical Engineering Division Technology","author":"National Institute of Standards U.S.","year":"2017","unstructured":"National Institute of Standards U.S. Commerce Department and Statistical Engineering Division Technology . 2017 . Cosine Distance, Cosine Similarity , Angular Cosine Distance, Angular Cosine Similarity . https:\/\/www.itl.nist.gov\/ div898\/software\/dataplot\/refman2\/auxillar\/cosdist.htmm National Institute of Standards U.S. Commerce Department and Statistical Engineering Division Technology. 2017. Cosine Distance, Cosine Similarity, Angular Cosine Distance, Angular Cosine Similarity. https:\/\/www.itl.nist.gov\/ div898\/software\/dataplot\/refman2\/auxillar\/cosdist.htmm"},{"key":"e_1_2_1_97_1","volume-title":"Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA '22). Association for Computing Machinery","author":"Vaithilingam Priyan","year":"1966","unstructured":"Priyan Vaithilingam , Tianyi Zhang , and Elena L. Glassman . 2022. Expectation vs.nbsp;Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models . In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA '22). Association for Computing Machinery , New York, NY, USA, Article 332, 7 pages. https:\/\/doi.org\/10.1145\/3491101.35 1966 5 10.1145\/3491101.3519665 Priyan Vaithilingam, Tianyi Zhang, and Elena L. Glassman. 2022. Expectation vs.nbsp;Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA '22). Association for Computing Machinery, New York, NY, USA, Article 332, 7 pages. https:\/\/doi.org\/10.1145\/3491101.3519665"},{"key":"e_1_2_1_98_1","volume-title":"An Experimental Comparison. In IEEE\/WIC\/ACM International Conference on Web Intelligence and Intelligent Agent Technology","author":"Vromman Flore Vancompernolle","year":"2021","unstructured":"Flore Vancompernolle Vromman and Fran\u00e7ois Fouss . 2021 . Filter Bubbles Created by Collaborative Filtering Algorithms Themselves, Fact or Fiction? An Experimental Comparison. In IEEE\/WIC\/ACM International Conference on Web Intelligence and Intelligent Agent Technology ( Melbourne, VIC, Australia) (WI-IAT '21). Association for Computing Machinery, New York, NY, USA, 153--159. https:\/\/doi.org\/10.1145\/3498851.3498945 10.1145\/3498851.3498945 Flore Vancompernolle Vromman and Fran\u00e7ois Fouss. 2021. Filter Bubbles Created by Collaborative Filtering Algorithms Themselves, Fact or Fiction? An Experimental Comparison. In IEEE\/WIC\/ACM International Conference on Web Intelligence and Intelligent Agent Technology (Melbourne, VIC, Australia) (WI-IAT '21). Association for Computing Machinery, New York, NY, USA, 153--159. https:\/\/doi.org\/10.1145\/3498851.3498945"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511600821.011"},{"key":"e_1_2_1_100_1","volume-title":"Proceeding of Annual Conference on Neural Information Processing Systems - Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017 . Attention is All you Need . In Proceeding of Annual Conference on Neural Information Processing Systems - Advances in Neural Information Processing Systems ( Long Beach, CA, USA), Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 5998--6008. http:\/\/papers.nips.cc\/paper\/7181-attention-is-all-you-need Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Proceeding of Annual Conference on Neural Information Processing Systems - Advances in Neural Information Processing Systems (Long Beach, CA, USA), Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 5998--6008. http:\/\/papers.nips.cc\/paper\/7181-attention-is-all-you-need"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5446"},{"key":"e_1_2_1_102_1","volume-title":"Workshop on Human-AI Co-Creation with Generative Models HAI-GEN '23","author":"Weisz Justin D.","year":"2023","unstructured":"Justin D. Weisz , Michael Muller , Jessica He , and Stephanie Houde . 2023 . Toward General Design Principles for Generative AI Applications. https:\/\/doi.org\/10.48550\/ARXIV.2301.05578 Submitted to the 4th Int . Workshop on Human-AI Co-Creation with Generative Models HAI-GEN '23 . 10.48550\/ARXIV.2301.05578 Justin D. Weisz, Michael Muller, Jessica He, and Stephanie Houde. 2023. Toward General Design Principles for Generative AI Applications. https:\/\/doi.org\/10.48550\/ARXIV.2301.05578 Submitted to the 4th Int. Workshop on Human-AI Co-Creation with Generative Models HAI-GEN '23."},{"key":"e_1_2_1_103_1","volume-title":"Empirical Methods and Studies in Software Engineering","author":"Wohlin Claes","unstructured":"Claes Wohlin , Martin H\u00f6st , and Kennet Henningsson . 2003. Empirical Research Methods in Software Engineering . In Empirical Methods and Studies in Software Engineering . Springer Berlin Heidelberg , 7--23. https:\/\/doi.org\/10.1007\/978- 3--540--45143--3_2 10.1007\/978- Claes Wohlin, Martin H\u00f6st, and Kennet Henningsson. 2003. Empirical Research Methods in Software Engineering. In Empirical Methods and Studies in Software Engineering. Springer Berlin Heidelberg, 7--23. https:\/\/doi.org\/10.1007\/978- 3--540--45143--3_2"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447526.3472048"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2857768"},{"key":"e_1_2_1_107_1","volume-title":"Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09)","author":"Yeh Tom","unstructured":"Tom Yeh , Tsung-Hsiang Chang , and Robert C. Miller . 2009. Sikuli: Using GUI Screenshots for Search and Automation . In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09) . Association for Computing Machinery, New York, NY, USA, 183--192. https:\/\/doi.org\/10.1145\/1622176.1622213 10.1145\/1622176.1622213 Tom Yeh, Tsung-Hsiang Chang, and Robert C. Miller. 2009. Sikuli: Using GUI Screenshots for Search and Automation. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09). Association for Computing Machinery, New York, NY, USA, 183--192. https:\/\/doi.org\/10.1145\/1622176.1622213"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1109\/RCIS.2014.6861050"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3593230","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3593230","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:20Z","timestamp":1750178240000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3593230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,14]]},"references-count":107,"journal-issue":{"issue":"EICS","published-print":{"date-parts":[[2023,6,14]]}},"alternative-id":["10.1145\/3593230"],"URL":"https:\/\/doi.org\/10.1145\/3593230","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,14]]},"assertion":[{"value":"2023-06-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}