{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:36:25Z","timestamp":1791459385625,"version":"4.3.4"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:00:00Z","timestamp":1750291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/publication-rights-and-licensing-policy"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>Declarative UI frameworks have gained widespread adoption in mobile app development, offering benefits such as improved code readability and easier maintenance. Despite these advantages, the process of translating UI designs into functional code remains challenging and time-consuming. Recent advancements in multimodal large language models (MLLMs) have shown promise in directly generating mobile app code from user interface (UI) designs. However, the direct application of MLLMs to this task is limited by challenges in accurately recognizing UI components and comprehensively capturing interaction logic.<\/jats:p>\n                  <jats:p>\n                    To address these challenges, we propose\n                    <jats:sc>DeclarUI,<\/jats:sc>\n                    an automated approach that synergizes computer vision (CV), MLLMs, and iterative compiler-driven optimization to generate and refine declarative UI code from designs.\n                    <jats:sc>DeclarUI<\/jats:sc>\n                    enhances visual fidelity, functional completeness, and code quality through precise component segmentation, Page Transition Graphs (PTGs) for modeling complex inter-page relationships, and iterative optimization. In our evaluation,\n                    <jats:sc>DeclarUI<\/jats:sc>\n                    outperforms baselines on React Native, a widely adopted declarative UI framework, achieving a 96.8% PTG coverage rate and a 98% compilation success rate. Notably,\n                    <jats:sc>DeclarUI<\/jats:sc>\n                    demonstrates significant improvements over state-of-the-art MLLMs, with a 123% increase in PTG coverage rate, up to 55% enhancement in visual similarity scores, and a 29% boost in compilation success rate. We further demonstrate\n                    <jats:sc>DeclarUI\u2019<\/jats:sc>\n                    s generalizability through successful applications to Flutter and ArkUI frameworks. User studies with professional developers confirm that\n                    <jats:sc>DeclarUI\u2019<\/jats:sc>\n                    s generated code meets industrial-grade standards in code availability, modification time, readability, and maintainability. By streamlining app development, improving efficiency, and fostering designer-developer collaboration,\n                    <jats:sc>DeclarUI<\/jats:sc>\n                    offers a practical solution to the persistent challenges in mobile UI development.\n                  <\/jats:p>","DOI":"10.1145\/3715726","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T11:16:02Z","timestamp":1750331762000},"page":"219-241","source":"Crossref","is-referenced-by-count":22,"title":["DeclarUI: Bridging Design and Development with Automated Declarative UI Code Generation"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4367-8299","authenticated-orcid":false,"given":"Ting","family":"Zhou","sequence":"first","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8793-5367","authenticated-orcid":false,"given":"Yanjie","family":"Zhao","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9965-2109","authenticated-orcid":false,"given":"Xinyi","family":"Hou","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7434-0452","authenticated-orcid":false,"given":"Xiaoyu","family":"Sun","sequence":"additional","affiliation":[{"name":"Australian National University, Canberra, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6030-0481","authenticated-orcid":false,"given":"Kai","family":"Chen","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1100-8633","authenticated-orcid":false,"given":"Haoyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"Anthropic Claude 3.5. [n. d.]. Introducing Claude 3.5 Sonnet | Anthropic. https:\/\/www.anthropic.com\/news\/claude-3-5-sonnet"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2303.09128"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10462-023-10631-Z"},{"key":"e_1_3_1_5_2","unstructured":"Tony Beltramelli. 2017. pix2code: Generating Code from a Graphical User Interface Screenshot. CoRR abs\/1705.07962 (2017). arXiv:1705.07962 http:\/\/arxiv.org\/abs\/1705.07962"},{"key":"e_1_3_1_6_2","doi-asserted-by":"crossref","unstructured":"Bo Cai Jian Luo and Zhen Feng. 2023. A novel code generator for graphical user interfaces. Scientific Reports 13 (2023). https:\/\/api.semanticscholar.org\/CorpusID:265349539","DOI":"10.1038\/s41598-023-46500-6"},{"key":"e_1_3_1_7_2","unstructured":"Jinyuan Chang Jing He Jian Kang and Mingcong Wu. 2023. Statistical inferences for complex dependence of multimodal imaging data. arXiv:2303.03582 [stat.ME] https:\/\/arxiv.org\/abs\/2303.03582"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180240"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","unstructured":"Fuxiang Chen Fatemeh H. Fard David Lo and Timofey Bryksin. 2022. On the Transferability of Pre-trained Language Models for Low-Resource Programming Languages. CoRR abs\/2204.09653 (2022). doi:10.48550\/ARXIV.2204.09653 arXiv:2204.09653","DOI":"10.48550\/ARXIV.2204.09653"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502073"},{"key":"e_1_3_1_11_2","unstructured":"Jieshan Chen Mulong Xie Zhenchang Xing Chunyang Chen Xiwei Xu Liming Zhu and Guoqiang Li. 2020. Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?. CoRR abs\/2008.05132 (2020). arXiv:2008.05132 https:\/\/arxiv.org\/abs\/2008.05132"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","unstructured":"Liuqing Chen Yunnong Chen Shuhong Xiao Yaxuan Song Lingyun Sun Yankun Zhen Tingting Zhou and Yan-fang Chang. 2023. EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning. CoRR abs\/2309.09867 (2023). doi:10.48550\/ARXIV.2309.09867 arXiv:2309.09867","DOI":"10.48550\/ARXIV.2309.09867"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","unstructured":"Liguo Chen Qi Guo Hongrui Jia Zhengran Zeng Xin Wang Yijiang Xu Jian Wu Yidong Wang Qing Gao Jindong Wang Wei Ye and Shikun Zhang. 2024. A Survey on Evaluating Large Language Models in Code Generation Tasks. CoRR abs\/2408.16498 (2024). doi:10.48550\/ARXIV.2408.16498 arXiv:2408.16498","DOI":"10.48550\/ARXIV.2408.16498"},{"key":"e_1_3_1_14_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pond\u00e9 de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman Alex Ray Raul Puri Gretchen Krueger Michael Petrov Heidy Khlaaf Girish Sastry Pamela Mishkin Brooke Chan Scott Gray Nick Ryder Mikhail Pavlov Alethea Power Lukasz Kaiser Mohammad Bavarian Clemens Winter Philippe Tillet Felipe Petroski Such Dave Cummings Matthias Plappert Fotios Chantzis Elizabeth Barnes Ariel Herbert-Voss William Hebgen Guss Alex Nichol Alex Paino Nikolas Tezak Jie Tang Igor Babuschkin Suchir Balaji Shantanu Jain William Saunders Christopher Hesse Andrew N. Carr Jan Leike Joshua Achiam Vedant Misra Evan Morikawa Alec Radford Matthew Knight Miles Brundage Mira Murati Katie Mayer Peter Welinder Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever and Wojciech Zaremba. 2021. Evaluating Large Language Models Trained on Code. CoRR abs\/2107.03374 (2021). arXiv:2107.03374 https:\/\/arxiv.org\/abs\/2107.03374"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/S00530-021-00804-7"},{"issue":"9","key":"e_1_3_1_16_2","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.3897\/jucs.2020.058","article-title":"Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques","volume":"26","author":"Baul\u00e9 Daniel de Souza","year":"2020","unstructured":"Daniel de Souza Baul\u00e9, Christiane Gresse von Wangenheim, Aldo von Wangenheim, and Jean C. R. Hauck. 2020. Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques. J. Univers. Comput. Sci. 26, 9 (2020), 1095\u20131127. http:\/\/www.jucs.org\/jucs_26_9\/recent_progress_in_automated","journal-title":"J. Univers. Comput. Sci."},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","unstructured":"Meghdad Dehghan Jie JW Wu Fatemeh H. Fard and Ali Ouni. 2024. MergeRepair: An Exploratory Study on Merging Task-Specific Adapters in Code LLMs for Automated Program Repair. CoRR abs\/2408.09568 (2024). doi:10.48550\/ARXIV.2408.09568 arXiv:2408.09568 .","DOI":"10.48550\/ARXIV.2408.09568"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","unstructured":"Jiangyi Deng Xinfeng Li Yanjiao Chen Yijie Bai Haiqin Weng Yan Liu Tao Wei and Wenyuan Xu. 2024. RACONTEUR: A Knowledgeable Insightful and Portable LLM-Powered Shell Command Explainer. CoRR abs\/2409.02074 (2024). doi:10.48550\/ARXIV.2409.02074 arXiv:2409.02074","DOI":"10.48550\/ARXIV.2409.02074"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","unstructured":"Yihong Dong Xue Jiang Zhi Jin and Ge Li. 2023. Self-collaboration Code Generation via ChatGPT. CoRR abs\/2304.07590 (2023). doi:10.48550\/ARXIV.2304.07590 arXiv:2304.07590","DOI":"10.48550\/ARXIV.2304.07590"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3637528.3671470"},{"key":"e_1_3_1_21_2","unstructured":"Figma. 2024. Figma: Collaborative Interface Design Tool. https:\/\/www.figma.com\/ Accessed: 2024-09-05."},{"key":"e_1_3_1_22_2","unstructured":"Flatirons. 2024. Popularity of Flutter vs. React Native in 2024. https:\/\/flatirons.com\/blog\/popularity-of-flutter-vs-react-native-2024\/ Accessed: 2024-09-05."},{"key":"e_1_3_1_23_2","unstructured":"Flutter. 2024. User Interface (UI) in Flutter. https:\/\/docs.flutter.dev\/ui Accessed: 2024-09-05."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","unstructured":"Shuzheng Gao Xin-Cheng Wen Cuiyun Gao Wenxuan Wang and Michael R. Lyu. 2023. Constructing Effective In-Context Demonstration for Code Intelligence Tasks: An Empirical Study. CoRR abs\/2304.07575 (2023). doi:10.48550\/ARXIV.2304.07575 arXiv:2304.07575","DOI":"10.48550\/ARXIV.2304.07575"},{"key":"e_1_3_1_25_2","unstructured":"Google Play Store. 2024. Amazon Shopping. https:\/\/play.google.com\/store\/apps\/details?id=com.amazon.mShop.android.shopping&hl=en Accessed: 2024-09-05."},{"key":"e_1_3_1_26_2","unstructured":"Google Play Store. 2024. Google Play Store: Apps Section. https:\/\/play.google.com\/store\/apps?hl=en Accessed: 2024-09-05."},{"key":"e_1_3_1_27_2","unstructured":"Google Play Store. 2024. Lazada - Online Shopping App. https:\/\/play.google.com\/store\/apps\/details?id=com.lazada.android&hl=en Accessed: 2024-09-05."},{"key":"e_1_3_1_28_2","unstructured":"Jian Gu Pasquale Salza and Harald C. Gall. 2022. Assemble Foundation Models for Automatic Code Summarization. CoRR abs\/2201.05222 (2022). arXiv:2201.05222 https:\/\/arxiv.org\/abs\/2201.05222"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","unstructured":"Yi Gui Zhen Li Yao Wan Yemin Shi Hongyu Zhang Yi Su Shaoling Dong Xing Zhou and Wenbin Jiang. 2024. VISION2UI: A Real-World Dataset with Layout for Code Generation from UI Designs. CoRR abs\/2404.06369 (2024). doi:10.48550\/ARXIV.2404.06369 arXiv:2404.06369","DOI":"10.48550\/ARXIV.2404.06369"},{"key":"e_1_3_1_30_2","unstructured":"Huawei. 2024. ArkUI Overview: HarmonyOS. https:\/\/developer.huawei.com\/consumer\/cn\/doc\/harmonyos-guides-V5\/arkui-overview-V5 Accessed: 2024-09-05."},{"key":"e_1_3_1_31_2","unstructured":"Increment. 2024. The Shift to Declarative UI. https:\/\/increment.com\/mobile\/the-shift-to-declarative-ui\/ Accessed: 2024-09-05."},{"key":"e_1_3_1_32_2","unstructured":"Vanita Jain Piyush Agrawal Subham Banga Rishabh Kapoor and Shashwat Gulyani. 2019. Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Network. CoRR abs\/1910.08930 (2019). arXiv:1910.08930 http:\/\/arxiv.org\/abs\/1910.08930"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","unstructured":"Juyong Jiang Fan Wang Jiasi Shen Sungju Kim and Sunghun Kim. 2024. A Survey on Large Language Models for Code Generation. CoRR abs\/2406.00515 (2024). doi:10.48550\/ARXIV.2406.00515 arXiv:2406.00515","DOI":"10.48550\/ARXIV.2406.00515"},{"key":"e_1_3_1_34_2","unstructured":"Dharma KC and Clayton T. Morrison. 2023. Neural Machine Translation for Code Generation. arXiv:2305.13504 [cs.CL] https:\/\/arxiv.org\/abs\/2305.13504"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","unstructured":"Alexander Kirillov Eric Mintun Nikhila Ravi Hanzi Mao Chlo\u00e9 Rolland Laura Gustafson Tete Xiao Spencer Whitehead Alexander C. Berg Wan-Yen Lo Piotr Doll\u00e1r and Ross B. Girshick. 2023. Segment Anything. CoRR abs\/2304.02643 (2023). doi:10.48550\/ARXIV.2304.02643 arXiv:2304.02643","DOI":"10.48550\/ARXIV.2304.02643"},{"key":"e_1_3_1_36_2","article-title":"A Multimodal Deep Learning Model Using Text, Image, and Code Data for Improving Issue Classification Tasks","author":"Kwak Changwon","year":"2023","unstructured":"Changwon Kwak, Pilsu Jung, and Seonah Lee. 2023. A Multimodal Deep Learning Model Using Text, Image, and Code Data for Improving Issue Classification Tasks. Applied Sciences (2023). https:\/\/api.semanticscholar.org\/CorpusID:261157795","journal-title":"Applied Sciences"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-C.2017.8"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","unstructured":"Dongyang Liu Shitian Zhao Le Zhuo Weifeng Lin Yu Qiao Hongsheng Li and Peng Gao. 2024. Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining. CoRR abs\/2408.02657 (2024). doi:10.48550\/ARXIV.2408.02657 arXiv:2408.02657","DOI":"10.48550\/ARXIV.2408.02657"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","unstructured":"Shilong Liu Zhaoyang Zeng Tianhe Ren Feng Li Hao Zhang Jie Yang Chunyuan Li Jianwei Yang Hang Su Jun Zhu and Lei Zhang. 2023. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection. CoRR abs\/2303.05499 (2023). doi:10.48550\/ARXIV.2303.05499 arXiv:2303.05499","DOI":"10.48550\/ARXIV.2303.05499"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","unstructured":"Yizhou Liu Pengfei Gao Xinchen Wang Jie Liu Yexuan Shi Zhao Zhang and Chao Peng. 2024. MarsCode Agent: AI-native Automated Bug Fixing. CoRR abs\/2409.00899 (2024). doi:10.48550\/ARXIV.2409.00899 arXiv:2409.00899","DOI":"10.48550\/ARXIV.2409.00899"},{"key":"e_1_3_1_41_2","unstructured":"Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy Ambrosio Blanco Colin B. Clement Dawn Drain Daxin Jiang Duyu Tang Ge Li Lidong Zhou Linjun Shou Long Zhou Michele Tufano Ming Gong Ming Zhou Nan Duan Neel Sundaresan Shao Kun Deng Shengyu Fu and Shujie Liu. 2021. CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. CoRR abs\/2102.04664 (2021). arXiv:2102.04664 https:\/\/arxiv.org\/abs\/2102.04664"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461353.3461388"},{"key":"e_1_3_1_43_2","unstructured":"MobileAppDaily. 2024. Mobile App Development Process: Step-by-Step Guide. https:\/\/www.mobileappdaily.com\/knowledge-hub\/mobile-app-development-process Accessed: 2024-09-05."},{"key":"e_1_3_1_44_2","unstructured":"Yun nong Chen Yan kun Zhen Chu ning Shi Jia zhi Li Liu qing Chen Ze jian Li Ling yun Sun Ting ting Zhou and Yan fang Chang. 2022. UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior. arXiv:2206.13389 [cs.CV] https:\/\/arxiv.org\/abs\/2206.13389"},{"key":"e_1_3_1_45_2","unstructured":"OpenAI. [n. d.]. Hello GPT-4o | OpenAI. https:\/\/openai.com\/index\/hello-gpt-4o\/"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","unstructured":"Ciyuan Peng Feng Xia Mehdi Naseriparsa and Francesco Osborne. 2023. Knowledge Graphs: Opportunities and Challenges. CoRR abs\/2303.13948 (2023). doi:10.48550\/ARXIV.2303.13948 arXiv:2303.13948","DOI":"10.48550\/ARXIV.2303.13948"},{"key":"e_1_3_1_47_2","unstructured":"Aditya Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen and Ilya Sutskever. 2021. Zero-Shot Text-to-Image Generation. CoRR abs\/2102.12092 (2021). arXiv:2102.12092 https:\/\/arxiv.org\/abs\/2102.12092"},{"key":"e_1_3_1_48_2","unstructured":"React Native. 2024. Getting Started with React Native. https:\/\/reactnative.dev\/docs\/getting-started Accessed: 2024-09-05."},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","unstructured":"Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang Emily Denton Seyed Kamyar Seyed Ghasemipour Burcu Karagol Ayan S. Sara Mahdavi Raphael Gontijo Lopes Tim Salimans Jonathan Ho David J. Fleet and Mohammad Norouzi. 2022. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding. CoRR abs\/2205.11487 (2022). doi:10.48550\/ARXIV.2205.11487 arXiv:2205.11487","DOI":"10.48550\/ARXIV.2205.11487"},{"key":"e_1_3_1_50_2","unstructured":"ScreenshotToCode2024. [n. d.]. Screenshot to Code: Transform Screenshots into Code!. https:\/\/supertools.therundown.ai\/content\/screenshot-to-code"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","unstructured":"Chenglei Si Yanzhe Zhang Zhengyuan Yang Ruibo Liu and Diyi Yang. 2024. Design2Code: How Far Are We From Automating Front-End Engineering?. CoRR abs\/2403.03163 (2024). doi:10.48550\/ARXIV.2403.03163 arXiv:2403.03163","DOI":"10.48550\/ARXIV.2403.03163"},{"key":"e_1_3_1_52_2","unstructured":"The Decoder. 2024. ChatGPT Guide: Effective Prompt Strategies. https:\/\/the-decoder.com\/chatgpt-guide-prompt-strategies\/ Accessed: 2024-09-05."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","unstructured":"Yuxuan Wan Chaozheng Wang Yi Dong Wenxuan Wang Shuqing Li Yintong Huo and Michael R. Lyu. 2024. Automatically Generating UI Code from Screenshot: A Divide-and-Conquer-Based Approach. CoRR abs\/2406.16386 (2024). doi:10.48550\/ARXIV.2406.16386 arXiv:2406.16386","DOI":"10.48550\/ARXIV.2406.16386"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_3_1_55_2","unstructured":"Wolfpack Digital. 2024. Declarative UI: A New Way of Building Mobile Apps. https:\/\/www.wolfpack-digital.com\/blogposts\/declarative-ui-new-way-of-building-mobile-apps Accessed: 2024-09-05."},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","unstructured":"Chenfei Wu Shengming Yin Weizhen Qi Xiaodong Wang Zecheng Tang and Nan Duan. 2023. Visual ChatGPT: Talking Drawing and Editing with Visual Foundation Models. CoRR abs\/2303.04671 (2023). doi:10.48550\/ARXIV.2303.04671 arXiv:2303.04671","DOI":"10.48550\/ARXIV.2303.04671"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","unstructured":"Jason Wu Eldon Schoop Alan Leung Titus Barik Jeffrey P. Bigham and Jeffrey Nichols. 2024. UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback. CoRR abs\/2406.07739 (2024). doi:10.48550\/ARXIV.2406.07739 arXiv:2406.07739","DOI":"10.48550\/ARXIV.2406.07739"},{"key":"e_1_3_1_58_2","unstructured":"Jason Wu Xiaoyi Zhang Jeffrey Nichols and Jeffrey P. Bigham. 2021. Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots. CoRR abs\/2109.08763 (2021). arXiv:2109.08763 https:\/\/arxiv.org\/abs\/2109.08763"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","unstructured":"Shuhong Xiao Yunnong Chen Jiazhi Li Liuqing Chen Lingyun Sun and Tingting Zhou. 2024. Prototype2Code: End-to-end Front-end Code Generation from UI Design Prototypes. CoRR abs\/2405.04975 (2024). doi:10.48550\/ARXIV.2405.04975 arXiv:2405.04975","DOI":"10.48550\/ARXIV.2405.04975"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","unstructured":"Kangwei Xu Grace Li Zhang Xunzhao Yin Cheng Zhuo Ulf Schlichtmann and Bing Li. 2024. Automated C\/C++ Program Repair for High-Level Synthesis via Large Language Models. CoRR abs\/2407.03889 (2024). doi:10.48550\/ARXIV.2407.03889 arXiv:2407.03889","DOI":"10.48550\/ARXIV.2407.03889"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","unstructured":"Boyang Yang Haoye Tian Weiguo Pian Haoran Yu Haitao Wang Jacques Klein Tegawend\u00e9 F. Bissyand\u00e9 and Shunfu Jin. 2024. CREF: An LLM-based Conversational Software Repair Framework for Programming Tutors. CoRR abs\/2406.13972 (2024). doi:10.48550\/ARXIV.2406.13972 arXiv:2406.13972","DOI":"10.48550\/ARXIV.2406.13972"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","unstructured":"Zhengyuan Yang Linjie Li Kevin Lin Jianfeng Wang Chung-Ching Lin Zicheng Liu and Lijuan Wang. 2023. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision). CoRR abs\/2309.17421 (2023). doi:10.48550\/ARXIV.2309.17421 arXiv:2309.17421","DOI":"10.48550\/ARXIV.2309.17421"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715726","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T11:07:55Z","timestamp":1787483275000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715726"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":61,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3715726"],"URL":"https:\/\/doi.org\/10.1145\/3715726","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}