{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T04:10:25Z","timestamp":1773375025876,"version":"3.50.1"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100016860","name":"Open Technology Fund","doi-asserted-by":"publisher","award":["B00236-1220-00"],"award-info":[{"award-number":["B00236-1220-00"]}],"id":[{"id":"10.13039\/100016860","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N000142212111"],"award-info":[{"award-number":["N000142212111"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>Release notes are essential documents that communicate the details of software updates to users and developers, yet their generation remains a time-consuming and error-prone process. In this paper, we present VerLog, a novel technique that enhances the generation of software release notes using Large Language Models (LLMs). VerLog leverages few-shot in-context learning with adaptive prompting to facilitate the graph reasoning capabilities of LLMs, enabling them to accurately interpret and document the semantic information of code changes. Additionally, VerLog incorporates multi-granularity information, including fine-grained code modifications and high-level non-code artifacts, to guide the generation process and ensure comprehensive, accurate, and readable release notes. We applied VerLog to the 42 releases of 248 unique Android applications and conducted extensive evaluations. Our results demonstrate that VerLog significantly (up to 18%\u201321% higher precision, recall, and F1) outperforms state-of-the-art baselines in terms of completeness, accuracy, readability, and overall quality of the generated release notes, in both controlled experiments with high-quality reference release notes and in-the-wild evaluations.<\/jats:p>","DOI":"10.1145\/3728961","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"1910-1932","source":"Crossref","is-referenced-by-count":1,"title":["VerLog: Enhancing Release Note Generation for Android Apps using Large Language Models"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-9134-9307","authenticated-orcid":false,"given":"Jiawei","family":"Guo","sequence":"first","affiliation":[{"name":"University at Buffalo, SUNY, Buffalo, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9298-9757","authenticated-orcid":false,"given":"Haoran","family":"Yang","sequence":"additional","affiliation":[{"name":"Washington State University, Pullman, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5224-9970","authenticated-orcid":false,"given":"Haipeng","family":"Cai","sequence":"additional","affiliation":[{"name":"University at Buffalo, SUNY, Buffalo, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2022. kaputnikgo\/pilfershushjammerm. https:\/\/github.com\/kaputnikGo\/PilferShushJammer"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9377-5"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639183"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/INMIC50486.2020.9318191"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-034-R2"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3279774"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i16.29720"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3038881"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387905.3388612"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330564"},{"key":"e_1_2_1_11_1","volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman.","author":"Chen Mark","year":"2021","unstructured":"Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374."},{"key":"e_1_2_1_12_1","unstructured":"GitHub Changelog Generator Contributors. 2024. GitHub Changelog Generator. https:\/\/github.com\/github-changelog-generator\/github-changelog-generator"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-64171-8_18"},{"key":"e_1_2_1_14_1","unstructured":"F-Droid.org. [n. d.]. F-Droid - free and Open source android app repository. https:\/\/f-droid.org\/en\/"},{"key":"e_1_2_1_15_1","unstructured":"Lishui Fan Jiakun Liu Zhongxin Liu David Lo Xin Xia and Shanping Li. 2024. Exploring the Capabilities of LLMs for Code Change Related Tasks. arxiv:2407.02824 arXiv:2407.02824 [cs]"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3608134"},{"key":"e_1_2_1_17_1","unstructured":"Git SCM. 2024. Git Diff Documentation. https:\/\/git-scm.com\/docs\/git-diff"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00135"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","unstructured":"Jiawei Guo Xiaoqin Fu Li Li Tao Zhang Mattia Fazzini and Haipeng Cai. 2025. Characterizing Installation- and Run-Time Compatibility Issues in Android Benign Apps and Malware. ACM Transactions on Software Engineering and Methodology issn:1049-331X https:\/\/doi.org\/10.1145\/3725810 10.1145\/3725810","DOI":"10.1145\/3725810"},{"key":"e_1_2_1_20_1","volume-title":"Code Speaks Louder: Exploring Security and Privacy Relevant Regional Variations in Mobile Applications. In IEEE Symposium on Security and Privacy (S&P).","author":"Guo Jiawei","year":"2025","unstructured":"Jiawei Guo, Yu Nong, Zhiqiang Lin, and Haipeng Cai. 2025. Code Speaks Louder: Exploring Security and Privacy Relevant Regional Variations in Mobile Applications. In IEEE Symposium on Security and Privacy (S&P)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC53868.2021.00018"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115626"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.597"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2006.02.040"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643760"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616339"},{"key":"e_1_2_1_27_1","unstructured":"Shangqing Liu Yanzhou Li Xiaofei Xie and Yang Liu. 2023. CommitBART: A Large Pre-trained Model for GitHub Commits. arxiv:2208.08100 arXiv:2208.08100 [cs]"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00026"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2015.2465386"},{"key":"e_1_2_1_30_1","unstructured":"Meta. 2024. Introducing Code Llama a State-of-the-Art Large Language Model for Coding. https:\/\/ai.meta.com\/blog\/code-llama-large-language-model-coding\/."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2591536"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639187"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194021400192"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194021400192"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","unstructured":"Sristy Sumana Nath and Banani Roy. 2021. Towards Automatically Generating Release Notes using Extractive Summarization Technique. 241\u2013248. https:\/\/doi.org\/10.18293\/SEKE2021-119 arXiv:2204.05345 [cs] 10.18293\/SEKE2021-119","DOI":"10.18293\/SEKE2021-119"},{"key":"e_1_2_1_36_1","unstructured":"OpenAI. 2024. GPT-4o Mini: Advancing Cost-Efficient Intelligence. https:\/\/openai.com\/index\/gpt-4o-mini-advancing-cost-efficient-intelligence\/"},{"key":"e_1_2_1_37_1","unstructured":"OpenAI. 2025. Hello GPT-4o. https:\/\/openai.com\/index\/hello-gpt-4o\/."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197231.3197251"},{"key":"e_1_2_1_39_1","volume-title":"Manning","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP). 1532\u20131543. http:\/\/www.aclweb.org\/anthology\/D14-1162"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2593882.2593893"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/smr.2657"},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Jiabin Tang Yuhao Yang Wei Wei Lei Shi Lixin Su Suqi Cheng Dawei Yin and Chao Huang. 2024. GraphGPT: Graph Instruction Tuning for Large Language Models. arxiv:2310.13023 arXiv:2310.13023 [cs]","DOI":"10.1145\/3626772.3657775"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510205"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568315"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS \u201923)","author":"Wang Heng","year":"2023","unstructured":"Heng Wang, Shangbin Feng, Tianxing He, Zhaoxuan Tan, Xiaochuang Han, and Yulia Tsvetkov. 2023. Can language models solve graph problems in natural language? In Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS \u201923). Curran Associates Inc., Red Hook, NY, USA. Article 1345, 22 pages. https:\/\/dl.acm.org\/doi\/abs\/10.5555\/3666122.3667467"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","unstructured":"Shengnan Wu Yangfan Zhou and Xin Wang. 2021. Exploring User Experience of Automatic Documentation Tools. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM Yokohama Japan. 1\u20136. isbn:978-1-4503-8095-9 https:\/\/doi.org\/10.1145\/3411763.3451606 10.1145\/3411763.3451606","DOI":"10.1145\/3411763.3451606"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-10086-2"},{"key":"e_1_2_1_48_1","unstructured":"Yue Zhang Yafu Li Leyang Cui Deng Cai Lemao Liu Tingchen Fu Xinting Huang Enbo Zhao Yu Zhang and Yulong Chen. 2023. Siren\u2019s song in the AI ocean: a survey on hallucination in large language models. arXiv preprint arXiv:2309.01219."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3364675"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/MOBILESoft.2019.00016"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-COMPANION.2009.5070993"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728961","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728961","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T16:47:09Z","timestamp":1752684429000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728961"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":51,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728961"],"URL":"https:\/\/doi.org\/10.1145\/3728961","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}