{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,24]],"date-time":"2025-05-24T04:01:33Z","timestamp":1748059293967,"version":"3.41.0"},"reference-count":37,"publisher":"World Scientific Pub Co Pte Ltd","issue":"05","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:p> During software maintenance and evolution, developers spend more than half of their time on code comprehension activities. In order to understand an unfamiliar code base, they would naturally ask different types of questions related to code snippets and try to find the answers. In this paper, we conduct an initial work to explore the possibility of automatic question generation for program comprehension. We construct a large-scale data set containing pairs of source code and questions that are automatically transformed from inline comments based on dependency analysis and semantic role labeling. We also build a comprehensive taxonomy of question types so as to generate questions concerning different aspects of code snippets, such as purpose, implementation details and so on. Then, we propose a deep learning-based prototype CodeQG to automatically generates multiple types of questions for code snippets. We evaluate CodeQG by using both typical performance metrics and manual evaluation. The results show that (1) we can achieve a value of 42.02 on BLEU4 and 60.81 on ROUGE-L for the generated questions; (2) overall, the questions are very correct in grammatical, semantic and format; (3) the questions are related to the corresponding code snippet and are helpful for developers in source code comprehension activities. Our work gives insights into automatically generating multiple types of questions for code comprehension. We expect this exploration will improve the applicability and generality of machine code comprehension. <\/jats:p>","DOI":"10.1142\/s0218194025500214","type":"journal-article","created":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T04:33:25Z","timestamp":1742618005000},"page":"737-765","source":"Crossref","is-referenced-by-count":0,"title":["CodeQG: Automated Multiple Question Generation for Source Code Comprehension"],"prefix":"10.1142","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1481-5158","authenticated-orcid":false,"given":"Xiaowei","family":"Zhang","sequence":"first","affiliation":[{"name":"Inspur Group, Co., Ltd., Jinan 250101, P. R. China"},{"name":"Jinan Inspur Data Technology Co., Ltd., Jinan 250101, P. R. China"},{"name":"State Key Laboratory of High-End Server System, Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2352-2226","authenticated-orcid":false,"given":"Lin","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210023, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9043-106X","authenticated-orcid":false,"given":"Kaiyuan","family":"Qi","sequence":"additional","affiliation":[{"name":"Jinan Inspur Data Technology Co., Ltd., Jinan 250101, P. R. China"},{"name":"State Key Laboratory of High-End Server System, Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0913-1539","authenticated-orcid":false,"given":"Weiqin","family":"Zou","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210023, P. R. China"},{"name":"Nanjing University of Aeronautics and Astronautics, Nanjing 210016, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3065-1698","authenticated-orcid":false,"given":"Liye","family":"Pang","sequence":"additional","affiliation":[{"name":"Jinan Inspur Data Technology Co., Ltd., Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2927-7318","authenticated-orcid":false,"given":"Lianfa","family":"Zhang","sequence":"additional","affiliation":[{"name":"Jinan Inspur Data Technology Co., Ltd., Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3814-4964","authenticated-orcid":false,"given":"Peng","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of High-End Server System, Jinan 250101, P. R. China"},{"name":"IEIT SYSTEMS Co., Ltd., Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7055-5188","authenticated-orcid":false,"given":"Guanqun","family":"Xu","sequence":"additional","affiliation":[{"name":"Jinan Inspur Data Technology Co., Ltd., Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Jinan Inspur Data Technology Co., Ltd., Jinan 250101, P. R. China"},{"name":"State Key Laboratory of High-End Server System, Jinan 250101, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2025,5,3]]},"reference":[{"key":"S0218194025500214BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.110945"},{"key":"S0218194025500214BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2734091"},{"key":"S0218194025500214BIB003","doi-asserted-by":"publisher","DOI":"10.1147\/sj.282.0294"},{"key":"S0218194025500214BIB004","doi-asserted-by":"publisher","DOI":"10.1145\/1937117.1937125"},{"key":"S0218194025500214BIB005","doi-asserted-by":"publisher","DOI":"10.1016\/0164-1212(87)90032-X"},{"key":"S0218194025500214BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.26"},{"key":"S0218194025500214BIB007","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018976708691"},{"key":"S0218194025500214BIB008","doi-asserted-by":"publisher","DOI":"10.1145\/2622669"},{"key":"S0218194025500214BIB009","doi-asserted-by":"publisher","DOI":"10.1145\/1181775.1181779"},{"key":"S0218194025500214BIB010","doi-asserted-by":"publisher","DOI":"10.1145\/2688204.2688212"},{"issue":"2","key":"S0218194025500214BIB011","first-page":"539","volume":"13","author":"Deena G.","year":"2022","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"S0218194025500214BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3216279"},{"key":"S0218194025500214BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070533"},{"key":"S0218194025500214BIB015","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115624"},{"key":"S0218194025500214BIB016","first-page":"4585","volume-title":"Proc. Ninth Int. Conf. Language Resources and Evaluation","author":"De Marneffe M.-C.","year":"2014"},{"key":"S0218194025500214BIB018","doi-asserted-by":"publisher","DOI":"10.1162\/0891201053630264"},{"key":"S0218194025500214BIB021","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-0530"},{"issue":"1","key":"S0218194025500214BIB022","first-page":"60","volume":"17","author":"Day R. R.","year":"2005","journal-title":"Read. Foreign Lang."},{"key":"S0218194025500214BIB023","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-006-9216-4"},{"key":"S0218194025500214BIB024","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549145"},{"key":"S0218194025500214BIB025","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380383"},{"key":"S0218194025500214BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2017.63"},{"key":"S0218194025500214BIB027","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468616"},{"key":"S0218194025500214BIB028","first-page":"5","volume":"22","author":"Likert R. A.","year":"1932","journal-title":"Arch. Psychol."},{"key":"S0218194025500214BIB029","first-page":"609","volume-title":"Human Language Technologies: 2010 Annual Conf. North American Chapter of the Association for Computational Linguistics","author":"Heilman M.","year":"2010"},{"key":"S0218194025500214BIB033","first-page":"311","volume-title":"Proc. 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni K.","year":"2002"},{"key":"S0218194025500214BIB034","first-page":"74","volume-title":"Proc. Workshop Text Summarization Branches Out","author":"Lin C.-Y.","year":"2004"},{"key":"S0218194025500214BIB035","doi-asserted-by":"publisher","DOI":"10.2298\/CSIS171121018Z"},{"key":"S0218194025500214BIB036","doi-asserted-by":"publisher","DOI":"10.1186\/s41039-017-0051-y"},{"key":"S0218194025500214BIB038","first-page":"1","volume":"31","author":"Cass S.","year":"2018","journal-title":"IEEE Spectr."},{"key":"S0218194025500214BIB039","doi-asserted-by":"publisher","DOI":"10.1109\/MS.1986.233414"},{"key":"S0218194025500214BIB040","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(83)80031-5"},{"key":"S0218194025500214BIB041","first-page":"1","volume-title":"Proc. IFIP World Computing Congress - Information Technology and Knowledge Engineering","author":"von Mayrhauser A.","year":"1998"},{"key":"S0218194025500214BIB042","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985712"},{"key":"S0218194025500214BIB043","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-11644-5_77"},{"key":"S0218194025500214BIB044","doi-asserted-by":"publisher","DOI":"10.1109\/SANER50967.2021.00015"},{"key":"S0218194025500214BIB048","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2021.04.026"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194025500214","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T03:57:47Z","timestamp":1747972667000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218194025500214"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5]]},"references-count":37,"journal-issue":{"issue":"05","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["10.1142\/S0218194025500214"],"URL":"https:\/\/doi.org\/10.1142\/s0218194025500214","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"type":"print","value":"0218-1940"},{"type":"electronic","value":"1793-6403"}],"subject":[],"published":{"date-parts":[[2025,5]]}}}