{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T16:00:32Z","timestamp":1785340832092,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":62,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:00:00Z","timestamp":1775952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,12]]},"DOI":"10.1145\/3794763.3794806","type":"proceedings-article","created":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T15:18:58Z","timestamp":1785338338000},"page":"146-158","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Put The \u201cCode\u201d Back in \u201cCode Comprehension Study\u201d"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-0863-1101","authenticated-orcid":false,"given":"Kyle D.","family":"Chin","sequence":"first","affiliation":[{"name":"University of British Columbia (UBC), Vancouver, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4213-494X","authenticated-orcid":false,"given":"Reid","family":"Holmes","sequence":"additional","affiliation":[{"name":"University of British Columbia (UBC), Vancouver, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,29]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"publisher","unstructured":"Vard Antinyan Miroslaw Staron J\u00f6rgen Hansson Wilhelm Meding Per \u00d6sterstr\u00f6m and Anders Henriksson. 2014. Monitoring evolution of code complexity and magnitude of changes. Acta Cybernetica 21 3 (Aug. 2014) 367\u2013382. 10.14232\/actacyb.21.3.2014.6","DOI":"10.14232\/actacyb.21.3.2014.6"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606617"},{"key":"e_1_3_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2017.18"},{"key":"e_1_3_3_2_5_2","doi-asserted-by":"publisher","unstructured":"Dave Binkley Marcia Davis Dawn Lawrie Jonathan\u00a0I. Maletic Christopher Morrell and Bonita Sharif. 2013. The impact of identifier style on effort and comprehension. Empirical Software Engineering (ESE) 18 2 (April 2013) 219\u2013276. 10.1007\/s10664-012-9201-4","DOI":"10.1007\/s10664-012-9201-4"},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"publisher","unstructured":"Dave Binkley Marcia Davis Dawn Lawrie Jonathan\u00a0I. Maletic Christopher Morrell and Bonita Sharif. 2013. The impact of identifier style on effort and comprehension. Empirical Software Engineering (ESE) 18 2 (April 2013) 219\u2013276. 10.1007\/s10664-012-9201-4","DOI":"10.1007\/s10664-012-9201-4"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","unstructured":"J\u00fcrgen B\u00f6rstler Kwabena\u00a0E. Bennin Sara Hooshangi Johan Jeuring Hieke Keuning Carsten Kleiner Bonnie MacKellar Rodrigo Duran Harald St\u00f6rrle Daniel Toll and Jelle van Assema. 2023. Developers talking about code quality. Empirical Software Engineering (ESE) 28 1 (2023) 128. 10.1007\/s10664-023-10381-0","DOI":"10.1007\/s10664-023-10381-0"},{"key":"e_1_3_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2015.21"},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.5555\/207583"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","unstructured":"Mohamad\u00a0A. Bujang. 2024. An elaboration on sample size determination for correlations based on effect sizes and confidence interval width: A guide for researchers. Restorative Dentistry & Endodontics 49 2 (2024) e21. 10.5395\/rde.2024.49.e21","DOI":"10.5395\/rde.2024.49.e21"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"publisher","unstructured":"Raymond\u00a0P.L. Buse and Westley\u00a0R. Weimer. 2010. Learning a Metric for Code Readability. Transactions on Software Engineering (TSE) 36 4 (2010) 546\u2013558. 10.1109\/TSE.2009.70","DOI":"10.1109\/TSE.2009.70"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/WCRE.2009.50"},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"publisher","unstructured":"J\u00fcrgen B\u00f6rstler and Barbara Paech. 2016. The Role of Method Chains and Comments in Software Readability and Comprehension\u2014An Experiment. Transactions on Software Engineering (TSE) 42 9 (2016) 886\u2013898. 10.1109\/TSE.2016.2527791","DOI":"10.1109\/TSE.2016.2527791"},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-3482-4_9"},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"publisher","unstructured":"Qiuyuan Chen Xin Xia Han Hu David Lo and Shanping Li. 2021. Why My Code Summarization Model Does Not Work: Code Comment Improvement with Category Prediction. Transactions on Software Engineering Methodolgy (TOSEM) 30 2 Article 25 (Feb. 2021) 29\u00a0pages. 10.1145\/3434280","DOI":"10.1145\/3434280"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"publisher","unstructured":"Shaiful Chowdhury Reid Holmes Andy Zaidman and Rick Kazman. 2022. Revisiting the debate: Are code metrics useful for measuring maintenance effort? Empirical Software Engineering (ESE) 27 6 (Nov. 2022) 31\u00a0pages. 10.1007\/s10664-022-10193-8","DOI":"10.1007\/s10664-022-10193-8"},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3527975"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"publisher","unstructured":"B. Curtis S.\u00a0B. Sheppard P. Milliman M.\u00a0A. Borst and T. Love. 1979. Measuring the Psychological Complexity of Software Maintenance Tasks with the Halstead and McCabe Metrics. Transactions on Software Engineering (TSE) 5 2 (March 1979) 96\u2013104. 10.1109\/TSE.1979.234165","DOI":"10.1109\/TSE.1979.234165"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/1085313.1085331"},{"key":"e_1_3_3_2_20_2","unstructured":"Jonathan Dorn. 2012. A General Software Readability Model. https:\/\/www.cs.virginia.edu\/\u00a0weimer\/students\/dorn-mcs-paper.pdf. https:\/\/www.cs.virginia.edu\/\u00a0weimer\/students\/dorn-mcs-paper.pdf Master\u2019s thesis University of Virginia."},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","unstructured":"Kalhed El\u00a0Emam Sa\u00efda Benlarbi Nishith Goel and Shesh\u00a0N. Rai. 2001. The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics. Transactions on Software Engineering (TSE) 27 7 (July 2001) 630\u2013650. 10.1109\/32.935855","DOI":"10.1109\/32.935855"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196321.3196347"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2019.00014"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2011.21"},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568266"},{"key":"e_1_3_3_2_26_2","doi-asserted-by":"publisher","unstructured":"Yossi Gil and Gal Lalouche. 2017. On the correlation between size and metric validity. Empirical Software Engineering 22 6 (2017) 2585\u20132611. 10.1007\/s10664-017-9513-5","DOI":"10.1007\/s10664-017-9513-5"},{"key":"e_1_3_3_2_27_2","unstructured":"Igor Grigorik. 2012. GH Archive: Record the public GitHub timeline archive it and make it easily accessible. https:\/\/www.gharchive.org\/. Accessed: 2025-10-23."},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2008.13"},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"publisher","unstructured":"D. Kafura and G.R. Reddy. 1987. The Use of Software Complexity Metrics in Software Maintenance. Transactions on Software Engineering (TSE) SE-13 3 (1987) 335\u2013343. 10.1109\/TSE.1987.233164","DOI":"10.1109\/TSE.1987.233164"},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"publisher","unstructured":"Amy\u00a0J. Ko Thomas\u00a0D. LaToza and Margaret\u00a0M. Burnett. 2015. A practical guide to controlled experiments of software engineering tools with human participants. Empirical Software Engineering 20 1 (2015) 110\u2013141. 10.1007\/s10664-013-9279-3","DOI":"10.1007\/s10664-013-9279-3"},{"key":"e_1_3_3_2_31_2","unstructured":"Dani\u00ebl Lakens. 2022. 8 Sample Size Justification \u2013 Improving Your Statistical Inferences. https:\/\/lakens.github.io\/statistical_inferences\/08-samplesizejustification.html#planprecision."},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"publisher","unstructured":"Dawn Lawrie Henry Feild and David Binkley. 2006. Leveraged Quality Assessment using Information Retrieval Techniques. International Conference on Program Comprehension (ICPC) 2006 149\u2013 158. 10.1109\/ICPC.2006.34","DOI":"10.1109\/ICPC.2006.34"},{"key":"e_1_3_3_2_33_2","doi-asserted-by":"publisher","unstructured":"Dawn Lawrie Henry Feild and David Binkley. 2007. Quantifying identifier quality: An analysis of trends. Empirical Software Engineering 12 (07 2007) 359\u2013388. 10.1007\/s10664-006-9032-2","DOI":"10.1007\/s10664-006-9032-2"},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"publisher","unstructured":"Taek Lee Jung-Been Lee and Hoh In. 2015. Effect Analysis of Coding Convention Violations on Readability of Post-Delivered Code. Transactions on Information and Systems (TIS) E98D (07 2015) 1\u201311. 10.1587\/transinf.2014EDP7327","DOI":"10.1587\/transinf.2014EDP7327"},{"key":"e_1_3_3_2_35_2","doi-asserted-by":"publisher","unstructured":"M.M. Lehman. 1980. Programs life cycles and laws of software evolution. Proc. IEEE 68 9 (1980) 1060\u20131076. 10.1109\/PROC.1980.11805","DOI":"10.1109\/PROC.1980.11805"},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"publisher","unstructured":"Marcus Messer Neil C.\u00a0C. Brown Michael K\u00f6lling and Miaojing Shi. 2025. How Consistent Are Humans When Grading Programming Assignments? Transactions on Computing Education (TCE) 25 4 Article 49 (Sept. 2025) 37\u00a0pages. 10.1145\/3759256","DOI":"10.1145\/3759256"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","unstructured":"Qing Mi Mingjie Chen Zhi Cai and Xibin Jia. 2023. What Makes a Readable Code? A Causal Analysis Method. Software: Practice and Experience 53 6 (2023) 1391\u20131409. 10.1002\/spe.3192","DOI":"10.1002\/spe.3192"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591098"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","unstructured":"Sebastian Nielebock Dariusz Krolikowski Jacob Kr\u00fcger Thomas Leich and Frank Ortmeier. 2019. Commenting source code: is it worth it for small programming tasks? Empirical Software Engineering (ESE) 24 3 (June 2019) 1418\u20131457. 10.1007\/s10664-018-9664-z","DOI":"10.1007\/s10664-018-9664-z"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME46990.2020.00041"},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2018.00017"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"publisher","unstructured":"Luca Pascarella Magiel Bruntink and Alberto Bacchelli. 2019. Classifying code comments in Java software systems. Empirical Software Engineering (ESE) 24 3 (June 2019) 1499\u20131537. 10.1007\/s10664-019-09694-w","DOI":"10.1007\/s10664-019-09694-w"},{"key":"e_1_3_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00056"},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"publisher","unstructured":"Valentina Piantadosi Fabiana Fierro Simone Scalabrino Alexander Serebrenik and Rocco Oliveto. 2020. How does code readability change during software evolution? Empirical Software Engineering (ESE) 25 6 (Nov. 2020) 5374\u20135412. 10.1007\/s10664-020-09886-9","DOI":"10.1007\/s10664-020-09886-9"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/1985441.1985454"},{"key":"e_1_3_3_2_46_2","doi-asserted-by":"publisher","unstructured":"Pooja Rani Arianna Blasi Nataliia Stulova Sebastiano Panichella Alessandra Gorla and Oscar Nierstrasz. 2023. A decade of code comment quality assessment: A systematic literature review. Journal of Systems and Software (JSS) 195 C (Jan. 2023) 22\u00a0pages. 10.1016\/j.jss.2022.111515","DOI":"10.1016\/j.jss.2022.111515"},{"key":"e_1_3_3_2_47_2","doi-asserted-by":"publisher","unstructured":"Talita\u00a0Vieira Ribeiro Paulo S\u00e9rgio\u00a0Medeiros dos Santos and Guilherme\u00a0Horta Travassos. 2023. On the Investigation of Empirical Contradictions - Aggregated Results of Local Studies on Readability and Comprehensibility of Source Code. Empirical Software Engineering (ESE) 28 6 (Nov. 2023) 41\u00a0pages. 10.1007\/s10664-023-10360-5","DOI":"10.1007\/s10664-023-10360-5"},{"key":"e_1_3_3_2_48_2","doi-asserted-by":"publisher","unstructured":"Peter Rigby Brendan Cleary Frederic Painchaud Margaret-Anne Storey and Daniel German. 2012. Contemporary Peer Review in Action: Lessons from Open Source Development. IEEE Software 29 6 (2012) 56\u201361. 10.1109\/MS.2012.24","DOI":"10.1109\/MS.2012.24"},{"key":"e_1_3_3_2_49_2","doi-asserted-by":"publisher","unstructured":"Martin\u00a0P. Robillard Deeksha\u00a0M. Arya Neil\u00a0A. Ernst Jin L.\u00a0C. Guo Maxime Lamothe Mathieu Nassif Nicole Novielli Alexander Serebrenik Igor Steinmacher and Klaas-Jan Stol. 2024. Communicating Study Design Trade-offs in Software Engineering. Transactions on Software Engineering Methodolgy (TOSEM) 33 5 Article 112 (June 2024) 10\u00a0pages. 10.1145\/3649598","DOI":"10.1145\/3649598"},{"key":"e_1_3_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389255"},{"key":"e_1_3_3_2_51_2","doi-asserted-by":"publisher","unstructured":"Felice Salviulo and Giuseppe Scanniello. 2014. Dealing with identifiers and comments in source code comprehension and maintenance: Results from an ethnographically-informed study with students and professionals. ACM International Conference Proceeding Series (05 2014). 10.1145\/2601248.2601251","DOI":"10.1145\/2601248.2601251"},{"key":"e_1_3_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCQ60895.2024.10576941"},{"key":"e_1_3_3_2_53_2","first-page":"417","volume-title":"International Conference on Automated Software Engineering (ASE)","author":"Scalabrino Simone","year":"2017","unstructured":"Simone Scalabrino, Gabriele Bavota, Christopher Vendome, Mario Linares-V\u00e1squez, Denys Poshyvanyk, and Rocco Oliveto. 2017. Automatically assessing code understandability: how far are we?. In International Conference on Automated Software Engineering (ASE). 417\u2013427."},{"key":"e_1_3_3_2_54_2","doi-asserted-by":"publisher","unstructured":"Simone Scalabrino Gabriele Bavota Christopher Vendome Mario Linares-V\u00e1squez Denys Poshyvanyk and Rocco Oliveto. 2021. Automatically Assessing Code Understandability. Transactions on Software Engineering (TSE) 47 3 (2021) 595\u2013613. 10.1109\/TSE.2019.2901468","DOI":"10.1109\/TSE.2019.2901468"},{"key":"e_1_3_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2010.41"},{"key":"e_1_3_3_2_56_2","doi-asserted-by":"publisher","unstructured":"Martin Shepperd. 1988. A critique of cyclomatic complexity as a software metric. Software Engineering Journal (SEJ) 3 2 (March 1988) 30\u201336. 10.1049\/sej.1988.0003","DOI":"10.1049\/sej.1988.0003"},{"key":"e_1_3_3_2_57_2","doi-asserted-by":"publisher","unstructured":"Dag\u00a0I.K. Sj\u00f8berg Aiko Yamashita Bente\u00a0C.D. Anda Audris Mockus and Tore Dyb\u00e5. 2013. Quantifying the Effect of Code Smells on Maintenance Effort. Transactions on Software Engineering (TSE) 39 8 (2013) 1144\u20131156. 10.1109\/TSE.2012.89","DOI":"10.1109\/TSE.2012.89"},{"key":"e_1_3_3_2_58_2","unstructured":"Armstrong Takang Penny Grubb and Robert Macredie. 1996. The effects of comments and identifier names on program comprehensibility: An experimental investigation. Journal of Programming Languages 4 (09 1996) 143\u2013167."},{"key":"e_1_3_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643916.3644432"},{"key":"e_1_3_3_2_60_2","doi-asserted-by":"publisher","unstructured":"T. Tenny. 1988. Program readability: Procedures versus comments. Transactions on Software Engineering (TSE) 14 9 (1988) 1271\u20131279. 10.1109\/32.6171","DOI":"10.1109\/32.6171"},{"key":"e_1_3_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389259"},{"key":"e_1_3_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196398.3196441"},{"key":"e_1_3_3_2_63_2","first-page":"1359","volume-title":"International Conference on Software Engineering (ICSE)","author":"Zhai Juan","year":"2020","unstructured":"Juan Zhai, Xiangzhe Xu, Yu Shi, Guanhong Tao, Minxue Pan, Shiqing Ma, Lei Xu, Weifeng Zhang, Lin Tan, and Xiangyu Zhang. 2020. CPC: Automatically Classifying and Propagating Natural Language Comments via Program Analysis. In International Conference on Software Engineering (ICSE). 1359\u20131371."}],"event":{"name":"ICPC '26: 34th IEEE\/ACM International Conference on Program Comprehension","location":"Rio de Janeiro , Brazil","acronym":"ICPC '26","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 2026 34th IEEE\/ACM International Conference on Program Comprehension"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3794763.3794806","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T15:20:38Z","timestamp":1785338438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3794763.3794806"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,12]]},"references-count":62,"alternative-id":["10.1145\/3794763.3794806","10.1145\/3794763"],"URL":"https:\/\/doi.org\/10.1145\/3794763.3794806","relation":{},"subject":[],"published":{"date-parts":[[2026,4,12]]},"assertion":[{"value":"2026-07-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}