{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T10:36:38Z","timestamp":1763202998571,"version":"3.41.2"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"6","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62172214"],"award-info":[{"award-number":["62172214"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,7,31]]},"abstract":"<jats:p>Proper naming of methods can make program code easier to understand, and thus enhance software maintainability. Yet, developers may use inconsistent names due to poor communication or a lack of familiarity with conventions within the software development lifecycle. To address this issue, much research effort has been invested into building automatic tools that can check for method name inconsistency and recommend consistent names. However, existing datasets generally do not provide precise details about why a method name was deemed improper and required to be changed. Such information can give useful hints on how to improve the recommendation of adequate method names. Accordingly, we construct a sample method-naming benchmark, ReName4J, by matching name changes with code reviews. We then present an empirical study on how state-of-the-art techniques perform in detecting or recommending consistent and inconsistent method names based on ReName4J. The main purpose of the study is to reveal a different perspective based on reviewed names rather than proposing a complete benchmark. We find that the existing techniques underperform on our review-driven benchmark, both in inconsistent checking and the recommendation. We further identify potential biases in the evaluation of existing techniques, which future research should consider thoroughly.<\/jats:p>","DOI":"10.1145\/3711901","type":"journal-article","created":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T11:03:31Z","timestamp":1736766211000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["How Are We Detecting Inconsistent Method Names? An Empirical Study from Code Review Perspective"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4462-6916","authenticated-orcid":false,"given":"Kisub","family":"Kim","sequence":"first","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4558-0622","authenticated-orcid":false,"given":"Xin","family":"Zhou","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0272-6860","authenticated-orcid":false,"given":"Dongsun","family":"Kim","sequence":"additional","affiliation":[{"name":"Korea University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1684-1264","authenticated-orcid":false,"given":"Julia","family":"Lawall","sequence":"additional","affiliation":[{"name":"Centre Inria de Paris, Inria, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0145-615X","authenticated-orcid":false,"given":"Kui","family":"Liu","sequence":"additional","affiliation":[{"name":"Huawei Software Engineering Application Technology Lab, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7270-9869","authenticated-orcid":false,"given":"Tegawende F.","family":"Bissyande","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4052-475X","authenticated-orcid":false,"given":"Jacques","family":"Klein","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5222-1820","authenticated-orcid":false,"given":"Jaekwon","family":"Lee","sequence":"additional","affiliation":[{"name":"Kangwon National University, Chuncheon, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4367-7201","authenticated-orcid":false,"given":"David","family":"Lo","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,7,2]]},"reference":[{"key":"e_1_3_2_2_1","volume-title":"Lazy Learning","author":"Aha David W.","year":"2013","unstructured":"David W. Aha. 2013. Lazy Learning. Springer Science & Business Media."},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786849"},{"key":"e_1_3_2_4_1","first-page":"2091","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Allamanis Miltiadis","year":"2016","unstructured":"Miltiadis Allamanis, Hao Peng, and Charles Sutton. 2016. A convolutional attention network for extreme summarization of source code. In Proceedings of the International Conference on Machine Learning. PMLR, 2091\u20132100."},{"key":"e_1_3_2_5_1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Alon Uri","year":"2019","unstructured":"Uri Alon, Shaked Brody, Omer Levy, and Eran Yahav. 2019. code2seq: Generating sequences from structured representations of code. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=H1gKYo09tX"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290353"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00061"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-014-9350-8"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2312942"},{"key":"e_1_3_2_10_1","unstructured":"Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv:1409.0473. Retrieved from https:\/\/arxiv.org\/abs\/1409.0473"},{"key":"e_1_3_2_11_1","doi-asserted-by":"crossref","unstructured":"Denny Britz Anna Goldie Minh-Thang Luong and Quoc Le. 2017. Massive exploration of neural machine translation architectures. arXiv:1703.03906. Retrieved from https:\/\/arxiv.org\/abs\/1703.03906","DOI":"10.18653\/v1\/D17-1151"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/WCRE.2009.50"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSMR.2010.27"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22655-7_7"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2011.6080776"},{"key":"e_1_3_2_16_1","unstructured":"Kyunghyun Cho Bart Van Merri\u00ebnboer Caglar Gulcehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv:1406.1078. Retrieved from https:\/\/arxiv.org\/abs\/1406.1078"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.89"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9"},{"key":"e_1_3_2_19_1","first-page":"286","volume-title":"Proceedings of the 2018 IEEE\/ACM 26th International Conference on Program Comprehension (ICPC)","author":"Fakhoury Sarah","year":"2018","unstructured":"Sarah Fakhoury, Yuzhan Ma, Venera Arnaoudova, and Olusola Adesope. 2018. The effect of poor source code lexicon and readability on developers\u2019 cognitive load. In Proceedings of the 2018 IEEE\/ACM 26th International Conference on Program Comprehension (ICPC). IEEE, 286\u201328610."},{"key":"e_1_3_2_20_1","unstructured":"GitHub. 2022. Retrieved from https:\/\/github.com\/"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180167"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7_14"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2012.6405275"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2017.7884623"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03013-0_14"},{"key":"e_1_3_2_26_1","unstructured":"Zhiheng Huang Wei Xu and Kai Yu. 2015. Bidirectional LSTM-CRF models for sequence tagging. arXiv:1508.01991. Retrieved from https:\/\/arxiv.org\/abs\/1508.01991"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03013-0_14"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00062"},{"key":"e_1_3_2_29_1","unstructured":"Karlton. 2022. Retrieved from https:\/\/www.nndb.com\/people\/400\/000031307\/"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9369-5"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2006.51"},{"key":"e_1_3_2_32_1","first-page":"1188","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Le Quoc","year":"2014","unstructured":"Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of the International Conference on Machine Learning. PMLR, 1188\u20131196."},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-46805-6_19"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC53868.2021.00010"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC53868.2021.00010"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00060"},{"key":"e_1_3_2_37_1","first-page":"11","article-title":"Cognitive perspectives on the role of naming in computer programs","author":"Liblit Ben","year":"2006","unstructured":"Ben Liblit, Andrew Begel, and Eve Sweetser. 2006. Cognitive perspectives on the role of naming in computer programs. In Psychology of Programming Interest Group. Citeseer, 11.","journal-title":"Psychology of Programming Interest Group"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510154"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00019"},{"key":"e_1_3_2_40_1","unstructured":"Minh-Thang Luong Ilya Sutskever Quoc V. Le Oriol Vinyals and Wojciech Zaremba. 2014. Addressing the rare word problem in neural machine translation. arXiv:1410.8206. Retrieved from https:\/\/arxiv.org\/abs\/1410.8206"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/381473.381484"},{"key":"e_1_3_2_42_1","doi-asserted-by":"crossref","unstructured":"Lili Mou Ge Li Lu Zhang Tao Wang and Zhi Jin. 2016. Convolutional neural networks over tree structures for programming language processing. In Proceedings of the 30th AAAI Conference on Artificial Intelligence Vol. 30 1287\u20131293.","DOI":"10.1609\/aaai.v30i1.10139"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380926"},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"issue":"2","key":"e_1_3_2_45_1","first-page":"595","article-title":"Automatically assessing code understandability","volume":"47","author":"Scalabrino Simone","year":"2019","unstructured":"Simone Scalabrino, Gabriele Bavota, Christopher Vendome, Mario Linares-Vasquez, Denys Poshyvanyk, and Rocco Oliveto. 2019. Automatically assessing code understandability. IEEE Transactions on Software Engineering 47, 2 (2019), 595\u2013613.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/smr.1958"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196321.3196332"},{"key":"e_1_3_2_48_1","unstructured":"Abigail See Peter J. Liu and Christopher D. Manning. 2017. Get to the point: Summarization with pointer-generator networks. arXiv:1704.04368. Retrieved from https:\/\/arxiv.org\/abs\/1704.04368"},{"key":"e_1_3_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597008.2597797"},{"issue":"3","key":"e_1_3_2_50_1","first-page":"143","article-title":"The effects of comments and identifier names on program comprehensibility: An experimental investigation","volume":"4","author":"Takang Armstrong A.","year":"1996","unstructured":"Armstrong A. Takang, Penny A. Grubb, and Robert D. Macredie. 1996. The effects of comments and identifier names on program comprehensibility: An experimental investigation. Journal of Programming Languages 4, 3 (1996), 143\u2013167.","journal-title":"Journal of Programming Languages"},{"key":"e_1_3_2_51_1","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017), 6000\u20136010.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00059"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468567"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389266"},{"key":"e_1_3_2_55_1","doi-asserted-by":"crossref","unstructured":"Fengcai Wen Csaba Nagy Michele Lanza and Gabriele Bavota. 2022. Quick remedy commits and their impact on mining software repositories. Empirical Software Engineering 27 (2022) 1\u201331.","DOI":"10.1007\/s10664-021-10051-z"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3711901","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T16:17:03Z","timestamp":1752596223000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711901"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,2]]},"references-count":54,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,7,31]]}},"alternative-id":["10.1145\/3711901"],"URL":"https:\/\/doi.org\/10.1145\/3711901","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"type":"print","value":"1049-331X"},{"type":"electronic","value":"1557-7392"}],"subject":[],"published":{"date-parts":[[2025,7,2]]},"assertion":[{"value":"2023-08-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}