{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T20:35:54Z","timestamp":1768422954641,"version":"3.49.0"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T00:00:00Z","timestamp":1765756800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T00:00:00Z","timestamp":1765756800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006447","name":"University of Zurich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006447","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Code review is a widespread practice in software engineering during which developers examine each other\u2019s source code changes to identify potential issues and improve code quality. Among the automated techniques proposed by researchers to reduce the manual workload of code review, Automated Code Revision (ACR) aims to automatically address reviewers\u2019 feedback by producing a revised version of the code. Transformer-based language models have demonstrated state-of-the-art results in ACR. The performance of these models, however, is significantly influenced by the quality and preparation of the training and evaluation data. We present several systematic analyses of prevalent preprocessing steps, examined both cumulatively and in isolation, across three established preprocessing pipelines and two dataset splitting strategies (time-level vs. project-level). Our study spans across models of different scales: OpenNMT (small), T5 and CodeReviewer (mid-sized), LoRA-tuned CodeLLaMA-7B (large), and GPT-3.5-Turbo (large, black-box). Using datasets up to 496k training records, we evaluate and statistically compare models\u2019 performance using exact match ratio (EXM), CodeBLEU, and Levenshtein ratio. Our findings show that preprocessing may be a significant component in the success of the different techniques: OpenNMT relies on heavy preprocessing; T5 benefits from light filtering (selective removal of records); CodeReviewer performs best when trained on larger, less aggressively filtered data; CodeLLaMA-7B and ChatGPT-3.5 Turbo are largely indifferent to preprocessing. Overall, the effectiveness of ACR tools depends on aligning preprocessing with model scale and training setup. In general, small models need abstraction, mid-sized ones benefit from light filtering, and large-scale models perform best when trained on the original, unprocessed form of the code.<\/jats:p>","DOI":"10.1007\/s10664-025-10781-4","type":"journal-article","created":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T12:50:09Z","timestamp":1765803009000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["The price of precision: the cost of preprocessing for automated code revision in code review"],"prefix":"10.1007","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7360-2648","authenticated-orcid":false,"given":"Shirin","family":"Pirouzkhah","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pooja","family":"Rani","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesco","family":"Sovrano","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vincent","family":"Hellendoorn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alberto","family":"Bacchelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,12,15]]},"reference":[{"key":"10781_CR1","unstructured":"Ackerman AF, Fowler PJ, Ebenau RG (1984) Software inspections and the industrial production of software. In: Proc. of a symposium on Software validation: inspection-testing-verification-alternatives, pages 13\u201340"},{"issue":"3","key":"10781_CR2","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/52.28121","volume":"6","author":"AF Ackerman","year":"1989","unstructured":"Ackerman AF, Buchwald LS, Lewski FH (1989) Software inspections: an effective verification process. IEEE Softw 6(3):31\u201336","journal-title":"IEEE Softw"},{"key":"10781_CR3","unstructured":"Acm digital library. https:\/\/dl.acm.org\/. Accessed: Sep 2023"},{"key":"10781_CR4","doi-asserted-by":"crossref","unstructured":"Bacchelli A, Bird C (2013) Expectations, outcomes, and challenges of modern code review. In: 2013 35th International conference on software engineering (ICSE), IEEE, pages 712\u2013721","DOI":"10.1109\/ICSE.2013.6606617"},{"key":"10781_CR5","doi-asserted-by":"crossref","unstructured":"Bavota G, Russo B (2015) Four eyes are better than two: On the impact of code reviews on software quality. In: 2015 IEEE International conference on software maintenance and evolution (ICSME), IEEE, pages 81\u201390","DOI":"10.1109\/ICSM.2015.7332454"},{"key":"10781_CR6","doi-asserted-by":"crossref","unstructured":"Bosu A, Carver JC (2013) Impact of peer code review on peer impression formation: A survey. In: 2013 ACM\/IEEE International symposium on empirical software engineering and measurement, IEEE, pages 133\u2013142","DOI":"10.1109\/ESEM.2013.23"},{"issue":"2","key":"10781_CR7","first-page":"179","volume":"14","author":"JL Elman","year":"1990","unstructured":"Elman JL (1990) Finding structure in time Cognitive Sci 14(2):179\u2013211","journal-title":"Finding structure in time Cognitive Sci"},{"issue":"200","key":"10781_CR8","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1080\/01621459.1937.10503522","volume":"32","author":"M Friedman","year":"1937","unstructured":"Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675\u2013701","journal-title":"J Am Stat Assoc"},{"key":"10781_CR9","unstructured":"Google scholar. https:\/\/scholar.google.com\/. Accessed: Sep 2023"},{"key":"10781_CR10","unstructured":"Gpt-3 (2025) https:\/\/en.wikipedia.org\/wiki\/GPT-3. Accessed: 2025-09-08"},{"key":"10781_CR11","doi-asserted-by":"crossref","unstructured":"Hellendoorn VJ, Tsay J, Mukherjee M, Hirzel M (2021) Towards automating code review at scale. In: Proceedings of the 29th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, pages 1479\u20131482","DOI":"10.1145\/3468264.3473134"},{"key":"10781_CR12","unstructured":"Ieee xplore digital library. https:\/\/ieeexplore.ieee.org\/. Accessed: Sep 2023"},{"key":"10781_CR13","unstructured":"Klein G, Kim Y, Deng Y, Nguyen V, Senellart J, Rush AM (2018) Opennmt: Neural machine translation toolkit. arXiv:1805.11462"},{"issue":"260","key":"10781_CR14","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1080\/01621459.1952.10483441","volume":"47","author":"WH Kruskal","year":"1952","unstructured":"Kruskal WH, Wallis WA (1952) Use of ranks in one-criterion variance analysis. J Am Stat Assoc 47(260):583\u2013621","journal-title":"J Am Stat Assoc"},{"key":"10781_CR15","doi-asserted-by":"crossref","unstructured":"Kudo T, Richardson J (2018) SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. arXiv:1808.06226","DOI":"10.18653\/v1\/D18-2012"},{"key":"10781_CR16","unstructured":"Lcvenshtcin VI (1966) Binary coors capable or \u2018correcting deletions, insertions, and reversals. In: Soviet physics-doklady, volume\u00a010"},{"key":"10781_CR17","doi-asserted-by":"crossref","unstructured":"Li HY, Shi ST, Thung F, Huo X, Xu B, Li M, Lo D (2019) Deepreview: automatic code review using deep multi-instance learning. In: Advances in knowledge discovery and data mining: 23rd Pacific-Asia Conference, PAKDD 2019, Macau, China, April 14-17, 2019, Proceedings, Part II 23, Springer, pages 318\u2013330","DOI":"10.1007\/978-3-030-16145-3_25"},{"key":"10781_CR18","doi-asserted-by":"crossref","unstructured":"Li Z, Lu S, Guo D, Duan N, Jannu S, Jenks G, Majumder D, Green J, Svyatkovskiy A, Fu S et\u00a0al (2022) Automating code review activities by large-scale pre-training. In: Proceedings of the 30th ACM joint European software engineering conference and symposium on the foundations of software engineering, pages 1035\u20131047","DOI":"10.1145\/3540250.3549081"},{"key":"10781_CR19","doi-asserted-by":"publisher","first-page":"2146","DOI":"10.1007\/s10664-015-9381-9","volume":"21","author":"S McIntosh","year":"2016","unstructured":"McIntosh S, Kamei Y, Adams B, Hassan AE (2016) An empirical study of the impact of modern code review practices on software quality. Empirical Softw Eng 21:2146\u20132189","journal-title":"Empirical Softw Eng"},{"key":"10781_CR20","doi-asserted-by":"crossref","unstructured":"Morales R, McIntosh S, Khomh F (2015) Do code review practices impact design quality? a case study of the qt, vtk, and itk projects. In: 2015 IEEE 22nd international conference on software analysis, evolution, and reengineering (SANER), IEEE, pages 171\u2013180","DOI":"10.1109\/SANER.2015.7081827"},{"key":"10781_CR21","unstructured":"Naduvil-Vadukootu S, Angryk RA, Riley P (2017) Evaluating preprocessing strategies for time series prediction using deep learning architectures. In: The thirtieth international flairs conference"},{"key":"10781_CR22","doi-asserted-by":"crossref","unstructured":"Pirouzkhah S (2025) Replication package for \u2018The Price of Precision: the Cost of Preprocessing for Automating Code Review\u2019. https:\/\/github.com\/shirinpirouzkhaah\/Price-of-Precision","DOI":"10.1007\/s10664-025-10781-4"},{"key":"10781_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107523","volume":"175","author":"C Pornprasit","year":"2024","unstructured":"Pornprasit C, Tantithamthavorn C (2024) Fine-tuning and prompt engineering for large language models-based code review automation. Inf Softw Technol 175:107523","journal-title":"Inf Softw Technol"},{"issue":"1","key":"10781_CR24","first-page":"5485","volume":"21","author":"C Raffel","year":"2020","unstructured":"Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res 21(1):5485\u20135551","journal-title":"J Mach Learn Res"},{"key":"10781_CR25","unstructured":"Ren S, Guo D, Lu S, Zhou L, Liu S, Tang D, Sundaresan N, Zhou M, Blanco A, Ma S (2020) Codebleu: a method for automatic evaluation of code synthesis. arXiv:2009.10297"},{"key":"10781_CR26","doi-asserted-by":"crossref","unstructured":"Rigby PC, Bird C (2013) Convergent contemporary software peer review practices. In: Proceedings of the 2013 9th joint meeting on foundations of software engineering, pages 202\u2013212","DOI":"10.1145\/2491411.2491444"},{"key":"10781_CR27","doi-asserted-by":"crossref","unstructured":"Rigby PC, German DM, Storey MA (2008) Open source software peer review practices: a case study of the apache server. In: Proceedings of the 30th international conference on Software engineering, pages 541\u2013550","DOI":"10.1145\/1368088.1368162"},{"key":"10781_CR28","doi-asserted-by":"crossref","unstructured":"Rigby PC, Storey MA (2011) Understanding broadcast based peer review on open source software projects. In: Proceedings of the 33rd international conference on software engineering, pages 541\u2013550","DOI":"10.1145\/1985793.1985867"},{"key":"10781_CR29","doi-asserted-by":"crossref","unstructured":"Sadowski C, S\u00f6derberg E, Church L, Sipko M, Bacchelli A (2018) Modern code review: a case study at google. In: Proceedings of the 40th international conference on software engineering: Software engineering in practice, pages 181\u2013190","DOI":"10.1145\/3183519.3183525"},{"key":"10781_CR30","doi-asserted-by":"publisher","first-page":"4910","DOI":"10.1609\/aaai.v33i01.33014910","volume":"33","author":"ST Shi","year":"2019","unstructured":"Shi ST, Li M, Lo D, Thung F, Huo X (2019) Automatic code review by learning the revision of source code. Proceedings of the AAAI conference on artificial intelligence 33:4910\u20134917","journal-title":"Proceedings of the AAAI conference on artificial intelligence"},{"key":"10781_CR31","doi-asserted-by":"publisher","unstructured":"Shi L, Mu F, Chen X, Wang S, Wang J, Yang Y, Li G, Xia X, Wang Q (2022) Are we building on the rock? On the importance of data preprocessing for code summarization. In Abhik Roychoudhury, Cristian Cadar, and Miryung Kim, editors, : Proceedings of the 30th ACM joint European software engineering conference and symposium on the foundations of software engineering, ESEC\/FSE 2022, Singapore, Singapore, November 14\u201318, 2022, pages 107\u2013119. ACM. https:\/\/doi.org\/10.1145\/3540250.3549145","DOI":"10.1145\/3540250.3549145"},{"key":"10781_CR32","doi-asserted-by":"crossref","unstructured":"Svyatkovskiy A, Deng SK, Fu S, Sundaresan N (2020) Intellicode compose: Code generation using transformer. In: Proceedings of the 28th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, pages 1433\u20131443","DOI":"10.1145\/3368089.3417058"},{"key":"10781_CR33","doi-asserted-by":"crossref","unstructured":"Thongtanunam P, Pornprasit C, Tantithamthavorn C (2022) Autotransform: Automated code transformation to support modern code review process. In: 2022 ieee\/acm 44st international conference on software engineering (icse)","DOI":"10.1145\/3510003.3510067"},{"key":"10781_CR34","doi-asserted-by":"crossref","unstructured":"Thongtanunam P, Tantithamthavorn C, Kula RG, Yoshida N, Iida H, Matsumoto KI (2015) Who should review my code? A file location-based code-reviewer recommendation approach for modern code review. In: 2015 IEEE 22nd international conference on software analysis, evolution, and reengineering, IEEE, pages 141\u2013150","DOI":"10.1109\/SANER.2015.7081824"},{"key":"10781_CR35","doi-asserted-by":"crossref","unstructured":"Tufano R, Masiero S, Mastropaolo A, Pascarella L, Poshyvanyk D, Bavota G (2022) Using pre-trained models to boost code review automation. In: Proceedings of the 44th international conference on software engineering, pages 2291\u20132302","DOI":"10.1145\/3510003.3510621"},{"key":"10781_CR36","doi-asserted-by":"crossref","unstructured":"Tufano M, Pantiuchina J, Watson C, Bavota G, Poshyvanyk D (2019) On learning meaningful code changes via neural machine translation. In: 2019 IEEE\/ACM 41st international conference on software engineering (ICSE), IEEE, pages 25\u201336","DOI":"10.1109\/ICSE.2019.00021"},{"key":"10781_CR37","doi-asserted-by":"crossref","unstructured":"Tufano R, Pascarella L, Bavota G (2023) Automating code-related tasks through transformers: The impact of pre-training. In: 45th IEEE\/ACM international conference on software engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023, IEEE, pages 2425\u20132437","DOI":"10.1109\/ICSE48619.2023.00203"},{"key":"10781_CR38","doi-asserted-by":"crossref","unstructured":"Tufano R, Pascarella L, Tufano M, Poshyvanyk D, Bavota G (2021) Towards automating code review activities. In: 2021 IEEE\/ACM 43rd international conference on software engineering (ICSE), IEEE, pages 163\u2013174","DOI":"10.1109\/ICSE43902.2021.00027"},{"key":"10781_CR39","doi-asserted-by":"crossref","unstructured":"Wang Y, Wang W, Joty S, Hoi SC (2021) CodeT5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation. arXiv:2109.00859","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"issue":"6","key":"10781_CR40","doi-asserted-by":"publisher","first-page":"80","DOI":"10.2307\/3001968","volume":"1","author":"F Wilcoxon","year":"1945","unstructured":"Wilcoxon F (1945) Individual comparisons by ranking methods. Biomet Bullet 1(6):80\u201383","journal-title":"Biomet Bullet"},{"key":"10781_CR41","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2022.111832","volume":"258","author":"Z Xiao","year":"2022","unstructured":"Xiao Z, Gang W, Yuan J, Chen Z, Li J, Wang X, Feng X (2022) Impacts of data preprocessing and selection on energy consumption prediction model of hvac systems based on deep learning. Energy Build 258:111832","journal-title":"Energy Build"},{"key":"10781_CR42","doi-asserted-by":"crossref","unstructured":"Xu FF, Alon U, Neubig G, Hellendoorn VJ (2022) A systematic evaluation of large language models of code. In: Proceedings of the 6th ACM SIGPLAN international symposium on machine programming, pages 1\u201310","DOI":"10.1145\/3520312.3534862"},{"key":"10781_CR43","unstructured":"Zhang Q, Zhang T, Zhai J, Fang C, Yu B, Sun W, Chen Z (2023) A critical review of large language model on software engineering: An example from ChatGPT and automated program repair"},{"key":"10781_CR44","doi-asserted-by":"crossref","unstructured":"Zhou X, Kim K, Xu B, Han D, He J, Lo D (2023) Generation-based code review automation: How far are we? arXiv:2303.07221","DOI":"10.1109\/ICPC58990.2023.00036"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-025-10781-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-025-10781-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-025-10781-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T04:33:10Z","timestamp":1768365190000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-025-10781-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,15]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["10781"],"URL":"https:\/\/doi.org\/10.1007\/s10664-025-10781-4","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,15]]},"assertion":[{"value":"22 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 November 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 December 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Clinical Trial Number"}}],"article-number":"47"}}