{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T07:41:05Z","timestamp":1777102865183,"version":"3.51.4"},"reference-count":62,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T00:00:00Z","timestamp":1774224000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T00:00:00Z","timestamp":1774224000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["2022.13474.BD"],"award-info":[{"award-number":["2022.13474.BD"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018319","name":"Computer Science and Artificial Intelligence Laboratory","doi-asserted-by":"crossref","award":["UID\/00027\/2025"],"award-info":[{"award-number":["UID\/00027\/2025"]}],"id":[{"id":"10.13039\/100018319","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006752","name":"Universidade do Porto","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006752","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The quality of peer review reports is essential to the integrity and effectiveness of scholarly communication. Yet review reports are often criticized for being vague, biased, or unconstructive, which limits their usefulness for both authors and editors. Existing frameworks for assessing review quality remain fragmented and are rarely validated through expert consensus. This study aims to define and validate a comprehensive set of quality dimensions for peer review reports, encompassing comments addressed to both authors and editors. We employed a two-phase design combining a thematic analysis of the literature with a Delphi study involving 43 scientific editors, primarily from journals in Computer Science and Engineering. Consensus was reached after two Delphi rounds, resulting in 62 validated statements organized into eight quality dimensions: Helpfulness, Specificity, Fairness, Thoroughness, Courteousness, Readability, Consistency, and Relevance. These findings provide an empirically grounded framework to inform the development of clearer standards for peer review practice.<\/jats:p>","DOI":"10.1007\/s11192-026-05603-3","type":"journal-article","created":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T15:48:07Z","timestamp":1774280887000},"page":"2133-2183","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Determining quality dimensions for peer review reports using a Delphi approach"],"prefix":"10.1007","volume":"131","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9516-7991","authenticated-orcid":false,"given":"Amanda","family":"Sizo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adriano","family":"Lino","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00c1lvaro","family":"Rocha","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis Paulo","family":"Reis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,3,23]]},"reference":[{"key":"5603_CR1","doi-asserted-by":"publisher","unstructured":"Al-Jefri, M., Evans, R., Uchyigit, G., & Ghezzi, P. (2018). What is health information quality? Ethical dimension and perception by users. Frontiers in Medicine, 5(SEP). https:\/\/doi.org\/10.3389\/fmed.2018.00260","DOI":"10.3389\/fmed.2018.00260"},{"issue":"2","key":"5603_CR2","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1002\/leap.1222","volume":"32","author":"H Allen","year":"2019","unstructured":"Allen, H., Cury, A., Gaston, T., Graf, C., Wakley, H., Willis, M., Allen, H., Cury, A., Gaston, T., Graf, C., Wakley, H., & Willis, M. (2019). What does better peer review look like? Underlying principles and recommendations for better practice. Learned Publishing, 32(2), 163\u2013175. https:\/\/doi.org\/10.1002\/leap.1222","journal-title":"Learned Publishing"},{"issue":"7","key":"5603_CR3","doi-asserted-by":"publisher","first-page":"1028","DOI":"10.1373\/clinchem.2013.208280","volume":"59","author":"TM Annesley","year":"2013","unstructured":"Annesley, T. M. (2013). Writing an effective manuscript review: The 6 \u201cBe\u2019s\u201d to success. Clinical Chemistry, 59(7), 1028\u20131035. https:\/\/doi.org\/10.1373\/clinchem.2013.208280","journal-title":"Clinical Chemistry"},{"key":"5603_CR4","doi-asserted-by":"publisher","unstructured":"Batini, C., & Scannapieco, M. (2016). Data and Information Quality. https:\/\/link.springer.com\/book\/https:\/\/doi.org\/10.1007\/978-3-319-24106-7","DOI":"10.1007\/978-3-319-24106-7"},{"issue":"2","key":"5603_CR5","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1152\/advan.00104.2006","volume":"31","author":"DJ Benos","year":"2007","unstructured":"Benos, D. J., Bashari, E., Chaves, J. M., Gaggar, A., Kapoor, N., LaFrance, M., Mans, R., Mayhew, D., McGowan, S., Polter, A., Qadri, Y., Sarfare, S., Schultz, K., Splittgerber, R., Stephenson, J., Tower, C., Walton, R. G., & Zotov, A. (2007). The ups and downs of peer review. Advances in Physiology Education, 31(2), 145\u2013152. https:\/\/doi.org\/10.1152\/advan.00104.2006","journal-title":"Advances in Physiology Education"},{"issue":"3","key":"5603_CR6","doi-asserted-by":"publisher","first-page":"1377","DOI":"10.1007\/s11192-024-04938-z","volume":"129","author":"PK Bharti","year":"2024","unstructured":"Bharti, P. K., Agarwal, M., & Ekbal, A. (2024). Please be polite to your peers: A multi-task model for assessing the tone and objectivity of critiques of peer review comments. Scientometrics, 129(3), 1377\u20131413. https:\/\/doi.org\/10.1007\/s11192-024-04938-z","journal-title":"Scientometrics"},{"issue":"4","key":"5603_CR7","doi-asserted-by":"publisher","first-page":"1291","DOI":"10.1007\/s10579-023-09662-3","volume":"58","author":"PK Bharti","year":"2023","unstructured":"Bharti, P. K., Navlakha, M., Agarwal, M., & Ekbal, A. (2023). PolitePEER: Does peer review hurt? A dataset to gauge politeness intensity in the peer reviews. Language Resources and Evaluation, 58(4), 1291\u20131313. https:\/\/doi.org\/10.1007\/s10579-023-09662-3","journal-title":"Language Resources and Evaluation"},{"issue":"85","key":"5603_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12916-016-0631-5","volume":"14","author":"R Bruce","year":"2016","unstructured":"Bruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016). Impact of interventions to improve the quality of peer review of biomedical journals: A systematic review and meta-analysis. BMC Medicine, 14(85), 1\u201316. https:\/\/doi.org\/10.1186\/s12916-016-0631-5","journal-title":"BMC Medicine"},{"issue":"1","key":"5603_CR9","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1001\/archpedi.156.1.11","volume":"156","author":"P Cummings","year":"2002","unstructured":"Cummings, P., & Rivara, F. P. (2002). Reviewing manuscripts for Archives of Pediatrics & Adolescent Medicine. Archives of Pediatrics & Adolescent Medicine, 156(1), 11\u201313. https:\/\/doi.org\/10.1001\/archpedi.156.1.11","journal-title":"Archives of Pediatrics & Adolescent Medicine"},{"key":"5603_CR75","doi-asserted-by":"publisher","unstructured":"Dalkey, N., & Helmer, O. (1963). An Experimental Application of the DELPHI Method to the Use of Experts.Management Science, 9(3), 458\u2013467. https:\/\/doi.org\/10.1287\/mnsc.9.3.458","DOI":"10.1287\/mnsc.9.3.458"},{"issue":"2","key":"5603_CR10","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1177\/105960117600100220","volume":"1","author":"AL Delbecq","year":"1976","unstructured":"Delbecq, A. L., Van de Ven, A. H., & G., D. H. G. (1976). Group techniques for program planning: A guide to Nominal Group and Delphi Processes. Group & Organization Studies, 1(2), 256\u2013256. https:\/\/doi.org\/10.1177\/105960117600100220","journal-title":"Group & Organization Studies"},{"issue":"7","key":"5603_CR11","doi-asserted-by":"publisher","first-page":"1314","DOI":"10.1016\/j.jacc.2003.08.020","volume":"42","author":"AN DeMaria","year":"2003","unstructured":"DeMaria, A. N. (2003). What constitutes a great review? Journal of the American College of Cardiology, 42(7), 1314\u20131315. https:\/\/doi.org\/10.1016\/j.jacc.2003.08.020","journal-title":"Journal of the American College of Cardiology"},{"issue":"24","key":"5603_CR12","doi-asserted-by":"publisher","first-page":"2080","DOI":"10.2146\/ajhp170190","volume":"74","author":"RJ DiDomenico","year":"2017","unstructured":"DiDomenico, R. J., Baker, W. L., & Haines, S. T. (2017). Improving peer review: What reviewers can do. American Journal of Health-System Pharmacy, 74(24), 2080\u20132084. https:\/\/doi.org\/10.2146\/ajhp170190","journal-title":"American Journal of Health-System Pharmacy"},{"key":"5603_CR13","doi-asserted-by":"publisher","DOI":"10.51936\/fcfm6982","author":"D Fink-Hafner","year":"2019","unstructured":"Fink-Hafner, D., Dagen, T., Dou\u0161ak, M., Novak, M., & Hafner-Fink, M. (2019). Delphi method: Strengths and weaknesses. Advances in Methodology and Statistics. https:\/\/doi.org\/10.51936\/fcfm6982","journal-title":"Advances in Methodology and Statistics"},{"key":"5603_CR14","unstructured":"Ge, M., & Helfert, M. (2007). A review of information quality research-develop a research agenda. Proceedings of the 2007 International Conference on Information Quality, ICIQ 2007."},{"key":"5603_CR15","doi-asserted-by":"publisher","unstructured":"Ghosal, T., Kumar, S., Bharti, P. K., & Ekbal, A. (2022). Peer review analyze: A novel benchmark resource for computational analysis of peer reviews. In L. Jiao (Ed.), PLoS ONE (Vol. 17, Issue 1 January). Public Library of Science. https:\/\/doi.org\/10.1371\/journal.pone.0259238","DOI":"10.1371\/journal.pone.0259238"},{"key":"5603_CR16","doi-asserted-by":"crossref","unstructured":"Giannarou, L., & Zervas, E. (2014). Using Delphi technique to build consensus in practice. Journal of Business Science and Applied Management, 9(2).","DOI":"10.69864\/ijbsam.9-2.106"},{"issue":"6","key":"5603_CR17","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1097\/JU.0000000000003460","volume":"209","author":"R Golan","year":"2023","unstructured":"Golan, R., Reddy, R., Deebel, N. A., Ramasamy, R., & Harris, A. M. (2023). Peer review: A process primed for quality improvement? Journal of Urology, 209(6), 1069\u20131070. https:\/\/doi.org\/10.1097\/JU.0000000000003460","journal-title":"Journal of Urology"},{"issue":"6","key":"5603_CR18","doi-asserted-by":"publisher","first-page":"729","DOI":"10.1111\/j.1365-2648.1987.tb01376.x","volume":"12","author":"CM Goodman","year":"1987","unstructured":"Goodman, C. M. (1987). The Delphi technique: A critique. Journal of Advanced Nursing, 12(6), 729\u2013734. https:\/\/doi.org\/10.1111\/j.1365-2648.1987.tb01376.x","journal-title":"Journal of Advanced Nursing"},{"key":"5603_CR76","doi-asserted-by":"publisher","unstructured":"Hill, K. Q., & Fowles, J. (1975). The methodological worth of the Delphi forecasting technique. TechnologicalForecasting and Social Change, 7(2), 179\u2013192. https:\/\/doi.org\/10.1016\/0040-1625(75)90057-8","DOI":"10.1016\/0040-1625(75)90057-8"},{"issue":"1","key":"5603_CR19","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1186\/s41073-018-0051-5","volume":"3","author":"SP Horbach","year":"2018","unstructured":"Horbach, S. P., & Halffman, W. (2018). The changing forms and expectations of peer review. Research Integrity and Peer Review, 3(1), 8. https:\/\/doi.org\/10.1186\/s41073-018-0051-5","journal-title":"Research Integrity and Peer Review"},{"issue":"10","key":"5603_CR20","first-page":"1","volume":"12","author":"CC Hsu","year":"2007","unstructured":"Hsu, C. C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research and Evaluation, 12(10), 1\u20138.","journal-title":"Practical Assessment, Research and Evaluation"},{"issue":"2","key":"5603_CR21","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1177\/1474515113476605","volume":"12","author":"T Jaarsma","year":"2013","unstructured":"Jaarsma, T., Str\u00f6mberg, A., \u00c5restedt, K., Brostr\u00f6m, A., K\u00e4rner, A., M\u00e5rtensson, J., Moons, P., Thyl\u00e9n, I., & Thompson, D. R. (2013). A good manuscript review for the European Journal of Cardiovascular Nursing. European Journal of Cardiovascular Nursing, 12(2), 102\u2013103. https:\/\/doi.org\/10.1177\/1474515113476605","journal-title":"European Journal of Cardiovascular Nursing"},{"issue":"2","key":"5603_CR22","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1002\/LEAP.1283","volume":"33","author":"HR Jamali","year":"2020","unstructured":"Jamali, H. R., Nicholas, D., Watkinson, A., Abrizah, A., Rodr\u00edguez-Bravo, B., Boukacem-Zeghmouri, C., Xu, J., Polezhaeva, T., Herman, E., & \u015awigon, M. (2020). Early career researchers and their authorship and peer review beliefs and practices: An international study. Learned Publishing, 33(2), 142\u2013152. https:\/\/doi.org\/10.1002\/LEAP.1283","journal-title":"Learned Publishing"},{"key":"5603_CR23","volume-title":"Juran on quality by design: the new steps for planning quality into goods","author":"JM Juran","year":"1992","unstructured":"Juran, J. M. (1992). Juran on quality by design: the new steps for planning quality into goods. Simon and Schuster."},{"issue":"2","key":"5603_CR24","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1111\/j.1365-2648.2006.03716.x","volume":"53","author":"S Keeney","year":"2006","unstructured":"Keeney, S., Hasson, F., & McKenna, H. (2006). Consulting the oracle: Ten lessons from using the Delphi technique in nursing research. Journal of Advanced Nursing, 53(2), 205\u2013212. https:\/\/doi.org\/10.1111\/j.1365-2648.2006.03716.x","journal-title":"Journal of Advanced Nursing"},{"issue":"1","key":"5603_CR25","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1177\/1080569906287960","volume":"13","author":"AS Lee","year":"1995","unstructured":"Lee, A. S. (1995). Reviewing a manuscript for publication. Journal of Operations Management, 13(1), 87\u201392. https:\/\/doi.org\/10.1177\/1080569906287960","journal-title":"Journal of Operations Management"},{"key":"5603_CR26","unstructured":"Liu, C., Cui, J., Shang, R., Jia, Q., Rashid, P., & Gehringer, E. (2024). Generative AI for Peer Assessment Helpfulness Evaluation. Proceedings of the 17th International Conference on Educational Data Mining, 412\u2013419. 10.5281\/ZENODO.12729848"},{"issue":"1","key":"5603_CR27","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/1471-2288-7-4","volume":"7","author":"PJ Lucas","year":"2007","unstructured":"Lucas, P. J., Baird, J., Arai, L., Law, C., & Roberts, H. M. (2007). Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Medical Research Methodology, 7(1), 4. https:\/\/doi.org\/10.1186\/1471-2288-7-4","journal-title":"BMC Medical Research Methodology"},{"key":"5603_CR28","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1016\/j.procs.2022.03.059","volume":"201","author":"J Mattioli","year":"2022","unstructured":"Mattioli, J., Robic, P.-O., & Jesson, E. (2022). Information quality: The cornerstone for AI-based Industry 4.0. Procedia Computer Science, 201, 453\u2013460. https:\/\/doi.org\/10.1016\/j.procs.2022.03.059","journal-title":"Procedia Computer Science"},{"key":"5603_CR77","doi-asserted-by":"publisher","unstructured":"Mitchell, V. \u2010W, & McGoldrick, P. J. (1994). The Role of Geodemographics in Segmenting and Targeting ConsumerMarkets: A Delphi Study. European Journal of Marketing, 28(5), 54\u201372. https:\/\/doi.org\/10.1108\/03090569410062032","DOI":"10.1108\/03090569410062032"},{"key":"5603_CR29","doi-asserted-by":"publisher","unstructured":"Niederberger, M., Schifano, J., Deckert, S., Hirt, J., Homberg, A., K\u00f6berich, S., Kuhn, R., Rommel, A., Sonnberger, M., Alam, M., Backman, C., Banno, M., Bartoszko, J., Bloomfield, F., Bober, M. B., Chalkoo, M., Chan, T. M., Chen, Y., Coscia, C., Zhang, X. (2024). Delphi studies in social and health sciences\u2014Recommendations for an interdisciplinary standardized reporting (DELPHISTAR). Results of a Delphi study. PLOS ONE, 19(8). https:\/\/doi.org\/10.1371\/JOURNAL.PONE.0304651","DOI":"10.1371\/JOURNAL.PONE.0304651"},{"key":"5603_CR30","doi-asserted-by":"crossref","unstructured":"Nils Reimers, I. G. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT. 9th International Joint Conference on Natural Language Processing, 3982\u20133992.","DOI":"10.18653\/v1\/D19-1410"},{"issue":"1","key":"5603_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/S12913-021-06501-5","volume":"21","author":"G Parker","year":"2021","unstructured":"Parker, G., Kastner, M., Born, K., & Berta, W. (2021). Development of an implementation process model: A Delphi study. BMC Health Services Research, 21(1), 1\u201312. https:\/\/doi.org\/10.1186\/S12913-021-06501-5","journal-title":"BMC Health Services Research"},{"issue":"12","key":"5603_CR32","doi-asserted-by":"publisher","first-page":"2263","DOI":"10.1080\/03075079.2017.1320374","volume":"43","author":"MM Patchan","year":"2018","unstructured":"Patchan, M. M., Schunn, C. D., & Clark, R. J. (2018). Accountability in peer assessment: Examining the effects of reviewing grades on peer ratings and peer feedback. Studies in Higher Education, 43(12), 2263\u20132278. https:\/\/doi.org\/10.1080\/03075079.2017.1320374","journal-title":"Studies in Higher Education"},{"issue":"12","key":"5603_CR33","doi-asserted-by":"publisher","first-page":"2229","DOI":"10.1185\/03007995.2011.624090","volume":"27","author":"JS Phillips","year":"2011","unstructured":"Phillips, J. S. (2011). Expert bias in peer review. Current Medical Research and Opinion, 27(12), 2229\u20132233. https:\/\/doi.org\/10.1185\/03007995.2011.624090","journal-title":"Current Medical Research and Opinion"},{"issue":"2","key":"5603_CR34","first-page":"92","volume":"34","author":"JM Provenzale","year":"2006","unstructured":"Provenzale, J. M., & Stanley, R. J. (2006). A systematic guide to reviewing a manuscript. Journal of Nuclear Medicine Technology, 34(2), 92\u201399.","journal-title":"Journal of Nuclear Medicine Technology"},{"issue":"2","key":"5603_CR35","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/s11192-013-1002-z","volume":"97","author":"A Ragone","year":"2013","unstructured":"Ragone, A., Mirylenka, K., Casati, F., & Marchese, M. (2013). On peer review in computer science: Analysis of its effectiveness and suggestions for improvement. Scientometrics, 97(2), 317\u2013356. https:\/\/doi.org\/10.1007\/s11192-013-1002-z","journal-title":"Scientometrics"},{"issue":"3","key":"5603_CR36","doi-asserted-by":"publisher","first-page":"iii","DOI":"10.25300\/MISQ\/2016\/40.3.E0","volume":"40","author":"A Rai","year":"2016","unstructured":"Rai, A. (2016). Editor\u2019s comments: Writing a virtuous review. MIS Quarterly, 40(3), iii\u2013x.","journal-title":"MIS Quarterly"},{"issue":"3","key":"5603_CR37","doi-asserted-by":"publisher","first-page":"534","DOI":"10.1007\/s40593-016-0132-x","volume":"27","author":"L Ramachandran","year":"2017","unstructured":"Ramachandran, L., Gehringer, E. F., & Yadav, R. K. (2017). Automated assessment of the quality of peer reviews using Natural Language Processing techniques. International Journal of Artificial Intelligence in Education, 27(3), 534\u2013581. https:\/\/doi.org\/10.1007\/s40593-016-0132-x","journal-title":"International Journal of Artificial Intelligence in Education"},{"issue":"12","key":"5603_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0189311","volume":"12","author":"T Ross-Hellauer","year":"2017","unstructured":"Ross-Hellauer, T., Deppe, A., & Schmidt, B. (2017). Survey on open peer review: Attitudes and experience amongst editors, authors and reviewers. PLoS ONE, 12(12), 1\u201328. https:\/\/doi.org\/10.1371\/journal.pone.0189311","journal-title":"PLoS ONE"},{"issue":"4","key":"5603_CR39","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1016\/S0169-2070(99)00018-7","volume":"15","author":"G Rowe","year":"1999","unstructured":"Rowe, G., & Wright, G. (1999). The Delphi technique as a forecasting tool: Issues and analysis. International Journal of Forecasting, 15(4), 353\u2013375. https:\/\/doi.org\/10.1016\/S0169-2070(99)00018-7","journal-title":"International Journal of Forecasting"},{"key":"5603_CR40","doi-asserted-by":"crossref","unstructured":"Sahil Sanjeev Salvi, S. S. K. (2020). Quality Assurance and Quality Control for Project Effectiveness in Construction and Management . International Journal of Engineering Research & Technology, 9(02).","DOI":"10.17577\/IJERTV9IS020028"},{"key":"5603_CR41","doi-asserted-by":"publisher","unstructured":"Severin, A., Strinzel, M., Egger, M., Barros, T., Sokolov, A., Mouatt, J. V., & M\u00fcller, S. (2022). Journal Impact Factor and Peer Review Thoroughness and Helpfulness: A Supervised Machine Learning Study. https:\/\/doi.org\/10.48550\/arxiv.2207.09821","DOI":"10.48550\/arxiv.2207.09821"},{"key":"5603_CR42","unstructured":"Shankar, G., & Watts, S. (2003). a Relevant , Believable Approach for Data Quality Assessment. 8th International Conference on Information Quality, 178\u2013189."},{"key":"5603_CR43","doi-asserted-by":"publisher","unstructured":"Sizo, A., Lino, A., Reis, L. P., & Rocha, \u00c1. (2018, July 20). An overview of assessing the quality of peer review reports of scientific articles. International Journal of Information Management. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2018.07.002","DOI":"10.1016\/j.ijinfomgt.2018.07.002"},{"key":"5603_CR44","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-025-02435-0","author":"A Sizo","year":"2025","unstructured":"Sizo, A., Lino, A., Rocha, \u00c1., & Reis, L. P. (2025). Defining quality in peer review reports: A scoping review. Knowledge and Information Systems. https:\/\/doi.org\/10.1007\/s10115-025-02435-0","journal-title":"Knowledge and Information Systems"},{"issue":"1","key":"5603_CR45","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1186\/s12874-019-0688-x","volume":"19","author":"C Superchi","year":"2019","unstructured":"Superchi, C., Gonz\u00e1lez, J. A., Sol\u00e0, I., Cobo, E., Hren, D., & Boutron, I. (2019). Tools used to assess the quality of peer review reports: A methodological systematic review. BMC Medical Research Methodology, 19(1), 48. https:\/\/doi.org\/10.1186\/s12874-019-0688-x","journal-title":"BMC Medical Research Methodology"},{"key":"5603_CR46","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2019-035604","author":"C Superchi","year":"2020","unstructured":"Superchi, C., Hren, D., Blanco, D., Rius, R., Recchioni, A., Boutron, I., & Gonz\u00e1lez, J. A. (2020). Development of ARCADIA: A tool for assessing the quality of peer-review reports in biomedical research. British Medical Journal Open. https:\/\/doi.org\/10.1136\/bmjopen-2019-035604","journal-title":"British Medical Journal Open"},{"issue":"5","key":"5603_CR47","doi-asserted-by":"publisher","first-page":"1057","DOI":"10.1108\/OIR-11-2019-0347","volume":"44","author":"M Thelwall","year":"2020","unstructured":"Thelwall, M. (2020). Automatically detecting open academic review praise and criticism. Online Information Review, 44(5), 1057\u20131076. https:\/\/doi.org\/10.1108\/OIR-11-2019-0347","journal-title":"Online Information Review"},{"issue":"2","key":"5603_CR48","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s10897-014-9802-8","volume":"24","author":"V Venne","year":"2015","unstructured":"Venne, V. (2015). Reviewing manuscripts for the Journal of Genetic Counseling: Practical suggestions. Journal of Genetic Counseling, 24(2), 189\u2013192. https:\/\/doi.org\/10.1007\/s10897-014-9802-8","journal-title":"Journal of Genetic Counseling"},{"issue":"2","key":"5603_CR49","doi-asserted-by":"publisher","first-page":"69","DOI":"10.12968\/ijtr.2009.16.2.38892","volume":"16","author":"W Vernon","year":"2013","unstructured":"Vernon, W., & Vernon, W. (2013). The Delphi technique: A review. International Journal of Therapy and Rehabilitation, 16(2), 69\u201376. https:\/\/doi.org\/10.12968\/ijtr.2009.16.2.38892","journal-title":"International Journal of Therapy and Rehabilitation"},{"issue":"12","key":"5603_CR50","doi-asserted-by":"publisher","first-page":"2573","DOI":"10.1038\/s41366-018-0313-9","volume":"43","author":"C Vogel","year":"2019","unstructured":"Vogel, C., Zwolinsky, S., Griffiths, C., Hobbs, M., Henderson, E., & Wilkins, E. (2019). A Delphi study to build consensus on the definition and use of big data in obesity research. International Journal of Obesity, 43(12), 2573\u20132586. https:\/\/doi.org\/10.1038\/s41366-018-0313-9","journal-title":"International Journal of Obesity"},{"issue":"8","key":"5603_CR51","doi-asserted-by":"publisher","first-page":"1525","DOI":"10.1016\/J.TECHFORE.2012.04.013","volume":"79","author":"HA von der Gracht","year":"2012","unstructured":"von der Gracht, H. A. (2012). Consensus measurement in Delphi studies: Review and implications for future quality assurance. Technological Forecasting and Social Change, 79(8), 1525\u20131536. https:\/\/doi.org\/10.1016\/J.TECHFORE.2012.04.013","journal-title":"Technological Forecasting and Social Change"},{"issue":"11","key":"5603_CR52","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1145\/240455.240479","volume":"39","author":"Y Wand","year":"1996","unstructured":"Wand, Y., & Wang, R. Y. (1996). Anchoring data quality dimensions in ontological foundations. Communications of the ACM, 39(11), 86\u201395. https:\/\/doi.org\/10.1145\/240455.240479","journal-title":"Communications of the ACM"},{"issue":"4","key":"5603_CR53","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1177\/1534484318809724","volume":"17","author":"J Wang","year":"2018","unstructured":"Wang, J. (2018). Making a difference through quality manuscript review. Human Resource Development Review, 17(4), 339\u2013348. https:\/\/doi.org\/10.1177\/1534484318809724","journal-title":"Human Resource Development Review"},{"issue":"4","key":"5603_CR54","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","volume":"12","author":"RY Wang","year":"1996","unstructured":"Wang, R. Y., & Strong, D. M. (1996). Beyond accuracy: What data quality means to data consumers. Journal of Management Information Systems, 12(4), 5\u201334. https:\/\/doi.org\/10.1080\/07421222.1996.11518099","journal-title":"Journal of Management Information Systems"},{"issue":"13","key":"5603_CR55","doi-asserted-by":"publisher","first-page":"4871","DOI":"10.1080\/01431161.2019.1596342","volume":"40","author":"TA Warner","year":"2019","unstructured":"Warner, T. A. (2019). How to write an effective peer-review report: An editor\u2019s perspective. International Journal of Remote Sensing, 40(13), 4871\u20134875. https:\/\/doi.org\/10.1080\/01431161.2019.1596342","journal-title":"International Journal of Remote Sensing"},{"issue":"6472","key":"5603_CR56","doi-asserted-by":"publisher","first-page":"1433","DOI":"10.1126\/science.366.6472.1433","volume":"366","author":"C Wilcox","year":"2019","unstructured":"Wilcox, C. (2019). Rude reviews are pervasive and sometimes harmful, study finds. Science, 366(6472), 1433\u20131433. https:\/\/doi.org\/10.1126\/science.366.6472.1433","journal-title":"Science"},{"key":"5603_CR57","unstructured":"Xiong, W., & Litman, D. (2011). Automatically predicting peer-review helpfulness. ACL-HLT 2011 - Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 2, 502\u2013507. http:\/\/www.wjh.harvard.edu\/"},{"key":"5603_CR58","unstructured":"Zhang, J., Zhang, H., Deng, Z., & Roth, D. (2022). Investigating Fairness Disparities in Peer Review: A Language Model Enhanced Approach. https:\/\/arxiv.org\/abs\/2211.06398v1"},{"key":"5603_CR59","unstructured":"Zhu, Z., Bernhard, D., & Gurevych, I. (2009). Amulti-dimensional model for assessing the quality of answers in social Q&A sites. Proceedings of the 2009 International Conference on Information Quality, ICIQ 2009. http:\/\/www.ukp.tu-darmstadt.de"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-026-05603-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-026-05603-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-026-05603-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T06:56:37Z","timestamp":1777100197000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-026-05603-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,23]]},"references-count":62,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["5603"],"URL":"https:\/\/doi.org\/10.1007\/s11192-026-05603-3","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,23]]},"assertion":[{"value":"1 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 March 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 March 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The author(s) declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}