{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T13:56:14Z","timestamp":1776779774409,"version":"3.51.2"},"reference-count":82,"publisher":"MIT Press","issue":"4","content-domain":{"domain":["www.mitpressjournals.org"],"crossmark-restriction":true},"short-container-title":["Quantitative Science Studies"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:p>Since the 1980s, many different methods have been proposed to field-normalize citations. In this study, an approach is introduced that combines two previously introduced methods: citing-side normalization and citation percentiles. The advantage of combining two methods is that their advantages can be integrated in one solution. Based on citing-side normalization, each citation is field weighted and, therefore, contextualized in its field. The most important advantage of citing-side normalization is that it is not necessary to work with a specific field categorization scheme for the normalization procedure. The disadvantages of citing-side normalization\u2014the calculation is complex and the numbers are elusive\u2014can be compensated for by calculating percentiles based on weighted citations that result from citing-side normalization. On the one hand, percentiles are easy to understand: They are the percentage of papers published in the same year with a lower citation impact. On the other hand, weighted citation distributions are skewed distributions with outliers. Percentiles are well suited to assigning the position of a focal paper in such distributions of comparable papers. The new approach of calculating percentiles based on weighted citations is demonstrated in this study on the basis of a citation impact comparison between several countries.<\/jats:p>","DOI":"10.1162\/qss_a_00089","type":"journal-article","created":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T19:09:52Z","timestamp":1599764992000},"page":"1553-1569","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":16,"title":["How can citation impact in bibliometrics be normalized? A new approach combining citing-side normalization and citation percentiles"],"prefix":"10.1162","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0810-7091","authenticated-orcid":true,"given":"Lutz","family":"Bornmann","sequence":"first","affiliation":[{"name":"Division for Science and Innovation Studies, Administrative Headquarters of the Max Planck Society, Hofgartenstr. 8, 80539 Munich, Germany"}]}],"member":"281","reference":[{"key":"bib1","volume-title":"Interdisciplinary research: Methodologies for identification and assessment. Do we know what we are measuring?","author":"Adams J.","year":"2016"},{"issue":"1","key":"bib2","doi-asserted-by":"crossref","DOI":"10.1177\/2158244019829575","volume":"9","author":"Aksnes D. W.","year":"2019","journal-title":"Sage Open"},{"issue":"10","key":"bib3","doi-asserted-by":"crossref","first-page":"2166","DOI":"10.1002\/asi.23554","volume":"66","author":"Bornmann L.","year":"2015","journal-title":"Journal of the Association For Information Science and Technology"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00012"},{"key":"bib5","doi-asserted-by":"crossref","first-page":"201","DOI":"10.7551\/mitpress\/9445.003.0015","volume-title":"Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact","author":"Bornmann L.","year":"2014"},{"issue":"11","key":"bib6","doi-asserted-by":"crossref","first-page":"1841","DOI":"10.1002\/asi.20901","volume":"59","author":"Bornmann L.","year":"2008","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"bib7","doi-asserted-by":"crossref","first-page":"e56768","DOI":"10.1371\/journal.pone.0056768","volume":"8","author":"Bornmann L.","year":"2013","journal-title":"PLOS ONE"},{"issue":"1","key":"bib8","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.joi.2012.10.001","volume":"7","author":"Bornmann L.","year":"2013","journal-title":"Journal of Informetrics"},{"issue":"2","key":"bib9","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1007\/s11192-019-03018-x","volume":"120","author":"Bornmann L.","year":"2019","journal-title":"Scientometrics"},{"issue":"1","key":"bib10","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s11192-013-1161-y","volume":"98","author":"Bornmann L.","year":"2014","journal-title":"Scientometrics"},{"issue":"2","key":"bib11","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1016\/j.joi.2015.01.006","volume":"9","author":"Bornmann L.","year":"2015","journal-title":"Journal of Informetrics"},{"issue":"2","key":"bib12","doi-asserted-by":"crossref","first-page":"78","DOI":"10.3390\/publications1020078","volume":"1","author":"Bornmann L.","year":"2013","journal-title":"Publications"},{"issue":"9","key":"bib13","doi-asserted-by":"crossref","first-page":"1939","DOI":"10.1002\/asi.23152","volume":"65","author":"Bornmann L.","year":"2014","journal-title":"Journal of the Association For Information Science and Technology"},{"issue":"1","key":"bib14","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1002\/asi.21418","volume":"62","author":"Bornmann L.","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"bib15","doi-asserted-by":"crossref","first-page":"e0194805","DOI":"10.1371\/journal.pone.0194805","volume":"13","author":"Bornmann L.","year":"2018","journal-title":"PLOS ONE"},{"key":"bib16","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1007\/s11192-020-03512-7","volume":"124","author":"Bornmann L.","year":"2020","journal-title":"Scientometrics"},{"issue":"2","key":"bib17","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1007\/s11192-019-03140-w","volume":"120","author":"Bornmann L.","year":"2019","journal-title":"Scientometrics"},{"issue":"12","key":"bib18","doi-asserted-by":"crossref","first-page":"2389","DOI":"10.1002\/asi.21419","volume":"61","author":"Boyack K. W.","year":"2010","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"bib19","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.joi.2010.09.003","volume":"5","author":"Colliander C.","year":"2011","journal-title":"Journal of Informetrics"},{"issue":"1","key":"bib20","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/s11192-019-03121-z","volume":"120","author":"Colliander C.","year":"2019","journal-title":"Scientometrics"},{"issue":"3","key":"bib21","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1177\/1536867X0500500312","volume":"5","author":"Cox N. J.","year":"2005","journal-title":"Stata Journal"},{"issue":"3","key":"bib22","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0058727","volume":"8","author":"Crespo J. A.","year":"2013","journal-title":"PLOS ONE"},{"issue":"2","key":"bib23","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1007\/s11192-017-2495-7","volume":"113","author":"D\u2019Agostino M.","year":"2017","journal-title":"Scientometrics"},{"key":"bib24","volume-title":"Bibliometrics and citation analysis: From the Science Citation Index to cybermetrics","author":"de Bellis N.","year":"2009"},{"key":"bib25","doi-asserted-by":"crossref","DOI":"10.1108\/S1876-0562(2005)05","volume-title":"Power laws in the information production process: Lotkaian informetrics","author":"Egghe L.","year":"2005"},{"issue":"2","key":"bib26","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/j.jeconom.2006.10.021","volume":"139","author":"Fok D.","year":"2007","journal-title":"Journal of Econometrics"},{"issue":"7781","key":"bib27","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1038\/d41586-019-03308-7","volume":"575","author":"Gates A. J.","year":"2019","journal-title":"Nature"},{"issue":"1","key":"bib28","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1007\/s11192-012-0898-z","volume":"96","author":"Gl\u00e4nzel W.","year":"2013","journal-title":"Scientometrics"},{"issue":"3","key":"bib29","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1093\/reseval\/rvx018","volume":"26","author":"Hammarfelt B.","year":"2017","journal-title":"Research Evaluation"},{"issue":"2","key":"bib30","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1016\/j.joi.2018.03.004","volume":"12","author":"Haunschild R.","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"7548","key":"bib31","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","volume":"520","author":"Hicks D.","year":"2015","journal-title":"Nature"},{"issue":"46","key":"bib32","doi-asserted-by":"crossref","first-page":"16569","DOI":"10.1073\/pnas.0507655102","volume":"102","author":"Hirsch J. E.","year":"2005","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"bib33","volume":"34","author":"Hou J.","year":"2019","journal-title":"Computer Science Review"},{"issue":"9","key":"bib34","doi-asserted-by":"crossref","first-page":"e1002542","DOI":"10.1371\/journal.pbio.1002542","volume":"14","author":"Ioannidis J. P. A.","year":"2016","journal-title":"PLOS Biology"},{"issue":"6","key":"bib35","doi-asserted-by":"crossref","first-page":"e0199031","DOI":"10.1371\/journal.pone.0199031","volume":"13","author":"Jappe A.","year":"2018","journal-title":"PLOS ONE"},{"issue":"1","key":"bib36","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1023\/A:1014831920172","volume":"53","author":"Kostoff R. N.","year":"2002","journal-title":"Scientometrics"},{"issue":"2","key":"bib37","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/s11051-005-9034-9","volume":"8","author":"Kostoff R. N.","year":"2006","journal-title":"Journal of Nanoparticle Research"},{"issue":"1","key":"bib38","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1146\/annurev-soc-070308-120022","volume":"38","author":"Lamont M.","year":"2012","journal-title":"Annual Review of Sociology"},{"issue":"2","key":"bib39","doi-asserted-by":"crossref","first-page":"193","DOI":"10.5771\/0038-6073-2015-2-193","volume":"66","author":"Leydesdorff L.","year":"2015","journal-title":"Soziale Welt"},{"issue":"11","key":"bib40","doi-asserted-by":"crossref","first-page":"2299","DOI":"10.1002\/asi.22911","volume":"64","author":"Leydesdorff L.","year":"2013","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"bib41","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1016\/j.joi.2014.05.002","volume":"8","author":"Leydesdorff L.","year":"2014","journal-title":"Journal of Informetrics"},{"issue":"2","key":"bib42","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.joi.2006.09.007","volume":"1","author":"Lundberg J.","year":"2007","journal-title":"Journal of Informetrics"},{"issue":"2","key":"bib43","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1007\/s11192-014-1499-9","volume":"102","author":"Marx W.","year":"2015","journal-title":"Scientometrics"},{"issue":"4","key":"bib44","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1109\/TEM.1983.6448622","volume":"30","author":"McAllister P. R.","year":"1983","journal-title":"IEEE Transactions on Engineering Management"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00014"},{"issue":"1","key":"bib46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ejor.2015.04.002","volume":"246","author":"Mingers J.","year":"2015","journal-title":"European Journal of Operational Research"},{"key":"bib47","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-60522-7","volume-title":"Applied evaluative informetrics","author":"Moed H. F.","year":"2017"},{"issue":"10","key":"bib48","first-page":"1988","volume":"66","author":"Moed H. F.","year":"2015","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"bib49","volume-title":"Evaluative bibliometrics: The use of publication and citation analysis in the evaluation of scientific activity","author":"Narin F.","year":"1976"},{"issue":"10","key":"bib50","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1177\/0146167210378111","volume":"36","author":"Nosek B. A.","year":"2010","journal-title":"Personality and Social Psychology Bulletin"},{"issue":"10","key":"bib51","first-page":"1144","volume":"103","author":"Panchal H.","year":"2012","journal-title":"Current Science"},{"issue":"4","key":"bib52","volume":"83","author":"Radicchi F.","year":"2011","journal-title":"Physical Review E"},{"issue":"1","key":"bib53","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.joi.2014.11.010","volume":"9","author":"Ruiz-Castillo J.","year":"2015","journal-title":"Journal of Informetrics"},{"key":"bib54","doi-asserted-by":"crossref","first-page":"17064","DOI":"10.1057\/palcomms.2017.64","volume":"3","author":"Ruocco G.","year":"2017","journal-title":"Palgrave Communications"},{"issue":"3","key":"bib55","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1007\/s11192-013-0984-x","volume":"97","author":"Schreiber M.","year":"2013","journal-title":"Scientometrics"},{"issue":"5","key":"bib56","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/BF02017249","volume":"9","author":"Schubert A.","year":"1986","journal-title":"Scientometrics"},{"issue":"9","key":"bib57","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1002\/(SICI)1097-4571(199210)43:9<628::AID-ASI5>3.0.CO;2-0","volume":"43","author":"Seglen P. O.","year":"1992","journal-title":"Journal of the American Society for Information Science"},{"issue":"1","key":"bib58","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.joi.2018.12.005","volume":"13","author":"Shu F.","year":"2019","journal-title":"Journal of Informetrics"},{"issue":"3","key":"bib60","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1007\/s11192-012-0647-3","volume":"91","author":"Smolinsky L.","year":"2012","journal-title":"Scientometrics"},{"key":"bib61","volume-title":"Performance and structures of the German science system 2020. Studies on the German innovation system No. 5-2020","author":"Stephen D.","year":"2020"},{"issue":"2","key":"bib62","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.joi.2009.12.001","volume":"4","author":"Strotmann A.","year":"2010","journal-title":"Journal of Informetrics"},{"issue":"4","key":"bib63","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1108\/JD-06-2014-0082","volume":"71","author":"Sugimoto C. R.","year":"2015","journal-title":"Journal of Documentation"},{"key":"bib64","volume-title":"White paper on bibliometrics, measuring research outputs through bibliometrics","author":"University of Waterloo Working Group on Bibliometrics","year":"2016"},{"issue":"7524","key":"bib65","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1038\/514550a","volume":"514","author":"van Noorden R.","year":"2014","journal-title":"Nature"},{"key":"bib66","first-page":"17","volume-title":"Bibliometrics: Use and Abuse in the Review of Research Performance","author":"van Raan A. F. J.","year":"2014"},{"key":"bib67","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/978-3-030-02511-3_10","volume-title":"Springer Handbook of Science and Technology Indicators","author":"van Raan A. F. J.","year":"2019"},{"issue":"3","key":"bib68","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0193762","volume":"13","author":"Vernon M. M.","year":"2018","journal-title":"PLOS ONE"},{"issue":"3","key":"bib69","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/BF02026039","volume":"10","author":"Vinkler P.","year":"1986","journal-title":"Scientometrics"},{"issue":"2","key":"bib70","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.joi.2016.02.007","volume":"10","author":"Waltman L.","year":"2016","journal-title":"Journal of Informetrics"},{"issue":"12","key":"bib71","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1002\/asi.22748","volume":"63","author":"Waltman L.","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"bib72","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1007\/s11192-012-0913-4","volume":"96","author":"Waltman L.","year":"2013","journal-title":"Scientometrics"},{"issue":"4","key":"bib73","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/j.joi.2013.08.002","volume":"7","author":"Waltman L.","year":"2013","journal-title":"Journal of Informetrics"},{"key":"bib74","first-page":"541","volume-title":"Proceedings of the 21st International Conference on Science and Technology Indicator","author":"Waltman L.","year":"2016"},{"key":"bib75","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/978-3-030-02511-3_11","volume-title":"Springer Handbook of Science and Technology Indicators","author":"Waltman L.","year":"2019"},{"issue":"2","key":"bib76","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.joi.2012.11.011","volume":"7","author":"Waltman L.","year":"2013","journal-title":"Journal of Informetrics"},{"issue":"1","key":"bib77","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.joi.2010.08.001","volume":"5","author":"Waltman L.","year":"2011","journal-title":"Journal of Informetrics"},{"issue":"3","key":"bib78","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1007\/s11192-012-0775-9","volume":"94","author":"Wang J.","year":"2013","journal-title":"Scientometrics"},{"issue":"2","key":"bib79","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/j.joi.2016.02.003","volume":"10","author":"Wang Q.","year":"2016","journal-title":"ournal of Informetrics"},{"key":"bib80","doi-asserted-by":"crossref","DOI":"10.4135\/9781473978782","volume-title":"The metric tide: Report of the independent review of the role of metrics in research assessment and management","author":"Wilsdon J.","year":"2015"},{"key":"bib81","volume-title":"The metric tide: Literature review (supplementary report I to the independent review of the role of metrics in research assessment and management)","author":"Wouters P.","year":"2015"},{"issue":"2","key":"bib82","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1007\/s11192-005-0218-y","volume":"63","author":"Zitt M.","year":"2005","journal-title":"Scientometrics"},{"issue":"11","key":"bib83","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1002\/asi.20880","volume":"59","author":"Zitt M.","year":"2008","journal-title":"Journal of the American Society for Information Science and Technology"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/qss_a_00089","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,13]],"date-time":"2024-08-13T15:55:37Z","timestamp":1723564537000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/4\/1553-1569\/96120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12]]},"references-count":82,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["10.1162\/qss_a_00089"],"URL":"https:\/\/doi.org\/10.1162\/qss_a_00089","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12]]},"assertion":[{"value":"2020-05-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}