{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T10:07:35Z","timestamp":1775815655414,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Although citations are used as a quantifiable, objective metric of academic influence, references could be added to a paper solely to inflate the perceived influence of a body of research. This reference list manipulation (RLM) could take place during the peer-review process, or prior to it. Surveys have estimated how many people may have been affected by coercive RLM at one time or another, but it is not known how many authors engage in RLM, nor to what degree. By examining a subset of active, highly published authors (n\u2009=\u200920,803) in PubMed, we find the frequency of non-self-citations (NSC) to one author coming from a single paper approximates Zipf\u2019s law. Author-centric deviations from it are approximately normally distributed, permitting deviations to be quantified statistically. Framed as an anomaly detection problem, statistical confidence increases when an author is an outlier by multiple metrics. Anomalies are not proof of RLM, but authors engaged in RLM will almost unavoidably create anomalies. We find the NSC Gini Index correlates highly with anomalous patterns across multiple \u201cred flags\u201d, each suggestive of RLM. Between 81 (0.4%, FDR\u2009&lt;\u20090.05) and 231 (1.1%, FDR\u2009&lt;\u20090.10) authors are outliers on the curve, suggestive of chronic, repeated RLM. Approximately 16% of all authors may have engaged in RLM to some degree. Authors who use 18% or more of their references for self-citation are significantly more likely to have NSC Gini distortions, suggesting a potential willingness to coerce others to cite them.<\/jats:p>","DOI":"10.1007\/s11192-022-04503-6","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T06:18:47Z","timestamp":1662617927000},"page":"5753-5771","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Detecting anomalous referencing patterns in PubMed papers suggestive of author-centric reference list manipulation"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2776-3545","authenticated-orcid":false,"given":"Jonathan D.","family":"Wren","sequence":"first","affiliation":[]},{"given":"Constantin","family":"Georgescu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"4503_CR1","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1016\/j.procs.2015.08.220","volume":"60","author":"S Agrawal","year":"2015","unstructured":"Agrawal, S., & Agrawal, J. (2015). Survey on anomaly detection using data mining techniques. Procedia Computer Science, 60, 708\u2013713.","journal-title":"Procedia Computer Science"},{"key":"4503_CR2","unstructured":"Baas, J., & Fennell, C. (2019). When Peer Reviewers Go Rogue - Estimated Prevalence of Citation Manipulation by Reviewers Based on the Citation Patterns of 69,000 Reviewers. ISSI 2019, Rome, Italy."},{"issue":"7611","key":"4503_CR3","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1038\/535201a","volume":"535","author":"M Biagioli","year":"2016","unstructured":"Biagioli, M. (2016). Watch out for cheats in citation game. Nature, 535(7611), 201. https:\/\/doi.org\/10.1038\/535201a","journal-title":"Nature"},{"key":"4503_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtbi.2020.110171","volume":"488","author":"M Chaplain","year":"2020","unstructured":"Chaplain, M., Kirschner, D., & Iwasa, Y. (2020). JTB editorial malpractice: A case report. Journal of Theoretical Biology, 488, 110171. https:\/\/doi.org\/10.1016\/j.jtbi.2020.110171","journal-title":"Journal of Theoretical Biology"},{"issue":"5","key":"4503_CR5","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1517\/14712598.2012.674507","volume":"12","author":"C Chen","year":"2012","unstructured":"Chen, C., Hu, Z., Liu, S., & Tseng, H. (2012). Emerging trends in regenerative medicine: A scientometric analysis in CiteSpace. Expert Opinion on Biological Therapy, 12(5), 593\u2013608. https:\/\/doi.org\/10.1517\/14712598.2012.674507","journal-title":"Expert Opinion on Biological Therapy"},{"key":"4503_CR6","first-page":"231","volume-title":"The concise encyclopedia of statistics","author":"Y Dodge","year":"2008","unstructured":"Dodge, Y. (2008). Gini index. The concise encyclopedia of statistics (pp. 231\u2013234). Springer."},{"issue":"12","key":"4503_CR7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0187394","volume":"12","author":"EA Fong","year":"2017","unstructured":"Fong, E. A., & Wilhite, A. W. (2017). Authorship and citation manipulation in academic research. PLoS ONE, 12(12), e0187394. https:\/\/doi.org\/10.1371\/journal.pone.0187394","journal-title":"PLoS ONE"},{"issue":"3","key":"4503_CR8","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1007\/s11192-007-1777-2","volume":"72","author":"JH Fowler","year":"2007","unstructured":"Fowler, J. H., & Aksnes, D. W. (2007). Does self-citation pay? Scientometrics, 72(3), 427\u2013437.","journal-title":"Scientometrics"},{"issue":"4","key":"4503_CR9","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.90.042815","volume":"90","author":"A Ghosh","year":"2014","unstructured":"Ghosh, A., Chatterjee, A., Chakrabarti, A. S., & Chakrabarti, B. K. (2014). Zipf\u2019s law in city size from a resource utilization model. Physical Review, 90(4), 042815. https:\/\/doi.org\/10.1103\/PhysRevE.90.042815","journal-title":"Physical Review"},{"issue":"4","key":"4503_CR10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0153730","volume":"11","author":"P Heneberg","year":"2016","unstructured":"Heneberg, P. (2016). From excessive journal self-cites to citation stacking: Analysis of journal self-citation kinetics in search for journals, which boost their scientometric indicators. PLoS ONE, 11(4), e0153730. https:\/\/doi.org\/10.1371\/journal.pone.0153730","journal-title":"PLoS ONE"},{"issue":"7","key":"4503_CR11","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1002\/sim.4780090710","volume":"9","author":"Y Hochberg","year":"1990","unstructured":"Hochberg, Y., & Benjamini, Y. (1990). More powerful procedures for multiple significance testing. Statistics in Medicine, 9(7), 811\u2013818. https:\/\/doi.org\/10.1002\/sim.4780090710","journal-title":"Statistics in Medicine"},{"issue":"2","key":"4503_CR12","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.atherosclerosis.2013.07.051","volume":"230","author":"S Huggett","year":"2013","unstructured":"Huggett, S. (2013). Journal bibliometrics indicators and citation ethics: A discussion of current issues. Atherosclerosis, 230(2), 275\u2013277. https:\/\/doi.org\/10.1016\/j.atherosclerosis.2013.07.051","journal-title":"Atherosclerosis"},{"issue":"1","key":"4503_CR13","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.jpsychores.2014.11.008","volume":"78","author":"JP Ioannidis","year":"2015","unstructured":"Ioannidis, J. P. (2015). A generalized view of self-citation: Direct, co-author, collaborative, and coercive induced self-citation. Journal of Psychosomatic Research, 78(1), 7\u201311. https:\/\/doi.org\/10.1016\/j.jpsychores.2014.11.008","journal-title":"Journal of Psychosomatic Research"},{"issue":"8","key":"4503_CR14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3000384","volume":"17","author":"JPA Ioannidis","year":"2019","unstructured":"Ioannidis, J. P. A., Baas, J., Klavans, R., & Boyack, K. W. (2019). A standardized citation metrics author database annotated for scientific field. PLoS Biology, 17(8), e3000384. https:\/\/doi.org\/10.1371\/journal.pbio.3000384","journal-title":"PLoS Biology"},{"issue":"6","key":"4503_CR15","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1016\/j.jpsychores.2015.08.004","volume":"79","author":"AW Levis","year":"2015","unstructured":"Levis, A. W., Leentjens, A. F., Levenson, J. L., Lumley, M. A., & Thombs, B. D. (2015). Comparison of self-citation by peer reviewers in a journal with single-blind peer review versus a journal with open peer review. Journal of Psychosomatic Research, 79(6), 561\u2013565. https:\/\/doi.org\/10.1016\/j.jpsychores.2015.08.004","journal-title":"Journal of Psychosomatic Research"},{"key":"4503_CR16","unstructured":"Lopez-Cozar, E. D., Robinson-Garcia, N., & Torres-Salinas, D. (2012). Manipulating Google Scholar Citations and Google Scholar Metrics: simple, easy and tempting. arXiv.org 1212.0638."},{"key":"4503_CR17","unstructured":"Lubrano, M. (2013). The econometrics of inequality and poverty. Lecture 4: Lorenz curves, the Gini coefficient and parametric distributions. In. http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.642.7285&rep=rep1&type=pdf"},{"key":"4503_CR18","doi-asserted-by":"publisher","first-page":"1005","DOI":"10.1016\/j.respol.2013.03.011","volume":"42","author":"BR Martin","year":"2013","unstructured":"Martin, B. R. (2013). Whither research integrity? Plagiarism, self-plagiarism, and coercive citation in the age of research assessment. Research Policy, 42, 1005\u20131014.","journal-title":"Research Policy"},{"key":"4503_CR19","unstructured":"MDPI_report. (2020). https:\/\/www.mdpi.com\/1422-0067\/21\/1\/75\/review_report."},{"issue":"3","key":"4503_CR20","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1007\/s11948-008-9059-4","volume":"14","author":"DB Resnik","year":"2008","unstructured":"Resnik, D. B., Gutierrez-Ford, C., & Peddada, S. (2008). Perceptions of ethical problems with scientific journal peer review: An exploratory study. Science and Engineering Ethics, 14(3), 305\u2013310. https:\/\/doi.org\/10.1007\/s11948-008-9059-4","journal-title":"Science and Engineering Ethics"},{"issue":"6","key":"4503_CR21","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.113.068102","volume":"113","author":"DJ Schwab","year":"2014","unstructured":"Schwab, D. J., Nemenman, I., & Mehta, P. (2014). Zipf\u2019s law and criticality in multivariate data without fine-tuning. Physical Review Letters, 113(6), 068102. https:\/\/doi.org\/10.1103\/PhysRevLett.113.068102","journal-title":"Physical Review Letters"},{"key":"4503_CR22","volume-title":"On economic inequality","author":"A Sen","year":"1997","unstructured":"Sen, A., Sen, M., Amarthya, S., & Foster, J. (1997). On economic inequality. Oxford University Press."},{"issue":"1","key":"4503_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jpsychores.2014.09.015","volume":"78","author":"BD Thombs","year":"2015","unstructured":"Thombs, B. D., Levis, A. W., Razykov, I., Syamchandra, A., Leentjens, A. F., Levenson, J. L., & Lumley, M. A. (2015). Potentially coercive self-citation by peer reviewers: A cross-sectional study. Journal of Psychosomatic Research, 78(1), 1\u20136. https:\/\/doi.org\/10.1016\/j.jpsychores.2014.09.015","journal-title":"Journal of Psychosomatic Research"},{"issue":"8","key":"4503_CR24","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0181572","volume":"12","author":"A Ultsch","year":"2017","unstructured":"Ultsch, A., & Lotsch, J. (2017). A data science based standardized Gini index as a Lorenz dominance preserving measure of the inequality of distributions. PLoS ONE, 12(8), e0181572. https:\/\/doi.org\/10.1371\/journal.pone.0181572","journal-title":"PLoS ONE"},{"issue":"7771","key":"4503_CR25","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1038\/d41586-019-02479-7","volume":"572","author":"R Van Noorden","year":"2019","unstructured":"Van Noorden, R., & Singh Chawla, D. (2019). Hundreds of extreme self-citing scientists revealed in new database. Nature, 572(7771), 578\u2013579. https:\/\/doi.org\/10.1038\/d41586-019-02479-7","journal-title":"Nature"},{"issue":"6068","key":"4503_CR26","doi-asserted-by":"publisher","first-page":"542","DOI":"10.1126\/science.1212540","volume":"335","author":"AW Wilhite","year":"2012","unstructured":"Wilhite, A. W., & Fong, E. A. (2012). Scientific publications. Coercive citation in Academic Publishing. Science, 335(6068), 542\u2013543. https:\/\/doi.org\/10.1126\/science.1212540","journal-title":"Science"},{"key":"4503_CR27","doi-asserted-by":"publisher","unstructured":"Wren, J. D., & Georgescu, C. (2020). https:\/\/doi.org\/10.1101\/2020.08.12.248369v1.full.pdf","DOI":"10.1101\/2020.08.12.248369v1.full.pdf"},{"key":"4503_CR28","unstructured":"Wren, J. D., & Georgescu, C. (2021). https:\/\/www.researchsquare.com\/article\/rs-812039\/v1"},{"issue":"11","key":"4503_CR29","doi-asserted-by":"publisher","first-page":"988","DOI":"10.1038\/sj.embor.7401095","volume":"8","author":"JD Wren","year":"2007","unstructured":"Wren, J. D., Kozak, K. Z., Johnson, K. R., Deakyne, S. J., Schilling, L. M., & Dellavalle, R. P. (2007). The write position. A survey of perceived contributions to papers based on byline position and number of authors. EMBO Reports, 8(11), 988\u2013991. https:\/\/doi.org\/10.1038\/sj.embor.7401095","journal-title":"EMBO Reports"},{"issue":"18","key":"4503_CR30","doi-asserted-by":"publisher","first-page":"3217","DOI":"10.1093\/bioinformatics\/btz071","volume":"35","author":"JD Wren","year":"2019","unstructured":"Wren, J. D., Valencia, A., & Kelso, J. (2019). Reviewer-coerced citation: Case report, update on journal policy and suggestions for future prevention. Bioinformatics, 35(18), 3217\u20133218. https:\/\/doi.org\/10.1093\/bioinformatics\/btz071","journal-title":"Bioinformatics"},{"issue":"11","key":"4503_CR31","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1090\/noti1164","volume":"61","author":"A Yong","year":"2014","unstructured":"Yong, A. (2014). Critique of Hirsch\u2019s citation index: A combinatorial fermi problem. Notices of the American Mathematical Society, 61(11), 1040\u20131050.","journal-title":"Notices of the American Mathematical Society"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04503-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04503-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04503-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T06:51:48Z","timestamp":1663138308000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04503-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":31,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["4503"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04503-6","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]},"assertion":[{"value":"12 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 September 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare they have no conflicts of interest to report.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}