{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T05:28:23Z","timestamp":1766467703736,"version":"3.37.3"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T00:00:00Z","timestamp":1721606400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T00:00:00Z","timestamp":1721606400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006752","name":"Universidade do Porto","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006752","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Citation counts are frequently used for assessing the scientific impact of articles. Current approaches for forecasting future citations counts have important limitations. This study aims to analyse and predict the trajectories of citation counts of systematic reviews (SR) based on their citation profiles in the previous years and predict quantiles of future citation counts. We included all SR published between 2010 and 2012 in medical journals indexed in the Web of Science. A longitudinal k-means (KML) clustering approach was applied to identify trajectories of citations counts 10\u00a0years after publication, according to the yearly citation count, the proportion of all cites attained in a specific year and the annual variation in citation counts. Finally, we built multinomial logistic regression models aiming to predict in what tercile or quartile of citation counts a SR would be 10\u00a0years after publication. Using clustering approaches, we obtained 24 groups of SR. Two groups (7.9% of the articles) had an average of\u2009&gt;\u2009200 citations, while two other groups (10.4% of the articles) presented an average of\u2009&lt;\u200910 citations. The model predicting terciles of citation counts attained an accuracy of 72.8% (95%CI\u2009=\u200971.1\u201374.3%) and a kappa coefficient of 0.59 (95%CI\u2009=\u20090.57\u20130.62). Prediction of citation quartiles (combining the second and third quartiles into a single group) attained a accuracy of 76.2% (95%CI\u2009=\u200974.7\u201377.8%) and a kappa coefficient of 0.62 (95%CI\u2009=\u20090.59\u20130.64). This study provides an approach for predicting of future citations of SR based exclusively on citation counts from the previous years, with the models developed displaying an encouraging accuracy and agreement.<\/jats:p>","DOI":"10.1007\/s11192-024-05105-0","type":"journal-article","created":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T09:02:44Z","timestamp":1721638964000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Ten year citation prediction model for systematic reviews using early years citation data"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9827-2551","authenticated-orcid":false,"given":"Manuel","family":"Marques-Cruz","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6201-6364","authenticated-orcid":false,"given":"Daniel Martinho","family":"Dias","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0887-8796","authenticated-orcid":false,"given":"Jo\u00e3o A.","family":"Fonseca","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1277-3401","authenticated-orcid":false,"given":"Bernardo","family":"Sousa-Pinto","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,7,22]]},"reference":[{"issue":"1","key":"5105_CR1","doi-asserted-by":"publisher","first-page":"215824401982957","DOI":"10.1177\/2158244019829575","volume":"9","author":"DW Aksnes","year":"2019","unstructured":"Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019). Citations, citation indicators, and research quality: An overview of basic concepts and theories. SAGE Open, 9(1), 215824401982957. https:\/\/doi.org\/10.1177\/2158244019829575","journal-title":"SAGE Open"},{"issue":"4","key":"5105_CR2","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1002\/asi.23009","volume":"65","author":"SE Baumgartner","year":"2014","unstructured":"Baumgartner, S. E., & Leydesdorff, L. (2014). Group-based trajectory modeling (GBTM) of citations in scholarly literature: dynamic qualities of \u201ctransient\u201d and \u201csticky knowledge claims.\u201d Journal of the Association for Information Science and Technology, 65(4), 797\u2013811. https:\/\/doi.org\/10.1002\/asi.23009","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"1","key":"5105_CR3","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.joi.2016.12.001","volume":"11","author":"L Bornmann","year":"2017","unstructured":"Bornmann, L., & Leydesdorff, L. (2017). Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data. Journal of Informetrics, 11(1), 164\u2013175. https:\/\/doi.org\/10.1016\/j.joi.2016.12.001","journal-title":"Journal of Informetrics"},{"issue":"1","key":"5105_CR4","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1007\/s11192-013-1161-y","volume":"98","author":"L Bornmann","year":"2014","unstructured":"Bornmann, L., & Marx, W. (2014). How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations. Scientometrics, 98(1), 487\u2013509. https:\/\/doi.org\/10.1007\/s11192-013-1161-y","journal-title":"Scientometrics"},{"issue":"3","key":"5105_CR5","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1007\/s11192-013-0995-7","volume":"97","author":"H Bouabid","year":"2013","unstructured":"Bouabid, H., & Larivi\u00e8re, V. (2013). The lengthening of papers\u2019 life expectancy: A diachronous analysis. Scientometrics, 97(3), 695\u2013717. https:\/\/doi.org\/10.1007\/s11192-013-0995-7","journal-title":"Scientometrics"},{"issue":"9","key":"5105_CR6","doi-asserted-by":"publisher","first-page":"82","DOI":"10.48550\/arXiv.1503.06268","volume":"58","author":"T Chakraborty","year":"2015","unstructured":"Chakraborty, T., Kumar, S., Goyal, P., Ganguly, N., & Mukherjee, A. (2015). On the categorization of scientific citation profiles in computer sciences. Communications of the ACM, 58(9), 82\u201390. https:\/\/doi.org\/10.48550\/arXiv.1503.06268","journal-title":"Communications of the ACM"},{"issue":"3","key":"5105_CR7","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1080\/03610918.2020.1861464","volume":"52","author":"NGP Den Teuling","year":"2023","unstructured":"Den Teuling, N. G. P., Pauws, S. C., & van den Heuvel, E. R. (2023). A comparison of methods for clustering longitudinal data with slowly changing trends. Communications in Statistics\u2014Simulation and Computation, 52(3), 621\u2013648. https:\/\/doi.org\/10.1080\/03610918.2020.1861464","journal-title":"Communications in Statistics\u2014Simulation and Computation"},{"issue":"2","key":"5105_CR8","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/s00180-009-0178-4","volume":"25","author":"C Genolini","year":"2010","unstructured":"Genolini, C., & Falissard, B. (2010). KmL: k-means for longitudinal data. Computational Statistics, 25(2), 317\u2013328. https:\/\/doi.org\/10.1007\/s00180-009-0178-4","journal-title":"Computational Statistics"},{"issue":"3","key":"5105_CR9","doi-asserted-by":"publisher","first-page":"e112","DOI":"10.1016\/j.cmpb.2011.05.008","volume":"104","author":"C Genolini","year":"2011","unstructured":"Genolini, C., & Falissard, B. (2011). Kml: A package to cluster longitudinal data. Computer Methods and Programs in Biomedicine, 104(3), e112\u2013e121. https:\/\/doi.org\/10.1016\/j.cmpb.2011.05.008","journal-title":"Computer Methods and Programs in Biomedicine"},{"issue":"5","key":"5105_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v028.i05","volume":"28","author":"M Kuhn","year":"2008","unstructured":"Kuhn, M. (2008). Building predictive models in R using the caret package. Journal of Statistical Software, 28(5), 1\u201326. https:\/\/doi.org\/10.18637\/jss.v028.i05","journal-title":"Journal of Statistical Software"},{"issue":"3","key":"5105_CR11","doi-asserted-by":"publisher","first-page":"2129","DOI":"10.1007\/s11192-016-2150-8","volume":"109","author":"L Leydesdorff","year":"2016","unstructured":"Leydesdorff, L., Wouters, P., & Bornmann, L. (2016). Professional and citizen bibliometrics: Complementarities and ambivalences in the development and use of indicators\u2014a state-of-the-art report. Scientometrics, 109(3), 2129\u20132150. https:\/\/doi.org\/10.1007\/s11192-016-2150-8","journal-title":"Scientometrics"},{"key":"5105_CR12","unstructured":"Livne, A., Adar, E., Teevan, J., & Dumais, S. (2013). Predicting Citation Counts Using Text and Graph Mining. IConference 2013, Workshop on Computational Scientometrics: Theory and Application."},{"issue":"7","key":"5105_CR13","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000097","volume":"6","author":"D Moher","year":"2009","unstructured":"Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https:\/\/doi.org\/10.1371\/journal.pmed.1000097","journal-title":"PLoS Medicine"},{"issue":"4","key":"5105_CR14","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1136\/ebmed-2016-110401","volume":"21","author":"MH Murad","year":"2016","unstructured":"Murad, M. H., Asi, N., Alsawas, M., & Alahdab, F. (2016). New evidence pyramid. Evidence Based Medicine, 21(4), 125\u2013127. https:\/\/doi.org\/10.1136\/ebmed-2016-110401","journal-title":"Evidence Based Medicine"},{"key":"5105_CR15","doi-asserted-by":"publisher","unstructured":"Pobiedina, N., & Ichise, R. (2014). Predicting Citation Counts for Academic Literature Using Graph Pattern Mining (pp. 109\u2013119). https:\/\/doi.org\/10.1007\/978-3-319-07467-2_12","DOI":"10.1007\/978-3-319-07467-2_12"},{"key":"5105_CR16","unstructured":"R Core Team. (2023). R: A Language and Environment for Statistical Computing."},{"key":"5105_CR17","first-page":"9","volume":"2","author":"W Revelle","year":"2023","unstructured":"Revelle, W. (2023). psych: Procedures for psychological, psychometric, and personality research. R Package Version, 2, 9.","journal-title":"R Package Version"},{"issue":"1","key":"5105_CR18","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1186\/2046-4053-2-74","volume":"2","author":"P Royle","year":"2013","unstructured":"Royle, P., Kandala, N.-B., Barnard, K., & Waugh, N. (2013). Bibliometrics of systematic reviews: Analysis of citation rates and journal impact factors. Systematic Reviews, 2(1), 74. https:\/\/doi.org\/10.1186\/2046-4053-2-74","journal-title":"Systematic Reviews"},{"key":"5105_CR19","doi-asserted-by":"publisher","unstructured":"Singh, M., Patidar, V., Kumar, S., Chakraborty, T., Mukherjee, A., & Goyal, P. (2015) The Role Of Citation Context In Predicting Long-Term Citation Profiles. Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, 1271\u20131280. https:\/\/doi.org\/10.1145\/2806416.2806566","DOI":"10.1145\/2806416.2806566"},{"issue":"3","key":"5105_CR20","doi-asserted-by":"publisher","first-page":"1195","DOI":"10.1007\/s11192-016-1889-2","volume":"107","author":"I Tahamtan","year":"2016","unstructured":"Tahamtan, I., SafipourAfshar, A., & Ahamdzadeh, K. (2016). Factors affecting number of citations: A comprehensive review of the literature. Scientometrics, 107(3), 1195\u20131225. https:\/\/doi.org\/10.1007\/s11192-016-1889-2","journal-title":"Scientometrics"},{"issue":"2","key":"5105_CR21","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11192-011-0561-0","volume":"92","author":"JK Vanclay","year":"2012","unstructured":"Vanclay, J. K. (2012). Impact factor: Outdated artefact or stepping-stone to journal certification? Scientometrics, 92(2), 211\u2013238. https:\/\/doi.org\/10.1007\/s11192-011-0561-0","journal-title":"Scientometrics"},{"key":"5105_CR22","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21706-2","volume-title":"Modern Applied Statistics with S (Fourth)","author":"WN Venables","year":"2002","unstructured":"Venables, W. N., & Ripley, B. D. (2002). Modern Applied Statistics with S (Fourth). Springer."},{"issue":"1","key":"5105_CR23","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.joi.2010.08.001","volume":"5","author":"L Waltman","year":"2011","unstructured":"Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. J. (2011). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5(1), 37\u201347. https:\/\/doi.org\/10.1016\/j.joi.2010.08.001","journal-title":"Journal of Informetrics"},{"issue":"1","key":"5105_CR24","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1007\/s11192-022-04547-8","volume":"128","author":"W Xia","year":"2023","unstructured":"Xia, W., Li, T., & Li, C. (2023). A review of scientific impact prediction: Tasks, features and methods. Scientometrics, 128(1), 543\u2013585. https:\/\/doi.org\/10.1007\/s11192-022-04547-8","journal-title":"Scientometrics"},{"key":"5105_CR25","doi-asserted-by":"publisher","unstructured":"Yan, R., Tang, J., Liu, X., Shan, D., & Li, X. (2011). Citation count prediction. Proceedings of the 20th ACM International Conference on Information and Knowledge Management, 1247\u20131252. https:\/\/doi.org\/10.1145\/2063576.2063757","DOI":"10.1145\/2063576.2063757"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-05105-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-024-05105-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-05105-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T09:08:07Z","timestamp":1721639287000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-024-05105-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,22]]},"references-count":25,"alternative-id":["5105"],"URL":"https:\/\/doi.org\/10.1007\/s11192-024-05105-0","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2024,7,22]]},"assertion":[{"value":"8 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}