{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T14:48:55Z","timestamp":1766587735724,"version":"3.37.3"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Universidad Polit\u00e8cnica de Val\u00e8ncia"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Reporting guidelines are tools to help improve the transparency, completeness, and clarity of published articles in health research. Specifically, the CONSORT (Consolidated Standards of Reporting Trials) and SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statements provide evidence-based guidance on what to include in randomised trial articles and protocols to guarantee the efficacy of interventions. These guidelines are subsequently described and discussed in journal articles and used to produce checklists. Determining the online impact (i.e., number and type of links received) of these articles can provide insights into the dissemination of reporting guidelines in broader environments (web-at-large) than simply that of the scientific publications that cite them. To address the technical limitations of link analysis, here the Debug-Validate-Access-Find (DVAF) method is designed and implemented to measure different facets of the guidelines\u2019 online impact. A total of 65 articles related to 38 reporting guidelines are taken as a baseline, providing 240,128 URL citations, which are then refined, analysed, and categorised using the DVAF method. A total of 15,582 links to journal articles related to the CONSORT and SPIRIT initiatives were identified. CONSORT 2010 and SPIRIT 2013 were the reporting guidelines that received most links (URL citations) from other online objects (5328 and 2190, respectively). Overall, the online impact obtained is scattered (URL citations are received by different article URL IDs, mainly from link-based DOIs), narrow (limited number of linking domain names, half of articles are linked from fewer than 29 domain names), concentrated (links come from just a few academic publishers, around 60% from publishers), non-reputed (84% of links come from dubious websites and fake domain names) and highly decayed (89% of linking domain names were not accessible at the time of the analysis). In light of these results, it is concluded that the online impact of these guidelines could be improved, and a set of recommendations are proposed to this end.<\/jats:p>","DOI":"10.1007\/s11192-022-04542-z","type":"journal-article","created":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T06:02:20Z","timestamp":1665986540000},"page":"407-440","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Evaluating the online impact of reporting guidelines for randomised trial reports and protocols: a cross-sectional web-based data analysis of CONSORT and SPIRIT initiatives"],"prefix":"10.1007","volume":"128","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1989-8477","authenticated-orcid":false,"given":"Enrique","family":"Ordu\u00f1a-Malea","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adolfo","family":"Alonso-Arroyo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jos\u00e9-Antonio","family":"Ontalba-Ruip\u00e9rez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ferr\u00e1n","family":"Catal\u00e1-L\u00f3pez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"issue":"3","key":"4542_CR1","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1007\/s11192-010-0183-y","volume":"82","author":"IF Aguillo","year":"2010","unstructured":"Aguillo, I. F., Ortega, J. L., Fern\u00e1ndez, M., & Utrilla, A. (2010). Indicators for a webometric ranking of open access repositories. Scientometrics, 82(3), 477\u2013486. https:\/\/doi.org\/10.1007\/s11192-010-0183-y","journal-title":"Scientometrics"},{"issue":"7499","key":"4542_CR2","doi-asserted-by":"publisher","first-page":"1056","DOI":"10.1136\/bmj.330.7499.1056","volume":"330","author":"DG Altman","year":"2005","unstructured":"Altman, D. G. (2005). Endorsement of the CONSORT statement by high impact medical journals: Survey of instructions for authors. BMJ (Clinical Research Ed.), 330(7499), 1056\u20131057. https:\/\/doi.org\/10.1136\/bmj.330.7499.1056","journal-title":"BMJ (Clinical Research Ed.)"},{"issue":"2","key":"4542_CR3","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1177\/0141076815625599","volume":"109","author":"DG Altman","year":"2016","unstructured":"Altman, D. G., & Simera, I. (2016). A history of the evolution of guidelines for reporting medical research: The long road to the EQUATOR Network. Journal of the Royal Society of Medicine, 109(2), 67\u201377. https:\/\/doi.org\/10.1177\/0141076815625599","journal-title":"Journal of the Royal Society of Medicine"},{"issue":"3","key":"4542_CR4","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1016\/j.ipm.2004.02.005","volume":"41","author":"J Bar-Ilan","year":"2005","unstructured":"Bar-Ilan, J. (2005). What do we know about links and linking? A framework for studying links in academic environments. Information Processing & Management, 41(3), 973\u2013986. https:\/\/doi.org\/10.1016\/j.ipm.2004.02.005","journal-title":"Information Processing & Management"},{"issue":"4","key":"4542_CR5","doi-asserted-by":"publisher","first-page":"628","DOI":"10.1002\/asi.20776","volume":"59","author":"F Barjak","year":"2008","unstructured":"Barjak, F., & Thelwall, M. (2008). A statistical analysis of the web presences of European life sciences research teams. Journal of the American Society for Information Science and Technology, 59(4), 628\u2013643. https:\/\/doi.org\/10.1002\/asi.20776","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"4542_CR6","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1002\/asi.20476","volume":"58","author":"F Barjak","year":"2007","unstructured":"Barjak, F., Li, X., & Thelwall, M. (2007). Which factors explain the web impact of scientists\u2019 personal homepages? Journal of the American Society for Information Science and Technology, 58(2), 200\u2013211. https:\/\/doi.org\/10.1002\/asi.20476","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"8","key":"4542_CR7","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1001\/jama.276.8.637","volume":"276","author":"C Begg","year":"1996","unstructured":"Begg, C., Cho, M., Eastwood, S., Horton, R., Moher, D., Olkin, I., Pitkin, R., Rennie, D., Schulz, K. F., Simel, D., & Stroup, D. F. (1996). Improving the quality of reporting of randomized controlled trials: The CONSORT statement. JAMA: The Journal of the American Medical Association, 276(8), 637\u2013639. https:\/\/doi.org\/10.1001\/jama.276.8.637","journal-title":"JAMA: The Journal of the American Medical Association"},{"issue":"3","key":"4542_CR8","doi-asserted-by":"publisher","first-page":"e022769","DOI":"10.1136\/bmjopen-2018-022769","volume":"9","author":"F Catal\u00e1-L\u00f3pez","year":"2019","unstructured":"Catal\u00e1-L\u00f3pez, F., Alonso-Arroyo, A., Page, M. J., Hutton, B., Ridao, M., Tabar\u00e9s-Seisdedos, R., Aleixandre-Benavent, R., & Moher, D. (2019). Reporting guidelines for health research: Protocol for a cross-sectional analysis of the EQUATOR Network Library. British Medical Journal Open, 9(3), e022769. https:\/\/doi.org\/10.1136\/bmjopen-2018-022769","journal-title":"British Medical Journal Open"},{"issue":"1","key":"4542_CR9","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1186\/s13063-019-3944-9","volume":"21","author":"F Catal\u00e1-L\u00f3pez","year":"2020","unstructured":"Catal\u00e1-L\u00f3pez, F., Aleixandre-Benavent, R., Caulley, L., Hutton, B., Tabar\u00e9s-Seisdedos, R., Moher, D., & Alonso-Arroyo, A. (2020). Global mapping of randomised trials related articles published in high-impact-factor medical journals: A cross-sectional analysis. Trials, 21(1), 34. https:\/\/doi.org\/10.1186\/s13063-019-3944-9","journal-title":"Trials"},{"key":"4542_CR10","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.jclinepi.2020.07.013","volume":"127","author":"L Caulley","year":"2020","unstructured":"Caulley, L., Cheng, W., Catal\u00e1-L\u00f3pez, F., Whelan, J., Khoury, M., Ferraro, J., Husereau, D., Altman, D. G., & Moher, D. (2020a). Citation impact was highly variable for reporting guidelines of health research: A citation analysis. Journal of Clinical Epidemiology, 127, 96\u2013104. https:\/\/doi.org\/10.1016\/j.jclinepi.2020.07.013","journal-title":"Journal of Clinical Epidemiology"},{"key":"4542_CR11","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.jclinepi.2020.03.006","volume":"122","author":"L Caulley","year":"2020","unstructured":"Caulley, L., Catal\u00e1-L\u00f3pez, F., Whelan, J., Khoury, M., Ferraro, J., Cheng, W., Husereau, D., Altman, D. G., & Moher, D. (2020b). Reporting guidelines of health research studies are frequently used inappropriately. Journal of Clinical Epidemiology, 122, 87\u201394. https:\/\/doi.org\/10.1016\/j.jclinepi.2020.03.006","journal-title":"Journal of Clinical Epidemiology"},{"issue":"3","key":"4542_CR12","doi-asserted-by":"publisher","first-page":"200","DOI":"10.7326\/0003-4819-158-3-201302050-00583","volume":"158","author":"A-W Chan","year":"2013","unstructured":"Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., G\u00f8tzsche, P. C., Krle\u017ea-Jeri\u0107, K., Hr\u00f3bjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., Dor\u00e9, C. J., Parulekar, W. R., Summerskill, W. S. M., Groves, T., Schulz, K. F., Sox, H. C., Rockhold, F. W., Rennie, D., & Moher, D. (2013a). SPIRIT 2013 statement: Defining standard protocol items for clinical trials. Annals of Internal Medicine, 158(3), 200\u2013207. https:\/\/doi.org\/10.7326\/0003-4819-158-3-201302050-00583","journal-title":"Annals of Internal Medicine"},{"key":"4542_CR13","doi-asserted-by":"publisher","first-page":"e7586","DOI":"10.1136\/bmj.e7586","volume":"346","author":"A-W Chan","year":"2013","unstructured":"Chan, A.-W., Tetzlaff, J. M., G\u00f8tzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hr\u00f3bjartsson, A., Schulz, K. F., Parulekar, W. R., Krleza-Jeric, K., Laupacis, A., & Moher, D. (2013). SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ (Clinical Research Ed.), 346, e7586. https:\/\/doi.org\/10.1136\/bmj.e7586","journal-title":"BMJ (Clinical Research Ed.)"},{"unstructured":"Dudek, J., Pina, D.G., & Costas, R. (2021). Co-link analysis as a monitoring tool: A webometric use case to map the web relationships of research projects. In W. Glanzel, S. Heeffer, P-S. Chi, & R. Rousseau (Eds.) 18th International Conference on Scientometrics and Informetrics, ISSI 2021 (pp. 339\u2013344). International Society for Scientometrics and Informetrics. https:\/\/research.tudelft.nl\/files\/100319468\/2110.04251.pdf","key":"4542_CR14"},{"unstructured":"Fang, Z., Dudek, J., Noyons, E., & Costas, R. (2020). Science cited in policy documents: Evidence from the Overton database. In Altmetrics conference. http:\/\/altmetrics.org\/wp-content\/uploads\/2020\/11\/02_submission_Fang_Dudek_Noyons_Costas-altmetrics20.pdf","key":"4542_CR15"},{"issue":"2","key":"4542_CR16","doi-asserted-by":"publisher","first-page":"160","DOI":"10.5530\/jscires.10.2.30","volume":"10","author":"F Farrokhzdeh","year":"2021","unstructured":"Farrokhzdeh, F., Shekofteh, M., Kazerani, M., Bakhshandeh, H., & Ghadrdoost, B. (2021). CONSORT Abstract item reporting quality and altmetrics in the cardiovascular core clinical journals. Journal of Scientometric Research, 10(2), 160\u2013165.","journal-title":"Journal of Scientometric Research"},{"issue":"1","key":"4542_CR17","doi-asserted-by":"publisher","first-page":"101247","DOI":"10.1016\/j.joi.2021.101247","volume":"16","author":"CI Font-Juli\u00e1n","year":"2022","unstructured":"Font-Juli\u00e1n, C. I., Ontalba-Ruip\u00e9rez, J.-A., Ordu\u00f1a-Malea, E., & Thelwall, M. (2022). Which types of online resource support US patent claims? Journal of Informetrics., 16(1), 101247. https:\/\/doi.org\/10.1016\/j.joi.2021.101247","journal-title":"Journal of Informetrics."},{"issue":"9","key":"4542_CR18","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1056\/NEJMp1207437","volume":"367","author":"SE Gabriel","year":"2012","unstructured":"Gabriel, S. E., & Normand, S.-L.T. (2012). Getting the methods right\u2013the foundation of patient-centered outcomes research. The New England Journal of Medicine, 367(9), 787\u2013790. https:\/\/doi.org\/10.1056\/NEJMp1207437","journal-title":"The New England Journal of Medicine"},{"issue":"9913","key":"4542_CR19","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1016\/S0140-6736(13)62228-X","volume":"383","author":"P Glasziou","year":"2014","unstructured":"Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014). Reducing waste from incomplete or unusable reports of biomedical research. Lancet, 383(9913), 267\u2013276. https:\/\/doi.org\/10.1016\/S0140-6736(13)62228-X","journal-title":"Lancet"},{"issue":"1","key":"4542_CR20","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1186\/1745-6215-9-20","volume":"9","author":"S Hopewell","year":"2008","unstructured":"Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2008). Endorsement of the CONSORT Statement by high impact factor medical journals: A survey of journal editors and journal \u201cInstructions to Authors.\u201d Trials, 9(1), 20. https:\/\/doi.org\/10.1186\/1745-6215-9-20","journal-title":"Trials"},{"unstructured":"Jones, D. (2012). Flow Metrics\u2122 will change the way you look at links. Majestic Blog. https:\/\/blog.majestic.com\/development\/flow-metrics","key":"4542_CR21"},{"issue":"5","key":"4542_CR22","doi-asserted-by":"publisher","first-page":"4465","DOI":"10.1007\/s11192-021-03941-y","volume":"126","author":"M Karmakar","year":"2021","unstructured":"Karmakar, M., Banshal, S. K., & Singh, V. K. (2021). A large-scale comparison of coverage and mentions captured by the two altmetric aggregators: Altmetric.com and PlumX. Scientometrics, 126(5), 4465\u20134489. https:\/\/doi.org\/10.1007\/s11192-021-03941-y","journal-title":"Scientometrics"},{"issue":"12","key":"4542_CR23","doi-asserted-by":"publisher","first-page":"e115253","DOI":"10.1371\/journal.pone.0115253","volume":"9","author":"M Klein","year":"2014","unstructured":"Klein, M., Van de Sompel, H., Sanderson, R., Shankar, H., Balakireva, L., Zhou, K., & Tobin, R. (2014). Scholarly context not found: One in five articles suffers from reference rot. PLoS ONE, 9(12), e115253. https:\/\/doi.org\/10.1371\/journal.pone.0115253","journal-title":"PLoS ONE"},{"issue":"2","key":"4542_CR24","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1002\/(SICI)1097-4571(1999)50:2%3C162::AID-ASI7%3E3.0.CO;2-B","volume":"50","author":"W Koehler","year":"1999","unstructured":"Koehler, W. (1999). An analysis of web page and web site constancy and permanence. Journal of the American Society for Information Science, 50(2), 162\u2013180. https:\/\/doi.org\/10.1002\/(SICI)1097-4571(1999)50:2%3C162::AID-ASI7%3E3.0.CO;2-B","journal-title":"Journal of the American Society for Information Science"},{"doi-asserted-by":"crossref","unstructured":"Kousha, K. (2019). Web citation indicators for wider impact assessment of articles. In W. Gl\u00e4nzel, H. Moed, U. Schmoch, & M. Thelwall (Eds.), Springer handbook of science and technology indicators (pp. 801\u2013818). Springer.","key":"4542_CR25","DOI":"10.1007\/978-3-030-02511-3_31"},{"issue":"2","key":"4542_CR26","doi-asserted-by":"publisher","first-page":"e000897","DOI":"10.1136\/bmjopen-2012-000897","volume":"2","author":"D Kryl","year":"2012","unstructured":"Kryl, D., Allen, L., Dolby, K., Sherbon, B., & Viney, I. (2012). Tracking the impact of research on policy and practice: Investigating the feasibility of using citations in clinical guidelines for research evaluation. British Medical Journal Open, 2(2), e000897. https:\/\/doi.org\/10.1136\/bmjopen-2012-000897","journal-title":"British Medical Journal Open"},{"issue":"4","key":"4542_CR27","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1108\/00012531211244752","volume":"64","author":"BS Kumar","year":"2012","unstructured":"Kumar, B. S., & Kumar, K. M. (2012). Persistence and half-life of URL citations cited in LIS open access journals. Aslib Proceedings, 64(4), 405\u2013422. https:\/\/doi.org\/10.1108\/00012531211244752","journal-title":"Aslib Proceedings"},{"issue":"9","key":"4542_CR28","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1038\/s41591-020-1034-x","volume":"26","author":"X Liu","year":"2020","unstructured":"Liu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., SPIRIT-AI and CONSORT-AI Working Group. (2020). Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nature Medicine, 26(9), 1364\u20131374. https:\/\/doi.org\/10.1038\/s41591-020-1034-x","journal-title":"Nature Medicine"},{"issue":"15","key":"4542_CR29","doi-asserted-by":"publisher","first-page":"1987","DOI":"10.1001\/jama.285.15.1987","volume":"285","author":"D Moher","year":"2001","unstructured":"Moher, D., Schulz, K. F., Altman, D., CONSORT Group. (2001). The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA: The Journal of the American Medical Association, 285(15), 1987\u20131991. https:\/\/doi.org\/10.1001\/jama.285.15.1987","journal-title":"JAMA: The Journal of the American Medical Association"},{"issue":"7","key":"4542_CR30","doi-asserted-by":"publisher","first-page":"e1000097","DOI":"10.1371\/journal.pmed.1000097","volume":"6","author":"D Moher","year":"2009","unstructured":"Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https:\/\/doi.org\/10.1371\/journal.pmed.1000097","journal-title":"PLoS Medicine"},{"issue":"2","key":"4542_CR31","doi-asserted-by":"publisher","first-page":"e1000217","DOI":"10.1371\/journal.pmed.1000217","volume":"7","author":"D Moher","year":"2010","unstructured":"Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010a). Guidance for developers of health research reporting guidelines. PLoS Medicine, 7(2), e1000217. https:\/\/doi.org\/10.1371\/journal.pmed.1000217","journal-title":"PLoS Medicine"},{"key":"4542_CR32","doi-asserted-by":"publisher","first-page":"c869","DOI":"10.1136\/bmj.c869","volume":"340","author":"D Moher","year":"2010","unstructured":"Moher, D., Hopewell, S., Schulz, K. F., Montori, V., G\u00f8tzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ (Clinical Research Ed.), 340, c869. https:\/\/doi.org\/10.1136\/bmj.c869","journal-title":"BMJ (Clinical Research Ed.)"},{"doi-asserted-by":"crossref","unstructured":"Moher, D., Altman, D. G., Schulz, K. F., Simera, I., & Wager, E. (Eds.). (2014). Guidelines for reporting health research: A user\u2019s manual. John Wiley & Sons.","key":"4542_CR33","DOI":"10.1002\/9781118715598"},{"issue":"2","key":"4542_CR34","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1002\/asi.23561","volume":"67","author":"F Oguz","year":"2016","unstructured":"Oguz, F., & Koehler, W. (2016). URL decay at year 20: A research note. Journal of the Association for Information Science and Technology, 67(2), 477\u2013479. https:\/\/doi.org\/10.1002\/asi.23561","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"4542_CR35","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1007\/s11192-016-1839-z","volume":"106","author":"J-A Ontalba-Ruip\u00e9rez","year":"2016","unstructured":"Ontalba-Ruip\u00e9rez, J.-A., Orduna-Malea, E., & Alonso-Arroyo, A. (2016). Identifying institutional relationships in a geographically distributed public health system using interlinking and co-authorship methods. Scientometrics, 106(3), 1167\u20131191. https:\/\/doi.org\/10.1007\/s11192-016-1839-z","journal-title":"Scientometrics"},{"issue":"4","key":"4542_CR36","doi-asserted-by":"publisher","first-page":"3565","DOI":"10.1007\/s11192-020-03832-8","volume":"126","author":"E Ordu\u00f1a-Malea","year":"2021","unstructured":"Ordu\u00f1a-Malea, E. (2021). Dot-science top level domain: Academic websites or dumpsites? Scientometrics, 126(4), 3565\u20133591. https:\/\/doi.org\/10.1007\/s11192-020-03832-8","journal-title":"Scientometrics"},{"key":"4542_CR37","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00199","author":"E Ordu\u00f1a-Malea","year":"2022","unstructured":"Ordu\u00f1a-Malea, E., & Aguillo, I. F. (2022). Are link-based and citation-based journal metrics correlated? An Open Access mega publisher case study. Quantitative Science Studies. https:\/\/doi.org\/10.1162\/qss_a_00199","journal-title":"Quantitative Science Studies"},{"unstructured":"Orduna-Malea, E., & Alonso-Arroyo, A. (2017). Cybermetric techniques to evaluate organizations using web-based data. Elsevier.","key":"4542_CR38"},{"issue":"9","key":"4542_CR39","doi-asserted-by":"publisher","first-page":"8153","DOI":"10.1007\/s11192-021-04082-y","volume":"126","author":"E Ordu\u00f1a-Malea","year":"2021","unstructured":"Ordu\u00f1a-Malea, E., & Costas, R. (2021). Link-based approach to study scientific software usage: The case of VOSviewer. Scientometrics, 126(9), 8153\u20138186. https:\/\/doi.org\/10.1007\/s11192-021-04082-y","journal-title":"Scientometrics"},{"issue":"8","key":"4542_CR40","doi-asserted-by":"publisher","first-page":"1967","DOI":"10.1002\/asi.23821","volume":"68","author":"E Ordu\u00f1a-Malea","year":"2017","unstructured":"Ordu\u00f1a-Malea, E., Thelwall, M., & Kousha, K. (2017). Web citations in patents: Evidence of technological impact? Journal of the Association for Information Science and Technology, 68(8), 1967\u20131974. https:\/\/doi.org\/10.1002\/asi.23821","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"4542_CR41","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1001\/jama.2021.9941","volume":"326","author":"AM Orkin","year":"2021","unstructured":"Orkin, A. M., Gill, P. J., Ghersi, D., Campbell, L., Sugarman, J., Emsley, R., Steg, P. G., Weijer, C., Simes, J., Rombey, T., Williams, H. C., Wittes, J., Moher, D., Richards, D. P., Kasamon, Y., Getz, K., Hopewell, S., Dickersin, K., Wu, T., et al. (2021). Guidelines for reporting trial protocols and completed trials modified due to the COVID-19 pandemic and other Extenuating Circumstances: The CONSERVE 2021 statement: The CONSERVE 2021 statement. JAMA: The Journal of the American Medical Association, 326(3), 257\u2013265. https:\/\/doi.org\/10.1001\/jama.2021.9941","journal-title":"JAMA: The Journal of the American Medical Association"},{"issue":"3","key":"4542_CR42","doi-asserted-by":"publisher","first-page":"2123","DOI":"10.1007\/s11192-018-2838-z","volume":"116","author":"JL Ortega","year":"2018","unstructured":"Ortega, J. L. (2018). Reliability and accuracy of altmetric providers: a comparison among Altmetric.com, PlumX and Crossref event data. Scientometrics, 116(3), 2123\u20132138. https:\/\/doi.org\/10.1007\/s11192-018-2838-z","journal-title":"Scientometrics"},{"issue":"1","key":"4542_CR43","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2020.ene.07","volume":"29","author":"JL Ortega","year":"2020","unstructured":"Ortega, J. L. (2020). Altmetrics data providers: A metaanalysis review of the coverage of metrics and publication. Profesional De La Informaci\u00f3n, 29(1), e290107. https:\/\/doi.org\/10.3145\/epi.2020.ene.07","journal-title":"Profesional De La Informaci\u00f3n"},{"issue":"2","key":"4542_CR44","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1016\/j.ipm.2008.10.001","volume":"45","author":"JL Ortega","year":"2009","unstructured":"Ortega, J. L., & Aguillo, I. F. (2009). Mapping world-class universities on the web. Information Processing & Management, 45(2), 272\u2013279. https:\/\/doi.org\/10.1016\/j.ipm.2008.10.001","journal-title":"Information Processing & Management"},{"issue":"1","key":"4542_CR45","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1186\/s13643-021-01626-4","volume":"10","author":"MJ Page","year":"2021","unstructured":"Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hr\u00f3bjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., \u2026 Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10(1), 89. https:\/\/doi.org\/10.1186\/s13643-021-01626-4","journal-title":"Systematic Reviews"},{"issue":"3","key":"4542_CR46","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1007\/s11192-007-1695-y","volume":"71","author":"N Payne","year":"2007","unstructured":"Payne, N., & Thelwall, M. (2007). A longitudinal study of academic webs: Growth and stabilisation. Scientometrics, 71(3), 523\u2013539. https:\/\/doi.org\/10.1007\/s11192-007-1695-y","journal-title":"Scientometrics"},{"key":"4542_CR47","doi-asserted-by":"publisher","first-page":"c332","DOI":"10.1136\/bmj.c332","volume":"340","author":"KF Schulz","year":"2010","unstructured":"Schulz, K. F., Altman, D. G., Moher, D., CONSORT Group. (2010a). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. BMJ (Clinical Research Ed.), 340, c332. https:\/\/doi.org\/10.1136\/bmj.c332","journal-title":"BMJ (Clinical Research Ed.)"},{"issue":"3","key":"4542_CR48","doi-asserted-by":"publisher","first-page":"e1000251","DOI":"10.1371\/journal.pmed.1000251","volume":"7","author":"KF Schulz","year":"2010","unstructured":"Schulz, K. F., Altman, D. G., Moher, D., CONSORT Group. (2010b). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. PLoS Medicine, 7(3), e1000251. https:\/\/doi.org\/10.1371\/journal.pmed.1000251","journal-title":"PLoS Medicine"},{"issue":"1","key":"4542_CR49","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1186\/s13063-016-1408-z","volume":"17","author":"L Shamseer","year":"2016","unstructured":"Shamseer, L., Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2016). Update on the endorsement of CONSORT by high impact factor journals: A survey of journal \u201cInstructions to Authors\u201d in 2014. Trials, 17(1), 301. https:\/\/doi.org\/10.1186\/s13063-016-1408-z","journal-title":"Trials"},{"issue":"1","key":"4542_CR50","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1145\/602421.602422","volume":"46","author":"D Spinellis","year":"2003","unstructured":"Spinellis, D. (2003). The decay and failures of web references. Communications of the ACM, 46(1), 71\u201377.","journal-title":"Communications of the ACM"},{"key":"4542_CR51","doi-asserted-by":"publisher","first-page":"g3804","DOI":"10.1136\/bmj.g3804","volume":"348","author":"A Stevens","year":"2014","unstructured":"Stevens, A., Shamseer, L., Weinstein, E., Yazdi, F., Turner, L., Thielman, J., Altman, D. G., Hirst, A., Hoey, J., Palepu, A., Schulz, K. F., & Moher, D. (2014). Relation of completeness of reporting of health research to journals\u2019 endorsement of reporting guidelines: Systematic review. BMJ (Clinical Research Ed.), 348, g3804. https:\/\/doi.org\/10.1136\/bmj.g3804","journal-title":"BMJ (Clinical Research Ed.)"},{"doi-asserted-by":"crossref","unstructured":"Szomszor, M., & Adie, E. (2022). Overton\u2014A bibliometric database of policy document citations. ArXiv preprint. https:\/\/arxiv.org\/pdf\/2201.07643.pdf","key":"4542_CR52","DOI":"10.1162\/qss_a_00204"},{"doi-asserted-by":"crossref","unstructured":"Thelwall, M. (2004). Link analysis: An information science approach. Elsevier.","key":"4542_CR53","DOI":"10.1108\/S1876-0562(2004)04"},{"issue":"1","key":"4542_CR54","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1002\/asi.20253","volume":"57","author":"M Thelwall","year":"2006","unstructured":"Thelwall, M. (2006). Interpreting social science link analysis research: A theoretical framework. Journal of the American Society for Information Science and Technology, 57(1), 60\u201368. https:\/\/doi.org\/10.1002\/asi.20253","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"4542_CR55","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1007\/s11192-007-1831-8","volume":"75","author":"M Thelwall","year":"2008","unstructured":"Thelwall, M., & Zuccala, A. (2008). A university-centred European Union link analysis. Scientometrics, 75(3), 407\u2013420. https:\/\/doi.org\/10.1007\/s11192-007-1831-8","journal-title":"Scientometrics"},{"issue":"4","key":"4542_CR56","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1108\/00012531111148985","volume":"63","author":"M Thelwall","year":"2011","unstructured":"Thelwall, M. (2011). A comparison of link and URL citation counting. Aslib Proceedings, 63(4), 419\u2013425. https:\/\/doi.org\/10.1108\/00012531111148985","journal-title":"Aslib Proceedings"},{"doi-asserted-by":"crossref","unstructured":"Thelwall, M. (2021). The story of a colony: Theory development in webometric research. In D. H. Sonnenwald (Ed.), Theory development in the information sciences (pp. 164\u2013182). University of Texas Press.","key":"4542_CR57","DOI":"10.7560\/308240-012"},{"issue":"5","key":"4542_CR58","doi-asserted-by":"publisher","first-page":"587","DOI":"10.3145\/epi.2015.sep.08","volume":"24","author":"M Thelwall","year":"2015","unstructured":"Thelwall, M., & Kousha, K. (2015). Web indicators for research evaluation. Part 1: Citations and links to academic articles from the Web. Profesional de la Informaci\u00f3n, 24(5), 587\u2013606. https:\/\/doi.org\/10.3145\/epi.2015.sep.08","journal-title":"Profesional de la Informaci\u00f3n"},{"issue":"2","key":"4542_CR59","doi-asserted-by":"publisher","first-page":"1341","DOI":"10.1007\/s11192-016-2112-1","volume":"109","author":"M Thelwall","year":"2016","unstructured":"Thelwall, M., & Kousha, K. (2016). Are citations from clinical trials evidence of higher impact research? An analysis of Clinicaltrialsgov. Scientometrics, 109(2), 1341\u20131351. https:\/\/doi.org\/10.1007\/s11192-016-2112-1","journal-title":"Scientometrics"},{"issue":"1","key":"4542_CR60","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1007\/s11192-017-2292-3","volume":"112","author":"M Thelwall","year":"2017","unstructured":"Thelwall, M., Kousha, K., & Abdoli, M. (2017). Is medical research informing professional practice more highly cited? Evidence from AHFS DI Essentials in drugs.com. Scientometrics, 112(1), 509\u2013527. https:\/\/doi.org\/10.1007\/s11192-017-2292-3","journal-title":"Scientometrics"},{"issue":"4","key":"4542_CR61","doi-asserted-by":"publisher","first-page":"960","DOI":"10.1002\/asi.23432","volume":"67","author":"M Thelwall","year":"2016","unstructured":"Thelwall, M., & Maflahi, N. (2016). Guideline references and academic citations as evidence of the clinical value of health research. Journal of the Association for Information Science and Technology, 67(4), 960\u2013966. https:\/\/doi.org\/10.1002\/asi.23432","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"11","key":"4542_CR62","doi-asserted-by":"publisher","first-page":"MR000030","DOI":"10.1002\/14651858.MR000030.pub2","volume":"11","author":"L Turner","year":"2012","unstructured":"Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012). Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database of Systematic Reviews, 11(11), MR000030. https:\/\/doi.org\/10.1002\/14651858.MR000030.pub2","journal-title":"Cochrane Database of Systematic Reviews"},{"issue":"1","key":"4542_CR63","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1002\/asi.10184","volume":"54","author":"L Vaughan","year":"2003","unstructured":"Vaughan, L., & Thelwall, M. (2003). Scholarly use of the web: What are the key inducers of links to journal Web sites? Journal of the American Society for Information Science and Technology, 54(1), 29\u201338. https:\/\/doi.org\/10.1002\/asi.10184","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"4542_CR64","doi-asserted-by":"publisher","first-page":"e3001162","DOI":"10.1371\/journal.pbio.3001162","volume":"19","author":"CH Vinkers","year":"2021","unstructured":"Vinkers, C. H., Lamberink, H. J., Tijdink, J. K., Heus, P., Bouter, L., Glasziou, P., Moher, D., Damen, J. A., Hooft, L., & Otte, W. M. (2021). The methodological quality of 176,620 randomized controlled trials published between 1966 and 2018 reveals a positive trend but also an urgent need for improvement. PLoS Biology, 19(4), e3001162. https:\/\/doi.org\/10.1371\/journal.pbio.3001162","journal-title":"PLoS Biology"},{"issue":"3\u20134","key":"4542_CR65","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1108\/DLP-08-2019-0031","volume":"35","author":"AE Williams","year":"2019","unstructured":"Williams, A. E. (2019). Exploring the utility of an emerging altmetric platform: A SWOT analysis of plum analytics. Digital Library Perspectives, 35(3\u20134), 193\u2013204. https:\/\/doi.org\/10.1108\/DLP-08-2019-0031","journal-title":"Digital Library Perspectives"},{"issue":"4","key":"4542_CR66","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1016\/j.ipm.2011.10.002","volume":"48","author":"S Yang","year":"2012","unstructured":"Yang, S., Han, R., Ding, J., & Song, Y. (2012). The distribution of web citations. Information Processing & Management, 48(4), 779\u2013790. https:\/\/doi.org\/10.1016\/j.ipm.2011.10.002","journal-title":"Information Processing & Management"},{"issue":"5","key":"4542_CR67","doi-asserted-by":"publisher","first-page":"e0197326","DOI":"10.1371\/journal.pone.0197326","volume":"13","author":"Z Zahedi","year":"2018","unstructured":"Zahedi, Z., & Costas, R. (2018). General discussion of data quality challenges in social media metrics: Extensive comparison of four major altmetric data aggregators. PLoS ONE, 13(5), e0197326. https:\/\/doi.org\/10.1371\/journal.pone.0197326","journal-title":"PLoS ONE"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04542-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04542-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04542-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T13:05:28Z","timestamp":1675256728000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04542-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":67,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["4542"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04542-z","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"18 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}