{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T23:32:33Z","timestamp":1762299153959,"version":"3.37.3"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2019,11,30]],"date-time":"2019-11-30T00:00:00Z","timestamp":1575072000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,30]],"date-time":"2019-11-30T00:00:00Z","timestamp":1575072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71874173","71273250"],"award-info":[{"award-number":["71874173","71273250"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002367","name":"Chinese Academy of Sciences","doi-asserted-by":"crossref","award":["2018-M04-B-004"],"award-info":[{"award-number":["2018-M04-B-004"]}],"id":[{"id":"10.13039\/501100002367","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100014455","name":"University of Tennessee, Knoxville","doi-asserted-by":"publisher","award":["CCI Dean's Summer Research Grant"],"award-info":[{"award-number":["CCI Dean's Summer Research Grant"]}],"id":[{"id":"10.13039\/100014455","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2020,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study examined F1000Prime recommended research and review articles published in Cell, JAMA: The Journal of the American Medical Association, The Lancet, and The New England Journal of Medicine (NEJM) in 2010. The analyses included (1) the classifications assigned to the articles; (2) differences in Web of Science (WoS) citation counts over 9\u00a0years between the articles with F1000Prime recommendations and the other articles of the same journal; (3) correlations between the F1000Prime rating scores and WoS citation counts; (4) scaled graphic comparisons of the two measures; (5) content analysis of the top 5 WoS cited and top 5 F1000Prime scored NEJM articles. The results show that most of the recommended articles were classified as New Finding, Clinical Trial, Conformation, Interesting Hypothesis, and Technical Advance. The top classifications differred between the medical journals (JAMA, The Lancet, and NEJM) and the biology journal (Cell); for the latter, both New Finding and Interesting Hypothesis occurred more frequently than the three medical journals. The articles recommended by F1000 Faculty members were cited significantly more than other articles of the same journal for the three medical journals, but no significance was found between the two sets of articles in Cell. The correlations between the F1000Prime rating scores and WoS citation counts of the articles in the same journal were significant for the two medical journals (The Lancet and NEJM) and the biology journal (Cell). NEJM showed significances in both the upper quantile (top 50%), and the upper quartile (top 25%) sets. One of the medical journals, JAMA, did not show any significant correlation between the two measures. Despite the significant correlations of the three journals, Min\u2013Max scaled graphic comparisons of the two measures did not reveal any patterns for predicting citation trends by F1000Prime rating scores. The peak citation year of the articles ranged from 2 to 8\u00a0years after the publication year for NEJM. Content analysis of the top-cited and top-scored NEJM articles found that highly commendable papers with comments such as \u201cexceptional,\u201d \u201clandmark study,\u201d or \u201cparadigm shift\u201d received varied rating scores. In comparison, some of the results corroborate with previous studies. Further studies are suggested to include additional journals and different years as well as alternative methods. Studies are needed to understand how F1000 Faculty assign ratings and what criteria they use. In addition, it is also worth investigating how F1000Prime users perceive the meanings of the ratings.<\/jats:p>","DOI":"10.1007\/s11192-019-03302-w","type":"journal-article","created":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T10:36:33Z","timestamp":1575282993000},"page":"933-955","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["F1000Prime recommended articles and their citations: an exploratory study of four journals"],"prefix":"10.1007","volume":"122","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4202-7570","authenticated-orcid":false,"given":"Peiling","family":"Wang","sequence":"first","affiliation":[]},{"given":"Joshua","family":"Williams","sequence":"additional","affiliation":[]},{"given":"Nan","family":"Zhang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1308-1669","authenticated-orcid":false,"given":"Qiang","family":"Wu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,11,30]]},"reference":[{"issue":"6","key":"3302_CR1","doi-asserted-by":"publisher","first-page":"e5910","DOI":"10.1371\/journal.pone.0005910","volume":"4","author":"L Allen","year":"2009","unstructured":"Allen, L., Jones, C., Dolby, K., Lynn, D., & Walport, M. (2009). Looking for landmarks: The role of expert review and bibliometric analysis in evaluating scientific publication outputs. PLoS ONE,4(6), e5910. https:\/\/doi.org\/10.1371\/journal.pone.0005910.","journal-title":"PLoS ONE"},{"issue":"2","key":"3302_CR2","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1152\/advan.00104.2006","volume":"31","author":"DJ Benos","year":"2007","unstructured":"Benos, D. J., et al. (2007). The ups and downs of peer review. American Journal of Physiology\u2014Advances in Physiology Education,31(2), 145\u2013152.","journal-title":"American Journal of Physiology\u2014Advances in Physiology Education"},{"issue":"12","key":"3302_CR3","doi-asserted-by":"publisher","first-page":"2415","DOI":"10.1002\/asi.23334","volume":"66","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L. (2015). Interrater reliability and convergent validity of F1000Prime peer review. Journal of the Association for Information Science and Technolog,66(12), 2415\u20132426. https:\/\/doi.org\/10.1002\/asi.23334.","journal-title":"Journal of the Association for Information Science and Technolog"},{"issue":"3","key":"3302_CR4","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1016\/j.joi.2015.04.001","volume":"9","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L., & Haunschild, R. (2015). Which people use which scientific papers? An evaluation of data from F1000 and Mendeley. Journal of Informetrics,9(3), 477\u2013487. https:\/\/doi.org\/10.1016\/j.joi.2015.04.001.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"3302_CR5","doi-asserted-by":"publisher","first-page":"1064","DOI":"10.1002\/asi.23729","volume":"68","author":"L Bornmann","year":"2016","unstructured":"Bornmann, L., & Haunschild, R. (2016). Relative citation ratio (RCR): An empirical attempt to study a new field\u2014Normalized bibliometric indicator. Journal of the Association for Information Science and Technology,68(4), 1064\u20131067. https:\/\/doi.org\/10.1002\/asi.23729.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"5","key":"3302_CR6","doi-asserted-by":"publisher","first-page":"e0197133","DOI":"10.1371\/journal.pone.0197133","volume":"13","author":"L Bornmann","year":"2018","unstructured":"Bornmann, L., & Haunschild, R. (2018). Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. PLoS ONE,13(5), e0197133. https:\/\/doi.org\/10.1371\/journal.pone.0197133.","journal-title":"PLoS ONE"},{"issue":"2","key":"3302_CR7","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1016\/j.joi.2012.12.0034","volume":"7","author":"L Bornmann","year":"2013","unstructured":"Bornmann, L., & Leydesdorff, L. (2013). The validation of (advanced) bibliometric indicators through peer assessments: A comparative study using data from InCites and F1000. Journal of Informetrics,7(2), 286\u2013291. https:\/\/doi.org\/10.1016\/j.joi.2012.12.0034.","journal-title":"Journal of Informetrics"},{"issue":"3","key":"3302_CR8","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1016\/j.joi.2015.03.001","volume":"9","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L., & Leydesdorff, L. (2015). Does quality and content matter for citedness? A comparison with para-textual factors and over time. Journal of Informetrics,9(3), 419\u2013429. https:\/\/doi.org\/10.1016\/j.joi.2015.03.001.","journal-title":"Journal of Informetrics"},{"issue":"29","key":"3302_CR28","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1016\/j.joi.2015.01.006","volume":"9","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L., & Marx, W. (2015). Methods for the generation of normalized citation impact scores in bibliometrics: Which method best reflects the judgments of experts? Journal of Informetrics, 9(29), 408\u2013418.","journal-title":"Journal of Informetrics"},{"issue":"11","key":"3302_CR29","doi-asserted-by":"publisher","first-page":"2215","DOI":"10.1002\/asi.23329","volume":"6","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L., & Mutz, R. (2015). Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 6(11), 2215\u20132222.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"4","key":"3302_CR9","doi-asserted-by":"publisher","first-page":"933","DOI":"10.1016\/j.joi.2013.09.003","volume":"7","author":"M Bornmann","year":"2013","unstructured":"Bornmann, M., Leydesdorff, L., & Wang, J. (2013). Which percentile-based approach should be preferred for calculating normalized citation impact values? An empirical comparison of five approaches including a newly developed citation-rank approach (P100). Journal of Informetrics,7(4), 933\u2013944. https:\/\/doi.org\/10.1016\/j.joi.2013.09.003.","journal-title":"Journal of Informetrics"},{"key":"3302_CR10","volume-title":"Science Since Babylon","author":"DJ de Solla Price","year":"1961","unstructured":"de Solla Price, D. J. (1961). Science Since Babylon. New Haven, CT: Yale University Press."},{"key":"3302_CR11","unstructured":"Doane, D. P., & Seward, L. E. (2011). Measuring skewness: A forgotten statistics? Journal of Statistics Education, 19(2). http:\/\/www.amstat.org\/publications\/jse\/v19n2\/doane.pdf. Accessed 11 Nov 2019."},{"key":"3302_CR12","unstructured":"Dorch, S. B. F. (2012). On the citation advantage of linking to data: Astrophysics. Journal of eScience Librarianship. Retrieved from https:\/\/www.researchgate.net\/publication\/229070295. Accessed 11 Nov 2019."},{"issue":"12","key":"3302_CR13","doi-asserted-by":"publisher","first-page":"3008","DOI":"10.1002\/asi.23548","volume":"67","author":"J Du","year":"2015","unstructured":"Du, J., Tang, X., & Wu, Y. (2015). The effects of research level and article type on the differences between citation metrics and F1000 recommendations. Journal of the Association for Information Science and Technology,67(12), 3008\u20133021. https:\/\/doi.org\/10.1002\/asi.23548.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"3302_CR14","doi-asserted-by":"publisher","first-page":"997","DOI":"10.1007\/s11192-018-2771-1","volume":"116","author":"R Haunschild","year":"2018","unstructured":"Haunschild, R., & Bornmann, L. (2018). Field- and time-normalization of data with many zeros: An empirical analysis using citation and Twitter data. Scientometrics,116(2), 997\u20131012.","journal-title":"Scientometrics"},{"key":"3302_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/s10746-014-9329-x","author":"S Hirschauer","year":"2015","unstructured":"Hirschauer, S. (2015). How editors decide; Oral communication in journal peer review. Human Studies. https:\/\/doi.org\/10.1007\/s10746-014-9329-x.","journal-title":"Human Studies"},{"issue":"2","key":"3302_CR16","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/s11192-011-0580-x","volume":"91","author":"X Li","year":"2011","unstructured":"Li, X., Thelwall, M., & Giustini, D. (2011). Validating online reference managers for scholarly impact measurement. Scientometrics,91(2), 461\u2013471.","journal-title":"Scientometrics"},{"issue":"2","key":"3302_CR17","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1007\/s11192-013-0993-9","volume":"97","author":"E Mohammadi","year":"2013","unstructured":"Mohammadi, E., & Thelwall, M. (2013). Assessing non-standard article impact using F1000 labels. Scientometrics,97(2), 383. https:\/\/doi.org\/10.1007\/s11192-013-0993-9.","journal-title":"Scientometrics"},{"issue":"1","key":"3302_CR18","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1002\/asi.23623","volume":"68","author":"S Pontis","year":"2015","unstructured":"Pontis, S., Blandford, A., Greifeneder, E., Attalla, H., & Neal, D. (2015). Keeping up to date: An academic researcher\u2019s information journey. Journal of the Association for Information Science and Technology,68(1), 22\u201335.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"3302_CR19","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1023\/B:SCIE.0000034376.55800.18","volume":"60","author":"H Small","year":"2004","unstructured":"Small, H. (2004). Why authors think their papers are highly cited. Scientometrics,60(3), 305\u2013316.","journal-title":"Scientometrics"},{"issue":"2","key":"3302_CR20","doi-asserted-by":"publisher","first-page":"e56180","DOI":"10.1371\/journal.pone.0056180","volume":"8","author":"PE Tressoldi","year":"2013","unstructured":"Tressoldi, P. E., Giofr\u00e9, D., Sella, F., & Cumming, G. (2013). High impact\u2009=\u2009high statistical standards? Not necessarily so. PLoS ONE,8(2), e56180.","journal-title":"PLoS ONE"},{"issue":"1","key":"3302_CR21","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1080\/02763869.2014.866488","volume":"33","author":"E Vardell","year":"2014","unstructured":"Vardell, E., & Swogger, S. E. (2014). F1000Prime: A faculty of 1000 tool. Medical Reference Services Quarterly,33(1), 75\u201384.","journal-title":"Medical Reference Services Quarterly"},{"issue":"3","key":"3302_CR22","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1002\/asi.23040","volume":"65","author":"L Waltman","year":"2014","unstructured":"Waltman, L., & Costas, R. (2014). F1000 recommendations as a potential new data source for research evaluation: A comparison with citations. Journal of the Association for Information Science & Technology,65(3), 433\u2013445.","journal-title":"Journal of the Association for Information Science & Technology"},{"issue":"3","key":"3302_CR23","doi-asserted-by":"publisher","first-page":"851","DOI":"10.1007\/s11192-012-0775-9","volume":"94","author":"J Wang","year":"2013","unstructured":"Wang, J. (2013). Citation time window choice for research impact evaluation. Scientometrics,94(3), 851\u2013872.","journal-title":"Scientometrics"},{"issue":"1","key":"3302_CR24","doi-asserted-by":"publisher","first-page":"n\/a-n\/a","DOI":"10.1002\/meet.14504201202","volume":"42","author":"Peiling Wang","year":"2006","unstructured":"Wang, P., & Bownas, J. (2005). Research classics and citation analysis. In Proceedings of the 2005 ASIST annual meeting (Charlotte, NC, October 28\u2013November 2) https:\/\/asistdl.onlinelibrary.wiley.com; https:\/\/doi.org\/10.1002\/meet.14504201202","journal-title":"Proceedings of the American Society for Information Science and Technology"},{"issue":"2","key":"3302_CR25","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1002\/(SICI)1097-4571(1999)50:2<98::AID-ASI2>3.0.CO;2-L","volume":"50","author":"P Wang","year":"1999","unstructured":"Wang, P., & White, M. D. (1999). A cognitive model of document use during a research project. Study II: Decisions at reading and citing stages. Journal of American Society for Information Science,50(2), 98\u2013114.","journal-title":"Journal of American Society for Information Science"},{"key":"3302_CR26","first-page":"11","volume":"3","author":"DA Wardle","year":"2010","unstructured":"Wardle, D. A. (2010). Do \u2018Faculty of 1000\u2019 (F1000) ratings of ecological publications serve as reasonable predictors of their future impact? Ideas in Ecology and Evolution, 3, 11\u201315.","journal-title":"Ideas in Ecology and Evolution"},{"issue":"4","key":"3302_CR27","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1087\/095315103322421982","volume":"16","author":"K Wets","year":"2003","unstructured":"Wets, K., Weedon, D., & Velterop, J. (2003). Post-publication filtering and evaluation: Faculty of 1000. Learned Publishing,16(4), 249\u2013258. https:\/\/doi.org\/10.1087\/095315103322421982.","journal-title":"Learned Publishing"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-019-03302-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-019-03302-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-019-03302-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,29]],"date-time":"2020-11-29T00:34:50Z","timestamp":1606610090000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-019-03302-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,30]]},"references-count":29,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,2]]}},"alternative-id":["3302"],"URL":"https:\/\/doi.org\/10.1007\/s11192-019-03302-w","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2019,11,30]]},"assertion":[{"value":"9 April 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 November 2019","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}