{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T22:49:52Z","timestamp":1775861392647,"version":"3.50.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2013,8,30]],"date-time":"2013-08-30T00:00:00Z","timestamp":1377820800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2014,2]]},"DOI":"10.1007\/s11192-013-1117-2","type":"journal-article","created":{"date-parts":[[2013,8,29]],"date-time":"2013-08-29T12:09:13Z","timestamp":1377778153000},"page":"1131-1143","source":"Crossref","is-referenced-by-count":197,"title":["Evaluating altmetrics"],"prefix":"10.1007","volume":"98","author":[{"given":"Pardeep","family":"Sud","sequence":"first","affiliation":[]},{"given":"Mike","family":"Thelwall","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2013,8,30]]},"reference":[{"key":"1117_CR1","unstructured":"Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., & Terliesner, J. (2012). Beyond citations: Scholars\u2019 visibility on the social Web, 17th International Conference on Science and Technology Indicators (STI2012) (pp. 98\u2013109). Montreal: Science-Metrix and OST."},{"issue":"5","key":"1117_CR2","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1111\/j.1467-9280.2006.01715.x","volume":"17","author":"JL Blackburn","year":"2006","unstructured":"Blackburn, J. L., & Hakel, M. D. (2006). An examination of sources of peer-review bias. Psychological Science, 17(5), 378\u2013382. doi: 10.1111\/j.1467-9280.2006.01715.x .","journal-title":"Psychological Science"},{"issue":"3","key":"1117_CR3","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s11192-007-1950-2","volume":"77","author":"L Bornmann","year":"2008","unstructured":"Bornmann, L., Nast, I., & Daniel, H.-D. (2008). Do editors and referees look for signs of scientific misconduct when reviewing manuscripts? A quantitative content analysis of studies that examined review criteria and reasons for accepting and rejecting manuscripts for publication. Scientometrics, 77(3), 415\u2013432.","journal-title":"Scientometrics"},{"key":"1117_CR4","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1002\/asi.4630370106","volume":"37","author":"TA Brooks","year":"1986","unstructured":"Brooks, T. A. (1986). Evidence of complex citer motivations. Journal of the American Society for Information Science, 37, 34\u201336.","journal-title":"Journal of the American Society for Information Science"},{"issue":"7","key":"1117_CR5","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1002\/(SICI)1097-4571(2000)51:7<635::AID-ASI6>3.0.CO;2-H","volume":"51","author":"DO Case","year":"2000","unstructured":"Case, D. O., & Higgins, G. M. (2000). How can we investigate citation behaviour? A study of reasons for citing literature in communication. Journal of the American Society for Information Science, 51(7), 635\u2013645.","journal-title":"Journal of the American Society for Information Science"},{"issue":"8","key":"1117_CR6","doi-asserted-by":"crossref","first-page":"3157","DOI":"10.1073\/pnas.1014871108","volume":"108","author":"SJ Ceci","year":"2011","unstructured":"Ceci, S. J., & Williams, W. M. (2011). Understanding current causes of women\u2019s underrepresentation in science. Proceedings of the National Academy of Sciences of the United States of America, 108(8), 3157\u20133162.","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"7","key":"1117_CR7","doi-asserted-by":"crossref","first-page":"e40253","DOI":"10.1371\/journal.pone.0040253","volume":"7","author":"T Desai","year":"2012","unstructured":"Desai, T., Shariff, A., Shariff, A., Kats, M., Fang, X., et al. (2012). Tweeting the meeting: An in-depth analysis of Twitter activity at Kidney Week 2011. PLoS One, 7(7), e40253. doi: 10.1371\/journal.pone.0040253 .","journal-title":"PLoS One"},{"key":"1117_CR8","unstructured":"Helic, H., Strohmaier, M., Trattner, C., Muhr, M., & Lerman, K. (2011). Pragmatic evaluation of folksonomies. Proceedings of the 20th international conference on world wide web (WWW2011) (pp. 417\u2013426). New York, NY: ACM."},{"issue":"10","key":"1117_CR9","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.1001\/jama.1990.03440100162024","volume":"263","author":"DF Horrobin","year":"1990","unstructured":"Horrobin, D. F. (1990). The philosophical basis of peer review and the suppression of innovation. Journal of the American Medical Association, 263(10), 1438\u20131441.","journal-title":"Journal of the American Medical Association"},{"issue":"7","key":"1117_CR10","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1002\/asi.20584","volume":"58","author":"K Kousha","year":"2007","unstructured":"Kousha, K., & Thelwall, M. (2007). Google scholar citations and Google Web\/URL citations: A multi-discipline exploratory analysis. Journal of the American Society for Information Science and Technology, 58(7), 1055\u20131065.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"13","key":"1117_CR11","doi-asserted-by":"crossref","first-page":"2060","DOI":"10.1002\/asi.20920","volume":"59","author":"K Kousha","year":"2008","unstructured":"Kousha, K., & Thelwall, M. (2008). Assessing the impact of disciplinary research on teaching: An automatic analysis of online syllabuses. Journal of the American Society for Information Science and Technology, 59(13), 2060\u20132069.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"8","key":"1117_CR12","doi-asserted-by":"crossref","first-page":"1537","DOI":"10.1002\/asi.21085","volume":"60","author":"K Kousha","year":"2009","unstructured":"Kousha, K., & Thelwall, M. (2009). Google book search: Citation analysis for social science and the humanities. Journal of the American Society for Information Science and Technology, 60(8), 1537\u20131549.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"1117_CR13","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.joi.2009.10.003","volume":"4","author":"K Kousha","year":"2010","unstructured":"Kousha, K., Thelwall, M., & Rezaie, S. (2010). Using the web for research evaluation: The integrated online impact indicator. Journal of Informetrics, 4(1), 124\u2013135.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"1117_CR14","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1002\/asi.22784","volume":"64","author":"C Lee","year":"2013","unstructured":"Lee, C., Sugimoto, C. R., & Zhang, G. (2013). Bias in peer review. Journal of American Society for Information Science and Technology, 64(1), 2\u201317.","journal-title":"Journal of American Society for Information Science and Technology"},{"issue":"2","key":"1117_CR15","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.ipm.2010.09.005","volume":"47","author":"J Levitt","year":"2011","unstructured":"Levitt, J., & Thelwall, M. (2011). A combined bibliometric indicator to predict article impact. Information Processing and Management, 47(2), 300\u20133008.","journal-title":"Information Processing and Management"},{"issue":"2","key":"1117_CR16","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1007\/s11192-011-0580-x","volume":"91","author":"X Li","year":"2012","unstructured":"Li, X., Thelwall, M., & Giustini, D. (2012). Validating online reference managers for scholarly impact measurement. Scientometrics, 91(2), 461\u2013471.","journal-title":"Scientometrics"},{"issue":"3","key":"1117_CR17","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1007\/BF02129604","volume":"36","author":"MH MacRoberts","year":"1996","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (1996). Problems of citation analysis. Scientometrics, 36(3), 435\u2013444.","journal-title":"Scientometrics"},{"issue":"2","key":"1117_CR18","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/BF01173636","volume":"1","author":"MJ Mahoney","year":"1977","unstructured":"Mahoney, M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research, 1(2), 161\u2013175.","journal-title":"Cognitive Therapy and Research"},{"key":"1117_CR19","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1038\/480449a","volume":"480","author":"A Marcus","year":"2011","unstructured":"Marcus, A., & Oransky, I. (2011). Science publishing: The paper is not sacred. Nature, 480, 449\u2013450.","journal-title":"Nature"},{"key":"1117_CR20","volume-title":"The sociology of science. Theoretical and empirical investigations","author":"RK Merton","year":"1973","unstructured":"Merton, R. K. (1973). The sociology of science. Theoretical and empirical investigations. Chicago: University of Chicago Press."},{"key":"1117_CR21","volume-title":"Citation analysis in research evaluation","author":"HF Moed","year":"2005","unstructured":"Moed, H. F. (2005). Citation analysis in research evaluation. New York: Springer."},{"key":"1117_CR22","doi-asserted-by":"crossref","unstructured":"Mohammadi, E., & Thelwall, M. (2013). Assessing non-standard article impact using F1000 labels. Scientometrics. doi: 10.1007\/s11192-013-0993-9 .","DOI":"10.1007\/s11192-013-0993-9"},{"key":"1117_CR23","volume-title":"The content analysis guidebook","author":"K Neuendorf","year":"2002","unstructured":"Neuendorf, K. (2002). The content analysis guidebook. London: Sage."},{"key":"1117_CR24","first-page":"405","volume-title":"The web of knowledge: A festschrift in honor of Eugene Garfield","author":"C Oppenheim","year":"2000","unstructured":"Oppenheim, C. (2000). Do patent citations count? In B. Cronin & H. B. Atkins (Eds.), The web of knowledge: A festschrift in honor of Eugene Garfield (pp. 405\u2013432). Metford, NJ: Information Today Inc. ASIS Monograph Series."},{"key":"1117_CR25","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1017\/S0140525X00011183","volume":"5","author":"DP Peters","year":"1982","unstructured":"Peters, D. P., & Cecia, S. J. (1982). Peer-review practices of psychological journals: The fate of published articles, submitted again. Behavioral and Brain Sciences, 5, 187\u2013195.","journal-title":"Behavioral and Brain Sciences"},{"key":"1117_CR26","doi-asserted-by":"crossref","unstructured":"Priem, J., & Costello, K. L. (2010). How and why scholars cite on twitter. Proceedings of the American society for information science and technology (ASIST 2010) (pp. 1\u20134). doi: 10.1002\/meet.14504701201 .","DOI":"10.1002\/meet.14504701201"},{"key":"1117_CR27","unstructured":"Priem, J., Piwowar, H.A., & Hemminger, B.M. (2012). Altmetrics in the wild: using social media to explore scholarly impact. Retrieved from http:\/\/arxiv.org\/abs\/1203.4745v1 . Accessed 23 Aug 2013."},{"key":"1117_CR28","unstructured":"Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2011). Altmetrics: A manifesto. Retrieved from http:\/\/altmetrics.org\/manifesto\/ . Accessed 23 Aug 2013."},{"issue":"1926","key":"1117_CR29","doi-asserted-by":"crossref","first-page":"4039","DOI":"10.1098\/rsta.2010.0155","volume":"368","author":"R Procter","year":"2010","unstructured":"Procter, R., Williams, R., Stewart, J., Poschen, M., Snee, H., Voss, A., et al. (2010). Adoption and use of Web 2.0 in scholarly communications. Philosophical Transactions of the Royal Society A, 368(1926), 4039\u20134056.","journal-title":"Philosophical Transactions of the Royal Society A"},{"issue":"3","key":"1117_CR30","doi-asserted-by":"crossref","first-page":"224","DOI":"10.3109\/17453679809000920","volume":"69","author":"PO Seglen","year":"1998","unstructured":"Seglen, P. O. (1998). Citation rates and journal impact factors are not suitable for evaluation of research. Acta Orthopaedica Scandinavica, 69(3), 224\u2013229.","journal-title":"Acta Orthopaedica Scandinavica"},{"issue":"5","key":"1117_CR31","doi-asserted-by":"crossref","first-page":"e35869","DOI":"10.1371\/journal.pone.0035869","volume":"7","author":"H Shema","year":"2012","unstructured":"Shema, H., Bar-Ilan, J., & Thelwall, M. (2012). Research blogs and the discussion of scholarly information. PLoS One, 7(5), e35869. doi: 10.1371\/journal.pone.0035869 .","journal-title":"PLoS One"},{"issue":"5","key":"1117_CR32","doi-asserted-by":"crossref","first-page":"e64841","DOI":"10.1371\/journal.pone.0064841","volume":"8","author":"M Thelwall","year":"2013","unstructured":"Thelwall, M., Haustein, S., Larivi\u00e8re, V., & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PLOS One, 8(5), e64841. doi: 10.1371\/journal.pone.0064841 .","journal-title":"PLOS One"},{"issue":"5","key":"1117_CR33","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1002\/asi.20803","volume":"59","author":"M Thelwall","year":"2008","unstructured":"Thelwall, M., & Kousha, K. (2008). Online presentations as a source of scientific impact? An analysis of PowerPoint files citing academic journals. Journal of the American Society for Information Science and Technology, 59(5), 805\u2013815.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"1117_CR34","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1007\/BF02458401","volume":"43","author":"AFJ Raan van","year":"1998","unstructured":"van Raan, A. F. J. (1998). In matters of quantitative studies of science the fault of theorists is offering too little and asking too much. Scientometrics, 43(1), 129\u2013148.","journal-title":"Scientometrics"},{"issue":"6","key":"1117_CR35","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1108\/00012530210452555","volume":"54","author":"L Vaughan","year":"2002","unstructured":"Vaughan, L., & Huysen, K. (2002). Relationship between links to journal Web sites and impact factors. ASLIB Proceedings, 54(6), 356\u2013361.","journal-title":"ASLIB Proceedings"},{"issue":"14","key":"1117_CR36","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1002\/asi.10338","volume":"54","author":"L Vaughan","year":"2003","unstructured":"Vaughan, L., & Shaw, D. (2003). Bibliographic and web citations: What is the difference? Journal of the American Society for Information Science and Technology, 54(14), 1313\u20131322.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"10","key":"1117_CR37","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1002\/asi.20199","volume":"56","author":"L Vaughan","year":"2005","unstructured":"Vaughan, L., & Shaw, D. (2005). Web citation data for impact assessment: A comparison of four science disciplines. Journal of the American Society for Information Science and Technology, 56(10), 1075\u20131087.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"1117_CR38","unstructured":"Weller, K., Dornst\u00e4dter, R., Freimanis, R., Klein, R. N., & Perez, M. (2010). Social software in academia: Three studies on users\u2019 acceptance of web 2.0 services. Proceedings of the 2nd Web Science Conference (WebSci10), Retrieved May 29, 2013 from http:\/\/www.phil-fak.uni-duesseldorf.de\/fileadmin\/Redaktion\/Institute\/Informationswissenschaft\/weller\/websci10_submission_62.pdf ."},{"key":"1117_CR39","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1038\/387341a0","volume":"387","author":"C Wenner\u00e5s","year":"1997","unstructured":"Wenner\u00e5s, C., & Wold, A. (1997). Nepotism and sexism in peer-review. Nature, 387, 341\u2013343.","journal-title":"Nature"},{"key":"1117_CR40","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199240531.001.0001","volume-title":"The intellectual and social organization of the sciences","author":"R Whitley","year":"2000","unstructured":"Whitley, R. (2000). The intellectual and social organization of the sciences (2nd ed.). Oxford: Oxford University Press.","edition":"2"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-013-1117-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-013-1117-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-013-1117-2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T12:15:01Z","timestamp":1715948101000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-013-1117-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,8,30]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2014,2]]}},"alternative-id":["1117"],"URL":"https:\/\/doi.org\/10.1007\/s11192-013-1117-2","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,8,30]]}}}