{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T15:54:47Z","timestamp":1776268487913,"version":"3.50.1"},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2013,4,7]],"date-time":"2013-04-07T00:00:00Z","timestamp":1365292800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2013,11]]},"DOI":"10.1007\/s11192-013-1002-z","type":"journal-article","created":{"date-parts":[[2013,4,6]],"date-time":"2013-04-06T03:09:57Z","timestamp":1365217797000},"page":"317-356","source":"Crossref","is-referenced-by-count":33,"title":["On peer review in computer science: analysis of its effectiveness and suggestions for improvement"],"prefix":"10.1007","volume":"97","author":[{"given":"Azzurra","family":"Ragone","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katsiaryna","family":"Mirylenka","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabio","family":"Casati","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maurizio","family":"Marchese","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2013,4,7]]},"reference":[{"issue":"8","key":"1002_CR1","first-page":"36","volume":"24","author":"J. Akst","year":"2010","unstructured":"Akst, J. (2010). I hate your paper. The Scientist, 24(8), 36\u201341.","journal-title":"The Scientist"},{"key":"1002_CR2","unstructured":"Barnes, J. (1981). Proof and the syllogism. In E. Berti (Ed.), Aristotle on science: The posterior analytics (pp. 17\u201359). Padua: Antenore."},{"key":"1002_CR3","doi-asserted-by":"crossref","first-page":"2","DOI":"10.2466\/pr0.1966.19.1.3","volume":"19","author":"J. J. Bartko","year":"1966","unstructured":"Bartko, J. J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological Reports, 19, 2\u201311.","journal-title":"Psychological Reports"},{"key":"1002_CR4","doi-asserted-by":"crossref","first-page":"418","DOI":"10.2466\/pr0.1974.34.2.418","volume":"34","author":"J. J. Bartko","year":"1974","unstructured":"Bartko, J. J. (1974). Corrective note to \u201cthe intraclass correlation coefficient as a measure of reliability\u201d. Psychological Reports, 34, 418.","journal-title":"Psychological Reports"},{"issue":"2","key":"1002_CR5","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1152\/advan.00104.2006","volume":"31","author":"D. J. Benos","year":"2007","unstructured":"Benos, D. J., Bashari, E., Chaves, J. M., Gaggar, A., et\u00a0al. (2007). The ups and downs of peer review. Advances in Physiology Education, 31(2), 145\u2013152.","journal-title":"Advances in Physiology Education"},{"issue":"5","key":"1002_CR6","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1145\/1506409.1506421","volume":"52","author":"K. Birman","year":"2009","unstructured":"Birman, K., & Schneider, F. (2009). Program committee overload in systems. Communications of the ACM, 52(5), 34\u201337.","journal-title":"Communications of the ACM"},{"issue":"6","key":"1002_CR7","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.1016\/j.ipm.2005.03.024","volume":"41","author":"J. Bollen","year":"2005","unstructured":"Bollen, J., Van de Sompel, H., Smith, J., & Luce, R. (2005). Toward alternative metrics of journal impact: A comparison of download and citation data. Information Processing & Management, 41(6), 1419\u20131440.","journal-title":"Information Processing Management"},{"key":"1002_CR8","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1038\/nj7127-566a","volume":"445","author":"L. Bornmann","year":"2007","unstructured":"Bornmann, L. (2007). Bias cut: Women, it seems, often get a raw deal in science\u2014So how can discrimination be tackled?. Nature, 445, 566.","journal-title":"Nature"},{"issue":"1","key":"1002_CR9","doi-asserted-by":"crossref","first-page":"15","DOI":"10.3152\/147154405781776283","volume":"14","author":"L. Bornmann","year":"2005","unstructured":"Bornmann, L., & Daniel, H. D. (2005a). Committee peer review at an international research foundation: Predictive validity and fairness of selection decisions on post-graduate fellowship applications. Research Evaluation, 14(1), 15\u201320.","journal-title":"Research Evaluation"},{"issue":"2","key":"1002_CR10","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/s11192-005-0214-2","volume":"63","author":"L. Bornmann","year":"2005","unstructured":"Bornmann, L., & Daniel, H. D. (2005b). Selection of research fellowship recipients by committee peer review. Reliability, fairness and predictive validity of board of trustees\u2019 decisions. Scientometrics, 63(2), 297\u2013320.","journal-title":"Scientometrics"},{"issue":"2","key":"1002_CR11","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1087\/20100207","volume":"23","author":"L. Bornmann","year":"2010","unstructured":"Bornmann, L., & Daniel, H. D. (2010a). Reliability of reviewers\u2019 ratings when using public peer review: A case study. Learned Publishing, 23(2), 124\u2013131.","journal-title":"Learned Publishing"},{"issue":"3","key":"1002_CR12","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1007\/s11192-010-0215-7","volume":"85","author":"L. Bornmann","year":"2010","unstructured":"Bornmann, L., & Daniel, H. D. (2010b). The validity of staff editors initial evaluations of manuscripts: A case study of angewandte chemie international edition. Scientometrics, 85(3), 681\u2013687.","journal-title":"Scientometrics"},{"issue":"4","key":"1002_CR13","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.joi.2008.09.003","volume":"2","author":"L. Bornmann","year":"2008","unstructured":"Bornmann, L., Mutz, R., & Daniel, H. D. D. (2008a). How to detect indications of potential sources of bias in peer review: A generalized latent variable modeling approach exemplified by a gender study. Journal of Informetrics, 2(4), 280\u2013287.","journal-title":"Journal of Informetrics"},{"key":"1002_CR14","doi-asserted-by":"crossref","unstructured":"Bornmann, L., Wallon, G., & Ledin, A. (2008b). Does the committee peer review select the best applicants for funding? An investigation of the selection process for two European Molecular Biology Organization Programmes. PLoS ONE, 3. doi: 10.1371\/journal.pone.0003480 .","DOI":"10.1371\/journal.pone.0003480"},{"key":"1002_CR15","unstructured":"Bornmann, L., Wolf, M., & Daniel, H. D. (2012). Closed versus open reviewing of journal manuscripts: How far do comments differ in language use? Scientometrics, 91(3), 843\u2013856. doi. 10.1007\/s11192-011-0569-5 . http:\/\/www.akademiai.com\/content\/0436287611KJ2063 ."},{"key":"1002_CR16","volume-title":"Statistics","author":"D. Brink","year":"2008","unstructured":"Brink, D. (2008). Statistics. Fredriksberg: Ventus Publishing ApS."},{"key":"1002_CR17","doi-asserted-by":"crossref","unstructured":"Cabanac, G., & Preuss, T. (2013). Capitalizing on order effects in the bids of peer-reviewed conferences to secure reviews by expert referees. Journal of the American Society for Information Science and Technology. doi: 10.1002\/asi.22747 .","DOI":"10.1002\/asi.22747"},{"issue":"8","key":"1002_CR18","doi-asserted-by":"crossref","first-page":"3157","DOI":"10.1073\/pnas.1014871108","volume":"108","author":"S. Ceci","year":"2011","unstructured":"Ceci, S., & Williams, W. (2011). Understanding current causes of women\u2019s underrepresentation in science. Proceedings of the National Academy of Sciences, 108(8), 3157\u20133162.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"6","key":"1002_CR19","first-page":"44","volume":"14","author":"S. J. Ceci","year":"1982","unstructured":"Ceci, S. J., & Peters, D. P. (1982). Peer review: A study of reliability. Climate Change, 14(6), 44\u201348.","journal-title":"Climate Change"},{"issue":"6","key":"1002_CR20","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1145\/1743546.1743569","volume":"53","author":"J. Chen","year":"2010","unstructured":"Chen, J., & Konstan, J. A. (2010). Conference paper selectivity and impact. Communications of the ACM, 53(6), 79\u201383. doi: 10.1145\/1743546.1743569 .","journal-title":"Communications of the ACM"},{"key":"1002_CR21","unstructured":"Cicchetti, D., & Sparrow, S. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127\u2013137."},{"issue":"4","key":"1002_CR22","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1007\/s10803-007-0448-3","volume":"36","author":"D. V. Cicchetti","year":"2008","unstructured":"Cicchetti, D. V., Lord, C., Koenig, K., Klin, A., & Volkmar, F. R. (2008). Reliability of the autism diagnostic interview: Multiple examiners evaluate a single case. Journal of Autism and Developmental Disorders, 36(4), 764\u2013770.","journal-title":"Journal of Autism and Developmental Disorders"},{"issue":"1","key":"1002_CR23","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"XX","author":"J. Cohen","year":"1960","unstructured":"Cohen, J. (1960). A coefficient of agreement for nominal scales. Education and Psychological Measurement, XX(1), 37\u201346.","journal-title":"Education and Psychological Measurement"},{"key":"1002_CR26","unstructured":"Davidoff, F., DeAngelis, C., Drazen, J., et\u00a0al. (2001). Sponsorship, authorship, and accountability. JAMA, 286(10), 1232\u20131234. doi: 10.1001\/jama.286.10.1232\/data\/Journals\/JAMA\/4799\/JED10056.pdf ."},{"issue":"1","key":"1002_CR24","doi-asserted-by":"crossref","first-page":"67","DOI":"10.2307\/1403259","volume":"54","author":"A. Donner","year":"1986","unstructured":"Donner, A. (1986). A review of inference procedures for the intraclass correlation coefficient in the one-way random effects model. International Statistical Review, 54(1), 67\u201382.","journal-title":"International Statistical Review"},{"issue":"4","key":"1002_CR25","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1007\/BF02288803","volume":"16","author":"R. L. Ebel","year":"1951","unstructured":"Ebel, R. L. (1951). Estimation of the reliability of ratings. Psychometrika, 16(4), 407\u2013424.","journal-title":"Psychometrika"},{"key":"1002_CR27","volume-title":"Statistical methods for research workers","author":"R. A. Fisher","year":"1925","unstructured":"Fisher, R. A. (1925). Statistical methods for research workers. Edinburgh: Oliver and Boyd."},{"issue":"5","key":"1002_CR28","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","volume":"76","author":"J. L. Fleiss","year":"1971","unstructured":"Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378\u2013382.","journal-title":"Psychological Bulletin"},{"issue":"11","key":"1002_CR29","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1145\/1839676.1839701","volume":"53","author":"J. Freyne","year":"2010","unstructured":"Freyne, J., Coyle, L., Smyth, B., & Cunningham, P. (2010). Relative status of journal and conference publications in computer science. Communications of the ACM, 53(11), 124\u2013132. doi: 10.1145\/1839676.1839701 .","journal-title":"Communications of the ACM"},{"issue":"3","key":"1002_CR30","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1001\/jama.280.3.237","volume":"280","author":"F. Godlee","year":"1998","unstructured":"Godlee, F., Gale, C. R., & Martyn, C. N. (1998). Effect on the quality of peer review of blinding reviewers and asking them to sign their reports a randomized controlled trial. JAMA, 280(3), 237\u2013240.","journal-title":"JAMA"},{"issue":"1","key":"1002_CR31","doi-asserted-by":"crossref","first-page":"11","DOI":"10.7326\/0003-4819-121-1-199407010-00003","volume":"121","author":"S. N. Goodman","year":"1994","unstructured":"Goodman, S. N., Berlin, J., Fletcher, S. W., & Fletcher, R. H. (1994). Manuscript quality before and after peer review and editing at annals of internal medicine. Annals of Internal Medicine, 121(1), 11\u201321.","journal-title":"Annals of Internal Medicine"},{"key":"1002_CR32","unstructured":"Grudin, J. (2010). Conferences, community, and technology: Avoiding a crisis. In iConference 2010."},{"key":"1002_CR33","doi-asserted-by":"crossref","DOI":"10.1002\/0471722146","volume-title":"Applied logistic regression","author":"D. W. Hosmer","year":"2000","unstructured":"Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression. Chichester: Wiley."},{"issue":"5","key":"1002_CR34","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/0002-9343(74)90635-4","volume":"56","author":"F. J. Ingelfinger","year":"1974","unstructured":"Ingelfinger, F. J. (1974). Peer review in biomedical publication. American Journal of Medicine, 56(5), 686\u2013692.","journal-title":"American Journal of Medicine"},{"issue":"1","key":"1002_CR35","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1108\/14684521011024191","volume":"34","author":"P. Jacso","year":"2010","unstructured":"Jacso, P. (2010). Metadata mega mess in Google Scholar. Online Information Review, 34(1), 175\u2013191.","journal-title":"Online Information Review"},{"issue":"21","key":"1002_CR36","doi-asserted-by":"crossref","first-page":"2784","DOI":"10.1001\/jama.287.21.2784","volume":"287","author":"T. Jefferson","year":"2002","unstructured":"Jefferson, T., Alderson, P., Wager, E., & Davidoff, F. (2002a). Effects of editorial peer review: A systematic review. JAMA, 287(21), 2784\u20132786.","journal-title":"JAMA"},{"issue":"21","key":"1002_CR37","doi-asserted-by":"crossref","first-page":"2786","DOI":"10.1001\/jama.287.21.2786","volume":"287","author":"T. Jefferson","year":"2002","unstructured":"Jefferson, T., Wager, E., & Davidoff, F. (2002b). Measuring the quality of editorial peer review. JAMA, 287(21), 2786\u20132790.","journal-title":"JAMA"},{"issue":"2","key":"1002_CR38","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1001\/jama.1994.03520020022005","volume":"272","author":"J. P. Kassirer","year":"1994","unstructured":"Kassirer, J. P., & Campion, E. W. (1994). Peer review: Crude and understudied, but indispensable. Journal of American Medical Association, 272(2), 96\u201397.","journal-title":"Journal of American Medical Association"},{"key":"1002_CR39","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.2214\/ajr.179.6.1791415","volume":"179","author":"D. S. Katz","year":"2002","unstructured":"Katz, D. S., Proto, A. V., & Olmsted, W. W. (2002). Incidence and nature of unblinding by authors: Our experience at two radiology journals with double-blinded peer review policies. The American Journal of Roentgenology, 179, 1415\u20131417.","journal-title":"The American Journal of Roentgenology"},{"issue":"1\u20132","key":"1002_CR40","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","volume":"30","author":"M. G. Kendall","year":"1938","unstructured":"Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1\u20132), 81\u201393.","journal-title":"Biometrika"},{"issue":"1","key":"1002_CR41","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1142\/S0219525910002487","volume":"13","author":"M. Krapivin","year":"2010","unstructured":"Krapivin, M., Marchese, M., & Casati, F. (2010). Exploring and understanding citation-based scientific metrics. Advances in Complex Systems, 13(1), 59\u201381.","journal-title":"Advances in Complex Systems"},{"issue":"260","key":"1002_CR42","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1080\/01621459.1952.10483441","volume":"47","author":"W. H. Kruskal","year":"1952","unstructured":"Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association, 47(260), 583\u2013621.","journal-title":"Journal of the American Statistical Association"},{"key":"1002_CR43","doi-asserted-by":"crossref","unstructured":"Li, X., Thelwall, M., & Giustini, D. (2012). Validating online reference managers for scholarly impact measurement. Scientometrics 91(2), 461\u2013471. doi: 10.1007\/s11192-011-0580-x . http:\/\/www.akademiai.com\/content\/35146TH23T1J1284 .","DOI":"10.1007\/s11192-011-0580-x"},{"issue":"3","key":"1002_CR44","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1001\/jama.280.3.246","volume":"280","author":"A. M. Link","year":"1998","unstructured":"Link, A. M. (1998). US and non-US submissions an analysis of reviewer bias. JAMA, 280(3), 246\u2013247.","journal-title":"JAMA"},{"issue":"1","key":"1002_CR45","doi-asserted-by":"crossref","first-page":"60","DOI":"10.7326\/0003-4819-121-1-199407010-00012","volume":"121","author":"S. Lock","year":"1994","unstructured":"Lock, S. (1994). Does editorial peer review work?. Annals of Internal Medicine, 121(1), 60\u201361.","journal-title":"Annals of Internal Medicine"},{"issue":"76450","key":"1002_CR46","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1136\/bmj.39482.526713.BE","volume":"336","author":"C. Lokker","year":"2008","unstructured":"Lokker, C., McKibbon, K. A., McKinlay, R. J., Wilczynski, N. L., & Haynes, R. B. (2008). Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: Retrospective cohort study. British Medical Journal, 336(76450), 655\u2013657.","journal-title":"British Medical Journal"},{"issue":"2","key":"1002_CR47","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/1147376.1147381","volume":"35","author":"S. Madden","year":"2006","unstructured":"Madden, S., & DeWitt, D. (2006). Impact of double-blind reviewing on sigmod publication rates. ACM SIGMOD Record, 35(2), 29\u201332.","journal-title":"ACM SIGMOD Record"},{"issue":"1","key":"1002_CR48","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1037\/1082-989X.1.1.30","volume":"1","author":"K. O. McGraw","year":"1996","unstructured":"McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30\u201346.","journal-title":"Psychological Methods"},{"issue":"1","key":"1002_CR49","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/1472-6963-2-8","volume":"2","author":"A. Montgomery","year":"2002","unstructured":"Montgomery, A., Graham, A., Evans. P., & Fahey, T. (2002). Inter-rater agreement in the scoring of abstracts submitted to a primary care research conference. BMC Health Services Research, 2(1), 8.","journal-title":"BMC Health Services Research"},{"key":"1002_CR50","unstructured":"Ragone, A., Mirylenka, K., Casati, F., & Marchese, M. (2011). A quantitative analysis of peer review. In E. Noyons & P. Ngulube (Eds.), Proceedings of ISSI 2011\u2014The 13th IIternational conference on scientometrics and Iiformetrics, South Africa, Durban, July 4\u20137, pp. 724\u2013746."},{"issue":"3","key":"1002_CR51","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1007\/s11192-008-2220-7","volume":"81","author":"M. Reinhart","year":"2009","unstructured":"Reinhart, M. (2009). Peer review of grant applications in biology and medicine. Reliability, fairness, and validity. Scientometrics, 81(3), 789\u2013809.","journal-title":"Scientometrics"},{"issue":"2","key":"1002_CR52","first-page":"420","volume":"86","author":"P. E. Shrout","year":"1979","unstructured":"Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. International Statistical Review, 86(2), 420\u2013428.","journal-title":"International Statistical Review"},{"issue":"4","key":"1002_CR53","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1258\/jrsm.99.4.178","volume":"99","author":"R. Smith","year":"2006","unstructured":"Smith, R. (2006). Peer review: A flawed process at the heart of science and journals. JRSM, 99(4), 178.","journal-title":"JRSM"},{"issue":"8","key":"1002_CR54","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/S0167-7799(02)01985-6","volume":"20","author":"R. Spier","year":"2002","unstructured":"Spier, R. (2002). The history of the peer-review process. Trends in Biotechnology, 20(8), 357\u2013358.","journal-title":"Trends in Biotechnology"},{"key":"1002_CR55","doi-asserted-by":"crossref","unstructured":"Tung, A. K. H. (2006). Impact of double blind reviewing on sigmod publication: A more detail analysis. SIGMOD Record, 35(3), 6\u20137.","DOI":"10.1145\/1168092.1168093"},{"key":"1002_CR56","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1136\/bmj.318.7175.23","volume":"318","author":"S. van Rooyen","year":"1999","unstructured":"van Rooyen, S., Godlee, F., Evans, S., Black, N., & Smith, R. (1999). Effect of open peer review on quality of reviews and on reviewers\u2019 recommendations: A randomised trial. British Medical Journal, 318, 23\u201327.","journal-title":"British Medical Journal"},{"key":"1002_CR57","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1192\/bjp.176.1.47","volume":"176","author":"E. Walsh","year":"2000","unstructured":"Walsh, E., Rooney, M., Appleby, L., & Wilkinson, G. (2000). Open peer review: A randomised controlled trial. The British Journal of Psychiatry, 176, 47\u201351.","journal-title":"The British Journal of Psychiatry"},{"issue":"1\/2","key":"1002_CR58","doi-asserted-by":"crossref","first-page":"28","DOI":"10.2307\/2332510","volume":"34","author":"B. L. Welch","year":"1947","unstructured":"Welch, B. L. (1947). The generalization of student\u2019s problem when several different population variances are involved. Biometrika, 34(1\/2), 28\u201335.","journal-title":"Biometrika"},{"key":"1002_CR59","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1038\/387341a0","volume":"387","author":"C. Wenneras","year":"1997","unstructured":"Wenneras, C., & Wold, A. (1997). Nepotism and sexism in peer-review. Nature, 387, 341\u2013343.","journal-title":"Nature"},{"key":"1002_CR60","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1007\/BF01553188","volume":"9","author":"H. Zuckerman","year":"1971","unstructured":"Zuckerman, H., & Merton, R. (1971). Patterns of evaluation in science: Institutionalisation, structure and functions of the referee system. Minerva, 9, 66\u2013100. doi: 10.1007\/BF01553188 .","journal-title":"Minerva"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-013-1002-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-013-1002-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-013-1002-z","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T05:34:28Z","timestamp":1559367268000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-013-1002-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4,7]]},"references-count":60,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2013,11]]}},"alternative-id":["1002"],"URL":"https:\/\/doi.org\/10.1007\/s11192-013-1002-z","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,4,7]]}}}