{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:26:32Z","timestamp":1777854392998,"version":"3.51.4"},"reference-count":120,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2004,8,1]],"date-time":"2004-08-01T00:00:00Z","timestamp":1091318400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2004,8]]},"abstract":"<jats:p>The use of peer review within both the scholarly communication system and the UK\u2019s Research Assessment Exercise is reviewed. The common denominator is that of peer-reviewed academic journals, since peer review is used by referees to aid publication decisions and by RAE panel members to evaluate a department\u2019s research performance. We propose that since academic research is now subject to peer review at all stages of evaluation, it is becoming an accepted method of rewarding (by funding) research. The growth of electronic publications (both toll-access and open access) provides possibilities for changes to some of the process of peer review and RAE, but the fundamental model of peer review to reduce the number of poor quality publications will remain. The paper concludes that because of the many criticisms of peer review, it is unwise to base funding decisions on second level peer review of articles that have already undergone peer review.<\/jats:p>","DOI":"10.1177\/0165551504045854","type":"journal-article","created":{"date-parts":[[2004,9,6]],"date-time":"2004-09-06T10:25:32Z","timestamp":1094466332000},"page":"347-368","source":"Crossref","is-referenced-by-count":45,"title":["The Influence of Peer Review on the Research Assessment Exercise"],"prefix":"10.1177","volume":"30","author":[{"given":"Valerie","family":"Bence","sequence":"first","affiliation":[{"name":"Department of Information Science, Loughborough University, UK"}]},{"given":"Charles","family":"Oppenheim","sequence":"additional","affiliation":[{"name":"Department of Information Science, Loughborough University, UK,"}]}],"member":"179","published-online":{"date-parts":[[2004,8,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2273.1989.tb01491.x"},{"key":"atypb2","volume-title":"PostNote No. 182 on Peer Review","year":"2002"},{"key":"atypb3","volume-title":"Public Knowledge","author":"J. Ziman","year":"1968"},{"key":"atypb4","volume-title":"EDUCOM Conference: Portland","author":"J. Willis"},{"key":"atypb5","volume-title":"Los Alamos pre-print server website","year":"2004"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1629\/040209"},{"key":"atypb7","series-title":"ASIST Monograph Series","volume-title":"Editorial Peer Review: Its Strength and Weaknesses","author":"A.C. Weller","year":"2001"},{"key":"atypb8","volume-title":"Scholarly Publishing: Books, Journals, Publishers and Libraries in the Twentieth Century","author":"R.E. Abel","year":"2002"},{"key":"atypb9","volume-title":"Proceedings, Conference of the PSA Political Science Group","author":"F. Nash"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1986.03380170107031"},{"key":"atypb11","volume-title":"Difficult Balance: Editorial Peer Review in Medicine","author":"S.A. Lock","year":"1986"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1002\/3527602208"},{"key":"atypb13","volume-title":"Towards Electronic Journals: Realities for Scientists, Librarians and Publishers","author":"C. Tenopir","year":"2000"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1087\/095315102753303634"},{"key":"atypb15","unstructured":"[15]                      A.J. Meadows                 , Communicating Research (                     Academic Press, San Diego                 , 1998) 177-194."},{"key":"atypb16","volume":"7","author":"F. Rowland","year":"1997","journal-title":"Ariadne"},{"key":"atypb17","unstructured":"[17] Journal of the American Medical Association, themed issue                 280 (1998)."},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1087\/095315104322710278"},{"key":"atypb19","first-page":"192","volume-title":"The New HE: Issues and Directions for the post-Dearing University","author":"F. Lee","year":"1998"},{"key":"atypb20","volume":"2","author":"P. Evans","year":"1995","journal-title":"Literati Newsline; Special Issue for Authors and Editors"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.5144\/0256-4947.2001.275"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.3138\/JSP-028-03-135"},{"key":"atypb23","volume-title":"ICSU Press Workshop, Keble College Oxford, 31\/3\/1998-2\/4\/1998","author":"B. Donovan"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1087\/095315102760319206"},{"key":"atypb25","volume-title":"Review of Research Assessment: A Report to the Funding Bodies","author":"G. Roberts","year":"2003"},{"key":"atypb26","unstructured":"[26]\n                      Ibid.\n                      ,\n                      Recommendation\n                      1, 7."},{"key":"atypb27","unstructured":"[27]                      A.C. Weller                 , Editorial peer review: its strength and weaknesses, ASIST                     Monograph Series (                     Medford, NJ: American Society for Information                         Science and Technology                 , 2001) 307."},{"key":"atypb28","first-page":"7","volume-title":"Editing the Refereed Scientific Journal: Practical, Political and Ethical Issues","author":"D.E. Chubin","year":"1994"},{"key":"atypb29","unstructured":"[29] Ibid. 8."},{"key":"atypb30","unstructured":"[30]                      J. Adams                 ,                      et al                 . Benchmarking of the International Standing of Research in England: a                     Consultancy Study on Bibliometric Analysis (Report by                      Centre for Policy Studies in Education, Leeds University                 , 1998) 31."},{"key":"atypb31","volume-title":"Proceedings of the 8th International Congress on Medical Librarianship","author":"A.C. Weller"},{"key":"atypb32","volume-title":"Peer Review in Medicine","author":"F. Godlee","year":"1999"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.176.1.47"},{"issue":"084","key":"atypb34","volume":"11","author":"C. Tenopir","year":"2000","journal-title":"Psycoloquy (e-Journal)"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1080\/01972243.1995.9960200"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1990.tb00234.x"},{"key":"atypb37","volume-title":"Scholarly Journals at the Crossroads: a Subversive Proposal for Electronic Publishing","author":"S. Harnad","year":"1995"},{"key":"atypb38","volume-title":"I in the Sky: Visions of the Information Future","author":"S. Harnad","year":"1999"},{"issue":"12","key":"atypb39","volume":"5","author":"S. Harnad","year":"1999","journal-title":"D-Lib Magazine"},{"key":"atypb40","volume-title":"ESPERE Project","year":"2004"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007165"},{"issue":"2","key":"atypb42","volume":"6","author":"S. Buckingham Shum","year":"2001","journal-title":"First Monday"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1087\/09531519750147148"},{"key":"atypb44","volume-title":"Emerald publisher\u2019s website","year":"2004"},{"key":"atypb45","volume-title":"Elsevier publisher\u2019s website, Author Gateway","year":"2004"},{"key":"atypb46","volume-title":"Report to RSLG","author":"JISC Scholarly Communications Group","year":"2004"},{"key":"atypb47","unstructured":"[47] Psycoloquy, e-journal. Available at:                 http:\/\/psycprints.ecs.soton.ac.uk\/ (accessed 17 May 2004)."},{"key":"atypb48","first-page":"103","volume-title":"Scholarly Publication: the Electronic Frontier","author":"S. Harnad","year":"1996"},{"key":"atypb49","unstructured":"[49] First Monday e-journal. Available at:                 www.firstmonday.org (accessed 17 May 2004)."},{"key":"atypb50","unstructured":"[50] Journal of Artificial Intelligence Research e-journal.                 Available at: http:\/\/cs.Washington.edu\/research\/jair\/submission-info.html                 (accessed 17 May 2004)."},{"key":"atypb51","volume-title":"Sociological Research Online","year":"2004"},{"key":"atypb52","unstructured":"[52] Internet Archaeology e-journal. Available at:                 http:\/\/intarch.ac.uk\/news\/rae.html (accessed 17 May 2004)."},{"key":"atypb53","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1136\/bmj.318.7175.4","volume":"318","author":"R. Smith","year":"1999","journal-title":"British Medical Journal"},{"key":"atypb54","volume-title":"Public Library of Science (PLoS)","year":"2004"},{"key":"atypb55","author":"S. Harnad","year":"1998","journal-title":"Nature"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1108\/09684880110381283"},{"key":"atypb57","unstructured":"[57]                      L.V. Jones                 ,                      et al. An Assessment of Research Doctorate Programs in the USA (                     National Academic Press, Washington DC                 , 1982) [5 vols] 2."},{"issue":"1","key":"atypb58","first-page":"42","volume":"45","author":"S.N. Ali","year":"1996","journal-title":"Library Review"},{"key":"atypb59","unstructured":"[59] A. Wells,\n                      Exploring the Development of the Independent, Electronic,                     Scholarly Journal.\n                      [Unpublished MSc Thesis, University of Sheffield,                 Department of Information Studies, 1998\/99]."},{"key":"atypb60","unstructured":"[60] A.S. Hirst,\n                      Measuring Journal Quality: Developing a Multi-item                     Measure and Investigating its Usefulness in Marketing\n                      . [Unpublished PhD                 Thesis, Loughborough University, 1999] 5."},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1080\/00014788.1996.9729516"},{"issue":"4","key":"atypb62","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1111\/1467-6478.00137","volume":"26","author":"K. Campbell","year":"1999","journal-title":"Journal of Law and Society"},{"issue":"1","key":"atypb63","volume":"7","author":"D.T. Hawkins","year":"2001","journal-title":"Information Research"},{"key":"atypb64","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jibs.8490166"},{"key":"atypb65","doi-asserted-by":"publisher","DOI":"10.1177\/016555159502100503"},{"key":"atypb66","volume-title":"Anglo-American Conference of Historians","author":"J. Morris"},{"key":"atypb67","doi-asserted-by":"publisher","DOI":"10.1111\/1467-6478.00137"},{"key":"atypb68","doi-asserted-by":"publisher","DOI":"10.1007\/BF02461122"},{"key":"atypb69","first-page":"48","journal-title":"Scientometrics"},{"key":"atypb70","doi-asserted-by":"publisher","DOI":"10.1177\/016555159402000102"},{"key":"atypb71","doi-asserted-by":"publisher","DOI":"10.3998\/3336451.0003.104"},{"key":"atypb72","unstructured":"[72] Journal Citation Reports. Social Science Citation Index. (                     Institute for Scientific Information, Philadelphia                 , 2001). Available at:                 www.isinet.com\/isi\/products\/citation\/jcr\/jcrweb\/index.html (accessed 17                 May 2004)."},{"key":"atypb73","first-page":"31","author":"J. Brown","year":"1997","journal-title":"British Society for Plant Pathology Newsletter"},{"key":"atypb74","unstructured":"[74]                      Anon. Editorial. An evaluation of impact factors and league tables                 , Journal of the Royal College of Physicians 32(3) (2002)."},{"key":"atypb75","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.314.7079.497"},{"key":"atypb76","doi-asserted-by":"publisher","DOI":"10.1108\/eb026920"},{"key":"atypb77","doi-asserted-by":"publisher","DOI":"10.1007\/BF02458472"},{"issue":"5","key":"atypb78","first-page":"5","volume":"7","author":"S. Harter","year":"1998","journal-title":"Public Access Computer Systems Review"},{"key":"atypb79","doi-asserted-by":"publisher","DOI":"10.1177\/016555150002600607"},{"key":"atypb80","volume-title":"The Correlation between RAE Ratings and Citation Counts in Psychology","author":"A. Smith","year":"2002"},{"issue":"2","key":"atypb81","volume":"6","author":"A. Holmes","year":"2001","journal-title":"Information Research"},{"key":"atypb82","doi-asserted-by":"publisher","DOI":"10.1080\/02691729608578815"},{"key":"atypb83","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.314.7079.497"},{"key":"atypb84","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U"},{"key":"atypb85","doi-asserted-by":"publisher","DOI":"10.1086\/602160"},{"issue":"2","key":"atypb86","first-page":"240","volume":"32","author":"N. Pope","year":"1992","journal-title":"Research Quarterly"},{"key":"atypb87","doi-asserted-by":"publisher","DOI":"10.3138\/JSP-026-03-183"},{"key":"atypb88","doi-asserted-by":"publisher","DOI":"10.1108\/eb026801"},{"key":"atypb89","doi-asserted-by":"publisher","DOI":"10.1016\/0143-6236(82)90001-1"},{"key":"atypb90","volume-title":"Money, Information and Uncertainty","author":"C. Goodhart","year":"1975"},{"key":"atypb91","doi-asserted-by":"publisher","DOI":"10.1017\/S1062798700002660"},{"key":"atypb92","doi-asserted-by":"publisher","DOI":"10.1629\/09155"},{"key":"atypb93","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007207"},{"key":"atypb94","volume-title":"Circular RAE 5\/99 Assessment panels\u2019 criteria and working methods","author":"Higher Education Funding Council for England","year":"1999"},{"key":"atypb95","volume-title":"Circular RAE 3\/95, Research Assessment Exercise: Criteria for Assessment","author":"Higher Education Funding Council for England","year":"1995"},{"key":"atypb96","first-page":"21","volume-title":"Proceedings, Higher Education Close-up Conference","author":"H. Willmott"},{"key":"atypb97","volume-title":"Evaluating University Research: the British RAE and Australian Practice","author":"P. Bourke","year":"1997"},{"key":"atypb98","first-page":"4","volume-title":"Proceedings, Higher Education Close-up Conference","author":"H. Willmott"},{"key":"atypb99","doi-asserted-by":"publisher","DOI":"10.1016\/0305-0483(95)00044-5"},{"key":"atypb100","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.176.1.47"},{"key":"atypb101","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8551.00076"},{"key":"atypb102","volume-title":"Circular RAE 4\/01, 2001 RAE: The Outcome","author":"Higher Education Funding Council for England","year":"2001"},{"key":"atypb103","volume-title":"Circular RAE 5\/99, Assessment Panels criteria and working methods","author":"Higher Education Funding Council for England","year":"1999"},{"key":"atypb104","first-page":"2","volume":"83","author":"S. Sayers","year":"1997","journal-title":"Radical Philosophy"},{"key":"atypb105","volume":"1537","author":"S. Watts","year":"2002","journal-title":"THES"},{"key":"atypb106","volume-title":"Memorandum submitted by the Institution of Environmental Sciences to HM Government Select Committee on Science and Technology","author":"J. Longhurst","year":"2002"},{"key":"atypb107","volume-title":"Proceedings of the Fifth Interdisciplinary Perspectives on Accounting Conference","author":"L.D. Parker"},{"issue":"1","key":"atypb108","first-page":"33","volume":"33","author":"A.A.Talib","year":"2000","journal-title":"Higher Education Review"},{"issue":"4","key":"atypb109","first-page":"490","volume":"48","author":"J.W. Barnard","year":"1998","journal-title":"Journal of Legal Education"},{"key":"atypb110","volume-title":"Circular RAE 5\/99, Assessment Panels Criteria and Working Methods","author":"Higher Education Funding Council for Education","year":"1999"},{"key":"atypb111","first-page":"13","author":"L. Back","year":"2000","journal-title":"The Guardian"},{"key":"atypb112","first-page":"37","volume":"43","author":"R. Gillette","year":"1989","journal-title":"Higher Education Quarterly"},{"key":"atypb113","first-page":"22","journal-title":"Higher Education Quarterly"},{"key":"atypb114","volume-title":"Review of Research Assessment: a report to the Funding Bodies","author":"G. Roberts","year":"2003"},{"key":"atypb115","volume-title":"RAND Report","year":"2004"},{"key":"atypb116","volume-title":"Review of Research Assessment: a report to the Funding Bodies","author":"G. Roberts","year":"2003"},{"key":"atypb117","volume-title":"Mandated online RAE CVs linked to university e-print archives: improving the UK RAE whilst making it cheaper and easier","author":"S. Harnad","year":"2004"},{"key":"atypb118","doi-asserted-by":"publisher","DOI":"10.1038\/35079151"},{"key":"atypb119","first-page":"109","volume":"38","author":"M. Henkle","year":"1999","journal-title":"Higher Education"},{"issue":"1","key":"atypb120","first-page":"31","volume":"34","author":"N. Piercy","year":"2000","journal-title":"European Journal of Marketing"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551504045854","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551504045854","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:06:51Z","timestamp":1777504011000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0165551504045854"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,8]]},"references-count":120,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2004,8]]}},"alternative-id":["10.1177\/0165551504045854"],"URL":"https:\/\/doi.org\/10.1177\/0165551504045854","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,8]]}}}