{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T04:42:46Z","timestamp":1767674566740,"version":"3.48.0"},"reference-count":25,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2000,12,1]],"date-time":"2000-12-01T00:00:00Z","timestamp":975628800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2000,12]]},"abstract":"<jats:p>\n                    <jats:bold>The Research Assessment Exercises (RAE) conducted in the UK have                     attractedvarious types of published response. These include citation analyses                     and a review of the public reception of the RAE 1996, which included a brief                     critique of the citation studies.<\/jats:bold>\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>This paper develops the critique. Largely unexplored issues in the theory or                     assumptions of bibliometrics, e.g. the level of citation which corresponds to a                     quantum of research quality, are found to emerge in the studies. A weak, and                     unsatisfactorily treated, correlation between citation aggregates and research                     quality for individual entities is revealed. The proposal to replace informed                     peer review by citation analysis is regarded as highly unrealistic.<\/jats:bold>\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Productive uses for citation analysis in research evaluation are suggested. A                     historically rare instance of correlation between rankings derived from citation                     aggregates and from real world peer review has been revealed by the studies. The                     future value of citation analysis could be to inform, but not to determine,                     judgements of research quality.<\/jats:bold>\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>A combination of methods is advocated for future studies of the RAEs.                     Information science must attend to considerations of value, as well as using                     established techniques, if it is to avoid marginalisation.<\/jats:bold>\n                  <\/jats:p>","DOI":"10.1177\/016555150002600607","type":"journal-article","created":{"date-parts":[[2004,12,17]],"date-time":"2004-12-17T20:36:35Z","timestamp":1103315795000},"page":"453-459","source":"Crossref","is-referenced-by-count":50,"title":["A critical review of the application of citation studies to the Research                 Assessment Exercises"],"prefix":"10.1177","volume":"26","author":[{"given":"Julian","family":"Warner","sequence":"first","affiliation":[{"name":"The Queen\u2019s University of Belfast, Northern Ireland, UK,"}]}],"member":"179","published-online":{"date-parts":[[2000,12]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"The Handbook of Research Impact Assessment","author":"R.N. Kostoff","year":"1997","unstructured":"[1] R.N. Kostoff , The Handbook of Research Impact Assessment (DTIC Report ADA296021, 7th ed., 1997). Available at: http:\/\/www.dtic.mil\/dtic\/kostoff\/Handweb71.html","edition":"7"},{"key":"e_1_2_1_2_1","unstructured":"[2] Department of Education Northern Ireland Higher Education Funding Council for England Higher Education Funding Council for Wales and Scottish Higher Education Funding Council RAE 2001. Available at: http:\/\/www.rae.ac.uk\/"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1006\/bare.1997.0053"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/096100069702900303"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/016555159502100109"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026940"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007207"},{"volume-title":"The Impact of the 1992 Research Assessment Exercise on Higher                     Education Institutions in England","year":"1997","key":"e_1_2_1_8_1","unstructured":"[8] The Impact of the 1992 Research Assessment Exercise on Higher Education Institutions in England (Report Ref: M 6\/97) ( Higher Education Funding Council for England , 1997)."},{"key":"e_1_2_1_9_1","volume-title":"The Impact of the 1992 RAE on Institutional and Individual Behaviour in                     English Higher Education: The Evidence from a Research Project","author":"I. McNay","year":"1997","unstructured":"[9] I. McNay , The Impact of the 1992 RAE on Institutional and Individual Behaviour in English Higher Education: The Evidence from a Research Project (Ref: M 6\/97) ( Higher Education Funding Council for England, Bristol , 1997)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb051475"},{"key":"e_1_2_1_10_2","unstructured":"Also in Information Research 3(4) (1998) available at: http:\/\/www.shef.ac.uk\/%7Eis\/publications\/infres\/paper45.html"},{"key":"e_1_2_1_11_1","volume-title":"We Have Never Been Modern","author":"B. Latour","year":"1993","unstructured":"[11] B. Latour , We Have Never Been Modern, translated by C. Porter ( Harvard University Press, Cambridge, MA , 1993)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/0143-6236(82)90003-5"},{"volume-title":"ASIS \u201992: Celebrating Change: Information Management                     on the Move (Proceedings of the 55th ASIS Annual Meeting","author":"J. Warner","key":"e_1_2_1_13_1","unstructured":"[13] J. Warner , Retrieval performance tests in relation to online bibliographic searching . In: D. Shaw (ed.), ASIS \u201992: Celebrating Change: Information Management on the Move (Proceedings of the 55th ASIS Annual Meeting, Pittsburgh, PA, 26-29 October 1992) (Learned Information for the American Society for Information Science, Medford, NJ, 1992)."},{"key":"e_1_2_1_14_1","volume-title":"The Foucault Reader","author":"M. Foucault","year":"1984","unstructured":"[14] M. Foucault , What is an author? In: P. Rabinow (ed.), The Foucault Reader ( Penguin Books , 1984)."},{"key":"e_1_2_1_15_1","volume-title":"Genesis and Development of a Scientific Fact","author":"L. Fleck","year":"1979","unstructured":"[15] L. Fleck , Genesis and Development of a Scientific Fact, translated by F. Bradley and T.J. Treen and edited by T.J. Treen and R.K. Merton ( Chicago University Press, Chicago, IL , 1979)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203303412"},{"key":"e_1_2_1_17_1","volume-title":"Documentation","author":"S.C. Bradford","year":"1948","unstructured":"[17] S.C. Bradford , Documentation ( C. Lockwood, London , 1948)."},{"key":"e_1_2_1_18_1","volume-title":"Romance of Roses","author":"S.C. Bradford","year":"1946","unstructured":"[18] S.C. Bradford , Romance of Roses ( London , 1946)."},{"key":"e_1_2_1_19_1","volume-title":"Alice in Many Tongues: The Translations of Alice in Wonderland","author":"W. Weaver","year":"1964","unstructured":"[19] W. Weaver , Alice in Many Tongues: The Translations of Alice in Wonderland ( University of Wisconsin Press, Madison, WI , 1964)."},{"key":"e_1_2_1_20_1","volume-title":"The Mathematical Theory of Communication","author":"W. Weaver","year":"1949","unstructured":"[20] W. Weaver and C.E. Shannon , The Mathematical Theory of Communication ( University of Illinois Press, Urbana, IL , 1949)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026972"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1515\/libr.1998.48.2.67"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02018229"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630250409"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555150002600607","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555150002600607","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T04:39:29Z","timestamp":1767674369000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/016555150002600607"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2000,12]]},"references-count":25,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2000,12]]}},"alternative-id":["10.1177\/016555150002600607"],"URL":"https:\/\/doi.org\/10.1177\/016555150002600607","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"type":"print","value":"0165-5515"},{"type":"electronic","value":"1741-6485"}],"subject":[],"published":{"date-parts":[[2000,12]]}}}