{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T17:39:55Z","timestamp":1760981995783,"version":"3.41.2"},"reference-count":35,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2003,12,1]],"date-time":"2003-12-01T00:00:00Z","timestamp":1070236800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2003,12,1]]},"abstract":"<jats:p>A citation study of the 692 staff that makes up unit of assessment 58 (archaeology), in the 2001 UK Research Assessment Exercise (RAE) was undertaken. Unlike earlier studies, which were obliged to make assumptions on who and what had been submitted for assessment, these were, for the first time available from the RAE Web site. This study, therefore, used the specific submission details of authors and their publications. Using the Spearman rank\u2010order correlation coefficient, all results showed high statistically significant correlation between the RAE result and citation counts. The results were significant at 0.01 per cent. The findings confirm earlier studies. Given the comparative cost and ease of citation analysis, it is recommended that, correctly applied, it should be the initial tool of assessment for the RAE. Panel members would then exercise their judgement and skill to confirm final rankings.<\/jats:p>","DOI":"10.1108\/00220410310698734","type":"journal-article","created":{"date-parts":[[2007,4,13]],"date-time":"2007-04-13T09:40:56Z","timestamp":1176457256000},"page":"709-730","source":"Crossref","is-referenced-by-count":62,"title":["Citation counts and the Research Assessment Exercise V"],"prefix":"10.1108","volume":"59","author":[{"given":"Michael","family":"Norris","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charles","family":"Oppenheim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022031720430616600_b1","doi-asserted-by":"crossref","unstructured":"Baird, L. and Oppenheim, C. (1994), \u201cDo citations matter?\u201d, Journal of Information Science, Vol. 20 No. 1, pp. 2\u201015.","DOI":"10.1177\/016555159402000102"},{"key":"key2022031720430616600_b2","doi-asserted-by":"crossref","unstructured":"Bence, V. and Oppenheim, C. (2001), \u201cJournals, scholarly communication and the RAE: a case study of the business and management sector\u201d, Serials, Vol. 14 No. 3, pp. 265\u201072.","DOI":"10.1629\/14265"},{"key":"key2022031720430616600_b3","doi-asserted-by":"crossref","unstructured":"Bernard, G.W. (2000), \u201cHistory and Research Assessment Exercises\u201d, Oxford Review of Education, Vol. 26 No. 1, pp. 95\u2010106.","DOI":"10.1080\/030549800103881"},{"key":"key2022031720430616600_b4","unstructured":"Braun, T., Glanzel, W. and Schubert, A. (2000), \u201cHow balanced is the Science Citation Index's journal coverage?\u201d, in Atkins, H. (Ed.), The Web of Knowledge: A Festschrift in Honor of Eugene Garfield, Information Today, Medford, NJ, pp. 251\u201077."},{"key":"key2022031720430616600_b5","doi-asserted-by":"crossref","unstructured":"Campbell, K. (1999), \u201cJournal publishing, journal reputation, and the United Kingdom's Research Assessment Exercise\u201d, Journal of Law and Society, Vol. 26 No. 4, pp. 470\u2010501.","DOI":"10.1111\/1467-6478.00137"},{"key":"key2022031720430616600_b6","unstructured":"Cronin, B. and Barsky Atkins, H. (2000), The Web of Knowledge: A Festschrift in Honor of Eugene Garfield, Information Today, Medford, NJ."},{"key":"key2022031720430616600_b7","doi-asserted-by":"crossref","unstructured":"Cronin, B., Snyder, H. and Atkins, H. (1997), \u201cComparative citation rankings of authors in monographic and journal literature: a study of sociology\u201d, Journal of Documentation, Vol. 53 No. 3, pp. 263\u201073.","DOI":"10.1108\/EUM0000000007200"},{"key":"key2022031720430616600_b8","unstructured":"Garfield, E. (1979), Citation Indexing \u2013 Its Theory and Application in Science, Technology and Humanities, John Wiley & Sons, New York, NY."},{"key":"key2022031720430616600_b9","unstructured":"Harnad, S., Carr, L., Brody, T. and Oppenheim, C. (2003), \u201cMandated online RAE CVs linked to university eprint archives: enhancing UK research impact and assessment\u201d, Ariadne, Vol. 35."},{"key":"key2022031720430616600_b10","unstructured":"HEFCE (2001a), Review of Research: Report Consultation (March) (01\/17), available at: www.hefce.ac.uk\/pubs\/hefce\/2001\/ (accessed 3 October 2002)."},{"key":"key2022031720430616600_b11","unstructured":"HEFCE (2001b), RAE 2001 Submissions, available at: www.hero.ac.uk\/rae\/submissions\/ (accessed 20 August 2002)."},{"key":"key2022031720430616600_b12","doi-asserted-by":"crossref","unstructured":"Henkel, M. (1999), \u201cThe modernisation of research evaluation: the case of the UK\u201d, Higher Education, Vol. 38 No. 1, pp. 105\u201022.","DOI":"10.1023\/A:1003799013939"},{"key":"key2022031720430616600_b13","unstructured":"Holmes, A. and Oppenheim, C. (2001), \u201cUse of citation analysis to predict the outcome of the 2001 RAE for Unit of Assessment 61: Library and Information Management\u201d, Information Research, Vol. 6 No. 2."},{"key":"key2022031720430616600_b14","unstructured":"Johnson, I. (2001), \u201cLetter to the Editor\u201d, Information Research, Vol. 6 No. 2."},{"key":"key2022031720430616600_b15","unstructured":"Lange, L.L. (2001), \u201cCitation counts of multi\u2010authored papers \u2013 first\u2010named authors and further authors\u201d, Scientometrics, Vol. 52 No. 3, pp. 457\u201070."},{"key":"key2022031720430616600_b16","doi-asserted-by":"crossref","unstructured":"Liu, M. (1993), \u201cProgress in documentation: the complexities of citation practice: a review of citation studies\u201d, Journal of Documentation, Vol. 49 No. 4, pp. 370\u2010408.","DOI":"10.1108\/eb026920"},{"key":"key2022031720430616600_b17","doi-asserted-by":"crossref","unstructured":"MacRoberts, M.H. and MacRoberts, B.R. (1989), \u201cProblems of citation analysis: a critical review\u201d, Journal of the American Society for Information Science, Vol. 40 No. 5, pp. 342\u20109.","DOI":"10.1002\/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U"},{"key":"key2022031720430616600_b18","doi-asserted-by":"crossref","unstructured":"Martin, B. (1996), \u201cThe use of multiple indicators in the assessment of basic research\u201d, Scientometrics, Vol. 36 No. 3, pp. 343\u201062.","DOI":"10.1007\/BF02129599"},{"key":"key2022031720430616600_b19","unstructured":"Meadows, A.J. (1998), Communicating Research, Academic Press, San Diego, CA."},{"key":"key2022031720430616600_b20","doi-asserted-by":"crossref","unstructured":"Mynott, J. (1999), \u201cPublishing: the view from Cambridge University Press\u201d, History of the Human Sciences, Vol. 12 No. 4, pp. 127\u201031.","DOI":"10.1177\/095269519901200418"},{"key":"key2022031720430616600_b21","doi-asserted-by":"crossref","unstructured":"Naylor, B. (2001), \u201cThe king is in the altogether?\u201d, Serials, Vol. 14 No. 2, pp. 149\u201051.","DOI":"10.1629\/14149"},{"key":"key2022031720430616600_b22","doi-asserted-by":"crossref","unstructured":"Oppenheim, C. (1995), \u201cThe correlation between citation counts and the 1992 Research Assessment ratings for British library and information science university departments\u201d, Journal of Documentation, Vol. 51 No. 1, pp. 18\u201027.","DOI":"10.1108\/eb026940"},{"key":"key2022031720430616600_b23","doi-asserted-by":"crossref","unstructured":"Oppenheim, C. (1996), \u201cDo citations count? Citation indexing and the Research Assessment Exercise (RAE)\u201d, Serials, Vol. 9 No. 2, pp. 155\u201061.","DOI":"10.1629\/09155"},{"key":"key2022031720430616600_b24","doi-asserted-by":"crossref","unstructured":"Oppenheim, C. (1997), \u201cThe correlation between citation counts and the 1992 Research Assessment Exercise ratings for British research in genetics, anatomy and archaeology\u201d, Journal of Documentation, Vol. 53 No. 5, pp. 477\u201087.","DOI":"10.1108\/EUM0000000007207"},{"key":"key2022031720430616600_b25","unstructured":"Publications, R. (2002), A Guide to the 2001 Research Assessment Exercise, HEFCE, available at: www.hero.ac.uk\/rae\/Pubs\/index.htm (accessed 20 August 2002)."},{"key":"key2022031720430616600_b26","unstructured":"Roberts, G. (2003), Review of Research Assessment, HEFCE, available at: www.raereview.ac.uk\/reports\/roberts.asp (accessed 30 May 2003)."},{"key":"key2022031720430616600_b27","doi-asserted-by":"crossref","unstructured":"Rogers, J. (2000), \u201cThe intellectual consequences of the Research Assessment Exercise: a response\u201d, History of the Human Sciences, Vol. 13.","DOI":"10.1177\/09526950022120692"},{"key":"key2022031720430616600_b28","unstructured":"Sarwar, S. (2000), \u201cA publication and citation analysis of civil engineering departments in the UK which participated in the 1996 Research Assessment Exercise (RAE)\u201d, unpublished MSc, Sheffield University, Sheffield."},{"key":"key2022031720430616600_b29","doi-asserted-by":"crossref","unstructured":"Seglen, P. (1992), \u201cThe skewness of science\u201d, Journal of the American Society for Information Science, Vol. 43 No. 9, pp. 628\u201038.","DOI":"10.1002\/(SICI)1097-4571(199210)43:9<628::AID-ASI5>3.0.CO;2-0"},{"key":"key2022031720430616600_b30","doi-asserted-by":"crossref","unstructured":"Seng, L.B. and Willett, P. (1995), \u201cThe citedness of publications by United Kingdom library schoools\u201d, Journal of Information Science, Vol. 21 No. 1, pp. 68\u201071.","DOI":"10.1177\/016555159502100109"},{"key":"key2022031720430616600_b31","unstructured":"Smith, A. and Eysenck, M. (2002), \u201cThe correlation between RAE ratings and citation counts in psychology\u201d, available at: http:\/\/psyserver.pc.rhbnc.ac.uk\/citations.pdf (accessed 13 November 2002)."},{"key":"key2022031720430616600_b32","doi-asserted-by":"crossref","unstructured":"Snyder, H. and Bonzi, S. (1998), \u201cPatterns of self\u2010citation across disciplines (1980\u20101989)\u201d, Journal of Information Science, Vol. 24 No. 6, pp. 431\u20105.","DOI":"10.1177\/016555159802400606"},{"key":"key2022031720430616600_b33","doi-asserted-by":"crossref","unstructured":"Van Raan, A.F.J. (1996), \u201cAdvanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises\u201d, Scientometrics, Vol. 36 No. 3, pp. 397\u2010420.","DOI":"10.1007\/BF02129602"},{"key":"key2022031720430616600_b34","doi-asserted-by":"crossref","unstructured":"Walford, L. (2000), \u201cThe Research Assessment Exercise : its effect on scholarly journal publishing\u201d, Learned Publishing, Vol. 13 No. 1, pp. 49\u201052.","DOI":"10.1087\/09531510050145551"},{"key":"key2022031720430616600_b35","doi-asserted-by":"crossref","unstructured":"Warner, J. (2000), \u201cA critical review of the application of citation studies to the Research Assessment Exercises\u201d, Journal of Information Science, Vol. 26 No. 6, pp. 453\u201060.","DOI":"10.1177\/016555150002600607"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/00220410310698734\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/00220410310698734\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:37:18Z","timestamp":1753400238000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/59\/6\/709-730\/205765"}},"subtitle":["Archaeology and the 2001 RAE"],"short-title":[],"issued":{"date-parts":[[2003,12,1]]},"references-count":35,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2003,12,1]]}},"alternative-id":["10.1108\/00220410310698734"],"URL":"https:\/\/doi.org\/10.1108\/00220410310698734","relation":{},"ISSN":["0022-0418"],"issn-type":[{"type":"print","value":"0022-0418"}],"subject":[],"published":{"date-parts":[[2003,12,1]]}}}