{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T14:51:38Z","timestamp":1776178298733,"version":"3.50.1"},"reference-count":79,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2023,4,27]],"date-time":"2023-04-27T00:00:00Z","timestamp":1682553600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JD"],"published-print":{"date-parts":[[2023,10,24]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>To assess whether interdisciplinary research evaluation scores vary between fields.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>The authors investigate whether published refereed journal articles were scored differently by expert assessors (two per output, agreeing a score and norm referencing) from multiple subject-based Units of Assessment (UoAs) in the REF2021\u00a0UK national research assessment exercise. The primary raw data was 8,015 journal articles published 2014\u20132020 and evaluated by multiple UoAs, and the agreement rates were compared to the estimated agreement rates for articles multiply-evaluated within a single UoA.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>The authors estimated a 53% agreement rate on a four-point quality scale between UoAs for the same article and a within-UoA agreement rate of 70%. This suggests that quality scores vary more between fields than within fields for interdisciplinary research. There were also some hierarchies between fields, in the sense of UoAs that tended to give higher scores for the same article than others.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title><jats:p>The results apply to one country and type of research evaluation. The agreement rate percentage estimates are both based on untested assumptions about the extent of cross-checking scores for the same articles in the REF, so the inferences about the agreement rates are tenuous.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title><jats:p>The results underline the importance of choosing relevant fields for any type of research evaluation.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>This is the first evaluation of the extent to which a careful peer-review exercise generates different scores for the same articles between disciplines.<\/jats:p><\/jats:sec>","DOI":"10.1108\/jd-01-2023-0012","type":"journal-article","created":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T05:42:21Z","timestamp":1682487741000},"page":"1514-1531","source":"Crossref","is-referenced-by-count":7,"title":["Does the perceived quality of\u00a0interdisciplinary research vary between fields?"],"prefix":"10.1108","volume":"79","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6065-205X","authenticated-orcid":false,"given":"Mike","family":"Thelwall","sequence":"first","affiliation":[]},{"given":"Kayvan","family":"Kousha","sequence":"additional","affiliation":[]},{"given":"Emma","family":"Stuart","sequence":"additional","affiliation":[]},{"given":"Meiko","family":"Makita","sequence":"additional","affiliation":[]},{"given":"Mahshid","family":"Abdoli","sequence":"additional","affiliation":[]},{"given":"Paul","family":"Wilson","sequence":"additional","affiliation":[]},{"given":"Jonathan M.","family":"Levitt","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2023,4,27]]},"reference":[{"issue":"1","key":"key2023102318082004700_ref001","first-page":"329","article-title":"Defining interdisciplinary research: conclusions from a critical review of the literature","volume":"42","year":"2007","journal-title":"Health Services Research"},{"issue":"1","key":"key2023102318082004700_ref002","article-title":"Citations, citation indicators, and research quality: an overview of basic concepts and theories","volume":"9","year":"2019"},{"issue":"3","key":"key2023102318082004700_ref003","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1080\/14494035.2017.1361634","article-title":"Wicked and less wicked problems: a typology and a contingency framework","volume":"36","year":"2017","journal-title":"Policy and Society"},{"key":"key2023102318082004700_ref004","first-page":"305","article-title":"Scientists rise up against statistical significance","volume":"567","year":"2019"},{"key":"key2023102318082004700_ref005","unstructured":"Arnold, E., Simmonds, P., Farla, K., Kolarz, P., Mahieu, B. and Nielsen, K. (2018), \u201cReview of the research excellence framework: evidence report\u201d, available at: https:\/\/assets.publishing.service.gov.uk\/government\/uploads\/system\/uploads\/attachment_data\/file\/768162\/research-excellence-framework-review-evidence-report.pdf"},{"issue":"9","key":"key2023102318082004700_ref006","article-title":"Perspective: promoting and fostering multidisciplinary research in universities","volume":"50","year":"2021","journal-title":"Research Policy"},{"issue":"3","key":"key2023102318082004700_ref007","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1086\/700070","article-title":"Scientific autonomy, public accountability, and the rise of \u201cpeer review\u201d in the Cold War United States","volume":"109","year":"2018","journal-title":"Isis"},{"issue":"3","key":"key2023102318082004700_ref008","first-page":"201","article-title":"Quality criteria under methodological pluralism: implications for conducting and evaluating research","volume":"35","year":"2005","journal-title":"American Journal of Community Psychology"},{"key":"key2023102318082004700_ref009","volume-title":"Academic Tribes and Territories","year":"2001"},{"issue":"4","key":"key2023102318082004700_ref010","doi-asserted-by":"publisher","first-page":"e280407","DOI":"10.3145\/epi.2019.jul.07","article-title":"Acceptance rates of scholarly peer-reviewed journals: a literature survey","volume":"28","year":"2019","journal-title":"Profesional de la Informaci\u00f3n"},{"key":"key2023102318082004700_ref011","volume-title":"Hierarchies of Evidence in Evidence-Based Medicine","year":"2015"},{"key":"key2023102318082004700_ref012","doi-asserted-by":"crossref","unstructured":"Bonaccorsi, A. (2018), \u201cPeer review in social sciences and humanities. Addressing the interpretation of quality criteria\u201d, in Bonaccorsi, A. (Ed.), The Evaluation of Research in Social Sciences and Humanities, Springer, Berlin, pp.\u00a071-101.","DOI":"10.1007\/978-3-319-68554-0_4"},{"issue":"8","key":"key2023102318082004700_ref013","doi-asserted-by":"crossref","first-page":"1746","DOI":"10.1080\/03075079.2019.1615044","article-title":"One model fits all? How centres of excellence affect research organisation and practices in the humanities","volume":"45","year":"2020","journal-title":"Studies in Higher Education"},{"issue":"1","key":"key2023102318082004700_ref014","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1002\/asi.21649","article-title":"A study of the evolution of interdisciplinarity in library and information science: using three bibliometric methods","volume":"63","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"key2023102318082004700_ref015","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1086\/227835","article-title":"The hierarchy of the sciences?","volume":"89","year":"1983","journal-title":"American Journal of Sociology"},{"issue":"4523","key":"key2023102318082004700_ref016","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1126\/science.7302566","article-title":"Chance and consensus in peer review","volume":"214","year":"1981","journal-title":"Science"},{"key":"key2023102318082004700_ref017","unstructured":"CORA (2022), \u201cAgreement on reforming research assessment\u201d, available at: https:\/\/www.scienceeurope.org\/media\/y41ks1wh\/20220720-rra-agreement.pdf"},{"issue":"4","key":"key2023102318082004700_ref018","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1080\/14746700.2015.1082874","article-title":"Theology as \u201cqueen of science\u201d reconsidered: a basis for scientific realism","volume":"13","year":"2015","journal-title":"Theology and Science"},{"issue":"1","key":"key2023102318082004700_ref019","doi-asserted-by":"crossref","first-page":"130","DOI":"10.5578\/keg.10059","article-title":"Is metaphysics hyper-physics or over-physics? Evaluating it with mathematical paradigms","volume":"9","year":"2016","journal-title":"Journal of Theoretical Educational Science"},{"issue":"3","key":"key2023102318082004700_ref020","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1111\/rssa.12681","article-title":"When zero may not be zero: a cautionary note on the use of inter\u2010rater reliability in evaluating grant peer review","volume":"184","year":"2021","journal-title":"Journal of the Royal Statistical Society: Series A (Statistics in Society)"},{"issue":"1","key":"key2023102318082004700_ref021","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1046\/j.1365-2702.2003.00662.x","article-title":"Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions","volume":"12","year":"2003","journal-title":"Journal of Clinical Nursing"},{"issue":"4","key":"key2023102318082004700_ref022","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/0191-8869(92)90066-X","article-title":"Peer review: advice to referees and contributors","volume":"13","year":"1992","journal-title":"Personality and Individual Differences"},{"issue":"6","key":"key2023102318082004700_ref023","article-title":"Bibliometric evidence for a hierarchy of the sciences","volume":"8","year":"2013","journal-title":"PLoS One"},{"issue":"7","key":"key2023102318082004700_ref024","article-title":"The interdisciplinarity dilemma: public versus private interests","volume":"51","year":"2022","journal-title":"Research Policy"},{"issue":"3","key":"key2023102318082004700_ref025","doi-asserted-by":"crossref","first-page":"159","DOI":"10.3152\/147154300781782011","article-title":"Mode 2 society and the emergence of context-sensitive science","volume":"27","year":"2000","journal-title":"Science and Public Policy"},{"issue":"2","key":"key2023102318082004700_ref026","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1177\/000312240406900203","article-title":"What is originality in the humanities and the social sciences?","volume":"69","year":"2004","journal-title":"American Sociological Review"},{"issue":"12","key":"key2023102318082004700_ref027","first-page":"1050","article-title":"Internal medicine: the queen of science","volume":"126","year":"2016","journal-title":"Polskie Archiwum Medycyny Wewnetrznej"},{"issue":"3","key":"key2023102318082004700_ref028","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/s11024-017-9315-3","article-title":"Epistemic cultures in conflict: the case of astronomy and high energy physics","volume":"55","year":"2017","journal-title":"Minerva"},{"issue":"7548","key":"key2023102318082004700_ref029","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","article-title":"Bibliometrics: the leiden manifesto for research metrics","volume":"520","year":"2015","journal-title":"Nature"},{"issue":"6","key":"key2023102318082004700_ref030","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1177\/0306312712458478","article-title":"Communicating and compromising on disciplinary expertise in the peer review of research proposals","volume":"42","year":"2012","journal-title":"Social Studies of Science"},{"key":"key2023102318082004700_ref031","unstructured":"JAMA (2022), \u201cInstructions for authors\u201d, available at: https:\/\/jamanetwork.com\/journals\/jama\/pages\/instructions-for-authors"},{"key":"key2023102318082004700_ref032","volume-title":"The Structure of Scientific Revolutions","year":"1970"},{"key":"key2023102318082004700_ref033","volume-title":"How Professors Think","year":"2009"},{"key":"key2023102318082004700_ref034","doi-asserted-by":"crossref","unstructured":"Lamont, M. and Guetzkow, J. (2016), \u201cHow quality is recognized by peer review panels: the case of the humanities\u201d, in Oschner, M. and Hug, S. (Eds), Research Assessment in the Humanities, Springer, Berlin, pp.\u00a031-41.","DOI":"10.1007\/978-3-319-29016-4_4"},{"key":"key2023102318082004700_ref035","doi-asserted-by":"crossref","unstructured":"Lamont, M., Fournier, M., Guetzkow, J., Mallard, G. and Bernier, R. (2007), \u201cEvaluating creative minds: the assessment of originality in peer review\u201d, in Sales, A. and Fournier, M. (Eds), Knowledge, Communication and Creativity, Sage, London, pp.\u00a0166-181, doi: 10.4135\/9781446215548.n10.","DOI":"10.4135\/9781446215548.n10"},{"issue":"1","key":"key2023102318082004700_ref036","doi-asserted-by":"crossref","first-page":"51","DOI":"10.3152\/147154404781776536","article-title":"Expert panels evaluating research: decision-making and sources of bias","volume":"13","year":"2004","journal-title":"Research Evaluation"},{"issue":"1","key":"key2023102318082004700_ref037","doi-asserted-by":"crossref","first-page":"31","DOI":"10.3152\/147154406781776039","article-title":"The policy challenges of peer review: managing bias, conflict of interests and interdisciplinary assessments","volume":"15","year":"2006","journal-title":"Research Evaluation"},{"issue":"1","key":"key2023102318082004700_ref038","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s11024-019-09385-2","article-title":"Co-existing notions of research quality: a framework to study context-specific understandings of good research","volume":"58","year":"2020","journal-title":"Minerva"},{"issue":"1","key":"key2023102318082004700_ref039","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1093\/reseval\/rvaa032","article-title":"The role of metrics in peer assessments","volume":"30","year":"2021","journal-title":"Research Evaluation"},{"key":"key2023102318082004700_ref040","article-title":"Gender representation cues labels of hard and soft sciences","volume":"98","year":"2022","journal-title":"Journal of Experimental Social Psychology"},{"issue":"1","key":"key2023102318082004700_ref041","first-page":"127","article-title":"The politics of English, language and uptake: the case\u00a0of\u00a0international academic journal article reviews","volume":"28","year":"2015","journal-title":"AILA Review"},{"issue":"3","key":"key2023102318082004700_ref042","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.respol.2015.11.009","article-title":"Evaluating research: a\u00a0multidisciplinary approach to assessing research practice and quality","volume":"45","year":"2016","journal-title":"Research Policy"},{"key":"key2023102318082004700_ref043","volume-title":"Silencing Scientists and Scholars in Other Fields: Power, Paradigm Controls, Peer Review, and Scholarly Communication","year":"1998"},{"issue":"7","key":"key2023102318082004700_ref044","doi-asserted-by":"crossref","first-page":"501","DOI":"10.3102\/0013189X09348351","article-title":"Learning from our differences: a dialogue across perspectives on quality in education research","volume":"38","year":"2009","journal-title":"Educational Researcher"},{"issue":"7045","key":"key2023102318082004700_ref045","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1038\/4351003a","article-title":"In praise of soft science","volume":"435","year":"2005","journal-title":"Nature"},{"issue":"5","key":"key2023102318082004700_ref046","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1080\/1523908X.2020.1767551","article-title":"Cumulating evidence in environmental governance, policy and planning research: towards a research reform agenda","volume":"22","year":"2020","journal-title":"Journal of Environmental Policy and Planning"},{"issue":"3","key":"key2023102318082004700_ref047","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1080\/08989621003791945","article-title":"Quality and peer review of research: an adjudicating role for editors","volume":"17","year":"2010","journal-title":"Accountability in Research"},{"issue":"1","key":"key2023102318082004700_ref048","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1177\/0950017017719841","article-title":"Pointless diversity training: unconscious bias, new racism and agency","volume":"32","year":"2018","journal-title":"Work, Employment and Society"},{"key":"key2023102318082004700_ref049","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1017\/S0140525X00011183","article-title":"Peer-review practices of psychological journals: the fate of published articles, submitted again","volume":"5","year":"1982","journal-title":"The Behavioral and Brain Sciences"},{"key":"key2023102318082004700_ref050","article-title":"Preliminary evidence of linguistic bias in academic reviewing","volume":"47","year":"2020","journal-title":"Journal of English for Academic Purposes"},{"key":"key2023102318082004700_ref051","unstructured":"REF (2019a), \u201cPanel criteria and working methods\u201d, available at: https:\/\/www.ref.ac.uk\/publications-and-reports\/panel-criteria-and-working-methods-201902\/"},{"key":"key2023102318082004700_ref052","unstructured":"REF (2019b), \u201cInterdisciplinary research\u201d, available at: https:\/\/www.ref.ac.uk\/about-the-ref\/interdisciplinary-research\/"},{"key":"key2023102318082004700_ref053","unstructured":"REF (2021), \u201cGuide to the REF results\u201d,available at: https:\/\/ref.ac.uk\/about-the-ref\/interdisciplinary-research\/"},{"key":"key2023102318082004700_ref054","unstructured":"Research England (2022), \u201cResearch England grant allocations for 2022-23\u201d, available at: https:\/\/www.ukri.org\/wp-content\/uploads\/2022\/08\/RE-040822-GrantAllocations2022To2023.pdf"},{"key":"key2023102318082004700_ref055","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.annals.2019.04.003","article-title":"Peer review assessment of originality in tourism journals: critical perspective of key gatekeepers","volume":"77","year":"2019","journal-title":"Annals of Tourism Research"},{"issue":"3","key":"key2023102318082004700_ref056","doi-asserted-by":"crossref","first-page":"1387","DOI":"10.1007\/s11192-019-03343-1","article-title":"How do journals of different rank instruct peer reviewers? Reviewer guidelines in the field of management","volume":"122","year":"2020","journal-title":"Scientometrics"},{"issue":"3","key":"key2023102318082004700_ref057","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1093\/reseval\/rvab011","article-title":"Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Sk\u0142odowska-Curie and COST Actions","volume":"30","year":"2021","journal-title":"Research Evaluation"},{"issue":"5","key":"key2023102318082004700_ref058","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1002\/asi.23985","article-title":"A critical evaluation of expert survey\u2010based journal rankings: the role of personal research interests","volume":"69","year":"2018","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"key2023102318082004700_ref059","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/9462201","article-title":"The concept of originality in academic research of engineering","volume":"2021","year":"2021","journal-title":"Education Research International"},{"issue":"1","key":"key2023102318082004700_ref060","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1177\/0162243916656919","article-title":"Peer review and scholarly originality: let 1,000 flowers bloom, but don\u2019t step on any","volume":"42","year":"2017","journal-title":"Science, Technology, and Human Values"},{"issue":"2","key":"key2023102318082004700_ref061","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1073\/pnas.1418218112","article-title":"Measuring the effectiveness of scientific gatekeeping","volume":"112","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"key2023102318082004700_ref062","doi-asserted-by":"crossref","unstructured":"Simonton, D.K. (2018), \u201cHard science, soft science, and pseudoscience: implications of research on the hierarchy of the sciences\u201d, in Kaufman, A.B. and Kaufman, J.C. (Eds), Pseudoscience: the Conspiracy against Science, MIT Press, Cambridge, MA, pp.\u00a077-99.","DOI":"10.7551\/mitpress\/9780262037426.003.0004"},{"issue":"1","key":"key2023102318082004700_ref063","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1177\/030631200030001003","article-title":"Scientific graphs and the hierarchy of the sciences: a Latourian survey of inscription practices","volume":"30","year":"2000","journal-title":"Social Studies of Science"},{"issue":"2","key":"key2023102318082004700_ref064","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s11245-013-9189-4","article-title":"Down with the hierarchies","volume":"33","year":"2014","journal-title":"Topoi"},{"key":"key2023102318082004700_ref065","unstructured":"Stern, N. (2016), \u201cBuilding on success and learning from experience: an independent review of the Research Excellence Framework\u201d, available at: https:\/\/www.gov.uk\/government\/publications\/research-excellence-framework-review"},{"issue":"4","key":"key2023102318082004700_ref066","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1108\/JD-06-2014-0082","article-title":"The kaleidoscope of disciplinarity","volume":"71","year":"2015","journal-title":"Journal of Documentation"},{"issue":"4","key":"key2023102318082004700_ref067","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1016\/j.joi.2013.08.007","article-title":"Journal acceptance rates: a cross-disciplinary analysis of variability and relationships with journal measures","volume":"7","year":"2013","journal-title":"Journal of Informetrics"},{"key":"key2023102318082004700_ref068","article-title":"Can REF output quality scores be assigned by AI? Experimental evidence","year":"2022","journal-title":"arXiv preprint arXiv:2212.08041"},{"issue":"1","key":"key2023102318082004700_ref069","first-page":"60","article-title":"Mathematics is the queen of science and the theory of numbers is the queen","volume":"26","year":"1989","journal-title":"The Philippine Scientist"},{"issue":"48","key":"key2023102318082004700_ref070","doi-asserted-by":"crossref","first-page":"12708","DOI":"10.1073\/pnas.1707323114","article-title":"Reviewer bias in single-versus double-blind peer review","volume":"114","year":"2017","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"3","key":"key2023102318082004700_ref071","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1177\/016224399101600303","article-title":"New light on old boys: cognitive and institutional particularism in the peer review system","volume":"16","year":"1991","journal-title":"Science, Technology, and Human Values"},{"key":"key2023102318082004700_ref072","first-page":"5","volume-title":"Tribes and Territories in the 21st-Century","year":"2012"},{"issue":"1","key":"key2023102318082004700_ref073","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1007\/s12124-020-09545-0","article-title":"Psychology\u2019s status as a science: peculiarities and intrinsic challenges. Moving beyond its current deadlock towards conceptual integration","volume":"55","year":"2021","journal-title":"Integrative Psychological and Behavioral Science"},{"issue":"1","key":"key2023102318082004700_ref074","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.joi.2010.06.004","article-title":"Approaches to understanding and measuring interdisciplinary scientific research (IDR): a\u00a0review of the literature","volume":"5","year":"2011","journal-title":"Journal of Informetrics"},{"issue":"6631","key":"key2023102318082004700_ref075","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1038\/387341a0","article-title":"Nepotism and sexism in peer-review","volume":"387","year":"1997","journal-title":"Nature"},{"key":"key2023102318082004700_ref076","volume-title":"The Intellectual and Social Organization of the Sciences","year":"2000","edition":"2 ed"},{"issue":"4","key":"key2023102318082004700_ref077","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s11024-011-9182-2","article-title":"Changing governance and authority relations in the public sciences","volume":"49","year":"2011","journal-title":"Minerva"},{"key":"key2023102318082004700_ref078","doi-asserted-by":"crossref","unstructured":"Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S. and Johnson, B. (2015), \u201cThe metric tide: report of the independent review of the role of metrics in research assessment and management\u201d, available at: https:\/\/core.ac.uk\/download\/pdf\/30612366.pdf","DOI":"10.4135\/9781473978782"},{"issue":"3","key":"key2023102318082004700_ref079","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s12124-020-09524-5","article-title":"Psychology: a giant with feet of clay","volume":"54","year":"2020","journal-title":"Integrative Psychological and Behavioral Science"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-01-2023-0012\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-01-2023-0012\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:33:12Z","timestamp":1753396392000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/79\/6\/1514-1531\/207251"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,27]]},"references-count":79,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,4,27]]},"published-print":{"date-parts":[[2023,10,24]]}},"alternative-id":["10.1108\/JD-01-2023-0012"],"URL":"https:\/\/doi.org\/10.1108\/jd-01-2023-0012","relation":{},"ISSN":["0022-0418"],"issn-type":[{"value":"0022-0418","type":"print"}],"subject":[],"published":{"date-parts":[[2023,4,27]]}}}