{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:44:15Z","timestamp":1754156655417,"version":"3.41.2"},"reference-count":49,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2018,10,31]],"date-time":"2018-10-31T00:00:00Z","timestamp":1540944000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AJIM"],"published-print":{"date-parts":[[2018,11,5]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The purpose of this paper is to contribute to the body of knowledge on how research evaluation in different national and organisational contexts affects, often in unintended ways, research and publication practices. In particular, it looks at the development of book publication in the social sciences and humanities (SSH) in the Czech Republic since 2004, when a performance-based system of evaluation was introduced, up to the present.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>The paper builds upon ethnographic research complemented by the analysis of Czech science policy documents, data available in the governmental database \u201cInformation Register of R&amp;D results\u201d and formal and informal interviews with expert evaluators and other stakeholders in the research system. It further draws on the authors\u2019 own experience as scholars, who have also over the years participated in a number of evaluation procedures as peers and experts.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>The number of books published by researchers in SSH based at Czech institutions has risen considerably in reaction to the pressure for productivity that is inscribed into the evaluation methodology and has resulted in the rise of in-house publishing by researchers\u2019 own research institution, \u201cfake internationalisation\u201d using foreign low-quality presses as the publication venue, and the development of a culture of orphaned books that have no readers.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title><jats:p>In the Czech Republic robust and internationally harmonised bibliometric data regarding books would definitely help to create a form of research evaluation that would stimulate meaningful scholarly book production. At the same time, better-resourced and better-designed peer review evaluation is needed.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>This is the first attempt to analyse in detail the conditions and consequences the Czech performance-based research evaluation system has for SSH book publication. The paper demonstrates that often discussed harming of SSH and book-writing in particular by performance-based IF-centred research evaluation does not necessarily manifest in declining numbers of publications. On the contrary, the number of books published may increase at the cost of producing more texts of questionable scholarly quality.<\/jats:p><\/jats:sec>","DOI":"10.1108\/ajim-03-2018-0063","type":"journal-article","created":{"date-parts":[[2018,10,31]],"date-time":"2018-10-31T09:50:37Z","timestamp":1540979437000},"page":"623-642","source":"Crossref","is-referenced-by-count":7,"title":["The culture of orphaned texts"],"prefix":"10.1108","volume":"70","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9971-0496","authenticated-orcid":false,"given":"Ludek","family":"Broz","sequence":"first","affiliation":[]},{"given":"Tereza","family":"St\u00f6ckelov\u00e1","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2018,10,31]]},"reference":[{"key":"key2021041412302797800_ref001","unstructured":"Arnold, E. and Mahieu, B. (2011), \u201cInternational audit of research, development & innovation in the Czech Republic\u201d, Synthesis Report, Ministry of Education, Youth and Sport of the Czech Republic, Prague."},{"key":"key2021041412302797800_ref002","unstructured":"Arnold, E. and Mahieu, B. (2015), \u201cR&D evaluation methodology and funding principles. Summary report\u201d, Prague: Ministry of Education, Youth and Sport of the Czech Republic, available at: http:\/\/metodika.reformy-msmt.cz\/souhrnna-zprava (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref004","doi-asserted-by":"crossref","unstructured":"Bonaccorsi, A. (Ed.) (2018a), The Evaluation of Research in Social Sciences and Humanities: Lessons from the Italian Experience, Springer, Cham.","DOI":"10.1007\/978-3-319-68554-0"},{"key":"key2021041412302797800_ref003","doi-asserted-by":"crossref","unstructured":"Bonaccorsi, A. (2018b), \u201cPeer review in social sciences and humanities. Addressing the interpretation of quality criteria\u201d, in Bonaccorsi, A. (Ed.), The Evaluation of Research in Social Sciences and Humanities: Lessons from the Italian Experience, Springer, Cham, pp. 71-101.","DOI":"10.1007\/978-3-319-68554-0_4"},{"volume-title":"Sorting Things Out: Classification and Its Consequences","year":"2000","key":"key2021041412302797800_ref005"},{"issue":"1","key":"key2021041412302797800_ref044","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/S0048-7333(02)00007-0","article-title":"Explaining Australia\u2019s increased share of ISI publications \u2013 the effects of a funding formula based on publication counts","volume":"32","year":"2003","journal-title":"Research Policy"},{"volume-title":"Informing Research Choices: Indicators and Judgment. The Expert Panel on Science Performance and Research Funding","year":"2012","key":"key2021041412302797800_ref006"},{"key":"key2021041412302797800_ref007","unstructured":"Czech Statistical Office (n.d.), \u201cKni\u017en\u00ed produkce v \u010cR v roce 2009\u201d, available at: www.czso.cz\/csu\/czso\/knizni_produkce_v_cr_v_roce_2009 (accessed 11 August 2018)."},{"issue":"2","key":"key2021041412302797800_ref045","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1093\/reseval\/rvv038","article-title":"Evaluation practices and effects of indicator uses \u2013 a literature review","volume":"25","year":"2016","journal-title":"Research Evaluation"},{"volume-title":"Politika a ka\u017edodennost na \u010desk\u00fdch vysok\u00fdch \u0161kol\u00e1ch: Etnografick\u00e9 pohledy na vzd\u011bl\u00e1v\u00e1n\u00ed a v\u00fdzkum","year":"2014","key":"key2021041412302797800_ref008"},{"key":"key2021041412302797800_ref009","doi-asserted-by":"crossref","unstructured":"Faggiolani, C. and Solimine, G. (2018), \u201cMapping the role of the book in evaluation at the individual and department level in Italian SSH. A multisource analysis\u201d, in Bonaccorsi, A. (Ed.), The Evaluation of Research in Social Sciences and Humanities: Lessons from the Italian Experience, Springer, Cham, pp. 33-53.","DOI":"10.1007\/978-3-319-68554-0_2"},{"key":"key2021041412302797800_ref010","doi-asserted-by":"crossref","first-page":"21","DOI":"10.17351\/ests2017.108","article-title":"Implicated in the indicator game? An experimental debate","volume":"3","year":"2017","journal-title":"Engaging Science, Technology, and Society"},{"issue":"2","key":"key2021041412302797800_ref046","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1007\/s11192-016-1886-5","article-title":"Taking scholarly books into account. Current developments in five European Countries","volume":"107","year":"2016","journal-title":"Scientometrics"},{"issue":"1","key":"key2021041412302797800_ref011","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1017\/S0003975616000047","article-title":"Governing science","volume":"57","year":"2016","journal-title":"European Journal of Sociology"},{"issue":"2","key":"key2021041412302797800_ref012","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1093\/reseval\/rvu035","article-title":"Counting quality? The Czech performance-based research funding system","volume":"24","year":"2015","journal-title":"Research Evaluation"},{"key":"key2021041412302797800_ref013","doi-asserted-by":"crossref","unstructured":"Hammarfelt, B. (2016), \u201cBeyond coverage: toward a bibliometrics for the humanities\u201d, in Ochsner, M., Hug, S.E. and Daniel, H.-D. (Eds), Research Assessment in the Humanities: Towards Criteria and Procedures, Springer Open, Cham, pp. 115-132.","DOI":"10.1007\/978-3-319-29016-4_10"},{"key":"key2021041412302797800_ref014","unstructured":"Havlov\u00e1, J. (n.d), \u201cEntry \u2018collective monograph\u2019, \u010cesk\u00e1 terminologick\u00e1 datab\u00e1ze knihovnictv\u00ed a informa\u010dn\u00ed v\u011bdy\u201d, Czech national library, Prague, available at: https:\/\/aleph.nkp.cz\/F\/?func=direct&doc_number=000014657&local_base=KTD (accessed 7 March 2017)."},{"key":"key2021041412302797800_ref015","unstructured":"Hicks, D. (2004), \u201cThe four literatures of social science\u201d, in Moed, H.F., Gl\u00e4nzel, W. and Schmoch, U. (Eds), Handbook of Quantitative Science and Technology Research: The Use of Publication and Patent Statistics in Studies of S&T Systems, Kluwer Academic Publishers, Dordrecht, pp. 476-496."},{"issue":"7548","key":"key2021041412302797800_ref016","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1038\/520429a","article-title":"The Leiden manifesto for research metrics","volume":"520","year":"2015","journal-title":"Nature"},{"key":"key2021041412302797800_ref017","doi-asserted-by":"crossref","unstructured":"Lamont, M. and Guetzkow, J. (2016), \u201cHow quality is recognized by peer review panels: the case of the humanities\u201d, in Ochsner, M., Hug, S.E. and Daniel, H.-D. (Eds), Research Assessment in the Humanities: Towards Criteria and Procedures, Springer Open, Cham, pp. 31-41.","DOI":"10.1007\/978-3-319-29016-4_4"},{"issue":"5","key":"key2021041412302797800_ref018","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1093\/scipol\/scs039","article-title":"Public accountability and the politicization of science: the peculiar journey of Czech research assessment","volume":"39","year":"2012","journal-title":"Science & Public Policy"},{"key":"key2021041412302797800_ref019","unstructured":"Mach\u00e1\u010dek, V. and Srholec, M. (2017), \u201cPredatory journals in Scopus\u201d, Studie 2\/2017 IDEA \u2013 CERGE-EI, Praha, available at: https:\/\/idea-en.cerge-ei.cz\/files\/IDEA_Study_2_2017_Predatory_journals_in_Scopus\/mobile\/index.html (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref020","unstructured":"Miholov\u00e1, K. and Majer, O. (2016), \u201cAnal\u00fdza mechanismu Metodiky hodnocen\u00ed v\u00fdsledk\u016f\u201d, internal report, The Office of the Government of the Czech Republic, Prague."},{"issue":"3","key":"key2021041412302797800_ref021","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1093\/reseval\/rvx023","article-title":"Thinking with indicators. Exploring the epistemic impacts of academic performance indicators in the life sciences","volume":"26","year":"2017","journal-title":"Research Evaluation"},{"key":"key2021041412302797800_ref022","doi-asserted-by":"crossref","unstructured":"Ochsner, M., Hug, S.E. and Daniel, H.-D. (Eds) (2016), Research Assessment in the Humanities: Towards Criteria and Procedures, Springer Open, Cham.","DOI":"10.1007\/978-3-319-29016-4_1"},{"volume-title":"Anthropology and Social Theory: Culture, Power, and the Acting Subject","year":"2007","key":"key2021041412302797800_ref023"},{"issue":"5998","key":"key2021041412302797800_ref024","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.1126\/science.329.5998.1466-a","article-title":"Battling the paper glut","volume":"329","year":"2010","journal-title":"Science"},{"key":"key2021041412302797800_ref028","unstructured":"St\u00f6ckelov\u00e1, T. (Ed.) (2009), Akademick\u00e9 pozn\u00e1v\u00e1n\u00ed, vykazov\u00e1n\u00ed a podnik\u00e1n\u00ed: Etnografie m\u011bn\u00edc\u00ed se \u010desk\u00e9 v\u011bdy (Czech Science in flux: Ethnography of making, administering and enterprising knowledge in the academy), Sociologick\u00e9 nakladatelstv\u00ed, Praha."},{"issue":"2","key":"key2021041412302797800_ref025","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1177\/0162243911415872","article-title":"Immutable mobiles derailed: STS and the epistemic geopolitics of research assessment","volume":"37","year":"2012","journal-title":"Science, Technology & Human Values"},{"issue":"4","key":"key2021041412302797800_ref026","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1057\/hep.2014.20","article-title":"Power at the interfaces: the contested orderings of academic presents and futures in a social science department","volume":"27","year":"2014","journal-title":"Higher Education Policy"},{"key":"key2021041412302797800_ref027","doi-asserted-by":"crossref","unstructured":"St\u00f6ckelov\u00e1, T. (2016), \u201cAcademics and policy-relevant knowledge\u201d, in Vesel\u00fd, A., Nekola, M. and Hejzlarov\u00e1, E.M. (Eds), Policy Analysis in the Czech Republic, The Policy Press, Bristol, pp. 291-301.","DOI":"10.2307\/j.ctt1t8929b.22"},{"issue":"6","key":"key2021041412302797800_ref029","first-page":"26","article-title":"Texty bez \u010dten\u00e1\u0159\u016f aneb Hore\u010dn\u00e1 nehybnost v\u011bdy","volume":"XXXI","year":"2015","journal-title":"Host"},{"issue":"5","key":"key2021041412302797800_ref030","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1108\/AJIM-01-2017-0013","article-title":"Academic stratospheres-cum-underworlds: when highs and lows of publication cultures meet","volume":"69","year":"2017","journal-title":"Aslib Journal of Information Management"},{"key":"key2021041412302797800_ref032","unstructured":"Strathern, M. (Ed.) (2000a), Audit Cultures: Anthropological Studies in Accountability, Ethics, and the Academy, Routledge, London."},{"key":"key2021041412302797800_ref031","unstructured":"Strathern, M. (2000b), \u201cNew accountabilities: Anthropological studies in audit, ethics and the academy\u201d, in Strathern, M. (Ed.), Audit Cultures: Anthropological Studies in Accountability, Ethics, and the Academy, Routledge, London, pp. 1-18."},{"volume-title":"Zpr\u00e1va o \u010desk\u00e9m kni\u017en\u00edm trhu 2014\/2015","year":"2015","key":"key2021041412302797800_ref047"},{"key":"key2021041412302797800_ref033","doi-asserted-by":"crossref","unstructured":"van den Akker, W. (2016), \u201cYes we should; research assessment in the humanities\u201d, in Ochsner, M., Hug, S.E. and Daniel, H.-D. (Eds), Research Assessment in the Humanities: Towards Criteria and Procedures, Springer Open, Cham, pp. 23-29.","DOI":"10.1007\/978-3-319-29016-4_3"},{"issue":"6","key":"key2021041412302797800_ref034","first-page":"935","article-title":"Happy together? on satisfaction in Czech Academia\u2013a response to Z\u00e1brodsk\u00e1 et al.","volume":"53","year":"2017","journal-title":"Sociologick\u00fd \u010dasopis \/ Czech Sociological Review"},{"key":"key2021041412302797800_ref035","unstructured":"Zuccala, A. and Robinson-Garcia, N. (in press), \u201cReviewing, indicating, and counting books for modern research evaluation systems\u201d, in Glanzel, W., Moed, H.F., Schmoch, U. and Thelwall, M. (Eds), Springer Handbook of Science and Technology Indicators, Springer, Cham."},{"issue":"7","key":"key2021041412302797800_ref036","first-page":"1333","article-title":"Can we rank scholarly book publishers? A bibliometric experiment with the field of history","volume":"66","year":"2014","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2021041412302797800_ref037"},{"key":"key2021041412302797800_ref038","unstructured":"The Office of the Government of the Czech Republic (2005), \u201cMetodika hodnocen\u00ed v\u00fdzkumu a v\u00fdvoje a jejich v\u00fdsledk\u016f v r. 2005\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=18751&ad=1&attid=21996 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref039","unstructured":"The Office of the Government of the Czech Republic (2006), \u201cMetodika hodnocen\u00ed v\u00fdzkumu a v\u00fdvoje a jejich v\u00fdsledk\u016f v r. 2006\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=21846&ad=1&attid=29975 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref040","unstructured":"The Office of the Government of the Czech Republic (2007), \u201cMetodika hodnocen\u00ed v\u00fdzkumu a v\u00fdvoje a jejich v\u00fdsledk\u016f v roce 2007\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=31543&ad=1&attid=32982 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref041","unstructured":"The Office of the Government of the Czech Republic (2008), \u201cMetodika hodnocen\u00ed v\u00fdsledk\u016f v\u00fdzkumu a v\u00fdvoje v roce 2008\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=503762&ad=1&attid=503858 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref042","unstructured":"The Office of the Government of the Czech Republic (2009), \u201cMetodika hodnocen\u00ed v\u00fdsledk\u016f v\u00fdzkumu a v\u00fdvoje v roce 2009\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=532412&ad=1&attid=630925 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref049","unstructured":"The Office of the Government of the Czech Republic (2010), \u201cMetodika hodnocen\u00ed v\u00fdsledk\u016f v\u00fdzkumn\u00fdch organizac\u00ed a hodnocen\u00ed v\u00fdsledk\u016f ukon\u010den\u00fdch program\u016f (platn\u00e1 pro l\u00e9ta 2010 a 2011 a rok 2012)\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=650022&ad=1&attid=669372 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref043","unstructured":"The Office of the Government of the Czech Republic (2013a), \u201cMethodology of evaluation of research organisations and evaluation of finished programmes (valid for years 2013-2015)\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=695512&ad=1&attid=831129 (accessed 7 March 2018)."},{"key":"key2021041412302797800_ref050","unstructured":"The Office of the Government of the Czech Republic (2013b), \u201cMetodika hodnocen\u00ed v\u00fdsledk\u016f v\u00fdzkumn\u00fdch organizac\u00ed a hodnocen\u00ed v\u00fdsledk\u016f ukon\u010den\u00fdch program\u016f (platn\u00e1 pro l\u00e9ta 2013 a\u017e 2016)\u201d, available at: www.vyzkum.cz\/FrontClanek.aspx?idsekce=685899&ad=1&attid=752948 (accessed 7 March 2018)."}],"container-title":["Aslib Journal of Information Management"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/AJIM-03-2018-0063\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/AJIM-03-2018-0063\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:00:28Z","timestamp":1753398028000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ajim\/article\/70\/6\/623-642\/31468"}},"subtitle":["Academic books in a performance-based evaluation system"],"short-title":[],"issued":{"date-parts":[[2018,10,31]]},"references-count":49,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2018,10,31]]},"published-print":{"date-parts":[[2018,11,5]]}},"alternative-id":["10.1108\/AJIM-03-2018-0063"],"URL":"https:\/\/doi.org\/10.1108\/ajim-03-2018-0063","relation":{},"ISSN":["2050-3806"],"issn-type":[{"type":"print","value":"2050-3806"}],"subject":[],"published":{"date-parts":[[2018,10,31]]}}}