{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:13:55Z","timestamp":1760148835016,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T00:00:00Z","timestamp":1685664000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"BMBF (German Bundesministerium f\u00fcr Bildung und Forschung","award":["01PQ17002"],"award-info":[{"award-number":["01PQ17002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Publications"],"abstract":"<jats:p>The concept of evaluation gaps captures potential discrepancies between what researchers value about their research, in particular research quality, and what metrics measure. The existence of evaluation gaps can give rise to questions about the relationship between intrinsic and extrinsic motivations to perform research, i.e., how field-specific notions of quality compete with notions captured via evaluation metrics, and consequently how researchers manage the balancing act between intrinsic values and requirements of evaluation procedures. This study analyses the evaluation gap from a rational choice point of view for the case of observational astronomers, based on a literature review and 19 semi-structured interviews with international astronomers. On the basis of the institutional norms and capital at play in academic astronomy, I shed light on the workings of the balancing act and its consequences on research quality in astronomy. I find that astronomers experience an anomie: they want to follow their intrinsic motivation to pursue science in order to push knowledge forward, while at the same time following their extrinsic motivation to comply with institutional norms. The balancing act is the art of serving performance indicators in order to stay in academia, while at the same time compromising research quality as little as possible. Gaming strategies shall give the appearance of compliance, while institutionalised means to achieve a good bibliometric record are used in innovative ways, such as salami slicing or going for easy publications. This leads to an overall decrease in research quality.<\/jats:p>","DOI":"10.3390\/publications11020033","type":"journal-article","created":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T08:50:31Z","timestamp":1685695831000},"page":"33","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["The Evaluation Gap in Astronomy\u2014Explained through a Rational Choice Framework"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0158-6771","authenticated-orcid":false,"given":"Julia","family":"Heuritsch","sequence":"first","affiliation":[{"name":"Research Group \u201cReflexive Metrics\u201d, Institut f\u00fcr Sozialwissenschaften, Humboldt Universit\u00e4t zu Berlin, Universit\u00e4tsstra\u00dfe 3b, 10117 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,2]]},"reference":[{"key":"ref_1","first-page":"21","article-title":"Implicated in the Indicator Game? An Experimental Debate","volume":"3","author":"Fochler","year":"2017","journal-title":"Engag. Sci. Technol. Soc."},{"key":"ref_2","unstructured":"Heuritsch, J. (2019, January 6\u20137). Effects of metrics in research evaluation on knowledge production in astronomy: A case study on Evaluation Gap and Constitutive Effects. Proceedings of the STS Conference, Graz, Austria."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Porter, T. (1995). Trust in Numbers, Princeton University Press.","DOI":"10.1515\/9780691210544"},{"key":"ref_4","unstructured":"Desrosi\u00e8res, A. (1998). The Politics of Large Numbers\u2014A History of Statistical Reasoning, Harvard University Press."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1017\/S0003975609000150","article-title":"A Sociology of Quantification","volume":"49","author":"Espeland","year":"2008","journal-title":"Eur. J. Sociol."},{"key":"ref_6","first-page":"108","article-title":"Bridging the Evaluation Gap","volume":"3","author":"Wouters","year":"2017","journal-title":"Engag. Sci. Technol. Soc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1016\/j.respol.2014.02.006","article-title":"Beyond breakthrough research: Epistemic properties of research and their consequences for research funding","volume":"43","author":"Laudel","year":"2014","journal-title":"Res. Policy"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s11024-015-9274-5","article-title":"Accounting for Impact?","volume":"53","author":"Rushforth","year":"2015","journal-title":"Minerva"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1080\/14719037.2013.770058","article-title":"Constitutive Effects of Performance Indicators: Getting beyond unintended consequences","volume":"16","year":"2014","journal-title":"Public Manag. Rev."},{"key":"ref_10","unstructured":"Heuritsch, J. (2021). The Structural Conditions for the Evaluation Gap in Astronomy. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/BF02019273","article-title":"A study of the publishing activity of astronomers since 1969","volume":"22","author":"Devoust","year":"1991","journal-title":"Scientometrics"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1002\/asi.23689","article-title":"Measuring Metrics\u2014A 40-Year Longitudinal Cross-Validation of Citations, Downloads, and Peer Review in Astrophysics","volume":"68","author":"Kurtz","year":"2017","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1177\/030631200030005002","article-title":"Large Telescopes and the Moral Economy of Recent astronomy","volume":"30","author":"McCray","year":"2000","journal-title":"Soc. Stud. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s11024-009-9121-7","article-title":"Moral Economies in Science: From Ideal to Pragmatic","volume":"47","author":"Fairley","year":"2009","journal-title":"Minerva"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1177\/0162243919846600","article-title":"Let\u2019s Not Talk About Science: The Normalization of Big Science and the Moral Economy of Modern astronomy","volume":"45","author":"Baneke","year":"2020","journal-title":"Sci. Technol. Hum. Values"},{"key":"ref_16","unstructured":"Thompson, E.P. (1993). Customs in Common: Studies in Traditional Popular Culture, New Press\/W.W. Norton."},{"key":"ref_17","unstructured":"Biagioli, M. (1999). The Science Studies Reader, Routledge."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1086\/286513","article-title":"Science and the social order","volume":"5","author":"Merton","year":"1938","journal-title":"Philos. Sci."},{"key":"ref_19","unstructured":"Esser, H. (1999). Soziologie. Spezielle Grundlagen. Band 1: Situationslogik und Handeln, Campus Verlag."},{"key":"ref_20","unstructured":"Esser, H. (2000). Soziologie. Spezielle Grundlagen. Band 5: Institutionen, Campus Verlag."},{"key":"ref_21","unstructured":"Merton, R.K. (1949). Social Theory and Social Structure. Toward the Codification of Theory and Research, Free Press."},{"key":"ref_22","unstructured":"Kreckel, R. (1983). Soziale Ungleichheiten, Sonderband 2 der Sozialen Welt."},{"key":"ref_23","unstructured":"Esser, H. (2000). Soziologie. Spezielle Grundlagen. Band 3: Soziales Handeln, Campus Verlag."},{"key":"ref_24","unstructured":"Mayring, P. (2000). Qualitative Content Analysis, SAGE Publication."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1126\/science.159.3810.56","article-title":"The Matthew effect in science","volume":"159","author":"Merton","year":"1968","journal-title":"Science"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Taubert, N. (2019). Fremde Galaxien und Abstrakte Welten: Open Access in Astronomie und Mathematik. Soziologische Perspektiven, transcript Verlag. Transcript Science Studies.","DOI":"10.1515\/9783839443576"},{"key":"ref_27","unstructured":"Storer, N.W. (1973). The Sociology of Science. Theoretical and Empirical Investigations, The University of Chicago Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1080\/1359432X.2013.877892","article-title":"The Multidimensional Work Motivation Scale: Validation evidence in seven languages and nine countries","volume":"24","author":"Forest","year":"2015","journal-title":"Eur. J. Work Organ. Psychol."},{"key":"ref_29","first-page":"558","article-title":"Hyperauthorship: A Postmodern Perversion or Evidence of a Structural Shiftin Scholarly Communication Practices?","volume":"52","author":"Cronin","year":"2001","journal-title":"J. Am. Soc. Sci. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1850014","DOI":"10.1142\/S0219525918500145","article-title":"Talent vs Luck: The role of randomness in success and failure","volume":"21","author":"Pluchino","year":"2018","journal-title":"Adv. Complex Syst."},{"key":"ref_31","first-page":"11","article-title":"The Evolving Sociology of Ground-Based Optical and Infrared astronomy at the Start of the 21st Century","volume":"Volume 6","author":"Heck","year":"2006","journal-title":"Organizations and Strategies in Astronomy"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/s11024-017-9315-3","article-title":"Epistemic Cultures in Conflict: The Case of astronomy and High Energy Physics","volume":"55","author":"Heidler","year":"2017","journal-title":"Minerva"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1126\/science.7008199","article-title":"The Publishing Game: Getting More for Less","volume":"211","author":"Broad","year":"1981","journal-title":"Science"},{"key":"ref_34","unstructured":"Humphreys, P. (2016). The Oxford Handbook of Philosophy of Science, Oxford Handbooks."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.ijinfomgt.2019.05.024","article-title":"Sharing and re-using open data: A case study of motivations in astrophysics","volume":"49","author":"Zuiderwijk","year":"2019","journal-title":"Int. J. Inf. Manag."},{"key":"ref_36","unstructured":"Patat, F., Boffin, H.M.J., Bordelon, D., Grothkopf, U., Meakins, S., Mieske, S., and Rejkuba, M. (2017). The ESO Survey of Non-Publishing Programmes. Eur. South. Obs., 51\u201357."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/BF02017241","article-title":"Astronomy in the twentieth century","volume":"9","author":"Herrmann","year":"1986","journal-title":"Scientometries"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1057\/s41307-017-0051-y","article-title":"Competition in Science: Links Between Publication Pressure, Grant Pressure and the Academic Job Market","volume":"31","author":"Waaijer","year":"2017","journal-title":"High Educ. Policy"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"17064","DOI":"10.1057\/palcomms.2017.64","article-title":"Bibliometric indicators: The origin of their log-normal distribution and why they are not a reliable proxy for an individual scholar\u2019s talent","volume":"3","author":"Ruocco","year":"2017","journal-title":"Palgrave Commun."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Thurner, S., Liu, W., Klimek, P., and Cheong, S.A. (2020). The role of mainstreamness and interdisciplinary for the relevance of scientific papers. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0230325"},{"key":"ref_41","unstructured":"Coleman, J.S. (1990). Foundations of Social Theory, Harvard University Press."},{"key":"ref_42","unstructured":"Heuritsch, J. (2019). Knowledge Utilization and Open Science Policies: Noble aims that ensure quality research or Ordering discoveries like a pizza? published at the International Astronautical Federation Congress 2019. arXiv, Available online: https:\/\/iafastro.directory\/iac\/paper\/id\/50665\/summary\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Stephan, P. (2012). How Economics Shapes Science, Harvard University Press.","DOI":"10.4159\/harvard.9780674062757"}],"container-title":["Publications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2304-6775\/11\/2\/33\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:47:50Z","timestamp":1760125670000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2304-6775\/11\/2\/33"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,2]]},"references-count":43,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["publications11020033"],"URL":"https:\/\/doi.org\/10.3390\/publications11020033","relation":{},"ISSN":["2304-6775"],"issn-type":[{"type":"electronic","value":"2304-6775"}],"subject":[],"published":{"date-parts":[[2023,6,2]]}}}