{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T00:50:34Z","timestamp":1772844634986,"version":"3.50.1"},"reference-count":34,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T00:00:00Z","timestamp":1695686400000},"content-version":"vor","delay-in-days":268,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This mapping review addresses scientometric indicators that quantify open scholarship. The goal is to determine what open scholarship metrics are currently being applied and which are discussed (e.g., in policy papers). The paper contributes to a better understanding of how open scholarship is quantitatively recorded in research assessment and where gaps can be identified. The review is based on a search in four databases, each with 22 queries. Out of 3,385 hits, we coded 248 documents chosen according to the research questions. The review discusses the open scholarship metrics of the documents as well as the topics addressed in the publications, the disciplines the publications come from, and the journals in which they were published. The results indicate that research and teaching practices are unequally represented regarding open scholarship metrics. Open research material is a central and exhausted topic in publications. Open teaching practices, on the other hand, play a role in the discussion and strategy papers of the review, but open teaching material is not recorded using concrete scientometric indicators. Here, we see a research gap and discuss the potential for further research and investigation.<\/jats:p>","DOI":"10.1162\/qss_a_00266","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T15:11:05Z","timestamp":1695827465000},"page":"650-670","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":8,"title":["The quantification of open scholarship\u2014a mapping\n                    review"],"prefix":"10.1162","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4500-7877","authenticated-orcid":true,"given":"Verena","family":"Weimer","sequence":"first","affiliation":[{"name":"DIPF | Leibniz Institute for Research and Information in Education, Frankfurt am Main, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5519-6395","authenticated-orcid":true,"given":"Tamara","family":"Heck","sequence":"additional","affiliation":[{"name":"DIPF | Leibniz Institute for Research and Information in Education, Frankfurt am Main, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7238-6289","authenticated-orcid":true,"given":"Thed","family":"van Leeuwen","sequence":"additional","affiliation":[{"name":"Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4641-3049","authenticated-orcid":true,"given":"Marc","family":"Rittberger","sequence":"additional","affiliation":[{"name":"DIPF | Leibniz Institute for Research and Information in Education, Frankfurt am Main, Germany"},{"name":"Hochschule Darmstadt, Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2023,12,8]]},"reference":[{"issue":"6","key":"2024032016305340200_bib1","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2019.nov.20","article-title":"Meloda 5: A metric to assess open data\n                        reusability","volume":"28","author":"Abella","year":"2019","journal-title":"Profesional de la\n                    Informaction"},{"key":"2024032016305340200_bib2","doi-asserted-by":"publisher","DOI":"10.1515\/9783110646610","volume-title":"Handbook bibliometrics","author":"Ball","year":"2021"},{"issue":"1\u20132","key":"2024032016305340200_bib3","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1080\/00987913.2022.2066968","article-title":"Open Access Monitor Germany: Best\n                        practice in providing metrics for analysis and\n                        decision-making","volume":"48","author":"Barbers","year":"2022","journal-title":"Serials Review"},{"key":"2024032016305340200_bib4","first-page":"207","article-title":"Evaluation der Hochschullehre: Modelle,\n                        Probleme und Perspektiven","volume":"41","author":"Bargel","year":"2000","journal-title":"Zeitschrift f\u00fcr\n                        P\u00e4dagogik"},{"key":"2024032016305340200_bib5","doi-asserted-by":"publisher","first-page":"19","DOI":"10.21240\/mpaed\/34\/2019.02.18.X","article-title":"Systematic Literature Review zu Open\n                        Educational Practices (OEP) in der Hochschule im europ\u00e4ischen\n                        Forschungskontext","volume":"34","author":"Bellinger","year":"2019","journal-title":"Zeitschrift f\u00fcr Theorie\n                        und Praxis der Medienbildung"},{"key":"2024032016305340200_bib6","volume-title":"Open Science und open innovation. Neue\n                        Indikatoren f\u00fcr die Analyse des Wissenschafts- und Innovationssystems\n                        im digitalen Zeitalter","author":"Bl\u00fcmel","year":"2019"},{"key":"2024032016305340200_bib7","doi-asserted-by":"publisher","first-page":"43","DOI":"10.3389\/fdata.2019.00043","article-title":"Open science, open data, and open\n                        scholarship: European policies to make science fit for the twenty-first\n                        century","volume":"2","author":"Burgelman","year":"2019","journal-title":"Frontiers in Big Data"},{"key":"2024032016305340200_bib8","volume-title":"Study on open science: Monitoring trends and\n                        drivers. Final report","author":"CWTS","year":"2019"},{"key":"2024032016305340200_bib9","doi-asserted-by":"publisher","first-page":"2667","DOI":"10.1007\/s11192-020-03705-0","article-title":"Open access initiatives in European\n                        universities: Analysis of their implementation and the visibility of\n                        publications in the YERUN network","volume":"125","author":"De Filippo","year":"2020","journal-title":"Scientometrics"},{"key":"2024032016305340200_bib10","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.54725","article-title":"The Danish Open Access Indicator. Green light for open\n                        access","author":"Elb\u00e6k","year":"2016","journal-title":"PASTEUR40A Conference"},{"key":"2024032016305340200_bib11","doi-asserted-by":"publisher","DOI":"10.2777\/337729","volume-title":"Next-generation metrics: Responsible metrics\n                        and evaluation for open science","author":"European\n                        Commission, Directorate-General for Research and Innovation","year":"2017"},{"key":"2024032016305340200_bib12","doi-asserted-by":"publisher","DOI":"10.2777\/75255","volume-title":"Evaluation of research careers fully\n                        acknowledging Open Science practices: Rewards, incentives and\/or recognition\n                        for researchers practicing Open Science","author":"European\n                        Commission, Directorate-General for Research and Innovation","year":"2017"},{"issue":"2","key":"2024032016305340200_bib13","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1111\/j.1471-1842.2009.00848.x","article-title":"A typology of reviews: An analysis of 14\n                        review types and associated methodologies","volume":"26","author":"Grant","year":"2009","journal-title":"Health\n                        Information and Libraries Journal"},{"issue":"7548","key":"2024032016305340200_bib14","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1038\/520429a","article-title":"Bibliometrics: The Leiden Manifesto for\n                        research metrics","volume":"520","author":"Hicks","year":"2015","journal-title":"Nature"},{"issue":"21","key":"2024032016305340200_bib15","doi-asserted-by":"publisher","first-page":"14344","DOI":"10.1002\/ece3.8126","article-title":"The data-index: An author-level metric that values impactful\n                        data and incentivizes data sharing","volume":"11","author":"Hood","year":"2021","journal-title":"Ecology and\n                        Evolution"},{"key":"2024032016305340200_bib16","doi-asserted-by":"publisher","DOI":"10.2791\/293408","article-title":"Opening up education: A support\n                        framework for higher education institutions","author":"Inamorato dos Santos","year":"2016","journal-title":"JRC\n                        Science for Policy Report"},{"key":"2024032016305340200_bib17","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4581490","article-title":"Openness profile: Modelling research\n                        evaluation for open scholarship","author":"Jones","year":"2021","journal-title":"Zenodo"},{"issue":"6","key":"2024032016305340200_bib18","doi-asserted-by":"publisher","first-page":"e0253129","DOI":"10.1371\/journal.pone.0253129","article-title":"Is the open access citation advantage\n                        real? A systematic review of the citation of open access and\n                        subscription-based articles","volume":"16","author":"Langham-Putrow","year":"2021","journal-title":"PLOS ONE"},{"issue":"3","key":"2024032016305340200_bib19","doi-asserted-by":"publisher","first-page":"2129","DOI":"10.1007\/s11192-016-2150-8","article-title":"Professional and citizen bibliometrics:\n                        Complementarities and ambivalences in the development and use of\n                        indicators\u2014A state-of-the-art report","volume":"109","author":"Leydesdorff","year":"2016","journal-title":"Scientometrics"},{"key":"2024032016305340200_bib20","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-60522-7","volume-title":"Applied evaluative informetrics","author":"Moed","year":"2017"},{"issue":"4","key":"2024032016305340200_bib21","doi-asserted-by":"publisher","first-page":"1048","DOI":"10.1002\/asi.23741","article-title":"Metrics for openness","volume":"68","author":"Nichols","year":"2017","journal-title":"Journal of the\n                        Association for Information Science and Technology"},{"issue":"71","key":"2024032016305340200_bib22","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting\n                        systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"British Medical\n                    Journal"},{"key":"2024032016305340200_bib23","volume-title":"Indikatoren f\u00fcr Open Science:\n                        Diskussionspapier des Helmholtz Open Science Office","author":"Pampel","year":"2020"},{"issue":"1","key":"2024032016305340200_bib24","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1111\/bjet.12010","article-title":"Scholarship in the digital age: Open\n                        educational resources, publication and public engagement","volume":"45","author":"Scanlon","year":"2013","journal-title":"British Journal of Educational Technology"},{"key":"2024032016305340200_bib25","doi-asserted-by":"publisher","DOI":"10.31222\/osf.io\/b4v8p","volume-title":"Foundations for open scholarship strategy\n                        development","author":"Tennant","year":"2019"},{"key":"2024032016305340200_bib26","volume-title":"Open Educational Resources\n                        (OER)","author":"UNESCO","year":"2012"},{"key":"2024032016305340200_bib27","volume-title":"Recommendation on Open\n                        Educational Resources (OER)","author":"UNESCO","year":"2019"},{"issue":"1","key":"2024032016305340200_bib28","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1023\/A:1010549719484","article-title":"Language biases in the coverage of the\n                        Science Citation Index and its consequences for international comparisons of\n                        national research performance","volume":"51","author":"van Leeuwen","year":"2001","journal-title":"Scientometrics"},{"key":"2024032016305340200_bib29","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.1254834","article-title":"OpenAIRE D 7.2\u2014The impact of open\n                        access published research","author":"van Leeuwen","year":"2018","journal-title":"Zenodo"},{"key":"2024032016305340200_bib30","doi-asserted-by":"publisher","first-page":"428","DOI":"10.1016\/j.jbusres.2017.12.043","article-title":"Open science now: A systematic\n                        literature review for an integrated definition","volume":"88","author":"Vicente-Saez","year":"2018","journal-title":"Journal of Business Research"},{"key":"2024032016305340200_bib31","first-page":"5638","article-title":"A comparison of bibliometric indicators\n                        for evaluating the top 100 open access journals","author":"Waris","year":"2021","journal-title":"Library Philosophy and Practice"},{"key":"2024032016305340200_bib32","article-title":"Defining the \u201copen\u201d in open content and open\n                        educational resources","author":"Wiley","year":".."},{"key":"2024032016305340200_bib33","first-page":"81","article-title":"Why openness in\n                        education?","volume-title":"Game changers: Education and information technologies","author":"Wiley","year":"2012"},{"key":"2024032016305340200_bib34","doi-asserted-by":"publisher","DOI":"10.2777\/445286","volume-title":"Indicator frameworks for fostering open\n                        knowledge practices in science and scholarship","author":"Wouters","year":"2019"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/4\/3\/650\/2351912\/qss_a_00266.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/4\/3\/650\/2351912\/qss_a_00266.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T12:31:26Z","timestamp":1710937886000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/4\/3\/650\/117678\/The-quantification-of-open-scholarship-a-mapping"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":34,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,8,12]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00266","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v2\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00266\/v2\/response1","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}