{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T03:23:05Z","timestamp":1792898585219,"version":"4.5.0"},"reference-count":45,"publisher":"MIT Press","issue":"1","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Research infrastructures (RIs) offer researchers a multitude of research opportunities and services and play a key role in the performance, innovative strength, and international competitiveness of science. As an important part of the generation and use of new knowledge and technologies, they are essential for research policies. Because of their strategic importance and their need for significant funding, there is a growing demand for the assessment of their scientific output and impact. Current research information systems (CRIS) have contributed for many years now to the evaluation of universities and research organizations. Based on studies on the application of CRIS to infrastructures and on a recent French report on the scientometric assessment of RI, this paper analyzes the potential of CRIS and their data models and standards (in particular the international CERIF format and the German RDC model) for the monitoring and evaluation of RIs. The interaction between functional specificities of RI and standards for their assessment is outlined, with reference to their own potential to stimulate and share innovation in the networks located inside and outside RIs. This societal challenge, more than an academic issue, is on the way to further harmonization and consolidation of shared and common RI metrics.<\/jats:p>","DOI":"10.1162\/qss_a_00111","type":"journal-article","created":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T19:31:01Z","timestamp":1611171061000},"page":"42-64","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":30,"title":["Evaluating the scientific impact of research infrastructures: The\n                    role of current research information systems"],"prefix":"10.1162","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4170-324X","authenticated-orcid":true,"given":"Renaud","family":"Fabre","sequence":"first","affiliation":[{"name":"Dionysian Economics Lab (LED), University Paris 8, Saint-Denis, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1605-7047","authenticated-orcid":true,"given":"Daniel","family":"Egret","sequence":"additional","affiliation":[{"name":"Observatoire de Paris, Universit\u00e9 Paris Sciences & Lettres, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4000-807X","authenticated-orcid":true,"given":"Joachim","family":"Sch\u00f6pfel","sequence":"additional","affiliation":[{"name":"GERiiCO Labor, University of Lille, Villeneuve-d\u2019Ascq, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5225-389X","authenticated-orcid":true,"given":"Otmane","family":"Azeroual","sequence":"additional","affiliation":[{"name":"German Center for Higher Education Research and Science Studies (DZHW), Berlin, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,4,8]]},"reference":[{"issue":"4","key":"2021041320052514600_bib1","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1016\/j.joi.2017.08.007","article-title":"Bibliometrix: An R-tool for\n                        comprehensive science mapping analysis","volume":"11","author":"Aria","year":"2017","journal-title":"Journal of\n                        Informetrics"},{"key":"2021041320052514600_bib2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-55814-7_16","article-title":"Open science graphs must\n                        interoperate!","volume-title":"ADBIS, TPDL and EDA 2020 Common\n                        Workshops and Doctoral Consortium. TPDL 2020, ADBIS 2020","author":"Aryani","year":"2020"},{"key":"2021041320052514600_bib3","doi-asserted-by":"crossref","DOI":"10.3389\/978-2-88945-964-3","volume-title":"Mining scientific papers: NLP-enhanced\n                        bibliometrics","author":"Atanassova","year":"2019"},{"issue":"1\u20132","key":"2021041320052514600_bib4","doi-asserted-by":"crossref","first-page":"87","DOI":"10.3233\/ISU-200076","article-title":"Mapping and semantic interoperability of\n                        the German RCD data model with the Europe-wide accepted\n                        CERIF","volume":"40","author":"Azeroual","year":"2020","journal-title":"Information Services & Use"},{"issue":"1\u20132","key":"2021041320052514600_bib5","doi-asserted-by":"crossref","first-page":"105","DOI":"10.3233\/ISU-180030","article-title":"Solving problems of research\n                        information heterogeneity during integration \u2013 using the European\n                        CERIF and German RCD standards as examples","volume":"39","author":"Azeroual","year":"2019","journal-title":"Information Services & Use"},{"key":"2021041320052514600_bib6","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1007\/978-3-030-20485-3_26","article-title":"Quality of research information in RIS\n                        databases: A multidimensional approach","volume":"353","author":"Azeroual","year":"2019","journal-title":"Lecture\n                        Notes in Business Information Processing"},{"issue":"2","key":"2021041320052514600_bib7","doi-asserted-by":"crossref","first-page":"30","DOI":"10.3390\/data5020030","article-title":"Influence of information quality via\n                        implemented German RCD standard in research information\n                        systems","volume":"5","author":"Azeroual","year":"2020","journal-title":"Data"},{"key":"2021041320052514600_bib8","article-title":"European Science Foundation: New\n                        projects and developments","volume-title":"EuroCRIS Strategic\n                        Membership Meeting","author":"Baginskaite","year":"2017"},{"key":"2021041320052514600_bib9","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.procs.2017.03.043","article-title":"Mapping solid earth data and research infrastructures to\n                        CERIF","volume":"106","author":"Bailo","year":"2017","journal-title":"Procedia Computer Science"},{"key":"2021041320052514600_bib10","article-title":"Advances in sharing and managing\n                        knowledge about European research infrastructures","volume-title":"CRIS2012: 11th International Conference on Current Research\n                        Information Systems","author":"Beckers","year":"2012"},{"key":"2021041320052514600_bib11","article-title":"The Research Core Dataset: Standardizing\n                        the management and reporting of research information in the German science\n                        system","volume-title":"EuroCRIS Strategic Membership\n                        Meeting","author":"Biesenbender","year":"2019"},{"key":"2021041320052514600_bib12","article-title":"The German Research Core Data Set\n                        (KDSF)","volume-title":"EuroCRIS Membership Meeting","author":"Biesenbender","year":"2019"},{"key":"2021041320052514600_bib13","doi-asserted-by":"crossref","DOI":"10.1016\/j.procs.2014.06.031","article-title":"Integrating CERIF entities in a\n                        multidisciplinary e-infrastructure for environmental research\n                        data","volume-title":"CRIS2014: 12th International Conference on\n                        Current Research Information Systems","author":"Boldrini","year":"2014"},{"key":"2021041320052514600_bib14","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-54956-5_1","article-title":"Requirements analysis for an open\n                        research knowledge graph","volume-title":"Digital libraries for open knowledge. TPDL 2020","author":"Brack","year":"2020"},{"key":"2021041320052514600_bib15","article-title":"MERIL: An e-infrastructure to connect\n                        research infrastructures","volume-title":"10th EuroCRIS Strategic\n                        Seminar: \u201cHorizon 2020 and Beyond,\u201d","author":"Brasse","year":"2012"},{"key":"2021041320052514600_bib16","doi-asserted-by":"crossref","DOI":"10.1145\/3308558.3313685","article-title":"Google dataset search: Building a search\n                        engine for datasets in an open Web ecosystem","volume-title":"The\n                        World Wide Web Conference\u2014WWW \u201919","author":"Brickley","year":"2019"},{"key":"2021041320052514600_bib17","volume-title":"Research information management: Defining RIM\n                        and the library\u2019s role","author":"Bryant","year":"2017"},{"key":"2021041320052514600_bib18","article-title":"Infrastructures for open, digital\n                        science","volume-title":"CRIS2014: 12th International Conference on\n                        Current Research Information Systems","author":"Buhr","year":"2014"},{"key":"2021041320052514600_bib19","doi-asserted-by":"crossref","first-page":"2835","DOI":"10.1007\/s11192-020-03763-4","article-title":"Scholarly literature mining with\n                        information retrieval and natural language processing:\n                        Preface","volume":"125","author":"Cabanac","year":"2020","journal-title":"Scientometrics"},{"key":"2021041320052514600_bib20","volume-title":"Catalogue d\u2019Offres Partag\u00e9es d\u2019IST (COPIST).\n                        Analyse conjointe des r\u00e9sultats de l\u2019enqu\u00eate nationale\n                        aupr\u00e8s des Universit\u00e9s, des Grandes \u00e9coles et des\n                        Organismes de recherche sur le partage et la gestion des ressources en\n                        IST","author":"Centre national\n                        de la recherche scientifique","year":"2017"},{"issue":"1","key":"2021041320052514600_bib21","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1002\/leap.1281","article-title":"Weathering changes and challenges to\n                        society publishing","volume":"33","author":"Conrad","year":"2020","journal-title":"Learned Publishing"},{"key":"2021041320052514600_bib22","volume-title":"Le pilotage et le financement\n                        des Tr\u00e8s Grandes Infrastructures de Recherche","author":"Cour des\n                        Comptes","year":"2019"},{"key":"2021041320052514600_bib23","doi-asserted-by":"crossref","DOI":"10.1109\/eScience.2012.6404478","article-title":"Collaborative information management in\n                        scientific research processes","volume-title":"IEEE 8th\n                        International Conference on E-Science","author":"Crompton","year":"2012"},{"key":"2021041320052514600_bib24","first-page":"21","article-title":"The role of Current Research Information\n                        Systems (CRIS) in supporting open science implementation: the case of\n                        Strathclyde","volume":"5","author":"De Castro","year":"2018","journal-title":"ITLib"},{"key":"2021041320052514600_bib25","article-title":"Research information: The euroCRIS\n                        context","volume-title":"Use Science: Open Infrastructure to Foster\n                        Collaboration between Industry and Academia","author":"Dvorak","year":"2013"},{"key":"2021041320052514600_bib26","volume-title":"Mission \u201cPublim\u00e9triques\u201d.\n                        Appr\u00e9cier l\u2019impact scientifique des TGIR\/OI \u201cComment\n                        mieux tracer les dynamiques du travail scientifique.\u201d","author":"Egret","year":"2019"},{"key":"2021041320052514600_bib27","first-page":"112","article-title":"A \u201cSearchable\u201d Space with\n                        Routes for Querying Scientific Information","volume-title":"BIR@ECIR, Proceedings of the 8th International Workshop on\n                        Bibliometric-enhanced Information Retrieval (BIR 2019)","author":"Fabre","year":"2019"},{"key":"2021041320052514600_bib28","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.techfore.2016.03.007","article-title":"Forecasting the socio-economic impact of\n                        the Large Hadron Collider: A cost\u2013benefit analysis to 2025 and\n                        beyond","volume":"112","author":"Florio","year":"2016","journal-title":"Technological Forecasting and Social\n                        Change"},{"key":"2021041320052514600_bib29","article-title":"The CERIF-based EuroRIs-Net +\n                        Observatory","volume-title":"EuroCRIS Membership Meeting","author":"Houssos","year":"2013"},{"key":"2021041320052514600_bib30","article-title":"A mapping tool for semantic\n                        interoperability of research information systems","volume-title":"8th International Conference on Information Society and\n                        Technology","author":"Ivanovic","year":"2018"},{"key":"2021041320052514600_bib31","article-title":"Entities and identities in research\n                        information systems","volume-title":"CRIS2012: 11th International\n                        Conference on Current Research Information Systems","author":"J\u00f6rg","year":"2012"},{"key":"2021041320052514600_bib32","volume-title":"Model of the data continuum in Photon and\n                        Neutron Facilities","author":"Matthews","year":"2012"},{"key":"2021041320052514600_bib33","volume-title":"Strat\u00e9gie nationale des infrastructures de\n                    recherche","author":"Minist\u00e8re de l\u2019enseignement sup\u00e9rieur, de la recherche\n                        et de l\u2019innovation","year":"2018"},{"key":"2021041320052514600_bib34","volume-title":"Reference framework for assessing the scientific and socio-economic\n                        impact of research infrastructures","author":"Organisation\n                        for Economic Co-operation and Development","year":"2019"},{"key":"2021041320052514600_bib35","article-title":"Linking funding to research output and\n                        facilities through the Finnish Research Information Hub","volume-title":"CRIS2018: 14th International Conference on Current Research\n                        Information Systems","author":"Puuska","year":"2018"},{"key":"2021041320052514600_bib36","volume-title":"Rapport d\u2019information au nom de la\n                        commission des finances sur l\u2019enqu\u00eate de la Cour des comptes\n                        sur le pilotage et le financement des tr\u00e8s grandes infrastructures de\n                        recherche","author":"Rapin","year":"2019"},{"key":"2021041320052514600_bib37","volume-title":"Panel\n                        criteria and working methods (REF 2019\/02)","author":"Research\n                        Excellence Framework 2021","year":"2019"},{"issue":"1","key":"2021041320052514600_bib38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1108\/DTA-01-2019-0009","article-title":"Implementation and user acceptance of\n                        research information systems","volume":"54","author":"Sch\u00f6pfel","year":"2019","journal-title":"Data Technologies and\n                        Applications"},{"key":"2021041320052514600_bib39","article-title":"Research Information in the selection\n                        process of Germany\u2019s universities of excellence","volume-title":"EuroCRIS Strategic Membership Meeting","author":"Spang-Grau","year":"2019"},{"issue":"1","key":"2021041320052514600_bib40","doi-asserted-by":"crossref","first-page":"18","DOI":"10.5334\/dsj-2020-018","article-title":"Persistent identification of\n                        instruments","volume":"19","author":"Stocker","year":"2020","journal-title":"Data Science Journal"},{"key":"2021041320052514600_bib41","article-title":"Towards contextual awareness and\n                        interoperability in an enhanced VRE: mapping individual metadata schemata to\n                        CERIF","volume-title":"EuroCRIS Strategic Membership\n                        Meeting","author":"Theodoridou","year":"2016"},{"key":"2021041320052514600_bib42","article-title":"Metrics and trends in assessing the\n                        scientific impact","volume-title":"BIR 2020 10th International\n                        Workshop on Bibliometric-enhanced Information Retrieval","author":"Tsatsaronis","year":"2020"},{"key":"2021041320052514600_bib43","article-title":"European wide infrastructures and\n                        services on research information management: The RICH\n                        project","volume-title":"EuroCRIS Strategic Membership\n                        Meeting","author":"Tzenou","year":"2016"},{"key":"2021041320052514600_bib44","volume-title":"The future of scientific knowledge discovery in\n                        open networked environments","author":"Uhlir","year":"2012"},{"key":"2021041320052514600_bib45","article-title":"Analyzing the research data\n                        infrastructure in Europe","volume-title":"EuroCRIS Strategic\n                        Membership Meeting","author":"Vancauwenbergh","year":"2019"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/1\/42\/1906550\/qss_a_00111.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/1\/42\/1906550\/qss_a_00111.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T00:29:24Z","timestamp":1618446564000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/2\/1\/42\/97575\/Evaluating-the-scientific-impact-of-research"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,4,8]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00111","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}