{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T11:38:06Z","timestamp":1774438686615,"version":"3.50.1"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T00:00:00Z","timestamp":1673222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["824671"],"award-info":[{"award-number":["824671"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["872687"],"award-info":[{"award-number":["872687"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Res. Metr. Anal."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>By a series of calls within the Horizon 2020 framework programme, the EU funded projects intended to deploy Responsible Research and Innovation (RRI) at a territorial level, in regional research and innovation ecosystems. This paper presents efforts to document and evaluate the achievements in TRANSFORM, one of these projects.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Evaluative inquiry and theoretical reasoning.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Noting the need for a general principle to be interpreted, adapted and translated in order to be rendered meaningful at a local level, we studied precisely these multiple territorial translations of RRI, the organizational and institutional orderings with which they co-emerge and the challenges that come with these translations. An important shared feature is that RRI work does not start from zero, but rather builds on pre-existing relationships and repertoires of collaboration. The RRI project is hence a way to continue ongoing work and follow pre-set purposes, aims and objectives, as a form of \u201cmaintenance work\u201d. In this very human sense, RRI is deployed with a logic of care in the regional context, while the Horizon 2020 calls and proposals above all are formulated in a logic of choice, to be assessed by indicators.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>We warn against undue standardization of RRI by toolification and use of quantitative indicators, and recommend that RRI performance is monitored by methods of evaluative inquiry.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frma.2022.1038970","type":"journal-article","created":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T11:10:39Z","timestamp":1673262639000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Translating tools and indicators in territorial RRI"],"prefix":"10.3389","volume":"7","author":[{"given":"Thomas","family":"V\u00f6lker","sequence":"first","affiliation":[]},{"given":"Marzia","family":"Mazzonetto","sequence":"additional","affiliation":[]},{"given":"Rasmus","family":"Slaattelid","sequence":"additional","affiliation":[]},{"given":"Roger","family":"Strand","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,1,9]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1177\/0963662509335459","article-title":"Analyzing acceptance politics: towards an epistemological shift in the public understanding of science and technology","volume":"19","author":"Barben","year":"2010","journal-title":"Public Underst. Sci."},{"key":"B2","first-page":"979","article-title":"Anticipatory governance of nanotechnlogy: foresight, engagement, and integration,","volume-title":"The Handbook of Science and Technology Studies","author":"Barben","year":"2007"},{"key":"B3","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1177\/0305829813481007","article-title":"The translation zone: between actor-network theory and international relations","volume":"41","author":"Barry","year":"2013","journal-title":"Millenn. J. Int. Stud."},{"key":"B4","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1080\/23299460.2021.1909812","article-title":"Rethinking societal engagement under the heading of Responsible Research and Innovation: (novel) requirements and challenges","volume":"8","author":"Bauer","year":"2021","journal-title":"J. Responsible Innov."},{"key":"B5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11948-016-9782-1","article-title":"Definitions and conceptual dimensions of responsible research and innovation: a literature review","volume":"23","author":"Burget","year":"2017","journal-title":"Sci. Eng. Ethics"},{"key":"B6","doi-asserted-by":"crossref","DOI":"10.4324\/9780203797693","volume-title":"Remaking Participation: Science, Environment and Emergent Publics","author":"Chilvers","year":"2015"},{"key":"B7","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.erss.2018.03.020","article-title":"Ecologies of participation in socio-technical change: the case of energy system transitions","volume":"42","author":"Chilvers","year":"2018","journal-title":"Energy Res. Soc. Sci."},{"key":"B8","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1093\/scipol\/scaa018","article-title":"What's in a name? Perceptions and promotion of responsible research and innovation practices across Europe","volume":"47","author":"Christensen","year":"2020","journal-title":"Sci. Public Policy"},{"key":"B9","first-page":"13","volume-title":"\u201cTravels of Ideas.\u201d in Translating Organizational Change","author":"Czarniawska","year":"2012"},{"key":"B10","doi-asserted-by":"publisher","first-page":"176","DOI":"10.22163\/fteval.2019.386","article-title":"Evaluative inquiry: engaging research evaluation analytically and strategically","volume":"48","author":"de Rijcke","year":"2019","journal-title":"fteval J. Res. Technol. Policy Eval"},{"key":"B11","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1023\/A:1004348123030","article-title":"The endless transition: a \u2018triple helix' of university - industry - government relations","volume":"36","author":"Etzkowitz","year":"1998","journal-title":"Minerva"},{"key":"B12","unstructured":"StilgoeJ.\n            J\u00e4gerA.\n            MadsenE.\n          Monitoring the Evolution and Benefits of Responsible Research and Innovation: Summarising Insights from the MoRRI Project2018"},{"key":"B13","unstructured":"Indicators for Promoting and Monitoring Responsible Research and Innovation: Report from the Expert Group on Policy Indicators for Responsible Research and Innovation, Publications Office2015"},{"key":"B14","volume-title":"Science in Society: Caring for Our Futures in Turbulent Times. ESF Science Policy Briefing","author":"Felt","year":"2013"},{"key":"B15","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1093\/scipol\/scz029","article-title":"Towards regional responsible research and innovation? Integrating RRI and RIS3 in European innovation policy","volume":"46","author":"Fitjar","year":"2019","journal-title":"Sci. Public Policy"},{"key":"B16","doi-asserted-by":"publisher","first-page":"21","DOI":"10.17351\/ests2017.108","article-title":"Implicated in the indicator game? An experimental debate | fochler | engaging science, technology, and society","volume":"3","author":"Fochler","year":"2017","journal-title":"Engag. Sci. Technol. Soc."},{"key":"B17","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1016\/0016-3287(93)90022-L","article-title":"Science for the post-normal age","volume":"25","author":"Funtowicz","year":"1993","journal-title":"Futures"},{"key":"B18","article-title":"The emergence of a new mode of knowledge production,","volume-title":"Social Studies of Science in an International Perspective. Proceedings of a Workshop, University of Vienna, 13\u201314 January 1994","author":"Gibbons","year":"1994"},{"key":"B19","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1177\/0306312713508669","article-title":"Understanding \u2018anticipatory governance.'","volume":"44","author":"Guston","year":"2013","journal-title":"Soc. Stud. Sci"},{"key":"B20","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/S0160-791X(01)00047-1","article-title":"Real-time technology assessment","volume":"24","author":"Guston","year":"2002","journal-title":"Technol. Soc."},{"key":"B21","doi-asserted-by":"publisher","first-page":"0270467616646637","DOI":"10.1177\/0270467616646637","article-title":"Stitching together creativity and responsibility interpreting frankenstein across disciplines","volume":"36","author":"Halpern","year":"2016","journal-title":"Bull. Sci. Technol. Soc."},{"key":"B22","doi-asserted-by":"crossref","DOI":"10.4324\/9780203818336","volume-title":"Being Alive: Essays on Movement, Knowledge and Description","author":"Ingold","year":"2011"},{"key":"B23","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1023\/A:1025557512320","article-title":"Technologies of humility: citizen participation in governing science","volume":"41","author":"Jasanoff","year":"2003","journal-title":"Minerva"},{"key":"B24","doi-asserted-by":"crossref","first-page":"13","DOI":"10.4324\/9780203413845-7","article-title":"Ordering knowledge, ordering society,","volume-title":"States of Knowledge. The Co-Production of Science and Social Order","author":"Jasanoff","year":"2004"},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.7208\/chicago\/9780226276663.001.0001","volume-title":"Dreamscapes of Modernity: Sociotechnical Imaginaries and the Fabrication of Power","author":"Jasanoff","year":"2015"},{"key":"B26","doi-asserted-by":"crossref","first-page":"77","DOI":"10.4324\/9781315457291-5","article-title":"Technocracy versus experimental learning in RRI: on making the most of RRI's interpretative flexibility,","volume-title":"Responsible Research and Innovation: From Concepts to Practices","author":"Klaassen","year":"2018"},{"key":"B27","doi-asserted-by":"publisher","first-page":"5","DOI":"10.23987\/sts.65543","article-title":"Lost in translation: Czech dialogues by Swedish design","volume":"31","author":"Konop\u00e1sek","year":"2018","journal-title":"Sci. Technol. Stud."},{"key":"B28","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1177\/1075547015588601","article-title":"Upstream public engagement in nanotechnology","volume":"37","author":"Krabbenborg","year":"2015","journal-title":"Sci. Commun."},{"key":"B29","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/s11133-014-9274-z","article-title":"Methodological pluralism and the possibilities and limits of interviewing","volume":"37","author":"Lamont","year":"2014","journal-title":"Qual. Sociol."},{"key":"B30","volume-title":"Science in Action. How to Follow Scientists and Engineers Through Society.","author":"Latour","year":"1987"},{"key":"B31","first-page":"29","article-title":"On technical mediation \u2014 philosophy, sociology, geneaology","volume":"3","author":"Latour","year":"1994","journal-title":"Common Knowl."},{"key":"B32","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1086\/421123","article-title":"Why has critique run out of steam? from matters of fact to matters of concern","volume":"30","author":"Latour","year":"2004","journal-title":"Crit. Inq."},{"key":"B33","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/10580.001.0001","volume-title":"Democratic Experiments : Problematizing Nanotechnology and Democracy in Europe and the United States","author":"Laurent","year":"2017"},{"key":"B34","volume-title":"Traduction\/Trahison: Notes on ANT","author":"Law","year":"2003"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1162\/qss_a_00062","article-title":"From indicators to indicating interdisciplinarity: a participatory mapping methodology for research communities in-the-making","volume":"1","author":"Marres","year":"2020","journal-title":"Quant. Sci. Stud."},{"key":"B36","first-page":"199","article-title":"Defining \u2018responsible' in responsible research and innovation: the case of quadruple helix innovation in the energy sector in the Tampere region,","volume-title":"Social Innovation in Higher Education. Innovation, Technology, and Knowledge Management","author":"Mehari","year":"2022"},{"key":"B37","doi-asserted-by":"crossref","DOI":"10.7208\/chicago\/9780226261317.001.0001","volume-title":"The Seductions of Quantification: Measuring Human Rights, Gender Violence, and Sex Trafficking","author":"Merry","year":"2016"},{"key":"B38","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1080\/23299460.2014.882064","article-title":"Responsible Innovation, the art and craft of anticipation","volume":"1","author":"Nordmann","year":"2014","journal-title":"J. Responsible Innov."},{"key":"B39","volume-title":"Re-Thinking Science. Knowledge and the Public in an Age of Uncertainty.","author":"Nowotny","year":"2001"},{"key":"B40","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1093\/scipol\/scs093","article-title":"Responsible research and innovation: from science in society to science for society, with society","volume":"39","author":"Owen","year":"2012","journal-title":"Sci. Public Policy"},{"key":"B41","volume-title":"Trust in Numbers. The Pursuit of Objectivity in Science and Public Life.","author":"Porter","year":"1995"},{"key":"B42","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1177\/0306312710380301","article-title":"Matters of care in technoscience: assembling neglected things","volume":"41","author":"Puig de la Bellacasa","year":"2011","journal-title":"Soc. Stud. Sci."},{"key":"B43","volume-title":"Matters of Care: Speculative Ethics in More than Human Worlds. Matters of Care: Speculative Ethics in More than Human Worlds","author":"Puig de la Bellacasa","year":"2017"},{"key":"B44","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1080\/23299460.2016.1255701","article-title":"The clothes of the emperor. An essay on RRI in and around Brussels","volume":"3","author":"Rip","year":"2016","journal-title":"J. Responsible Innov."},{"key":"B45","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/978-1-4020-8416-4_4","article-title":"Constructive technology assessment and socio-technical scenarios,","volume-title":"The Yearbook of Nanotechnology in Society, Volume I: Presenting Futures","author":"Rip","year":"2008"},{"key":"B46","volume-title":"Seeing like a State: How Certain Schemes to Improve the Human Condition Have Failed","author":"Scott","year":"1998"},{"key":"B47","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1093\/reseval\/rvz032","article-title":"Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?","volume":"29","author":"Sivertsen","year":"2020","journal-title":"Res. Eval"},{"key":"B48","first-page":"144","article-title":"Technologies of participation and the making of technologized futures,","volume-title":"Remaking Participation: Science, Environment and Emergent Publics","author":"Soneryd","year":"2015"},{"key":"B49","first-page":"155","article-title":"Translating participation: scenario workshops and citizens' juries across situations and contexts,","volume-title":"Knowing Governance. The Epistemic Construction of Political Order","author":"Soneryd","year":"2016"},{"key":"B50","first-page":"72","article-title":"Framework analysis: a qualitative methodology for applied policy research","volume":"4","author":"Srivastava","year":"2009","journal-title":"J. Adm. Gov."},{"key":"B51","doi-asserted-by":"publisher","first-page":"1568","DOI":"10.1016\/j.respol.2013.05.008","article-title":"Developing a framework for responsible innovation","volume":"42","author":"Stilgoe","year":"2013","journal-title":"Res. Policy"},{"key":"B52","doi-asserted-by":"publisher","first-page":"56","DOI":"10.22163\/fteval.2019.368","article-title":"Striving for reflexive science","volume":"48","author":"Strand","year":"2019","journal-title":"Fteval J. Res. Technol. Policy Eval."},{"key":"B53","doi-asserted-by":"crossref","first-page":"42","DOI":"10.4324\/9780429298998-4","article-title":"Locomotive breath? Post festum reflections on the EC Expert Group on Policy Indicators for Responsible Research and Innovation,","volume-title":"Assessment of Responsible Innovation: Methods and Practices","author":"Strand","year":"2020"},{"key":"B54","first-page":"63","article-title":"Die projektf\u00f6rmigkeit der forschung","volume":"1","author":"Torka","year":"2006","journal-title":"Die Hochschule"},{"key":"B55","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1177\/0963662513515371","article-title":"The politics of buzzwords at the interface of technoscience, market and society: the case of \u2018public engagement in science.'","volume":"23","author":"Vincent","year":"2014","journal-title":"Public Underst. Sci."},{"key":"B56","volume-title":"The Innovation Delusion : How Our Obsession with the New Has Disrupted the Work That Matters Most","author":"Vinsel","year":"2020"},{"key":"B57","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1080\/14759551.2019.1699092","article-title":"Indicator development as a site of collective imagination? The case of european commission policies on the circular economy","volume":"26","author":"V\u00f6lker","year":"2020","journal-title":"Cult. Organ."},{"key":"B58","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/978-3-531-93468-6_2","article-title":"Prospects for technology assessment in a framework of responsible research and innovation,","volume-title":"Technikfolgen Absch\u00e4tzen Lehren: Bildungspotenziale Transdisziplin\u00e4rer Methode","author":"von Schomberg","year":"2012"},{"key":"B59","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1080\/23299460.2014.963004","article-title":"Quality criteria and indicators for responsible research and innovation: learning from transdisciplinarity","volume":"1","author":"Wickson","year":"2014","journal-title":"J. Responsible Innov."},{"key":"B60","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1159\/000092659","article-title":"Public engagement as a means of restoring public trust in science\u2013hitting the notes, but missing the music?","volume":"9","author":"Wynne","year":"2006","journal-title":"Public Health Genom."},{"key":"B61","doi-asserted-by":"crossref","DOI":"10.4324\/9780429298998","volume-title":"Assessment of Responsible Innovation: Methods and Practices","author":"Yaghmaei","year":"2020"}],"container-title":["Frontiers in Research Metrics and Analytics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2022.1038970\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T11:11:25Z","timestamp":1673262685000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2022.1038970\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,9]]},"references-count":61,"alternative-id":["10.3389\/frma.2022.1038970"],"URL":"https:\/\/doi.org\/10.3389\/frma.2022.1038970","relation":{},"ISSN":["2504-0537"],"issn-type":[{"value":"2504-0537","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,9]]},"article-number":"1038970"}}