{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,13]],"date-time":"2025-09-13T16:42:34Z","timestamp":1757781754646,"version":"3.38.0"},"reference-count":19,"publisher":"China Science Publishing & Media Ltd.","issue":"2","license":[{"start":{"date-parts":[[2022,3,7]],"date-time":"2022-03-07T00:00:00Z","timestamp":1646611200000},"content-version":"vor","delay-in-days":65,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Sharing sensitive data is a specific challenge for research infrastructures in the field of life sciences. For that reason a toolbox has been developed, providing resources for researchers who wish to share and use sensitive data, to support the workflows for handling these kinds of digital objects. Common and community approved annotations are required to be compliant with FAIR principles (Findability, Accessibility, Interoperability, Reusability). The toolbox makes use of a tagging (categorisation) system, allowing consistent labelling and categorisation of digital objects, in terms relevant to data sharing tasks and activities. A pilot study was performed within the Horizon 2020 project EOSC-Life, in which 2 experts from 6 life sciences research infrastructures were recruited to independently assign tags to the same set of 10 to 25 resources related to sensitive data management and data sharing (in total 110). Summary statistics of agreement and observer variation per research infrastructure are provided. The pilot study has shown that experts were able to attribute tags but in most cases with a considerable observer variation between experts. In the context of CWFR (Canonical Workflow Frameworks for Research), this indicates the necessity for careful definition, evaluation and validation of parameters and processes related to workflow descriptions. The results from this pilot study were used to tackle this issue by revising the categorisation system and providing an updated version.<\/jats:p>","DOI":"10.1162\/dint_a_00126","type":"journal-article","created":{"date-parts":[[2022,3,7]],"date-time":"2022-03-07T18:06:44Z","timestamp":1646676404000},"page":"196-211","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Pilot Study on the Intercalibration of a Categorisation System for\n                    FAIRer Digital Objects Related to Sensitive Data in the Life\n                    Sciences"],"prefix":"10.3724","volume":"4","author":[{"given":"Christian","family":"Ohmann","sequence":"first","affiliation":[{"name":"European Clinical Research Infrastructure Network (ECRIN), Paris 75013, France"}]},{"given":"Romain","family":"David","sequence":"additional","affiliation":[{"name":"European Research Infrastructure on Highly Pathogenic Agents (ERINHA AISBL), Brussels 1000, Belgium"}]},{"given":"M\u00f3nica Cano","family":"Abadia","sequence":"additional","affiliation":[{"name":"Biobanking and Biomolecular Resources Research Infrastructure (BBMRI), Graz 8010, Austria"}]},{"given":"Florence","family":"Bietrix","sequence":"additional","affiliation":[{"name":"European Infrastructure for Translational Medicine (EATRIS), Amsterdam 1081 HZ, The Netherlands"}]},{"given":"Jan-Willem","family":"Boiten","sequence":"additional","affiliation":[{"name":"European Advanced Translational Research Infrastructure (EATRIS)\/Lygature, Utrecht 3521 AL, The Netherlands"}]},{"given":"Steve","family":"Canham","sequence":"additional","affiliation":[{"name":"European Clinical Research Infrastructure Network (ECRIN), Paris 75013, France"}]},{"given":"Maria Luisa","family":"Chiusano","sequence":"additional","affiliation":[{"name":"European Marine Biological Resource Centre (EMBRC)\u2014Department of Agricultural Sciences, University Federico II of Naples via Universit\u00e0, Naples 80138, Italy"}]},{"given":"Walter","family":"Dastr\u00f9","sequence":"additional","affiliation":[{"name":"Department of Molecular Biotechnology and Health Sciences, Molecular Imaging Center, University of Torino, Torino I-10125, Italy"}]},{"given":"Arnaud","family":"Laroquette","sequence":"additional","affiliation":[{"name":"European Marine Biological Resource Centre (EMBRC), Paris 75252, France"}]},{"given":"Dario","family":"Longo","sequence":"additional","affiliation":[{"name":"European Research Infrastructure for Biological and Biomedical Imaging (Euro-BioImaging), Torino 10126, Italy"}]},{"given":"Michaela Theresia","family":"Mayrhofer","sequence":"additional","affiliation":[{"name":"Biobanking and Biomolecular Resources Research Infrastructure (BBMRI), Graz 8010, Austria"}]},{"given":"Maria","family":"Panagiotopoulou","sequence":"additional","affiliation":[{"name":"European Clinical Research Infrastructure Network (ECRIN), Paris 75013, France"}]},{"given":"Audrey","family":"Richard","sequence":"additional","affiliation":[{"name":"European Research Infrastructure on Highly Pathogenic Agents (ERINHA AISBL), Brussels 1000, Belgium"}]},{"given":"Pablo Emilio","family":"Verde","sequence":"additional","affiliation":[{"name":"Coordination Centre for Clinical Trials, Heinrich Heine University D\u00fcsseldorf Ringgold standard institution, Nordrhein-Westfalen 40225, Germany"}]}],"member":"2026","published-online":{"date-parts":[[2022,4,1]]},"reference":[{"volume-title":"EOSC-LIFE WP4 toolbox","year":"2021","author":"Boiten","key":"2022042714421835600_ref1"},{"volume-title":"Nagoya protocol on access to genetic resources and the Fair and\n                        equitable sharing of benefits arising from their utilization to the\n                        convention on biological diversity","year":"2013","author":"Secretariat of the Convention on Biological Diversity","key":"2022042714421835600_ref2"},{"issue":"1","key":"2022042714421835600_ref3","doi-asserted-by":"crossref","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR guiding principles for scientific data management\n                        and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Scientific Data"},{"volume-title":"EOSC-Life WP4 toolbox: Categorisation system for resources to be\n                        referenced in the toolbox for sharing of sensitive data (Version\n                    1)","author":"Ohmann","key":"2022042714421835600_ref4"},{"volume-title":"Frascati Manual 2015: Guidelines for collecting\n                        and reporting data on research and experimental development, the measurement\n                        of scientific, technological and innovation activities","author":"OECD","key":"2022042714421835600_ref5"},{"volume-title":"Subject ranking\n                        2015-2016: Life sciences top 100","author":"The world university rankings","key":"2022042714421835600_ref6"},{"volume-title":"Web of Science core collection\n                        help: Research areas (Categories\/classification)","author":"Clarivate Analytics","key":"2022042714421835600_ref7"},{"volume-title":"Australian and New\n                        Zealand Standard Research Classification (ANZSRC)","author":"Australian Bureau of Statistics","key":"2022042714421835600_ref8"},{"volume-title":"Research\n                        data management team","year":"2013","author":"Van den\n                                Eynden","key":"2022042714421835600_ref9"},{"volume-title":"Classification of processes involved in sharing individual\n                        participant data from clinical trials [version 2; peer review: 3\n                        approved]","year":"2018","author":"Ohmann","key":"2022042714421835600_ref10"},{"volume-title":"Statistics Division: Standard country or area codes for statistical\n                        use (M49)","year":"1999","author":"United Nations, Department of Economic and Social Affairs","key":"2022042714421835600_ref11"},{"volume-title":"Canonical Workflow Framework for Research (CWFR)\u2014position\n                        paper\u2014 version 2, December 2020","author":"Hardisty","key":"2022042714421835600_ref12"},{"key":"2022042714421835600_ref13","article-title":"Evaluating FAIR maturity through a scalable, automated,\n                        community-governed framework","volume":"6","author":"Wilkinson","year":"2019","journal-title":"Scientific\n                        Data"},{"issue":"40","key":"2022042714421835600_ref14","first-page":"1","article-title":"From FAIR leading practices to FAIR implementation and back:\n                        An inclusive approach to FAIR at Leiden University\n                    Libraries","volume":"19","author":"Hettne","year":"2020","journal-title":"Data Science Journal"},{"issue":"41","key":"2022042714421835600_ref15","first-page":"1","article-title":"The FAIR data maturity model: An approach to harmonise FAIR\n                        assessments","volume":"19","author":"Bahim","year":"2020","journal-title":"Data Science Journal"},{"volume-title":"EOSC-Life WP4 toolbox: Pilot study protocol for the evaluation of\n                        the categorisation system (Version 1)","year":"2020","author":"Ohmann","key":"2022042714421835600_ref16"},{"issue":"5","key":"2022042714421835600_ref17","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many\n                        raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychological Bulletin"},{"volume-title":"Interactions about CWFR at RDA BoF","year":"2021","author":"Peer","key":"2022042714421835600_ref18"},{"issue":"1","key":"2022042714421835600_ref19","doi-asserted-by":"crossref","first-page":"32","DOI":"10.5334\/dsj-2020-032","article-title":"The Research Data Alliance\u2014SHAring Reward and Credit\n                        (SHARC) Interest Group: FAIRness literacy: The Achilles' heel of\n                        applying FAIR principles","volume":"19","author":"David","year":"2020","journal-title":"Data Science\n                        Journal"}],"container-title":["Data Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/dint\/article-pdf\/4\/2\/196\/2012348\/dint_a_00126.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/dint\/article-pdf\/4\/2\/196\/2012348\/dint_a_00126.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T07:43:46Z","timestamp":1741938226000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.sciengine.com\/doi\/10.1162\/dint_a_00126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":19,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,4,1]]}},"URL":"https:\/\/doi.org\/10.1162\/dint_a_00126","relation":{},"ISSN":["2641-435X"],"issn-type":[{"type":"electronic","value":"2641-435X"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}