{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T15:23:10Z","timestamp":1772119390874,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,11,27]],"date-time":"2023-11-27T00:00:00Z","timestamp":1701043200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,27]],"date-time":"2023-11-27T00:00:00Z","timestamp":1701043200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"crossref","award":["825003 (DIH-HERO project)"],"award-info":[{"award-number":["825003 (DIH-HERO project)"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"crossref","award":["TIN2017-85409-P"],"award-info":[{"award-number":["TIN2017-85409-P"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Department of Education, Universities and Research of the Basque Government","award":["IT1437-22"],"award-info":[{"award-number":["IT1437-22"]}]},{"name":"Ministry of Economy and Competitiveness of the Spanish Government"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Univ Access Inf Soc"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Human participation in technological research projects has become more frequent in recent years. However, most of the technological researchers who organize such experimentation are unaware about the various ethical and legal implications involved. Further, when it is a medical device prototype that is being evaluated, the ethical and legal implications may be even more complex. A review of the laws, standards and recommendations in Europe has been drawn up regarding human participation in new technology co-design, development and evaluation, focusing on technological research for assistive and medical devices. An easy-to-use tool, called Ethool, which acts as a guideline for European technological researchers has been designed and developed. In this manuscript, the iterative usability evaluation of Ethool is explained as well as the improvements made, following participants\u2019 feedback. Ethool was rated as acceptable and usable by participants obtaining a SUS score of 93.0 in its last evaluation. The tool is currently available to be used by any interested parties with the aim of gathering additional feedback.<\/jats:p>","DOI":"10.1007\/s10209-023-01052-4","type":"journal-article","created":{"date-parts":[[2023,11,26]],"date-time":"2023-11-26T22:01:42Z","timestamp":1701036102000},"page":"475-486","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Ethool, a tool to enable legal decision-making in research involving humans using new technologies in Europe: design and usability validation"],"prefix":"10.1007","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0391-2879","authenticated-orcid":false,"given":"Ainara","family":"Garzo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1561-4799","authenticated-orcid":false,"given":"Nestor","family":"Garay-Vitoria","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,11,27]]},"reference":[{"key":"1052_CR1","unstructured":"International Organization for Standardization: ISO 9241\u2013210: 2010 Ergonomics of human-system interaction\u2014part 210: human-centred design for interactive systems (2010)"},{"key":"1052_CR2","unstructured":"Marcos Mu\u00f1oz, M.J., Marijuan, M.: Investigaci\u00f3n con personas fuera del \u00e1mbito sanitario: estudios de comportamiento, psicolog\u00eda, ciencias del deporte y otros. \u00bfC\u00f3mo la evaluamos en los CEI? In: Arribas, M.C.M. (ed.) VI Congreso ANCEI. Asociaci\u00f3n Nacional de Comit\u00e9s de \u00c9tica de la Investigaci\u00f3n (ANCEI), pp. 39\u201341. Tarragona (2019)"},{"key":"1052_CR3","doi-asserted-by":"crossref","unstructured":"Garzo, A., Garay-Vitoria, N.: Ethical issues for user involvement in technological research projects: directives and recommendations. In: Sethy, S.S. (ed.) Contemporary Ethical Issues in Engineering, pp. 251\u2013269. IGI Global (2015)","DOI":"10.4018\/978-1-4666-8130-9.ch017"},{"key":"1052_CR4","unstructured":"Harvard University. Committee on the Use of Human Subjects: Required Ethics Training Overview. https:\/\/cuhs.harvard.edu\/required-ethics-training (2020)"},{"key":"1052_CR5","unstructured":"UC Berkeley: CITI Training: Required Human Subjects Research Training for UC Berkeley Faculty, Staff, and Students. https:\/\/cphs.berkeley.edu\/training.html (2020)"},{"key":"1052_CR6","unstructured":"University of Colorado Boulder: CITI Training. https:\/\/www.colorado.edu\/researchinnovation\/irb\/getting-started\/citi-training"},{"key":"1052_CR7","unstructured":"Eberhard Karls Universit\u00e4t T\u00fcbingen: Certificate \u201cEthics in practice\u201d. https:\/\/uni-tuebingen.de\/en\/facilities\/central-institutions\/international-center-for-ethics-in-the-sciences-and-humanities\/teaching\/ethics-in-practice\/ (2020)"},{"key":"1052_CR8","doi-asserted-by":"publisher","unstructured":"Garzo, A., Garay-Vitoria, N.: Ethical and legal implications for technological devices in clinical research in Europe: flowchart design for ethical and legal decisions in clinical research. In: ACM International Conference Proceeding Series (2021). https:\/\/doi.org\/10.1145\/3471391.3471403","DOI":"10.1145\/3471391.3471403"},{"key":"1052_CR9","unstructured":"World Medical Association: WMA Declaration of Helsinki\u2014Ethical Principles for Scientific Requirements and Research Protocols. https:\/\/www.wma.net\/policies-post\/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects\/ (2013)"},{"key":"1052_CR10","unstructured":"European Parliament and the Council: Regulation No 536\/2014 of the European Parliament and of the Council of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001\/20\/EC. Strasbourg (2014)"},{"key":"1052_CR11","doi-asserted-by":"crossref","unstructured":"Council of Europe: Convention for the Protection of Human Rights and Dignity of the Human Being with regard to the Application of Biology and Medicine: Convention on Human Rights and Biomedicine (1997)","DOI":"10.1353\/ken.1997.0021"},{"key":"1052_CR12","unstructured":"European Council: Directive 93\/42\/EEC of 14 June 1993 concerning medical devices. Luxembourg (1993)"},{"key":"1052_CR13","unstructured":"European Parliament and the Council: Regulation (EU) 2017\/745 of the European parliament and of the council of 5 April 2017 on medical devices, amending Directive 2001\/83\/EC, Regulation (EC) No 178\/2002 and Regulation (EC) No 1223\/2009 and repealing Council Directives 90\/385\/EEC and 93\/42\/EE. Strasbourg (2017)"},{"key":"1052_CR14","unstructured":"European Parliament and the Council: Regulation 2020\/561 of the European Parliament and of the Council of 23 April 2020 amending Regulation (EU) 2017\/745 on medical devices, as regards the dates of application of certain of its provisions. Brussels (2020)"},{"key":"1052_CR15","unstructured":"European Commission. Medical Devices\u2014Sector: Contact Points of National Authorities. https:\/\/ec.europa.eu\/health\/sites\/health\/files\/md_sector\/docs\/md_contact_points_of_national_authorities.pdf"},{"key":"1052_CR16","unstructured":"International Organization for Standardization: ISO 14155:2011. Clinical Investigation of Medical Devices for Human Subjects\u2014Good Clinical Practice (2011)"},{"key":"1052_CR17","unstructured":"International Conference on Harmonisation (ICH): ICH Harmonised Tripartite Guideline for Good Clinical Practice E6(R1) (1996)"},{"key":"1052_CR18","doi-asserted-by":"publisher","first-page":"52","DOI":"10.18359\/rlbi.535","volume":"15","author":"M Florencia Santi","year":"2015","unstructured":"Florencia Santi, M.: Vulnerabilidad y \u00e9tica de la investigaci\u00f3n social: perspectivas actuales. Rev. Latinoam. Bioet. 15, 52 (2015). https:\/\/doi.org\/10.18359\/rlbi.535","journal-title":"Rev. Latinoam. Bioet."},{"key":"1052_CR19","unstructured":"Clinical Trials in the European Union\u2014EMA. https:\/\/euclinicaltrials.eu\/"},{"key":"1052_CR20","unstructured":"Federal Office of Public health (FOPH) and Federal Department of Home Affairs (FDHA).: Swiss National Clinical Trials Portal (SNCTP Portal). https:\/\/www.kofam.ch\/en\/snctp-portal\/"},{"key":"1052_CR21","unstructured":"U.S. National Library of Medicine: ClinicalTrials.gov. https:\/\/clinicaltrials.gov\/ (2020)"},{"key":"1052_CR22","unstructured":"World Health Organization: International Clinical Trials Registry Platform (ICRTRP). https:\/\/www.who.int\/clinical-trials-registry-platform (2020)"},{"key":"1052_CR23","unstructured":"Microsoft 365: Microsoft Forms. https:\/\/forms.office.com\/ (2020)"},{"key":"1052_CR24","unstructured":"European Parliament and the Council: Regulation (EU) 2016\/679 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data (General Data Protection Regulation\u2014GDPR) (2016)"},{"key":"1052_CR25","unstructured":"Nielsen, J.: Usability 101: Introduction to Usability. https:\/\/www.nngroup.com\/articles\/usability-101-introduction-to-usability\/ (2012)"},{"key":"1052_CR26","unstructured":"Flor\u00eda Cort\u00e9s, A.: Algunos cuestionarios conocidos. http:\/\/www.sidar.org\/recur\/desdi\/traduc\/es\/visitable\/nuevos\/CuestCon.htm (2000)"},{"key":"1052_CR27","unstructured":"Sauro, J.: Measuring Usability with the System Usability Scale (SUS). https:\/\/measuringu.com\/sus\/ (2011)"},{"key":"1052_CR28","doi-asserted-by":"crossref","unstructured":"Nielsen, J., Landauer, J.: A mathematical model of finding the usability problem. Proceedings of the CHI 93 proceedings of the interact conference on human factors in computing systems. In: Proceedings of ACM INTERCHI\u201993 Conference, pp. 206\u2013213. Amsterdam (1993)","DOI":"10.1145\/169059.169166"},{"key":"1052_CR29","unstructured":"Nielsen, J.: Why You Only Need to Test with 5 Users. https:\/\/www.nngroup.com\/articles\/why-you-only-need-to-test-with-5-users\/ (2000)"},{"key":"1052_CR30","unstructured":"Euskal Herriko Unibertsitatea: CEID: Comisi\u00f3n de \u00c9tica. https:\/\/www.ehu.eus\/es\/web\/ceid\/ceish\/comite"},{"key":"1052_CR31","unstructured":"Ley 14\/2007, de 3 de julio, de Investigaci\u00f3n biom\u00e9dica. Madrid (2007)"},{"key":"1052_CR32","first-page":"29","volume":"8","author":"J Brooke","year":"2013","unstructured":"Brooke, J.: SUS: a retrospective. J. Usability Stud. 8, 29\u201340 (2013)","journal-title":"J. Usability Stud."},{"key":"1052_CR33","unstructured":"Garzo, A.: sus_process. https:\/\/github.com\/agarzo\/sus_process (2020)"},{"key":"1052_CR34","first-page":"114","volume":"4","author":"A Bangor","year":"2009","unstructured":"Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Stud. 4, 114\u2013123 (2009)","journal-title":"J. Usability Stud."},{"key":"1052_CR35","doi-asserted-by":"publisher","DOI":"10.1109\/TETC.2020.3037962","author":"E Pedroli","year":"2020","unstructured":"Pedroli, E., Cipresso, P., Greci, L., Arlati, S., Mahroo, A., Mancuso, V., Rossi, M., Stefanelli, L., Goulene, K., Sacco, M., Stramba-badiale, M., Riva, G., Gaggioli, A.: A new application for the motor rehabilitation at home: structure and usability of bal-app. IEEE Trans. Emerg. Top. Comput. (2020). https:\/\/doi.org\/10.1109\/TETC.2020.3037962","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"1052_CR36","unstructured":"Guidance Tool\u2014Robotic Devices Evaluation with Human Beings\u2014Digital Innovation Hubs, https:\/\/dih-hero.eu\/ethics-tool\/"},{"key":"1052_CR37","doi-asserted-by":"publisher","DOI":"10.21227\/m8yv-0133","author":"A Garzo","year":"2021","unstructured":"Garzo, A., Garay-Vitoria, N.: Ethool usability evaluation. IEEE Dataport (2021). https:\/\/doi.org\/10.21227\/m8yv-0133","journal-title":"IEEE Dataport"}],"container-title":["Universal Access in the Information Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10209-023-01052-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10209-023-01052-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10209-023-01052-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,11]],"date-time":"2025-03-11T08:15:31Z","timestamp":1741680931000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10209-023-01052-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,27]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["1052"],"URL":"https:\/\/doi.org\/10.1007\/s10209-023-01052-4","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2328902\/v1","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.3.rs-2328902\/v2","asserted-by":"object"}]},"ISSN":["1615-5289","1615-5297"],"issn-type":[{"value":"1615-5289","type":"print"},{"value":"1615-5297","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,27]]},"assertion":[{"value":"4 October 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 November 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No potential competing interest was reported by the authors.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Presented work was approved on 23 May 2019 under protocol number M10\/\/2019\/128 (document 113\/2019) by the Ethical Committee of the University of the Basque Country University for Research involving Human Beings (CEISH-UPV\/EHU) which has number BOPV 32, 17\/2\/2014.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}