{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,15]],"date-time":"2026-08-15T16:50:54Z","timestamp":1786812654694,"version":"build-2736575974"},"reference-count":128,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T00:00:00Z","timestamp":1748217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>As testified by new regulations like the European AI Act, worries about the human and societal impact of (autonomous) software technologies are becoming of public concern. Human, societal, and environmental values, alongside traditional software quality, are increasingly recognized as essential for sustainability and long-term well-being. Traditionally, systems are engineered taking into account business goals and technology drivers. Considering the growing awareness in the community, in this article, we argue that engineering of systems should also consider human, societal, and environmental drivers. Then, we identify the macro and technological challenges by focusing on humans and their role while co-existing with digital systems. The first challenge considers humans in a proactive role when interacting with digital systems, i.e., taking initiative in making things happen instead of reacting to events. The second concerns humans having a reactive role in interacting with digital systems, i.e., humans interacting with digital systems as a reaction to events. The third challenge focuses on humans with a passive role, i.e., they experience, enjoy or even suffer the decisions and\/or actions of digital systems. The fourth challenge concerns the duality of trust and trustworthiness, with humans playing any role. Building on the new human, societal, and environmental drivers and the macro and technological challenges, we identify a research roadmap of digital systems for humanity. The research roadmap is concretized in a number of research directions organized into four groups: development process, requirements engineering, software architecture and design, and verification and validation.<\/jats:p>","DOI":"10.1145\/3712006","type":"journal-article","created":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T16:03:31Z","timestamp":1736784211000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Engineering Digital Systems for Humanity: A Research Roadmap"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5951-1567","authenticated-orcid":false,"given":"Marco","family":"Autili","sequence":"first","affiliation":[{"name":"University of L\u2019Aquila, L\u2019Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9417-660X","authenticated-orcid":false,"given":"Martina","family":"De Sanctis","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Gran Sasso Science Institute, L\u2019Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6734-1318","authenticated-orcid":false,"given":"Paola","family":"Inverardi","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Gran Sasso Science Institute, L\u2019Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5438-2281","authenticated-orcid":false,"given":"Patrizio","family":"Pelliccione","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Gran Sasso Science Institute, L\u2019Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,26]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Chemicool Dictionary. 2020. Definition of technology driver. Retrieved November 8 2020 from https:\/\/www.chemicool.com\/definition\/technology_driver.html"},{"key":"e_1_3_2_3_2","unstructured":"Institute of Electrical and Electronics Engineers (IEEE). 2019. Version 2. Ethically aligned design\u2013a vision for prioritizing human well-being with autonomous and intelligent systems. Retrieved from https:\/\/standards.ieee.org\/wp-content\/uploads\/import\/documents\/other\/ead_v2.pdf"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3624699"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3466819"},{"key":"e_1_3_2_6_2","first-page":"36","article-title":"In search of clarity: discerning between human replacement and augmentation","author":"Alfieri Costanza","year":"2024","unstructured":"Costanza Alfieri, Martina De Sanctis, Donatella Donati, and Paola Inverardi. 2024. In search of clarity: discerning between human replacement and augmentation. In Hybrid Human Artificial Intelligence (HHAI), 36\u201345.","journal-title":"Hybrid Human Artificial Intelligence (HHAI)"},{"key":"e_1_3_2_7_2","first-page":"128","volume-title":"1st International Conference on Hybrid Human-Artificial Intelligence (HHAI \u201922)","author":"Alfieri Costanza","year":"2022","unstructured":"Costanza Alfieri, Paola Inverardi, Patrizio Migliarini, and Massimiliano Palmiero. 2022. Exosoul: Ethical profiling in the digital world. In 1st International Conference on Hybrid Human-Artificial Intelligence (HHAI \u201922). Stefan Schlobach, Mar\u00eda P\u00e9rez-Ortiz, and Myrthe Tielman (Eds.), IOS Press, 128\u2013142. DOI: 10.3233\/FAIA220194"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781351009805"},{"key":"e_1_3_2_9_2","first-page":"245","volume-title":"International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS)","author":"Askarpour Mehrnoosh","year":"2021","unstructured":"Mehrnoosh Askarpour, Christos Tsigkanos, Claudio Menghi, Radu Calinescu, Patrizio Pelliccione, Sergio Garc\u00eda, Ricardo Caldas, Tim J. von Oertzen, Manuel Wimmer, Luca Berardinelli, et al. 2021. RoboMAX: Robotic mission adaptation eXemplars. In International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), 245\u2013251."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2916203"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2015.2398877"},{"issue":"7729","key":"e_1_3_2_12_2","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1038\/s41586-018-0637-6","article-title":"The moral machine experiment","volume":"563","author":"Awad Edmond","year":"2018","unstructured":"Edmond Awad, Sohan Dsouza, Richard Kim, Jonathan Schulz, Joseph Henrich, Azim Shariff, Jean-Fran\u00e7ois Bonnefon, and Iyad Rahwan. 2018. The moral machine experiment. Nature 563, 7729 (2018), 59\u201364. Retrieved from https:\/\/www.nature.com\/articles\/s41586-018-0637-6","journal-title":"Nature"},{"key":"e_1_3_2_13_2","first-page":"200","volume-title":"3rd International Conference on AI Engineering: Software Engineering for AI (CAIN \u201924)","author":"Baldassarre Maria Teresa","year":"2024","unstructured":"Maria Teresa Baldassarre, Domenico Gigante, Marcos Kalinowski, and Azzurra Ragone. 2024. POLARIS: A framework to guide the development of trustworthy AI systems. In 3rd International Conference on AI Engineering: Software Engineering for AI (CAIN \u201924). IEEE\/ACM, 200\u2013210."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.11.041"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-75632-5_1"},{"issue":"5","key":"e_1_3_2_16_2","first-page":"358","article-title":"Design Science research contributions: Finding a balance between artifact and theory","volume":"19","author":"Baskerville Richard","year":"2018","unstructured":"Richard Baskerville, Abayomi Baiyere, Shirley Gregor, Alan Hevner, and Matti Rossi. 2018. Design Science research contributions: Finding a balance between artifact and theory. J. Assoc. for Inf. Syst. 19, 5 (2018), 358\u2013376.","journal-title":"J. Assoc. for Inf. Syst."},{"key":"e_1_3_2_17_2","volume-title":"Software Architecture in Practice","author":"Bass Len","year":"2012","unstructured":"Len Bass, Paul Clements, and Rick Kazman. 2012. Software Architecture in Practice (3rd ed.). Addison-Wesley Professional.","edition":"3"},{"key":"e_1_3_2_18_2","first-page":"467","volume-title":"37th IEEE\/ACM International Conference on Software Engineering (ICSE \u201915)IEEE Computer Society","author":"Becker Christoph","year":"2015","unstructured":"Christoph Becker, Ruzanna Chitchyan, Leticia Duboc, Steve Easterbrook, Birgit Penzenstadler, Norbert Seyff, and Colin C. Venters. 2015. Sustainability design and software: The Karlskrona manifesto. In 37th IEEE\/ACM International Conference on Software Engineering (ICSE \u201915). Antonia Bertolino, Gerardo Canfora, and Sebastian G. Elbaum (Eds.), IEEE Computer Society, 467\u2013476. DOI: 10.1109\/ICSE.2015.179"},{"key":"e_1_3_2_19_2","first-page":"175","volume-title":"45th IEEE\/ACM International Conference on Software Engineering: Software Engineering in Society (SEIS@ICSE \u201923)","author":"Bennaceur Amel","year":"2023","unstructured":"Amel Bennaceur, Diane Hassett, Bashar Nuseibeh, and Andrea Zisman. 2023. Values@Runtime: An adaptive framework for operationalising values. In 45th IEEE\/ACM International Conference on Software Engineering: Software Engineering in Society (SEIS@ICSE \u201923). IEEE, 175\u2013179. DOI: 10.1109\/ICSE-SEIS58686.2023.00024"},{"key":"e_1_3_2_20_2","unstructured":"D. Benyon. 2013. Designing Interactive Systems: A Comprehensive Guide to HCI UX and Interaction Design. Pearson. Retrieved from https:\/\/books.google.it\/books?id=HeW6mgEACAAJ"},{"issue":"5","key":"e_1_3_2_21_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3447240","article-title":"A survey of field-based testing techniques","volume":"54","author":"Bertolino Antonia","year":"2021","unstructured":"Antonia Bertolino, Pietro Braione, Guglielmo De Angelis, Luca Gazzola, Fitsum Kifetew, Leonardo Mariani, Matteo Orr\u00f9, Mauro Pezz\u00e8, Roberto Pietrantuono, Stefano Russo, et al. 2021. A survey of field-based testing techniques. ACM Computing Surveys (CSUR) 54, 5 (2021), 1\u201339.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_3_2_22_2","unstructured":"United nations AI Advisory Body. 2024. Governing Ai for humanity. Retrieved from https:\/\/www.un.org\/sites\/un2.un.org\/files\/governing_ai_for_humanity_final_report_en.pdf"},{"key":"e_1_3_2_23_2","first-page":"200","volume-title":"19th International Conference on Software Engineering for Adaptive and Self-Managing Systems (SEAMS@ICSE)","author":"Boltz Nicolas","year":"2024","unstructured":"Nicolas Boltz, Sinem Getir Yaman, Paola Inverardi, Rog\u00e9rio de Lemos, Dimitri Van Landuyt, and Andrea Zisman. 2024. Human empowerment in self-adaptive socio-technical systems. In 19th International Conference on Software Engineering for Adaptive and Self-Managing Systems (SEAMS@ICSE), 200\u2013206."},{"issue":"107","key":"e_1_3_2_24_2","article-title":"The Brussels effect","volume":"1","author":"Bradford Anu","year":"2012","unstructured":"Anu Bradford. 2012. The Brussels effect. Nw. U. L. Rev. 1, 107 (2012). Retrieved from https:\/\/scholarship.law.columbia.edu\/faculty_scholarship\/271","journal-title":"Nw. U. L. Rev."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-9198-0_11"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1145\/1882362.1882373","volume-title":"FSE\/SDP Workshop on the Future of Software Engineering Research at ACM (SIGSOFT FSE-18)","author":"Brown N.","year":"2010","unstructured":"N. Brown, Y. Cai, Y. Guo, R. Kazman, M. Kim, P. Kruchten, E. Lim, A. MacCormack, R. Nord, I. Ozkaya, R. Sangwan, C. Seaman, K. Sullivan, and N. Zazworka. 2010. Managing technical debt in software-reliant systems. In FSE\/SDP Workshop on the Future of Software Engineering Research at ACM (SIGSOFT FSE-18), 47\u201352."},{"key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/ICSA51549.2021.00020","volume-title":"2021 IEEE 18th International Conference on Software Architecture (ICSA)","author":"Bucaioni Alessio","year":"2021","unstructured":"Alessio Bucaioni, Patrizio Pelliccione, and Rebekka Wohlrab. 2021. Aligning architecture with business goals in the automotive domain. In 2021 IEEE 18th International Conference on Software Architecture (ICSA), 126\u2013137. DOI: 10.1109\/ICSA51549.2021.00020"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3444697"},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/ACSOS49614.2020.00047","volume-title":"2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)","author":"Calinescu Radu","year":"2020","unstructured":"Radu Calinescu, Raffaela Mirandola, Diego Perez-Palacin, and Danny Weyns. 2020. Understanding uncertainty in self-adaptive systems. In 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS), 242\u2013251. DOI: 10.1109\/ACSOS49614.2020.00047"},{"key":"e_1_3_2_30_2","first-page":"429","volume-title":"29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201921)ACM","author":"Chakraborty Joymallya","year":"2021","unstructured":"Joymallya Chakraborty, Suvodeep Majumder, and Tim Menzies. 2021. Bias in machine learning software: Why? How? What to do? In 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201921). Diomidis Spinellis, Georgios Gousios, Marsha Chechik, and Massimiliano Di Penta (Eds.), ACM, 429\u2013440. DOI: 10.1145\/3468264.3468537"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2004.10.002"},{"key":"e_1_3_2_32_2","unstructured":"China. 2023. Interim administrative measures for generative artificial intelligence service. Retrieved from https:\/\/www.pillsburylaw.com\/en\/news-and-insights\/china-generative-ai-measures.html"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-022-01473-4"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3618001"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1145\/1833335.1833337","volume-title":"2010 ICSE Workshop on Sharing and Reusing Architectural Knowledge (SHARK \u201910)","author":"Clements Paul","year":"2010","unstructured":"Paul Clements and Len Bass. 2010. Business goals as architectural knowledge. In 2010 ICSE Workshop on Sharing and Reusing Architectural Knowledge (SHARK \u201910). ACM, New York, NY, 9\u201312. DOI: 10.1145\/1833335.1833337"},{"key":"e_1_3_2_36_2","unstructured":"Paul C. Clements and Leonard J. Bass. 2010. Relating business goals to architecturally significant requirements for software systems. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:110270852"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.3905\/jfds.2021.1.075"},{"key":"e_1_3_2_38_2","first-page":"11470","volume-title":"AAAI Conference on Artificial Intelligence","volume":"35","author":"Dennis Louise A.","year":"2021","unstructured":"Louise A. Dennis, Martin Mose Bentzen, Felix Lindner, and Michael Fisher. 2021. Verifiable machine ethics in changing contexts. In AAAI Conference on Artificial Intelligence 35, 13 (May 2021), 11470\u201311478. DOI: 10.1609\/aaai.v35i13.17366"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-020-00854-x"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-66494-7_12"},{"key":"e_1_3_2_41_2","volume-title":"4th National Conference on Control Architectures of Robots","author":"Durand Bastien","year":"2009","unstructured":"Bastien Durand, Karen Godary-Dejean, Lionel Lapierre, and Didier Crestani. 2009. Inconsistencies evaluation mechanisms for an hybrid control architecture with adaptive autonomy. In 4th National Conference on Control Architectures of Robots. Retrieved from https:\/\/hal-lirmm.ccsd.cnrs.fr\/lirmm-00386063v1\/file\/CAR_09_BDKGLLDC.pdf"},{"issue":"9","key":"e_1_3_2_42_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3561048","article-title":"Explainable AI (XAI): Core ideas, techniques, and solutions","volume":"55","author":"Dwivedi Rudresh","year":"2023","unstructured":"Rudresh Dwivedi, Devam Dave, Het Naik, Smiti Singhal, Rana Omer, Pankesh Patel, Bin Qian, Zhenyu Wen, Tejal Shah, Graham Morgan, et al. 2023. Explainable AI (XAI): Core ideas, techniques, and solutions. Comput. Surv. 55, 9 (2023), 1\u201333.","journal-title":"Comput. Surv."},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.robot.2019.03.003","article-title":"Cobot programming for collaborative industrial tasks: An overview","volume":"116","author":"El Zaatari Shirine","year":"2019","unstructured":"Shirine El Zaatari, Mohamed Marei, Weidong Li, and Zahid Usman. 2019. Cobot programming for collaborative industrial tasks: An overview. Rob. Auton. Syst. 116 (2019), 162\u2013180.","journal-title":"Rob. Auton. Syst."},{"key":"e_1_3_2_44_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/12440.001.0001","volume-title":"Technical Debt in Practice","author":"Ernst Neil","year":"2021","unstructured":"Neil Ernst, Julien Delange, and Rick Kazman. 2021. Technical Debt in Practice. MIT Press."},{"key":"e_1_3_2_45_2","unstructured":"European Commission. 2010. Europe 2020 a European strategy for Smart sustainable and inclusive growth. Retrieved from https:\/\/bit.ly\/2R8siwl"},{"key":"e_1_3_2_46_2","unstructured":"European Commission Directorate-General for Research and Innovation Breque M. De Nul L. Petridis. 2021. Industry 5.0 - towards a sustainable human-centric and resilient European industry. Retrieved from https:\/\/data.europa.eu\/doi\/10.2777\/308407"},{"key":"e_1_3_2_47_2","unstructured":"European Commission High-Level Expert Group on AI. 2019. The ethics guidelines for trustworthy artificial intelligence. Retrieved from https:\/\/op.europa.eu\/en\/publication-detail\/-\/publication\/d3988569-0434-11ea-8c1f-01aa75ed71a1 from the European Union."},{"issue":"2","key":"e_1_3_2_48_2","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s10009-021-00609-z","article-title":"A taxonomy for classifying runtime verification tools","volume":"23","author":"Falcone Yli\u00e8s","year":"2021","unstructured":"Yli\u00e8s Falcone, Sr\u0111an Krsti\u0107, Giles Reger, and Dmitriy Traytel. 2021. A taxonomy for classifying runtime verification tools. International Journal on Software Tools for Technology Transfer 23, 2 (2021), 255\u2013284.","journal-title":"International Journal on Software Tools for Technology Transfer"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639093"},{"issue":"1","key":"e_1_3_2_50_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13347-018-0303-9","article-title":"Soft ethics and the governance of the digital","volume":"31","author":"Floridi Luciano","year":"2018","unstructured":"Luciano Floridi. 2018. Soft ethics and the governance of the digital. Philos. Technol. 31, 1 (2018), 1\u20138.","journal-title":"Philos. Technol."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-022-10231-5"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","unstructured":"Gillespie Nicole Lockey Steven Curtis Caitlin Pool Javad and Ali Akbari. 2023. Trust in artificial intelligence: A global study. The University of Queensland KPMG Australia. DOI: 10.14264\/00d3c94","DOI":"10.14264\/00d3c94"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3236009"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.JSS.2024.111978"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1147\/sj.382.0472"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbah.2024.100043"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1038\/S41746-022-00597-7"},{"key":"e_1_3_2_58_2","volume":"12807","author":"Hevner Alan R.","year":"2021","unstructured":"Alan R. Hevner and Veda C. Storey. 2021. Externalities of Design Science Research: Preparation for Project Success. Vol. 12807 LNCS. Springer International Publishing.","journal-title":"Externalities of Design Science Research: Preparation for Project Success"},{"key":"e_1_3_2_59_2","unstructured":"High-Level Expert Group on AI. 2019 last update January 31 2024. Ethics guidelines for trustworthy AI. Retrieved from https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai"},{"key":"e_1_3_2_60_2","doi-asserted-by":"crossref","first-page":"10912","DOI":"10.1109\/ICRA48506.2021.9561240","volume-title":"2021 IEEE International Conference on Robotics and Automation (ICRA)","author":"Hildebrandt Carl","year":"2021","unstructured":"Carl Hildebrandt and Sebastian Elbaum. 2021. World-in-the-loop simulation for autonomous systems validation. In 2021 IEEE International Conference on Robotics and Automation (ICRA), 10912\u201310919. DOI: 10.1109\/ICRA48506.2021.9561240"},{"key":"e_1_3_2_61_2","first-page":"449","volume-title":"32nd ACM SIGSOFT International Symposium on Software Testing and Analysis(ISSTA 2023)","author":"Hildebrandt Carl","year":"2023","unstructured":"Carl Hildebrandt, Meriel von Stein, and Sebastian Elbaum. 2023. PhysCov: Physical test coverage for autonomous vehicles. In 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023). ACM, New York, NY, 449\u2013461. DOI: 10.1145\/3597926.3598069"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","unstructured":"Max Hort Zhenpeng Chen Jie M. Zhang Mark Harman and Federica Sarro. 2024. Bias mitigation for machine learning classifiers: A comprehensive survey. Association for Computing Machinery New York NY Vol. 1. DOI: 10.1145\/3631326","DOI":"10.1145\/3631326"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmsy.2022.07.010"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2022.2050543"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3690043"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3311783"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.COSREV.2023.100574"},{"key":"e_1_3_2_68_2","unstructured":"ISO25000. 2023. ISO\/IEC 25010 - system and software quality models. Retrieved from https:\/\/iso25000.com\/index.php\/en\/iso-25000-standards\/iso-25010"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2024.100225"},{"key":"e_1_3_2_70_2","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s10209-004-0102-1","article-title":"Interaction design: Beyond human\u2013computer interaction by Preece, Sharp and Rogers (2001)","volume":"3","author":"Kurniawan Sri","year":"2004","unstructured":"Sri Kurniawan. 2004. Interaction design: Beyond human\u2013computer interaction by Preece, Sharp and Rogers (2001). Univers. Access Inf. Soc. 3 (2004), 289\u2013289.","journal-title":"Univers. Access Inf. Soc."},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-86144-5"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmsy.2022.09.017"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2023.3240730"},{"key":"e_1_3_2_74_2","first-page":"48","volume-title":"2021 International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS)","author":"Li Nianyu","year":"2021","unstructured":"Nianyu Li, Javier C\u00e1mara, David Garlan, Bradley Schmerl, and Zhi Jin. 2021. Hey! Preparing humans to do tasks in self-adaptive systems. In 2021 International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), 48\u201358. DOI: 10.1109\/SEAMS51251.2021.00017"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640541"},{"key":"e_1_3_2_76_2","unstructured":"Qinghua Lu Liming Zhu Jon Whittle and Xiwei Xu. 2023. Responsible AI: Best Practices for Creating Trustworthy AI Systems. Pearson. Retrieved from https:\/\/books.google.it\/books?id=yFelzwEACAAJ"},{"key":"e_1_3_2_77_2","first-page":"101","volume-title":"1st International Conference on AI Engineering: Software Engineering for AI (CAIN \u201922)ACM","author":"Lu Qinghua","year":"2022","unstructured":"Qinghua Lu, Liming Zhu, Xiwei Xu, Jon Whittle, and Zhenchang Xing. 2022. Towards a roadmap on software engineering for responsible AI. In 1st International Conference on AI Engineering: Software Engineering for AI (CAIN \u201922). Ivica Crnkovic (Ed.). ACM, 101\u2013112. DOI: 10.1145\/3522664.3528607"},{"key":"e_1_3_2_78_2","unstructured":"Madiega Tambiama Andr\u00e9. 2024. Artificial intelligence act. Retrieved from https:\/\/www.europarl.europa.eu\/RegData\/etudes\/BRIE\/2021\/698792\/EPRS_BRI(2021)698792_EN.pdf"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3487043"},{"key":"e_1_3_2_80_2","unstructured":"Meaghan Tobin. 2024. A.I. pioneers call for protections against \u2018catastrophic risks\u2019. Retrieved from https:\/\/www.nytimes.com\/2024\/09\/16\/business\/china-ai-safety.html"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3457607"},{"key":"e_1_3_2_82_2","first-page":"60","volume-title":"21st IEEE International Conference on Software Architecture (ICSA)","author":"Memon Mashal Afzal","year":"2024","unstructured":"Mashal Afzal Memon, Gian Luca Scoccia, Marco Autili, and Paola Inverardi. 2024. An architecture for ethics-based negotiation in the decision-making of intelligent autonomous systems. In 21st IEEE International Conference on Software Architecture (ICSA), 60\u201364. DOI: 10.1109\/ICSA-C63560.2024.00016"},{"key":"e_1_3_2_83_2","first-page":"385","volume-title":"2nd International Conference on Hybrid Human-Artificial Intelligence - Augmenting Human Intellect (HHAI \u201923)","volume":"368","author":"Memon Mashal Afzal","year":"2023","unstructured":"Mashal Afzal Memon, Gian Luca Scoccia, Paola Inverardi, and Marco Autili. 2023. Don\u2019t you agree with my ethics? Let's negotiate! In 2nd International Conference on Hybrid Human-Artificial Intelligence - Augmenting Human Intellect (HHAI \u201923). Frontiers in Artificial Intelligence and Applications, Vol. 368, 385\u2013388. DOI: 10.3233\/FAIA230105"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3230059"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2945329"},{"key":"e_1_3_2_86_2","unstructured":"moodys.com\/kyc. 2023. Navigating the AI landscape \u2013 Insights from compliance and risk management leaders. Retrieved from https:\/\/www.moodys.com\/web\/en\/us\/site-assets\/ma-kyc-navigating-the-ai-landscape-report.pdf"},{"issue":"2","key":"e_1_3_2_87_2","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/s10462-017-9560-8","article-title":"Adjustable autonomy: A systematic literature review","volume":"51","author":"Mostafa Salama A.","year":"2019","unstructured":"Salama A. Mostafa, Mohd Sharifuddin Ahmad, and Aida Mustapha. 2019. Adjustable autonomy: A systematic literature review. Artif. Intell. Rev. 51, 2 (2019), 149\u2013186.","journal-title":"Artif. Intell. Rev."},{"key":"e_1_3_2_88_2","volume-title":"The Stanford Encyclopedia of Philosophy","author":"M\u00fcller Vincent C.","year":"2021","unstructured":"Vincent C. M\u00fcller. 2021. Ethics of artificial intelligence and robotics. In The Stanford Encyclopedia of Philosophy (Summer 2021 Edition). Edward N. Zalta (Ed.), Metaphysics Research Lab, Stanford University."},{"key":"e_1_3_2_89_2","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1109\/EDUCON52537.2022.9766663","volume-title":"IEEE Global Engineering Education Conference (EDUCON \u201922)","author":"Naiseh Mohammad","year":"2022","unstructured":"Mohammad Naiseh, Caitlin M. Bentley, and Sarvapali D. Ramchurn. 2022. Trustworthy autonomous systems (TAS): Engaging TAS experts in curriculum design. In IEEE Global Engineering Education Conference (EDUCON \u201922). Ilhem Kallel, Habib M. Kammoun, and Lobna Hsairi (Eds.), IEEE, 901\u2013905. DOI: 10.1109\/EDUCON52537.2022.9766663"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111860"},{"key":"e_1_3_2_91_2","first-page":"68:1","volume-title":"46th IEEE\/ACM International Conference on Software Engineering (ICSE \u201924)ACM","author":"Neelofar","year":"2024","unstructured":"Neelofar and Aldeida Aleti. 2024. Towards reliable AI: Adequacy metrics for ensuring the quality of system-level testing of autonomous vehicles. In 46th IEEE\/ACM International Conference on Software Engineering (ICSE \u201924). ACM, 68:1\u201368:12. DOI: 10.1145\/3597503.3623314"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2020.102085"},{"key":"e_1_3_2_93_2","unstructured":"OECD.AI Policy Observatory. 2019 updated May 2024. OECD AI principles overview. Retrieved from https:\/\/oecd.ai\/en\/ai-principles"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.06.002"},{"key":"e_1_3_2_95_2","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/978-3-031-36847-9_3","volume-title":"Software Architecture: Research Roadmaps from the Community","author":"Pelliccione Patrizio","year":"2023","unstructured":"Patrizio Pelliccione, Barbora Buhnova, Sebastian Gottschalk, Ingo Weber, and Gregor Engels. 2023. Architecting and engineering value-based ecosystems. In Software Architecture: Research Roadmaps from the Community. Springer, 41\u201368."},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRL.2024.3358736"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2024.3412406"},{"key":"e_1_3_2_98_2","doi-asserted-by":"crossref","unstructured":"Mauro Pezz\u00e8 Mauro Ciniselli Luca Di Grazia Niccol\u00f2 Puccinelli and Ketai Qiu. 2024. The trailer of the ACM 2030 roadmap for software engineering. Retrieved September 23 2024 from https:\/\/www.inf.usi.ch\/faculty\/pezze\/media\/SE2030SENreport.pdf","DOI":"10.1145\/3696117.3696126"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10515-024-00415-2"},{"key":"e_1_3_2_100_2","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1007\/978-3-031-70245-7_6","volume-title":"17th International Conference on the Quality of Information and Communications Technology (QUATIC 2024)","author":"De Sanctis Martina","year":"2024","unstructured":"Martina De Sanctis, Paola Inverardi, and Patrizio Pelliccione. 2024. Do modern systems require new quality dimensions? In 17th International Conference on the Quality of Information and Communications Technology (QUATIC 2024), 83\u201390."},{"key":"e_1_3_2_101_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2023.3342974"},{"key":"e_1_3_2_102_2","unstructured":"Inc. Scaled agile. [n.d.]. Scaled agile framework. Retrieved December 1 2020 from https:\/\/www.scaledagileframework.com\/agile-architecture\/"},{"key":"e_1_3_2_103_2","doi-asserted-by":"publisher","DOI":"10.1145\/3672359.3672364"},{"key":"e_1_3_2_104_2","first-page":"114","volume-title":"9th IEEE\/ACM International Conference on Mobile Software Engineering and Systems (MobileSoft@ICSE \u201922)","author":"Scoccia Gian Luca","year":"2022","unstructured":"Gian Luca Scoccia, Marco Autili, Giovanni Stilo, and Paola Inverardi. 2022. An empirical study of privacy labels on the Apple IOS Mobile app store. In 9th IEEE\/ACM International Conference on Mobile Software Engineering and Systems (MobileSoft@ICSE \u201922). IEEE, 114\u2013124. DOI: 10.1145\/3524613.3527813"},{"issue":"1","key":"e_1_3_2_105_2","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/s10676-014-9338-5","article-title":"Robots and human dignity: A consideration of the effects of robot care on the dignity of older people","volume":"16","author":"Sharkey Amanda","year":"2014","unstructured":"Amanda Sharkey. 2014. Robots and human dignity: A consideration of the effects of robot care on the dignity of older people. Ethics and Information Technology 16, 1 (2014), 63\u201375.","journal-title":"Ethics and Information Technology"},{"key":"e_1_3_2_106_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627163"},{"key":"e_1_3_2_107_2","unstructured":"ISO 25000 Software and Data Quality. [n.d.]. ISO\/IEC 25010 Standard. Retrieved from https:\/\/iso25000.com\/index.php\/en\/iso-25000-standards\/iso-25010"},{"key":"e_1_3_2_108_2","unstructured":"Stamford Conn. 2021. Gartner says digital ethics is at the peak of inflated expectations in the 2021 Gartner hype cycle for privacy. Retrieved from https:\/\/www.gartner.com\/en\/newsroom\/press-releases\/2021-09-30-gartner-says-digital-ethics-is-at-the-peak-of-inflate"},{"key":"e_1_3_2_109_2","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1145\/3442188.3445939","volume-title":"2021 ACM Conference on Fairness, Accountability, and Transparency","author":"Stark Luke","year":"2021","unstructured":"Luke Stark and Jesse Hoey. 2021. The ethics of emotion in artificial intelligence systems. In 2021 ACM Conference on Fairness, Accountability, and Transparency, 782\u2013793."},{"key":"e_1_3_2_110_2","doi-asserted-by":"crossref","first-page":"1058","DOI":"10.1002\/9781119636113.ch41","article-title":"Human factors in ambient intelligence environments","author":"Stephanidis Constantine","year":"2021","unstructured":"Constantine Stephanidis, Margherita Antona, and Stavroula Ntoa. 2021. Human factors in ambient intelligence environments. Handbook of Human Factors and Ergonomics (2021), 1058\u20131084.","journal-title":"Handbook of Human Factors and Ergonomics"},{"key":"e_1_3_2_111_2","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1145\/3306618.3314286","volume-title":"2019 AAAI\/ACM Conference on AI, Ethics, and Society (AIES \u201919)","author":"Susser Daniel","year":"2019","unstructured":"Daniel Susser. 2019. Invisible influence: Artificial intelligence and the ethics of adaptive choice architectures. In 2019 AAAI\/ACM Conference on AI, Ethics, and Society (AIES \u201919). Vincent Conitzer, Gillian K. Hadfield, and Shannon Vallor (Eds.), ACM, 403\u2013408. DOI: 10.1145\/3306618.3314286"},{"key":"e_1_3_2_112_2","first-page":"11657","volume-title":"AAAI Conference on Artificial Intelligence","volume":"35","author":"Svegliato Justin","year":"2021","unstructured":"Justin Svegliato, Samer B. Nashed, and Shlomo Zilberstein. 2021. Ethically compliant sequential decision making. AAAI Conference on Artificial Intelligence 35, 13 (May 2021), 11657\u201311665. DOI: 10.1609\/aaai.v35i13.17386"},{"key":"e_1_3_2_113_2","doi-asserted-by":"publisher","DOI":"10.1186\/S13174-015-0024-6"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2023.3246686"},{"key":"e_1_3_2_115_2","doi-asserted-by":"publisher","DOI":"10.1007\/S11023-022-09614-W"},{"key":"e_1_3_2_116_2","first-page":"22385","volume-title":"38th AAAI Conference on Artificial Intelligence (AAAI \u201924), 36th Conference on Innovative Applications of Artificial Intelligence (IAAI \u201924), 14th Symposium on Educational Advances in Artificial Intelligence (EAAI \u201924)","author":"Troquard Nicolas","year":"2024","unstructured":"Nicolas Troquard, Martina De Sanctis, Paola Inverardi, Patrizio Pelliccione, and Gian Luca Scoccia. 2024. Social, legal, ethical, empathetic, and cultural rules: Compilation and reasoning. In 38th AAAI Conference on Artificial Intelligence (AAAI \u201924), 36th Conference on Innovative Applications of Artificial Intelligence (IAAI \u201924), 14th Symposium on Educational Advances in Artificial Intelligence (EAAI \u201924). AAAI Press, 22385\u201322392. DOI: 10.1609\/AAAI.V38I20.30245"},{"key":"e_1_3_2_117_2","unstructured":"UNESCO. 2022. Recommendation on the ethics of artificial intelligence. Retrieved from https:\/\/www.unesco.org\/en\/artificial-intelligence\/recommendation-ethics"},{"key":"e_1_3_2_118_2","unstructured":"United Nations. 2024. Progress towards the sustainable development goals. Retrieved from https:\/\/unstats.un.org\/sdgs\/files\/report\/2024\/SG-SDG-Progress-Report-2024-advanced-unedited-version.pdf"},{"key":"e_1_3_2_119_2","unstructured":"United States Government. 2022. Blueprint for an AI Bill of rights making automated systems work for the American people. Retrieved from https:\/\/www.whitehouse.gov\/wp-content\/uploads\/2022\/10\/Blueprint-for-an-AI-Bill-of- Rights.pdf"},{"key":"e_1_3_2_120_2","unstructured":"USA. 2023. Executive order on the safe secure and trustworthy development and use of artificial intelligence. Retrieved from https:\/\/www.whitehouse.gov\/briefing-room\/presidential-actions\/2023\/10\/30\/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence\/"},{"key":"e_1_3_2_121_2","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/978-3-030-82017-6_8","volume-title":"3rd International Workshop on Explainable and Transparent AI and Multi-Agent Systems (EXTRAAMAS \u201921)","author":"Verhagen Ruben S.","year":"2021","unstructured":"Ruben S. Verhagen, Mark A. Neerincx, and Myrthe L. Tielman. 2021. A two-dimensional explanation framework to classify AI as incomprehensible, interpretable, or understandable. In 3rd International Workshop on Explainable and Transparent AI and Multi-Agent Systems (EXTRAAMAS \u201921). Springer-Verlag, Berlin, 119\u2013138. DOI: 10.1007\/978-3-030-82017-6_8"},{"key":"e_1_3_2_122_2","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/IWESEP49350.2019.00017","volume-title":"2019 10th International Workshop on Empirical Software Engineering in Practice (IWESEP)","author":"Washizaki Hironori","year":"2019","unstructured":"Hironori Washizaki, Hiromu Uchida, Foutse Khomh, and Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc. 2019. Studying software engineering patterns for designing machine learning systems. In 2019 10th International Workshop on Empirical Software Engineering in Practice (IWESEP). IEEE, 49\u2013495."},{"key":"e_1_3_2_123_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2014.01.005"},{"key":"e_1_3_2_124_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-45304-5"},{"key":"e_1_3_2_125_2","unstructured":"Hannes Werthner Edward A. Lee Hans Akkermans Moshe Vardi Carlo Ghezzi Nadia Magnenat-Thalmann Helga Nowotny Lynda Hardman Oliviero Stock James Larus et al. 2024. Vienna Manifesto on Digital Humanism. Retrieved from https:\/\/caiml.org\/dighum\/dighum-manifesto\/"},{"key":"e_1_3_2_126_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2022.3219528"},{"key":"e_1_3_2_127_2","first-page":"1","volume-title":"4th International Conference on Design Science Research in Information Systems and Technology","author":"Wieringa Roel","year":"2009","unstructured":"Roel Wieringa. 2009. Design science as nested problem solving. In 4th International Conference on Design Science Research in Information Systems and Technology, 1\u201312."},{"key":"e_1_3_2_128_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.SCICO.2024.103118"},{"key":"e_1_3_2_129_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2010.09.035"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3712006","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3712006","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:10Z","timestamp":1750295890000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3712006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,26]]},"references-count":128,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3712006"],"URL":"https:\/\/doi.org\/10.1145\/3712006","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,26]]},"assertion":[{"value":"2024-04-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-18","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}