{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T23:09:12Z","timestamp":1778368152917,"version":"3.51.4"},"publisher-location":"Cham","reference-count":40,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783032190987","type":"print"},{"value":"9783032190994","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T00:00:00Z","timestamp":1775001600000},"content-version":"vor","delay-in-days":90,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Traditional software for critical applications is typically built through a structured approach, with a clear set of predefined rules and logic imposing how the system will respond to different inputs, and prepared for safety certification accordingly. Recent innovations are pushing for conceptualizing, designing, implementing and validating autonomous systems that require the deployment of complex software functions which cannot be fully managed by traditional software development approaches. Those complex functions comprise a massive amount of inputs and virtually infinite input combinations, which are typically fed to a Machine Learning (ML) algorithm tasked to learn rules and logic that humans cannot derive due to excessive complexity or incomplete understanding of the phenomena. This paves the way for potential issues when architecting the software, and especially exposes it to facing inputs \u2013 referred to as unknowns - for which the behavior of the target software is untested. This has a detrimental impact on the overall software development, and it is the main obstacle to fulfilling certification processes in accordance to applicable standards. Domain experts should focus on trust rather than the traditional correctness, embracing software design patterns proven in use since decades, ultimately enabling the development of autonomous systems that will drive the upcoming fifth industrial revolution.<\/jats:p>","DOI":"10.1007\/978-3-032-19099-4_39","type":"book-chapter","created":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T22:17:32Z","timestamp":1778365052000},"page":"573-583","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Beyond Correctness: Architecting Trustworthy Software for Autonomous Systems in the Age of AI"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3460-7164","authenticated-orcid":false,"given":"Muhammad","family":"Atif","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9820-6047","authenticated-orcid":false,"given":"Tommaso","family":"Zoppi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7366-6530","authenticated-orcid":false,"given":"Andrea","family":"Bondavalli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,4,1]]},"reference":[{"key":"39_CR1","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/TDSC.2004.2","volume":"1","author":"A Avizienis","year":"2004","unstructured":"Avizienis, A., Laprie, J.C., Randell, B., Landwehr, C.: Basic concepts and taxonomy of dependable and secure computing. IEEE Trans. Dependable Secur. Comput. 1, 11\u201333 (2004)","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"39_CR2","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1109\/OJITS.2022.3213183","volume":"3","author":"M Atif","year":"2022","unstructured":"Atif, M., Ceccarelli, A., Zoppi, T., Gharib, M., Bondavalli, A.: Robust traffic sign recognition against camera failures. IEEE Open J. Intell. Transp. Syst. 3, 709\u2013722 (2022)","journal-title":"IEEE Open J. Intell. Transp. Syst."},{"key":"39_CR3","series-title":"Lecture Notes on Data Engineering and Communications Technologies","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1007\/978-981-10-8681-6_91","volume-title":"International Conference on Computer Networks and Communication Technologies","author":"G Sasikala","year":"2019","unstructured":"Sasikala, G., Ramesh Kumar, V.: Development of advanced driver assistance system using intelligent surveillance. In: Smys, S., Bestak, R., Chen, J.I.-Z., Kotuliak, I. (eds.) International Conference on Computer Networks and Communication Technologies. LNDECT, vol. 15, pp. 991\u20131003. Springer, Singapore (2019). https:\/\/doi.org\/10.1007\/978-981-10-8681-6_91"},{"key":"39_CR4","unstructured":"International Organization for Standardization, ISO PAS 21448, \u201cRoad vehicles - Safety of the intended functionality (2022)"},{"key":"39_CR5","unstructured":"ISO\/IEC. ISO\/IEC TR 24028:2020: Information Technology \u2014 Artificial Intelligence (AI) \u2014 Overview of Trustworthiness in Artificial Intelligence. International Organization for Standardization (2020)"},{"key":"39_CR6","unstructured":"Carlini, N., et al.: On evaluating adversarial robustness. arXiv preprint arXiv:1902.06705 (2019)"},{"key":"39_CR7","unstructured":"Brown, T.B., Man\u00e9, D., Roy, A., Abadi, M., Gilmer, J.: Adversarial patch. arXiv preprint arXiv:1712.09665 (2017)"},{"key":"39_CR8","unstructured":"Mohseni, S., Pitale, M., Singh, V., Wang, Z.: Practical solutions for machine learning safety in autonomous vehicles. SafeAI workshop @ AAAI (2019)"},{"issue":"2","key":"39_CR9","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.jretai.2022.04.003","volume":"98","author":"SM Noble","year":"2022","unstructured":"Noble, S.M., Mende, M., Grewal, D., Parasuraman, A.: The fifth industrial revolution: how harmonious human-machine collaboration is triggering a retail and service [R]evolution. J. Retail. 98(2), 199\u2013208 (2022)","journal-title":"J. Retail."},{"key":"39_CR10","doi-asserted-by":"crossref","unstructured":"Ami, A.S., Moran, K., Poshyvanyk, D., Nadkarni, A.: \u2018False negative - that one is going to kill you\u2019: understanding industry perspectives of static analysis based security testing. In: 2024 IEEE Symposium on Security and Privacy (SP), pp. 3979\u20133997. IEEE (2024)","DOI":"10.1109\/SP54263.2024.00019"},{"issue":"4","key":"39_CR11","doi-asserted-by":"publisher","first-page":"1292","DOI":"10.1109\/TITS.2011.2158424","volume":"12","author":"CG Keller","year":"2011","unstructured":"Keller, C.G., Dang, T., Fritz, H., Joos, A., Rabe, C., Gavrila, D.M.: Active pedestrian safety by automatic braking and evasive steering. IEEE Trans. Intell. Transp. Syst. 12(4), 1292\u20131304 (2011)","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"39_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102158","volume":"124","author":"TP Quinn","year":"2022","unstructured":"Quinn, T.P., Jacobs, S., Senadeera, M., Le, V., Coghlan, S.: The three ghosts of medical AI: can the black-box present deliver? Artif. Intell. Med. 124, 102158 (2022)","journal-title":"Artif. Intell. Med."},{"key":"39_CR13","unstructured":"McAllister, D.F., Vouk, M.A.: Fault-tolerant software reliability engineering. In: Lyu, M. (ed.) Handbook of Software Reliability Engineering. ch. 14 (1996)"},{"key":"39_CR14","doi-asserted-by":"crossref","unstructured":"Guerin, J., Ferreira, R.S., Delmas, K., Guiochet, J.: Unifying evaluation of machine learning safety monitors. In: 2022 IEEE 33rd International Symposium on Software Reliability Engineering (ISSRE), pp. 414\u2013422. IEEE (2022)","DOI":"10.1109\/ISSRE55969.2022.00047"},{"issue":"3","key":"39_CR15","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1109\/LES.2019.2953253","volume":"12","author":"A Biondi","year":"2020","unstructured":"Biondi, A., Nesti, F., Cicero, G., Casini, D., Buttazzo, G.: A safe, secure, and predictable software architecture for deep learning in safety-critical systems. IEEE Embed. Syst. Lett. 12(3), 78\u201382 (2020)","journal-title":"IEEE Embed. Syst. Lett."},{"key":"39_CR16","doi-asserted-by":"crossref","unstructured":"Ocheretny, V.: Self-checking arithmetic logic unit with duplicated outputs. In: 2010 IEEE 16th International On-Line Testing Symposium, pp. 202\u2013203. IEEE (2010)","DOI":"10.1109\/IOLTS.2010.5560204"},{"issue":"3","key":"39_CR17","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/MDT.2010.5","volume":"27","author":"M Psarakis","year":"2010","unstructured":"Psarakis, M., Gizopoulos, D., Sanchez, E., Reorda, M.S.: Microprocessor software-based self-testing. IEEE Des. Test Comput. 27(3), 4\u201319 (2010)","journal-title":"IEEE Des. Test Comput."},{"issue":"2","key":"39_CR18","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/BF00993088","volume":"6","author":"I David","year":"1995","unstructured":"David, I., Ginosar, R., Yoeli, M.: Self-timed is self-checking. J. Electron. Test. 6(2), 219\u2013228 (1995)","journal-title":"J. Electron. Test."},{"key":"39_CR19","doi-asserted-by":"crossref","unstructured":"Lyu, M.R., Avi\u017eienis, A.: Assuring design diversity in N-version software: a design paradigm for N-version programming, Dependable Computing for Critical Applications 2, Springer, Vienna, pp. 197\u2013218 (1992)","DOI":"10.1007\/978-3-7091-9198-9_10"},{"key":"39_CR20","doi-asserted-by":"crossref","unstructured":"Di Giandomenico, F., Strigini, L.: Adjudicators for diverse-redundant components. In: Proceedings Ninth Symposium on Reliable Distributed Systems, IEEE Comput. Soc. Press, pp. 114\u2013123","DOI":"10.1109\/RELDIS.1990.93957"},{"key":"39_CR21","doi-asserted-by":"publisher","unstructured":"Randell, B.: Recovery Blocks. In: Encyclopedia of Software Engineering, Wiley (2002). https:\/\/doi.org\/10.1002\/0471028959.sof277","DOI":"10.1002\/0471028959.sof277"},{"key":"39_CR22","doi-asserted-by":"crossref","unstructured":"Ch\u00e9r\u00e8que, M., Powell, D., Reynier, P., Richier, J.L., Voiron, J.: Active replication in Delta-4. In: [1992] Digest of Papers. FTCS-22: The Twenty-Second International Symposium on Fault-Tolerant Computing, pp. 28\u201337. IEEE (1992)","DOI":"10.1109\/FTCS.1992.243618"},{"issue":"9","key":"39_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3555803","volume":"55","author":"B Li","year":"2023","unstructured":"Li, B., et al.: Trustworthy AI: from principles to practices. ACM Comput. Surv. 55(9), 1\u201346 (2023)","journal-title":"ACM Comput. Surv."},{"issue":"9","key":"39_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3561048","volume":"55","author":"R Dwivedi","year":"2023","unstructured":"Dwivedi, R., et al.: Explainable AI (XAI): core ideas, techniques, and solutions. ACM Comput. Surv. 55(9), 1\u201333 (2023)","journal-title":"ACM Comput. Surv."},{"key":"39_CR25","doi-asserted-by":"crossref","unstructured":"Boulanger, J.L.: CENELEC 50128 and IEC 62279 Standards. Wiley (2015)","DOI":"10.1002\/9781119005056"},{"issue":"10","key":"39_CR26","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1109\/32.6190","volume":"14","author":"AM Davis","year":"1988","unstructured":"Davis, A.M., Bersoff, E.H., Comer, E.R.: A strategy for comparing alternative software development life cycle models. IEEE Trans. Software Eng. 14(10), 1453\u20131461 (1988)","journal-title":"IEEE Trans. Software Eng."},{"issue":"2","key":"39_CR27","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1109\/JPROC.2023.3238024","volume":"111","author":"XY Zhang","year":"2023","unstructured":"Zhang, X.Y., Xie, G.S., Li, X., Mei, T., Liu, C.L.: A survey on learning to reject. Proc. IEEE 111(2), 185\u2013215 (2023)","journal-title":"Proc. IEEE"},{"key":"39_CR28","doi-asserted-by":"crossref","unstructured":"Zoppi, T., Ceccarelli, A., Bondavalli, A.: Ensembling uncertainty measures to improve safety of black-box classifiers. In: ECAI 2023, pp. 3156\u20133164. IOS Press (2023)","DOI":"10.3233\/FAIA230635"},{"issue":"3","key":"39_CR29","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10994-021-05946-3","volume":"110","author":"E H\u00fcllermeier","year":"2021","unstructured":"H\u00fcllermeier, E., Waegeman, W.: Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Mach. Learn. 110(3), 457\u2013506 (2021)","journal-title":"Mach. Learn."},{"key":"39_CR30","unstructured":"Hendrycks, D., Gimpel, K.: A baseline for detecting misclassified and out-of-distribution examples in neural network.  arXiv preprint arXiv:1610.02136 (2016)"},{"key":"39_CR31","unstructured":"Xiao, Z., Yan, Q., Amit, Y.: Likelihood regret: an out-of-distribution detection score for variational auto-encoder. In: Advances in neural information processing systems, pp. 20685\u201320696 (2020)"},{"key":"39_CR32","doi-asserted-by":"crossref","unstructured":"Zoppi, T., Ceccarelli, A., Puccetti, T., Bondavalli, A.: Which algorithm can detect unknown attacks? Comparison of supervised, unsupervised and meta-learning algorithms for intrusion detection. Comput Secur. 127 (2023)","DOI":"10.1016\/j.cose.2023.103107"},{"key":"39_CR33","doi-asserted-by":"crossref","unstructured":"Hein, M., Andriushchenko, M., Bitterwolf, J.:Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2019)","DOI":"10.1109\/CVPR.2019.00013"},{"key":"39_CR34","doi-asserted-by":"crossref","unstructured":"Mirza, M.J., et al.: Robustness of Object Detectors in Degrading Weather Conditions. In: 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), IEEE (2021)","DOI":"10.1109\/ITSC48978.2021.9564505"},{"key":"39_CR35","doi-asserted-by":"publisher","DOI":"10.1016\/j.iot.2023.100999","volume":"24","author":"D-T Nguyen","year":"2023","unstructured":"Nguyen, D.-T., Le, K.-H.: The robust scheme for intrusion detection system in Internet of Things. Internet Things 24, 100999 (2023)","journal-title":"Internet Things"},{"key":"39_CR36","doi-asserted-by":"publisher","unstructured":"Laprie, J.C., Arlat, J., Beounes, C., Kanoun, K.: Definition and analysis of hardware-and-software fault-tolerant architectures. In: Randell, B., Laprie, J.C., Kopetz, H., Littlewood, B. (eds) Predictably Dependable Computing Systems, pp. 103\u2013122. Springer, Heidelberg (1995). https:\/\/doi.org\/10.1007\/978-3-642-79789-7_7","DOI":"10.1007\/978-3-642-79789-7_7"},{"key":"39_CR37","doi-asserted-by":"crossref","unstructured":"Powell, D.: Failure mode assumptions and assumption coverage. In: FTCS 1992 - 22nd Annual International Symposium on Fault-Tolerant Computing, art. no. 243562, pp. 386\u2013395 (1992)","DOI":"10.1109\/FTCS.1992.243562"},{"key":"39_CR38","doi-asserted-by":"crossref","unstructured":"Parginos, K., Kariniotakis, G., Bessa, R.J., Camal, S.: Towards a paradigm of explainable AI applied in energy meteorology. In: EGU General Assembly (2023)","DOI":"10.5194\/egusphere-egu23-13992"},{"key":"39_CR39","unstructured":"Bondavalli, A., Simoncini, L.: Failure classification with respect to detection (1990) Proceedings. In: Second IEEE Workshop on Future Trends of Distributed Computing Systems Proceedings"},{"key":"39_CR40","doi-asserted-by":"crossref","unstructured":"Leyli-Abadi, M., et al.: A Conceptual Framework for AI-based Decision Systems in Critical Infrastructures. arXiv preprint arXiv:2504.16133 (2025)","DOI":"10.1109\/SMC58881.2025.11342626"}],"container-title":["Communications in Computer and Information Science","Machine Learning and Principles and Practice of Knowledge Discovery in Databases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-032-19099-4_39","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T22:17:34Z","timestamp":1778365054000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-032-19099-4_39"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026]]},"ISBN":["9783032190987","9783032190994"],"references-count":40,"URL":"https:\/\/doi.org\/10.1007\/978-3-032-19099-4_39","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"value":"1865-0929","type":"print"},{"value":"1865-0937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026]]},"assertion":[{"value":"1 April 2026","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECML PKDD","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Porto","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Portugal","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2025","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"15 September 2025","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"19 September 2025","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"ecml2025","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/ecmlpkdd.org\/2025\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}