{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T15:41:56Z","timestamp":1780674116705,"version":"3.54.1"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"name":"EU Next-GenEU NRRP - M4C2, 1.4 - D.D.","award":["1033 17\/06\/2022, CN00000023"],"award-info":[{"award-number":["1033 17\/06\/2022, CN00000023"]}]},{"name":"National Resilience and Recovery Plan (PNRR) through the National Center for HPC, Big Data and Quantum Computing"},{"name":"MUR - M4C2 1.5 of PNRR","award":["ECS00000036"],"award-info":[{"award-number":["ECS00000036"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Things"],"published-print":{"date-parts":[[2026,8,31]]},"abstract":"<jats:p>\n                    The availability of powerful Artificial Intelligence (AI) algorithms boosts the development of advanced functionalities in the automotive domain and is essential to enable the deployment of autonomous and semi-autonomous decision-making vehicles. However, integrating such advanced and complex functionalities in automotive systems is challenging due to several factors, including:\n                    <jats:italic toggle=\"yes\">(i)<\/jats:italic>\n                    the mandatory compliance with strict safety regulations, which require effective strategies to ensure timely development while allowing thorough dependability evaluations, and\n                    <jats:italic toggle=\"yes\">(ii)<\/jats:italic>\n                    the short time-to-market imposing limited development, verification, and validation periods. In particular, the analysis of the effects of faults affecting the hardware executing an AI-based application is made challenging by the target system\u2019s complexity (in terms of both hardware and software). Reliability analysis often resorts to Fault Injection techniques. However, Fault Injection experiments are often unacceptably time-consuming and limited to some components of the overall system, thus failing to consider the fault impact at the vehicle level. This work proposes a new method, named\n                    <jats:italic toggle=\"yes\">Two-steps IntegrAted Reliability Assessment<\/jats:italic>\n                    (\n                    <jats:italic toggle=\"yes\">TIARA<\/jats:italic>\n                    ), for early estimation of the impact at the vehicle level of faults affecting the hardware running AI-based perception tasks in the automotive domain. TIARA allows for the early exploration and evaluation of algorithms, driving agents, and critical operational scenarios. TIARA can estimate the effects of faults affecting a subsystem up to the vehicle level, integrating a fault injection approach at the neural network level with a commercial automotive-grade virtual scenario generator. When compared to previous works, TIARA dramatically reduces the required computational effort by adopting a two-stage evaluation strategy. It first performs static analysis to determine fault vulnerabilities and identify the most vulnerable parts (code blocks) in a targeted application. Then, it focuses on the most susceptible parts of the neural network and estimates system-level effects on vehicle dynamics by combining the system\u2019s perception, control, and driving features. We validated our methodology through the exhaustive evaluation of two applications:\n                    <jats:italic toggle=\"yes\">Lane Centering Assistance<\/jats:italic>\n                    (LCA) and\n                    <jats:italic toggle=\"yes\">Emergency\u00a0Lane\u00a0Keeping\u00a0Assistance<\/jats:italic>\n                    (ELKA), using the\n                    <jats:italic toggle=\"yes\">YoloP<\/jats:italic>\n                    model for perception. The experimental results show that TIARA allows for an efective early estimation of systems reliability through relevant driving dynamics and comfort metrics on the nine evaluated driving scenarios, as mandated by standards, while reducing computing complexity by up to 43.2X in comparison with a fully exhaustive evaluation approach. In addition, the validation of the TIARA methodology through a hardware-in-the-loop implementation shows that the results closely match the behavior of a real-world system, demonstrating the versatility of the TIARA strategy for the evaluation of automotive systems.\n                  <\/jats:p>","DOI":"10.1145\/3758327","type":"journal-article","created":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T11:13:12Z","timestamp":1754565192000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Early Reliability Assessment of AI-based Automotive Systems"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1150-790X","authenticated-orcid":false,"given":"Shailesh","family":"Hegde","sequence":"first","affiliation":[{"name":"Department of Mechanical and Aerospace Engineering (DIMEAS), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4793-0590","authenticated-orcid":false,"given":"Dinesh","family":"Selvaraj","sequence":"additional","affiliation":[{"name":"Department of Electronics and Telecommunications (DET), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5957-5624","authenticated-orcid":false,"given":"Josie Esteban","family":"Rodriguez Condia","sequence":"additional","affiliation":[{"name":"Department of Control and Computer Engineering (DAUIN), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3380-9346","authenticated-orcid":false,"given":"Nicola","family":"Amati","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Aerospace Engineering (DIMEAS), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1410-660X","authenticated-orcid":false,"given":"Carla","family":"Chiasserini","sequence":"additional","affiliation":[{"name":"Department of Electronics and Telecommunications (DET), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4109-8019","authenticated-orcid":false,"given":"Francesco","family":"Deflorio","sequence":"additional","affiliation":[{"name":"Department of Environment, Land and Infrastructure Engineering (DIATI), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2899-7669","authenticated-orcid":false,"given":"Matteo","family":"Sonza Reorda","sequence":"additional","affiliation":[{"name":"Department of Control and Computer Engineering (DAUIN), Politecnico di Torino","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,4,21]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22041360"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-85617-749-8.00005-2"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/IRPS46558.2021.9405193"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2004.2"},{"key":"e_1_3_3_6_2","unstructured":"AVSimulation. 2025. SCANeR - AVSimulation \u2014 avsimulation.com. Retrieved February 24 2025 from https:\/\/www.avsimulation.com\/en\/scaner\/"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","unstructured":"Rahul Kumar Bhadani Jonathan Sprinkle and Matthew Bunting. 2018. The CAT vehicle testbed: A simulator with hardware in the loop for autonomous vehicle applications. In Proceedings 2nd International Workshop on Safe Control of Autonomous Vehicles (SCAV 2018) Electronic Proceedings in Theoretical Computer Science 269 (April 2018) 32\u201347. DOI:10.4204\/eptcs.269.4","DOI":"10.4204\/eptcs.269.4"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2976513"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/IV48863.2021.9575530"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2021.3073807"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2023.3276218"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3510677"},{"key":"e_1_3_3_13_2","unstructured":"Comma.ai. 2017. Openpilot. Retrieved August 18 2025 from https:\/\/github.com\/commaai\/openpilot"},{"key":"e_1_3_3_14_2","unstructured":"European Commission. 2021. Implementing regulation - 2021\/646 - EN - EUR-Lex. https:\/\/eur-lex.europa.eu\/eli\/reg_impl\/2021\/646\/oj\/eng Doc ID: 32021R0646 Doc Sector: 3 Doc Title: Commission Implementing Regulation (EU) 2021\/646 of 19 April 2021 laying down rules for the application of Regulation (EU) 2019\/2144 of the European Parliament and of the Council as regards uniform procedures and technical specifications for the type-approval of motor vehicles with regard to their emergency lane-keeping systems (ELKS) (Text with EEA relevance) Doc Type: R Usr_lan: en."},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/VTS50974.2021.9441044"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITC50671.2022.00036"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/HCS59251.2023.10254716"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/VTS.2019.8758636"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC45102.2020.9294454"},{"key":"e_1_3_3_20_2","unstructured":"Alexey Dosovitskiy German Ros Felipe Codevilla Antonio Lopez and Vladlen Koltun 2017. CARLA: An open urban driving simulator. Proceedings of the 1st Annual Conference on Robot Learning in Proceedings of Machine Learning Research 78 (2017) 1\u201316. https:\/\/proceedings.mlr.press\/v78\/dosovitskiy17a.html"},{"key":"e_1_3_3_21_2","unstructured":"Florian Faucher Jean Latger Aude Mesnil and Christian Ruiz. 2022. SCANeR studio\/SE-workbench-RF physical radar sensor. In Proceedings of the DSC Europe VR. 1\u20136."},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","unstructured":"Stefano Favelli Meng Xie and Andrea Tonoli. 2024. Sensor fusion method for object detection and distance estimation in assisted driving applications. Sensors 24 24 (Dec. 2024) 7895. DOI:10.3390\/s24247895","DOI":"10.3390\/s24247895"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/SECON.2018.8479057"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3581784.3607086"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.7873\/DATE.2013.040"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/IRPS46558.2021.9405177"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2389824"},{"key":"e_1_3_3_28_2","first-page":"1","article-title":"Estimating the impact of soft errors on AI-based perception in automotive","year":"2025","unstructured":"Shailesh Sudhakara Hegde, Dinesh Cyril Selvaraj, Josie E. Rodriguez Condia, Nicola Amati Carla Fabiana Chiasserini, Francesco Paolo Deflorio, and Matteo Sonza Reorda. 2025. Estimating the impact of soft errors on AI-based perception in automotive. In Proceedings of the Latin American Test Symposium (LATS\u201925). 1\u20136.","journal-title":"Proceedings of the Latin American Test Symposium (LATS\u201925)"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114777"},{"key":"e_1_3_3_30_2","first-page":"111","volume-title":"Proceedings of the 54th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S)","author":"Hukerikar Saurabh","year":"2024","unstructured":"Saurabh Hukerikar, Atieh Lotfi, Yanxiang Huang, Jason Campbell, and Nirmal Saxena. 2024. Optimizing large-scale fault injection experiments through martingale hypothesis: A systematic approach for reliability assessment of safety-critical systems. In Proceedings of the 54th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S). 111\u2013117."},{"key":"e_1_3_3_31_2","volume-title":"Institute of Electrical and Electronics Engineers (IEEE)","year":"2022","unstructured":"IEEE. 2022. The International Roadmap for Devices and Systems: 2022. Institute of Electrical and Electronics Engineers (IEEE)."},{"key":"e_1_3_3_32_2","unstructured":"International Organization for Standardization. 1997. ISO 2631-1:1997 - Mechanical vibration and shock \u2014 Evaluation of human exposure to whole-body vibration. The International Organization for Standardization (ISO)."},{"key":"e_1_3_3_33_2","unstructured":"International Organization for Standardization. 2011. BS ISO 8855:2011 - Road vehicles \u2014 Vehicle dynamics and road-holding ability \u2014 Vocabulary. The International Organization for Standardization (ISO)."},{"key":"e_1_3_3_34_2","unstructured":"International Organization for Standardization. 2022. BS ISO 34502:2022 - Road vehicles \u2014 Test scenarios for automated driving systems \u2014 Scenario-based safety evaluation framework. The International Organization for Standardization (ISO)."},{"key":"e_1_3_3_35_2","unstructured":"Saurabh Jha Timothy Tsai Siva Hari Michael Sullivan Zbigniew Kalbarczyk Stephen W. Keckler and Ravishankar K. Iyer. 2019. Kayotee: A fault injection-based system to assess the safety and reliability of autonomous vehicles to faults and errors. Third IEEE International Workshop on Automotive Reliability & Test (ART\u201918). arXiv:1907.01024 [cs.SE]. Retrieved from https:\/\/arxiv.org\/abs\/1907.01024"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSN-W.2018.00027"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.11959\/j.issn.2096-1081.2016.002"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/DATE.2009.5090716"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2023.3309100"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42154-022-00179-z"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1177\/1687814020974532"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSN-W50199.2020.00014"},{"key":"e_1_3_3_43_2","unstructured":"United Nations. 2014. Regulation No 130 of the Economic Commission for Europe of the United Nations (UN\/ECE) \u2014 Uniform provisions concerning the approval of motor vehicles with regard to the Lane Departure Warning System (LDWS). Official Journal L 178 (2014) 29\u201346. http:\/\/data.europa.eu\/eli\/reg\/2014\/130\/oj"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3402239"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.4271\/2014-01-0240"},{"key":"e_1_3_3_46_2","unstructured":"Nvidia Corporation. 2025. isaacsim. Retrieved August 18 2025 from https:\/\/docs.isaacsim.omniverse.nvidia.com\/5.0.0\/index.html"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/IOLTS60994.2024.10616087"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-47198-8_5"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/IRPS.2013.6532036"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","unstructured":"J. Redmon S. Divvala R. Girshick and A. Farhadi. 2016. You only look once: Unified real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 779\u2013788. DOI:10.1109\/CVPR.2016.91","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE56975.2023.10136998"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1115\/1.4039333"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2878387"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trpro.2021.01.037"},{"key":"e_1_3_3_55_2","unstructured":"Speedgoat. 2025. Baseline real-time target machine | Speedgoat. https:\/\/www.speedgoat.com\/products-services\/real-time-target-machines\/baselinereal-time-target-machine. [Accessed 07-07-2025]."},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2019.8673277"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/EDTM.2019.8731146"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2020.2975764"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/MVT.2019.2939757"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSN48987.2021.00041"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2020.2987987"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","unstructured":"Sijie Wei Peter E. Pfeffer and Johannes Edelmann. 2024. State of the art: Ongoing research in assessment methods for lane keeping assistance systems. IEEE Transactions on Intelligent Vehicles 9 9 (2024) 5853\u20135875. DOI:10.1109\/TIV.2023.3269156","DOI":"10.1109\/TIV.2023.3269156"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11633-022-1339-y"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3350512"}],"container-title":["ACM Transactions on Internet of Things"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3758327","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T16:23:15Z","timestamp":1776788595000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3758327"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,21]]},"references-count":63,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,8,31]]}},"alternative-id":["10.1145\/3758327"],"URL":"https:\/\/doi.org\/10.1145\/3758327","relation":{},"ISSN":["2691-1914","2577-6207"],"issn-type":[{"value":"2691-1914","type":"print"},{"value":"2577-6207","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,21]]},"assertion":[{"value":"2025-03-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-27","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}