{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T21:23:35Z","timestamp":1770499415110,"version":"3.49.0"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"7","funder":[{"name":"Doctoral College Resilient Embedded Systems, TU Wien\u2019s Faculty of Informatics and the UAS Technikum Wien"},{"name":"Centro Nazionale HPC, Big Data e Quantum Computing","award":["PNRR CN1 spoke 9 Digital Society Smart Cities"],"award-info":[{"award-number":["PNRR CN1 spoke 9 Digital Society Smart Cities"]}]},{"name":"MUR under the PRIN 2020 program","award":["Contract 2020W3A5FY"],"award-info":[{"award-number":["Contract 2020W3A5FY"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>\n            Design of cyber-physical systems (CPS) typically involves dataflow modeling. The structure of dataflow models differs from the traditional software, making standard coverage metrics not appropriate for measuring the thoroughness of testing. To address this limitation, this article proposes\n            <jats:italic toggle=\"yes\">signal feature coverage<\/jats:italic>\n            as a new coverage metric for systematically testing CPS dataflow models. We derive signal feature coverage by leveraging signal features. We developed a testing framework in Simulink, a popular dataflow modeling and simulation environment, that automates the generation and execution of test cases based on the defined coverage metric. We evaluated the effectiveness of our approach by carrying out experiments on five Simulink models tested against ten Signal Temporal Logic specifications. We compared our coverage-based testing approach to adaptive random testing, falsification testing, output diversity-based approaches, and testing using MathWorks\u2019 Simulink Design Verifier. The results demonstrate that our coverage-based testing approach outperforms the conventional techniques regarding fault detection capability.\n          <\/jats:p>","DOI":"10.1145\/3714467","type":"journal-article","created":{"date-parts":[[2025,1,22]],"date-time":"2025-01-22T08:26:55Z","timestamp":1737534415000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Signal Feature Coverage and Testing for CPS Dataflow Models"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8004-6601","authenticated-orcid":false,"given":"Ezio","family":"Bartocci","sequence":"first","affiliation":[{"name":"TU Wien, Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9527-7042","authenticated-orcid":false,"given":"Leonardo","family":"Mariani","sequence":"additional","affiliation":[{"name":"University of Milano-Bicocca, Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5468-0396","authenticated-orcid":false,"given":"Dejan","family":"Nickovic","sequence":"additional","affiliation":[{"name":"AIT Austrian Institute of Technology, Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2974-0323","authenticated-orcid":false,"given":"Drishti","family":"Yadav","sequence":"additional","affiliation":[{"name":"TU Wien, Vienna, Austria"}]}],"member":"320","published-online":{"date-parts":[[2025,8,17]]},"reference":[{"key":"e_1_3_2_2_2","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1007\/978-3-319-63387-9_24","volume-title":"Proceedings of the 29th International Conference on Computer Aided Verification (CAV \u201917)","volume":"10426","author":"Adimoolam Arvind S.","year":"2017","unstructured":"Arvind S. Adimoolam, Thao Dang, Alexandre Donz\u00e9, James Kapinski, and Xiaoqing Jin. 2017. Classification and coverage-based falsification for embedded control systems. In Proceedings of the 29th International Conference on Computer Aided Verification (CAV \u201917). Rupak Majumdar and Viktor Kuncak (Eds.), Lecture Notes in Computer Science, Vol. 10426, Springer, Cham, 483\u2013503. DOI: https:\/\/doi.org\/10.1007\/978-3-319-63387-9_24"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2004.15"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2017.2788019"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.nahs.2022.101254"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10009-020-00599-4"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3558932"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE55969.2022.00024"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST57152.2023.00029"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Seyede Marziyeh Ghoreshi Beyrami and Peyvand Ghaderyan. 2020. A robust cost-effective and non-invasive computer-aided method for diagnosis three types of neurodegenerative diseases with gait signal analysis. Measurement 156 (2020) 107579.","DOI":"10.1016\/j.measurement.2020.107579"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.135376"},{"key":"e_1_3_2_12_2","first-page":"540","volume-title":"Proc. IEEE","volume":"80","author":"Boashash Boualem","year":"1992","unstructured":"Boualem Boashash. 1992. Estimating and interpreting the instantaneous frequency of a signal. II. Algorithms and applications. Proc. IEEE 80, 4 (1992), 540\u2013568."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.JSS.2020.110881"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17071-3_11"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2008.23"},{"key":"e_1_3_2_16_2","first-page":"320","volume-title":"Advances in Computer Science-ASIAN 2004: Proceedings of the 9th Asian Computing Science Conference on Higher-Level Decision Making. Dedicated to Jean-Louis Lassez on the Occasion of His 5th Birthday","author":"Chen Tsong Yueh","year":"2005","unstructured":"Tsong Yueh Chen, Hing Leung, and Ieng Kei Mak. 2005. Adaptive random testing. In Advances in Computer Science-ASIAN 2004: Proceedings of the 9th Asian Computing Science Conference on Higher-Level Decision Making. Dedicated to Jean-Louis Lassez on the Occasion of His 5th Birthday. Springer, Berlin, 320\u2013329."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/COASE.2017.8256286"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMSOFT.2015.7318257"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15297-9_9"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-17524-9_10"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.29007\/xwl1"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.29007\/fhnk"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.TCS.2009.06.021"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025179"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2934672"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1145\/2676585.2676617","volume-title":"Proceedings of the 5th Symposium on Information and Communication Technology (SoICT \u201914)","author":"Hanh Le Thi My","year":"2014","unstructured":"Le Thi My Hanh, Thanh Binh Nguyen, and Khuat Thanh Tung. 2014. Applying the meta-heuristic algorithms for mutation-based test data generation for simulink models. In Proceedings of the 5th Symposium on Information and Communication Technology (SoICT \u201914). Nguyen Trong Giang, Huynh Quyet Thang, Ismal Khalil, Son Hong Ngo, Yves Deville, and Marc Bui (Eds.), ACM, 102\u2013109. DOI: 10.1145\/2676585.2676617"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.29007\/xwrs"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1145\/2568225.2568271","volume-title":"Proceedings of the 36th International Conference on Software Engineering (ICSE \u201914)","author":"Inozemtseva Laura","year":"2014","unstructured":"Laura Inozemtseva and Reid Holmes. 2014. Coverage is not strongly correlated with test suite effectiveness. In Proceedings of the 36th International Conference on Software Engineering (ICSE \u201914). Pankaj Jalote, Lionel C. Briand, and Andr\u00e9 van der Hoek (Eds.). ACM, New York, NY, 435\u2013445. DOI: 10.1145\/2568225.2568271"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3340459"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635929"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1995.488968"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","first-page":"102562","DOI":"10.1016\/j.bspc.2021.102562","article-title":"An instantaneous frequency and group delay based feature for classifying EEG signals","volume":"67","author":"Khan Nabeel Ali","year":"2021","unstructured":"Nabeel Ali Khan, Sadiq Ali, and Kwonhue Choi. 2021. An instantaneous frequency and group delay based feature for classifying EEG signals. Biomed. Signal Process. Control 67 (2021), 102562.","journal-title":"Biomed. Signal Process. Control"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05520-3"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ECCE44975.2020.9235734"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-018-9611-z"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30206-3_12"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1049\/IET-SEN.2019.0325"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/COASE.2019.8843005"},{"key":"e_1_3_2_39_2","unstructured":"Mathworks. 2023. Detect faults in aircraft elevator control system. Mathworks. Retrieved July 20 2023 from https:\/\/in.mathworks.com\/help\/stateflow\/ug\/fault-detection-control-logic-in-an-aircraft-elevator-control-system.html"},{"key":"e_1_3_2_40_2","unstructured":"Mathworks. 2023. Model a fault-tolerant fuel control system. Mathworks. Retrieved July 20 2023 from https:\/\/in.mathworks.com\/help\/simulink\/slref\/modeling-a-fault-tolerant-fuel-control-system.html"},{"key":"e_1_3_2_41_2","unstructured":"Mathworks. 2023. Model an automatic transmission controller. Mathworks. Retrieved July 20 2023 from https:\/\/in.mathworks.com\/help\/simulink\/slref\/modeling-an-automatic-transmission-controller.html"},{"key":"e_1_3_2_42_2","unstructured":"Mathworks. 2023. Signal features. Mathworks. Retrieved July 20 2023 from https:\/\/in.mathworks.com\/help\/predmaint\/ug\/signal-features.html"},{"key":"e_1_3_2_43_2","unstructured":"Mathworks. 2023. Simulink documentation. Mathworks. Retrieved July 20 2023 from https:\/\/in.mathworks.com\/help\/simulink\/"},{"key":"e_1_3_2_44_2","unstructured":"Mathworks. 2023. Structural coverage metrics. Mathworks. Retrieved July 20 2023 from https:\/\/in.mathworks.com\/help\/slcoverage\/gs\/coverage-terminology.html"},{"key":"e_1_3_2_45_2","unstructured":"Mathworks. 2024. Design NARMA-L2 neural controller in simulink. Mathworks. Retrieved May 13 2024 from https:\/\/au.mathworks.com\/help\/deeplearning\/ug\/design-narma-l2-neural-controller-in-simulink.html"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/2786805.2786818","volume-title":"Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE \u201915)","author":"Matinnejad Reza","year":"2015","unstructured":"Reza Matinnejad, Shiva Nejati, Lionel C. Briand, and Thomas Bruckmann. 2015. Effective test suites for mixed discrete-continuous stateflow controllers. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE \u201915). Elisabetta Di Nitto, Mark Harman, and Patrick Heymans (Eds.), ACM, 84\u201395. DOI: 10.1145\/2786805.2786818"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2811489"},{"key":"e_1_3_2_48_2","first-page":"300","volume-title":"Proceedings of the 28th IEEE International Requirements Engineering Conference (RE \u201920)","author":"Mavridou Anastasia","year":"2020","unstructured":"Anastasia Mavridou, Hamza Bourbouh, Dimitra Giannakopoulou, Thomas Pressburger, Mohammad Hejase, Pierre-Lo\u00efc Garoche, and Johann Schumann. 2020. The ten lockheed Martin cyber-physical challenges: Formalized, analyzed, and explained. In Proceedings of the 28th IEEE International Requirements Engineering Conference (RE \u201920). Travis D. Breaux, Andrea Zisman, Samuel Fricker, and Martin Glinz (Eds.). IEEE, 300\u2013310. DOI: 10.1109\/RE48521.2020.00040"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.29007\/6nqs"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-17524-9_20"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/1572272.1572280"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3340444"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3127041.3127058"},{"key":"e_1_3_2_54_2","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1007\/978-3-030-59152-6_34","volume-title":"Proceedings of the 18th International Symposium on Automated Technology for Verification and Analysis (ATVA \u201920)","volume":"12302","author":"Nickovic Dejan","year":"2020","unstructured":"Dejan Nickovic and Tomoya Yamaguchi. 2020. RTAMT: Online robustness monitors from STL. In Proceedings of the 18th International Symposium on Automated Technology for Verification and Analysis (ATVA \u201920). Dang Van Hung and Oleg Sokolsky (Eds.), Lecture Notes in Computer Science, Vol. 12302, Springer, Berlin, 564\u2013571. DOI: 10.1007\/978-3-030-59152-6_34"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001825"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2023.3297984"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.3390\/app11010192"},{"key":"e_1_3_2_58_2","unstructured":"Zion Market Research. 2023. Cyber-physical systems (CPS) market size share trends & research 2030. Zion Market Research. Retrieved July 20 2023 from https:\/\/www.zionmarketresearch.com\/report\/cyber-physical-systems-market"},{"issue":"2","key":"e_1_3_2_59_2","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.bbe.2023.04.001","article-title":"Combining homomorphic filtering and recurrent neural network in gait signal analysis for neurodegenerative diseases detection","volume":"43","author":"Saljuqi Masume","year":"2023","unstructured":"Masume Saljuqi and Peyvand Ghaderyan. 2023. Combining homomorphic filtering and recurrent neural network in gait signal analysis for neurodegenerative diseases detection. Biocybern. Biomed. Eng. 43, 2 (2023), 476\u2013493.","journal-title":"Biocybern. Biomed. Eng"},{"key":"e_1_3_2_60_2","first-page":"110","volume-title":"Proceedings of the 42nd International Conference on Software Engineering (ICSE \u201920)","author":"Shrestha Sohil Lal","year":"2020","unstructured":"Sohil Lal Shrestha. 2020. Automatic generation of simulink models to find bugs in a cyber-physical system tool chain using deep learning. In Proceedings of the 42nd International Conference on Software Engineering (ICSE \u201920). Gregg Rothermel and Doo-Hwan Bae (Eds.), Companion Volume, ACM, 110\u2013112. DOI: 10.1145\/3377812.3382163"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3528001"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2020.3012862"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","unstructured":"Lev Sorokin Tiziano Munaro Damir Safin Brian Hsuan-Cheng Liao and Adam Molin. 2023. OpenSBT: A modular framework for search-based testing of automated driving systems. arXiv:2306.10296. DOI: 10.48550\/arXiv.2306.10296","DOI":"10.48550\/arXiv.2306.10296"},{"key":"e_1_3_2_64_2","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1145\/1831708.1831732","volume-title":"Proceedings of the 19th International Symposium on Software Testing and Analysis (ISSTA \u201910)","author":"Staats Matt","year":"2010","unstructured":"Matt Staats and Corina S. Pasareanu. 2010. Parallel symbolic execution for structural test generation. In Proceedings of the 19th International Symposium on Software Testing and Analysis (ISSTA \u201910). Paolo Tonella and Alessandro Orso (Eds.). ACM, 183\u2013194. DOI: 10.1145\/1831708.1831732"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2022.3201157"},{"key":"e_1_3_2_66_2","series-title":"Advances in Intelligent Systems and Computing","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1007\/978-3-319-19216-1_47","volume-title":"Proceedings of the 10th International Conference on Dependability and Complex Systems on Theory and Engineering of Complex Systems and Dependability (DepCoS-RELCOMEX)","volume":"365","author":"Tekaya Manel","year":"2015","unstructured":"Manel Tekaya, Mohamed Taha Bennani, Mohamed Abidi Alagui, and Samir Ben Ahmed. 2015. Aspect-oriented test case generation from matlab\/simulink models. In Proceedings of the 10th International Conference on Dependability and Complex Systems on Theory and Engineering of Complex Systems and Dependability (DepCoS-RELCOMEX). Wojciech Zamojski, Jacek Mazurkiewicz, Jaroslaw Sugier, Tomasz Walkowiak, and Janusz Kacprzyk (Eds.), Advances in Intelligent Systems and Computing, Vol. 365, Springer, Cham, 495\u2013504. DOI: 10.1007\/978-3-319-19216-1_47"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-85248-1_15"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3302504.3311814"},{"key":"e_1_3_2_69_2","doi-asserted-by":"crossref","first-page":"109483","DOI":"10.1016\/j.mehy.2019.109483","article-title":"Automated Parkinson's disease recognition based on statistical pooling method using acoustic features","volume":"135","author":"Yaman Orhan","year":"2020","unstructured":"Orhan Yaman, Fatih Ertam, and Turker Tuncer. 2020. Automated Parkinson's disease recognition based on statistical pooling method using acoustic features. Med. Hypotheses 135 (2020), 109483.","journal-title":"Med. Hypotheses"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/1138929.1138949"},{"key":"e_1_3_2_71_2","volume-title":"Model-Based Testing of Real-Time Embedded Systems in the Automotive Domain","author":"Zander-Nowicka Justyna","year":"2009","unstructured":"Justyna Zander-Nowicka. 2009. Model-Based Testing of Real-Time Embedded Systems in the Automotive Domain. Technical University Berlin, Berlin, Germany."},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2007.05.039"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3714467","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,18]],"date-time":"2025-08-18T02:54:15Z","timestamp":1755485655000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3714467"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,17]]},"references-count":71,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3714467"],"URL":"https:\/\/doi.org\/10.1145\/3714467","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,17]]},"assertion":[{"value":"2024-05-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-06","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}