{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T19:59:26Z","timestamp":1776887966250,"version":"3.51.2"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,12,21]],"date-time":"2023-12-21T00:00:00Z","timestamp":1703116800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["871259 and 957254"],"award-info":[{"award-number":["871259 and 957254"]}]},{"name":"NSERC of Canada under the Discovery and CRC programs"},{"DOI":"10.13039\/501100004063","name":"Knut and Alice Wallenberg Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004063","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>Cyber-physical Systems (CPSs) are often safety-critical and deployed in uncertain environments. Identifying scenarios where CPSs do not comply with requirements is fundamental but difficult due to the multidisciplinary nature of CPSs. We investigate the testing of control-based CPSs, where control and software engineers develop the software collaboratively. Control engineers make design assumptions during system development to leverage control theory and obtain guarantees on CPS behaviour. In the implemented system, however, such assumptions are not always satisfied, and their falsification can lead the loss of guarantees. We define stress testing of control-based CPSs as generating tests to falsify such design assumptions. We highlight different types of assumptions, focusing on the use of linearised physics models. To generate stress tests falsifying such assumptions, we leverage control theory to qualitatively characterise the input space of a control-based CPS. We propose a novel test parametrisation for control-based CPSs and use it with the input space characterisation to develop a stress testing approach. We evaluate our approach on three case study systems, including a drone, a continuous-current motor (in five configurations), and an aircraft. Our results show the effectiveness of the proposed testing approach in falsifying the design assumptions and highlighting the causes of assumption violations.<\/jats:p>","DOI":"10.1145\/3624742","type":"journal-article","created":{"date-parts":[[2023,9,20]],"date-time":"2023-09-20T11:52:47Z","timestamp":1695210767000},"page":"1-58","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Stress Testing Control Loops in Cyber-physical Systems"],"prefix":"10.1145","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7013-1191","authenticated-orcid":false,"given":"Claudio","family":"Mandrioli","sequence":"first","affiliation":[{"name":"University of Luxembourg, Luxembourg"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9025-7173","authenticated-orcid":false,"given":"Seung Yeob","family":"Shin","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1143-1127","authenticated-orcid":false,"given":"Martina","family":"Maggio","sequence":"additional","affiliation":[{"name":"Saarland University, Germany Lund University, Sweden"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4854-685X","authenticated-orcid":false,"given":"Domenico","family":"Bianculli","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1393-1010","authenticated-orcid":false,"given":"Lionel","family":"Briand","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg University of Ottawa, Canada"}]}],"member":"320","published-online":{"date-parts":[[2023,12,21]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19849-6_16"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.11.035"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1515\/9781400828739"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3473920"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPS48487.2020.00022"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781119546405.ch4."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTSS52674.2021.00039"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.2514\/6.2020-2102."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2889160.2889212"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/1138474.1138479"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2008.45"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2006.888386"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1007\/978-3-642-29860-8_22","volume-title":"Runtime Verification","author":"Chakarov Aleksandar","year":"2012","unstructured":"Aleksandar Chakarov, Sriram Sankaranarayanan, and Georgios Fainekos. 2012. Combining time and frequency domain specifications for periodic signals. In Runtime Verification, Sarfraz Khurshid and Koushik Sen (Eds.). Springer, Berlin, 294\u2013309."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3143561"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30502-6_23"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1090\/S0025-5718-1965-0178586-1"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20872-0_2"},{"key":"e_1_3_2_19_2","unstructured":"Lane Desborough and Randy Miller. 2002. Increasing Customer Value of Industrial Control Performance Monitoring\u2014Honeywell\u2019s Experience. https:\/\/core.ac.uk\/display\/102313613"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/978-3-642-33386-6_9","volume-title":"Automated Technology for Verification and Analysis","author":"Donz\u00e9 Alexandre","year":"2012","unstructured":"Alexandre Donz\u00e9, Oded Maler, Ezio Bartocci, Dejan Nickovic, Radu Grosu, and Scott Smolka. 2012. On temporal logic and signal processing. In Automated Technology for Verification and Analysis, Supratik Chakraborty and Madhavan Mukund (Eds.). Springer, Berlin, 92\u2013106."},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/978-3-319-17524-9_10","volume-title":"NASA Formal Methods","author":"Dreossi Tommaso","year":"2015","unstructured":"Tommaso Dreossi, Thao Dang, Alexandre Donz\u00e9, James Kapinski, Xiaoqing Jin, and Jyotirmoy V. Deshmukh. 2015. Efficient guiding strategies for testing of temporal properties of hybrid systems. In NASA Formal Methods, Klaus Havelund, Gerard Holzmann, and Rajeev Joshi (Eds.). Springer International Publishing, Cham, 127\u2013142."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTCSA55878.2022.00008"},{"key":"e_1_3_2_23_2","volume-title":"Feedback Control Systems: Analysis, Synthesis, and Design","author":"Gille-Maisani J. C.","year":"1959","unstructured":"J. C. Gille-Maisani and P. Decaulne. 1959. Feedback Control Systems: Analysis, Synthesis, and Design. McGraw-Hill. 58009856 Retrieved from https:\/\/books.google.se\/books?id=9WG9zQEACAAJ"},{"key":"e_1_3_2_24_2","unstructured":"Marcus Greiff. 2017. Modelling and Control of the Crazyflie Quadrotor for Aggressive and Autonomous Flight by Optical Flow Driven State Estimation. Student Paper. https:\/\/lup.lub.lu.se\/student-papers\/search\/publication\/8905295"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2110.01099"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397382"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00029"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0205-9_1"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2011.37"},{"key":"e_1_3_2_30_2","volume-title":"Nonlinear Systems","author":"Khalil H. K.","year":"2002","unstructured":"H. K. Khalil. 2002. Nonlinear Systems. Prentice Hall. 95045804 Retrieved from https:\/\/books.google.se\/books?id=t_d1QgAACAAJ"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.4271\/2004-01-1593"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.3390\/s150304837"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTSS.2012.85"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.4230\/OASIcs.PARMA-DITAM.2021.3"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617170"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2014.12.025"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642978"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3117770"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884797"},{"key":"e_1_3_2_40_2","doi-asserted-by":"crossref","unstructured":"Claudio Menghi Shiva Nejati Lionel C. Briand and Yago Isasi Parache. 2019. Approximation-refinement testing of compute-intensive cyber-physical models: An approach based on system identification. Retrieved from http:\/\/arxiv.org\/abs\/1910.02837","DOI":"10.1145\/3377811.3380370"},{"key":"e_1_3_2_41_2","first-page":"27","volume-title":"Foundations of Software Engineering","author":"Menghi Claudio","year":"2019","unstructured":"Claudio Menghi, Shiva Nejati, Khouloud Gaaloul, and Lionel C. Briand. 2019. Generating automated and online test oracles for simulink models with continuous and uncertain behaviors. In Foundations of Software Engineering. ACM, 27\u201338."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00082"},{"issue":"9","key":"e_1_3_2_43_2","first-page":"1","article-title":"Covariance correction step for Kalman filtering with an attitude","volume":"40","author":"Mueller Mark W.","year":"2016","unstructured":"Mark W. Mueller, Markus Hehn, and Raffaello D\u2019Andrea. 2016. Covariance correction step for Kalman filtering with an attitude. J. Guid. Control Dynam. 40, 9 (2016), 1\u20137.","journal-title":"J. Guid. Control Dynam."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3340444"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-35497-2_24"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1007\/978-3-642-00768-2_31","volume-title":"Tools and Algorithms for the Construction and Analysis of Systems","author":"Plaku Erion","year":"2009","unstructured":"Erion Plaku, Lydia E. Kavraki, and Moshe Y. Vardi. 2009. Falsification of LTL safety properties in hybrid systems. In Tools and Algorithms for the Construction and Analysis of Systems, Stefan Kowalewski and Anna Philippou (Eds.). Springer, Berlin, 368\u2013382."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470382844.ch14"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1002\/047172288X.fmatter"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3296979.3192411"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/MED.2018.8442759"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-08-044894-7.01720-6"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2018.00040"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.4230\/LIPIcs.ECRTS.2021.15"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/AERO.2001.931302"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3072957"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.2969178"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC.2017.7"},{"key":"e_1_3_2_58_2","first-page":"2014","article-title":"Ramifications of software implementation and deployment: A case study on yaw moment controller design","author":"Zimmer Michael","year":"2015","unstructured":"Michael Zimmer, J. Hedrick, and Edward A. Lee. 2015. Ramifications of software implementation and deployment: A case study on yaw moment controller design. In Proceedings of the American Control Conference (ACC\u201915). 2014\u20132019.","journal-title":"Proceedings of the American Control Conference (ACC\u201915)"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3624742","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3624742","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:44Z","timestamp":1750178144000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3624742"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,21]]},"references-count":57,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3624742"],"URL":"https:\/\/doi.org\/10.1145\/3624742","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,21]]},"assertion":[{"value":"2022-12-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-16","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}