{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T10:23:54Z","timestamp":1771669434556,"version":"3.50.1"},"reference-count":70,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"name":"National Science Foundation","award":["SHF-2048094, CNS-1932620, CNS-2039087, FMitF-1837131, CCF-SHF-1932620, IIS-SLES-2417075"],"award-info":[{"award-number":["SHF-2048094, CNS-1932620, CNS-2039087, FMitF-1837131, CCF-SHF-1932620, IIS-SLES-2417075"]}]},{"name":"Airbus Institute for Engineering Research, Amazon Faculty Research Award, Siemens Corporate Research,\u00a0and\u00a0Toyota R&D"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Cyber-Phys. Syst."],"published-print":{"date-parts":[[2025,10,31]]},"abstract":"<jats:p>\n                    Cyber-physical systems (CPS) designed in simulators, often consisting of multiple interacting agents (e.g., in multi-agent formations), behave differently in the real-world. We would like to verify these systems during runtime when they are deployed. Thus, we propose robust predictive runtime verification (RPRV) algorithms for: (1) general stochastic CPS under signal temporal logic (STL) tasks, and (2) stochastic multi-agent systems (MAS) under spatio-temporal logic tasks. The RPRV problem presents the following challenges: (1) there may not be sufficient data on the behavior of the deployed CPS, (2) predictive models based on design phase system trajectories may encounter distribution shift during real-world deployment, and (3) the algorithms need to scale to the complexity of MAS and be applicable to spatio-temporal logic tasks. To address these challenges, we assume knowledge of an upper bound on the statistical distance (in terms of an\n                    <jats:italic toggle=\"yes\">f<\/jats:italic>\n                    -divergence) between the trajectory distributions of the system at deployment and design time. We are motivated by our prior work where we proposed an accurate and an interpretable RPRV algorithm for general CPS, which we here extend to the MAS setting and spatio-temporal logic tasks. Specifically, we use a learned predictive model to estimate the system behavior at runtime and\n                    <jats:italic toggle=\"yes\">robust conformal prediction<\/jats:italic>\n                    to obtain probabilistic guarantees by accounting for distribution shifts. Building on our prior work, we perform robust conformal prediction over the robust semantics of spatio-temporal reach and escape logic (STREL) to obtain centralized RPRV algorithms for MAS. We empirically validate our results in a drone swarm simulator, where we show the scalability of our RPRV algorithms to MAS and analyze the impact of different trajectory predictors on the verification result. To the best of our knowledge, these are the first statistically valid algorithms for MAS under distribution shift.\n                  <\/jats:p>","DOI":"10.1145\/3748818","type":"journal-article","created":{"date-parts":[[2025,7,17]],"date-time":"2025-07-17T14:29:49Z","timestamp":1752762589000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Distributionally Robust Predictive Runtime Verification under Spatio-Temporal Logic Specifications"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-4283-6358","authenticated-orcid":false,"given":"Yiqi","family":"Zhao","sequence":"first","affiliation":[{"name":"Thomas Lord Department of Computer Science, University of Southern California, Los Angeles, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5465-0032","authenticated-orcid":false,"given":"Emily","family":"Zhu","sequence":"additional","affiliation":[{"name":"Thomas Lord Department of Computer Science, University of Southern California, Los Angeles, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6255-7566","authenticated-orcid":false,"given":"Bardh","family":"Hoxha","sequence":"additional","affiliation":[{"name":"Toyota NA R&amp;D, Ann Arbor, Michigan, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0456-2129","authenticated-orcid":false,"given":"Georgios","family":"Fainekos","sequence":"additional","affiliation":[{"name":"Toyota NA R&amp;D, Ann Arbor, Michigan, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4683-5540","authenticated-orcid":false,"given":"Jyotirmoy V.","family":"Deshmukh","sequence":"additional","affiliation":[{"name":"Thomas Lord Department of Computer Science, University of Southern California, Los Angeles, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3430-6625","authenticated-orcid":false,"given":"Lars","family":"Lindemann","sequence":"additional","affiliation":[{"name":"Thomas Lord Department of Computer Science, University of Southern California, Los Angeles, California, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,11,4]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3158668"},{"key":"e_1_3_3_3_2","unstructured":"A. N. Angelopoulos and S. Bates. 2021. A gentle introduction to conformal prediction and distribution-free uncertainty quantification. arXiv:2107.07511. Retrieved from https:\/\/arxiv.org\/abs\/2107.07511"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1998.1601"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1145\/3127041.3127050","article-title":"Monitoring mobile and spatially distributed cyber-physical systems","author":"Bartocci E.","year":"2017","unstructured":"E. Bartocci, L. Bortolussi, M. Loreti, and L. Nenzi. 2017. Monitoring mobile and spatially distributed cyber-physical systems. In Proceedings of the 15th ACM-IEEE International Conference on Formal Methods and Models for System Design (FMSD), 146\u2013155.","journal-title":"Proceedings of the 15th ACM-IEEE International Conference on Formal Methods and Models for System Design (FMSD)"},{"key":"e_1_3_3_6_2","first-page":"3","volume-title":"Proceedings of the 1st International Workshop on Hybrid Systems and Biology","author":"Bartocci E.","year":"2013","unstructured":"E. Bartocci, L. Bortolussi, L. Nenzi, and G. Sanguinetti. 2013. On the robustness of temporal properties for stochastic models. In Proceedings of the 1st International Workshop on Hybrid Systems and Biology, 3\u201319."},{"key":"e_1_3_3_7_2","first-page":"1","article-title":"Introduction to runtime verification","author":"Bartocci E.","year":"2018","unstructured":"E. Bartocci, Y. Falcone, A. Francalanza, and G. Reger. 2018. Introduction to runtime verification. In Lectures on Runtime Verification: Introductory and Advanced Topics. Springer, 1\u201333.","journal-title":"Lectures on Runtime Verification: Introductory and Advanced Topics"},{"key":"e_1_3_3_8_2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1007\/978-3-030-32079-9_8","article-title":"Neural predictive monitoring","author":"Bortolussi L.","year":"2019","unstructured":"L. Bortolussi, F. Cairoli, N. Paoletti, S. A. Smolka, and S. D. Stoller. 2019. Neural predictive monitoring. In Proceedings of the International Conference on Runtime Verification (RV), 129\u2013147.","journal-title":"Proceedings of the International Conference on Runtime Verification (RV)"},{"key":"e_1_3_3_9_2","volume-title":"Time Series Analysis: Forecasting and Control","author":"Box G.","year":"2015","unstructured":"G. Box, G. Jenkins, G. C. Reinsel, and G. M. Ljung. 2015. Time Series Analysis: Forecasting and Control. Wiley & Sons."},{"key":"e_1_3_3_10_2","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1007\/978-3-031-44267-4_26","volume-title":"Proceedings of the International Conference on Runtime Verification (RV)","author":"Cairoli F.","year":"2023","unstructured":"F. Cairoli, L. Bortolussi, and N. Paoletti. 2023. Learning-based approaches to predictive monitoring with conformal statistical guarantees. In Proceedings of the International Conference on Runtime Verification (RV). Springer, 461\u2013487."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3575870.3587113"},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Maxime Cauchois Suyash Gupta Alnur Ali and John C. Duchi. 2024. Robust validation: Confident predictions even when distributions shift. Journal of the American Statistical Association 119 548 (2024) 3033\u20133044.","DOI":"10.1080\/01621459.2023.2298037"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/SRDS.2013.19"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.3023733"},{"key":"e_1_3_3_15_2","unstructured":"M. Cleaveland I. Lee G. J. Pappas and L. Lindemann. 2023. Conformal prediction regions for time series using linear complementarity programming. arXiv:2304.01075. Retrieved from https:\/\/arxiv.org\/abs\/2304.01075"},{"key":"e_1_3_3_16_2","first-page":"167","volume-title":"ACM SIGPLAN Notices","volume":"26","author":"Cooper R.","year":"1991","unstructured":"R. Cooper and K. Marzullo. 1991. Consistent detection of global predicates. ACM SIGPLAN Notices 26, 12 (1991), 167\u2013174."},{"key":"e_1_3_3_17_2","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1023\/A:1022627411411","article-title":"Support-vector networks","volume":"20","author":"Cortes C.","year":"1995","unstructured":"C. Cortes and V. Vapnik. 1995. Support-vector networks. Machine Learning 20 (1995), 273\u2013297.","journal-title":"Machine Learning"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10703-017-0286-7"},{"key":"e_1_3_3_19_2","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/978-3-642-15297-9_9","volume-title":"Proceedings of the International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS)","author":"Donz\u00e9 A.","year":"2010","unstructured":"A. Donz\u00e9 and O. Maler. 2010. Robust satisfaction of temporal logic over real-valued signals. In Proceedings of the International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS), 92\u2013106."},{"issue":"8","key":"e_1_3_3_20_2","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1016\/0967-0661(96)83721-X","article-title":"Robust and optimal control","volume":"4","author":"Doyle J. C.","year":"1996","unstructured":"J. C. Doyle. 1996. Robust and optimal control. Control Engineering Practice 4, 8 (1996), 1189\u20131190.","journal-title":"Control Engineering Practice"},{"key":"e_1_3_3_21_2","unstructured":"S. Dutta M. Caprio V. Lin M. Cleaveland K. J. Jang I. Ruchkin O. Sokolsky and I. Lee. 2023. Distributionally robust statistical verification with imprecise neural networks. arXiv:2308.14815. Retrieved from https:\/\/arxiv.org\/abs\/2308.14815"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2009.06.021"},{"key":"e_1_3_3_23_2","first-page":"140","volume-title":"Proceedings of the International Conference on Practical Applications of Agents and Multi-Agent Systems","author":"Ferrando A.","year":"2022","unstructured":"A. Ferrando and V. Malvone. 2022. Towards the combination of model checking and runtime verification on multi-agent systems. In Proceedings of the International Conference on Practical Applications of Agents and Multi-Agent Systems, 140\u2013152."},{"key":"e_1_3_3_24_2","first-page":"3145","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Filos Angelos","year":"2020","unstructured":"Angelos Filos, Panagiotis Tigkas, Rowan McAllister, Nicholas Rhinehart, Sergey Levine, and Yarin Gal. 2020. Can autonomous vehicles identify, recover from, and adapt to distribution shifts? In Proceedings of the International Conference on Machine Learning (ICML). PMLR, 3145\u20133153."},{"key":"e_1_3_3_25_2","doi-asserted-by":"crossref","first-page":"3496","DOI":"10.1109\/BigData55660.2022.10020784","volume-title":"Proceedings of 2022 International Conference on Big Data","author":"Fjellstr\u00f6m C.","year":"2022","unstructured":"C. Fjellstr\u00f6m. 2022. Long short-term memory neural network for financial time series. In Proceedings of 2022 International Conference on Big Data. IEEE, 3496\u20133504."},{"key":"e_1_3_3_26_2","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1007\/978-3-319-75632-5_6","article-title":"Runtime verification for decentralised and distributed systems","author":"Francalanza A.","year":"2018","unstructured":"A. Francalanza, J. A. P\u00e9rez, and C. S\u00e1nchez. 2018. Runtime verification for decentralised and distributed systems. In Lectures on Runtime Verification: Introductory and Advanced Topics. Springer, 176\u2013210.","journal-title":"Lectures on Runtime Verification: Introductory and Advanced Topics"},{"key":"e_1_3_3_27_2","first-page":"189","volume-title":"Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control (HSCC)","author":"Haghighi I.","year":"2015","unstructured":"I. Haghighi, A. Jones, Z. Kong, E. Bartocci, R. Gros, and C. Belta. 2015. SpaTeL: A novel spatial-temporal logic and its applications to networked systems. In Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control (HSCC), 189\u2013198."},{"key":"e_1_3_3_28_2","first-page":"208","article-title":"Verification challenges in F-16 ground collision avoidance and other automated maneuvers","author":"Heidlauf P.","year":"2018","unstructured":"P. Heidlauf, A. Collins, M. Bolender, and S. Bak. 2018. Verification challenges in F-16 ground collision avoidance and other automated maneuvers. In ARCH@ADHS, 208\u2013217.","journal-title":"ARCH@ADHS"},{"key":"e_1_3_3_29_2","first-page":"109","volume-title":"Proceedings of the 3rd International Workshop on Engineering Multi-Agent Systems (EMAS \u201915), Revised, Selected, and Invited Papers","author":"Herd B.","year":"2015","unstructured":"B. Herd, S. Miles, P. McBurney, and M. Luck. 2015. Quantitative analysis of multiagent systems through statistical model checking. In Proceedings of the 3rd International Workshop on Engineering Multi-Agent Systems (EMAS \u201915), Revised, Selected, and Invited Papers, 109\u2013130."},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_3_31_2","unstructured":"H. Huang S. He and F. Miao. 2024. Adaptive uncertainty quantification for trajectory prediction under distributional shift. arXiv:2406.12100. Retrieved from https:\/\/arxiv.org\/abs\/2406.12100"},{"key":"e_1_3_3_32_2","first-page":"517","article-title":"From statistical model checking to run-time monitoring using a Bayesian network approach","author":"Jaeger M.","year":"2020","unstructured":"M. Jaeger, K. G. Larsen, and A. Tibo. 2020. From statistical model checking to run-time monitoring using a Bayesian network approach. In Proceedings of the International Conference on Runtime Verification (RV), 517\u2013535.","journal-title":"Proceedings of the International Conference on Runtime Verification (RV)"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_3_3_34_2","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1007\/978-3-319-91908-9_23","volume-title":"Computing and Software Science: State of the Art and Perspectives","author":"Legay A.","year":"2019","unstructured":"A. Legay, A. Lukina, L. M. Traonouez, J. Yang, S. A. Smolka, and R. Grosu. 2019. Statistical model checking. In Computing and Software Science: State of the Art and Perspectives. Springer, 478\u2013504."},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2017.1307116"},{"key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.automatica.2018.12.022","article-title":"Robust control for signal temporal logic specifications using discrete average space robustness","volume":"101","author":"Lindemann L.","year":"2019","unstructured":"L. Lindemann and D. V. Dimarogonas. 2019. Robust control for signal temporal logic specifications using discrete average space robustness. Automatica 101 (2019), 377\u2013387.","journal-title":"Automatica"},{"key":"e_1_3_3_37_2","article-title":"Conformal prediction for STL runtime verification","author":"Lindemann L.","year":"2023","unstructured":"L. Lindemann, X. Qin, J. V. Deshmukh, and G. J. Pappas. 2023. Conformal prediction for STL runtime verification. In Proceedings of the ACM\/IEEE 14th International Conference on Cyber-Physical Systems (ICCPS).","journal-title":"Proceedings of the ACM\/IEEE 14th International Conference on Cyber-Physical Systems (ICCPS)"},{"key":"e_1_3_3_38_2","unstructured":"Lars Lindemann Yiqi Zhao Xinyi Yu George J. Pappas and Jyotirmoy V. Deshmukh. 2024. Formal verification and control with conformal prediction. arXiv:2409.00536. Retrieved from https:\/\/arxiv.org\/abs\/2409.00536"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPS48487.2020.00013"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477032"},{"key":"e_1_3_3_41_2","first-page":"152","volume-title":"Proceedings of the International Symposium on Formal Techniques in Real-Time and Fault-Tolerant Systems (FTRTFT FORMATS)","author":"Maler O.","year":"2004","unstructured":"O. Maler and D. Nickovic. 2004. Monitoring temporal properties of continuous signals. In Proceedings of the International Symposium on Formal Techniques in Real-Time and Fault-Tolerant Systems (FTRTFT FORMATS), 152\u2013166."},{"key":"e_1_3_3_42_2","unstructured":"Z. Mao C. Sobolewski and I. Ruchkin. 2023. How safe am I given what I see? Calibrated prediction of safety chances for image-controlled autonomy. arXiv:2308.12252. Retrieved from https:\/\/arxiv.org\/abs\/2308.12252"},{"key":"e_1_3_3_43_2","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1109\/RIOS.2016.7529496","volume-title":"Proceedings of the 2016 Artificial Intelligence and Robotics (IRANOPEN)","author":"Mehrmolaei S.","year":"2016","unstructured":"S. Mehrmolaei and M. R. Keyvanpour. 2016. Time series forecasting using improved ARIMA. In Proceedings of the 2016 Artificial Intelligence and Robotics (IRANOPEN). IEEE, 92\u201397."},{"key":"e_1_3_3_44_2","unstructured":"R. Micalizio. 2007. On-Line Monitoring and Diagnosis of a Multi-Agent System: A Model-Based Approach. Ph.D. Dissertation."},{"key":"e_1_3_3_45_2","first-page":"154","volume-title":"Proceedings of the ACM\/IEEE 14th International Conference on Cyber-Physical Systems (ICCPS)","author":"Momtaz A.","year":"2023","unstructured":"A. Momtaz, H. Abbas, and B. Bonakdarpour. 2023. Monitoring signal temporal logic in distributed cyber-physical systems. In Proceedings of the ACM\/IEEE 14th International Conference on Cyber-Physical Systems (ICCPS), 154\u2013165."},{"key":"e_1_3_3_46_2","doi-asserted-by":"crossref","unstructured":"A. Muthali H. Shen S. Deglurkar M. H. Lim R. Roelofs A. Faust and C. Tomlin. 2023. Multi-agent reachability calibration with conformal prediction. arXiv:2304.00432. Retrieved from https:\/\/arxiv.org\/abs\/2304.00432","DOI":"10.1109\/CDC49753.2023.10383723"},{"key":"e_1_3_3_47_2","article-title":"A logic for monitoring dynamic networks of spatially-distributed cyber-physical systems","volume":"18","author":"Nenzi L.","year":"2022","unstructured":"L. Nenzi, E. Bartocci, L. Bortolussi, and M. Loreti. 2022. A logic for monitoring dynamic networks of spatially-distributed cyber-physical systems. Logical Methods in Computer Science 18 (2022), 4:1\u20134:30.","journal-title":"Logical Methods in Computer Science"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10009-023-00710-5"},{"issue":"3","key":"e_1_3_3_49_2","doi-asserted-by":"crossref","first-page":"4504","DOI":"10.1109\/TASE.2023.3297984","article-title":"Part-x: A family of stochastic algorithms for search-based test generation with probabilistic guarantees","volume":"21","author":"Pedrielli G.","year":"2023","unstructured":"G. Pedrielli, T. Khandait, Y. Cao, Q. Thibeault, H. Huang, M. Castillo-Effen, and G. Fainekos. 2023. Part-x: A family of stochastic algorithms for search-based test generation with probabilistic guarantees. IEEE Transactions on Automation Science and Engineering 21, 3 (2023), 4504\u20134525.","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"key":"e_1_3_3_50_2","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1007\/978-3-030-57628-8_11","volume-title":"Proceedings of the International Conference on Formal Modeling and Analysis of Timed Systems","author":"Qin X.","year":"2020","unstructured":"X. Qin and J. V. Deshmukh. 2020. Clairvoyant monitoring for signal temporal logic. In Proceedings of the International Conference on Formal Modeling and Analysis of Timed Systems, 178\u2013195."},{"key":"e_1_3_3_51_2","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/ICCPS54341.2022.00017","article-title":"Statistical verification of cyber-physical systems using surrogate models and conformal inference","author":"Qin X.","year":"2022","unstructured":"X. Qin, Y. Xian, A. Zutshi, C. Fan, and J. V. Deshmukh. 2022. Statistical verification of cyber-physical systems using surrogate models and conformal inference. In Proceedings of the ACM\/IEEE 13th International Conference on Cyber-Physical Systems (ICCPS), 116\u2013126.","journal-title":"Proceedings of the ACM\/IEEE 13th International Conference on Cyber-Physical Systems (ICCPS)"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1137\/060674909"},{"key":"e_1_3_3_53_2","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1145\/2487575.2487655","volume-title":"Proceedings of the SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Ristanoski G.","year":"2013","unstructured":"G. Ristanoski, W. Liu, and J. Bailey. 2013. A time-dependent enhanced support vector machine for time series regression. In Proceedings of the SIGKDD International Conference on Knowledge Discovery and Data Mining, 946\u2013954."},{"key":"e_1_3_3_54_2","article-title":"Conformalized quantile regression","volume":"32","author":"Romano Y.","year":"2019","unstructured":"Y. Romano, E. Patterson, and E. Candes. 2019. Conformalized quantile regression. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 32.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_55_2","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/ICRERA.2013.6749783","article-title":"Smart city by multi-agent systems","author":"Roscia M.","year":"2013","unstructured":"M. Roscia, M. Longo, and G. C. Lazaroiu. 2013. Smart city by multi-agent systems. In Proceedings of the 2013 International Conference on Renewable Energy Research and Applications (ICRERA), 371\u2013376.","journal-title":"Proceedings of the 2013 International Conference on Renewable Energy Research and Applications (ICRERA)"},{"key":"e_1_3_3_56_2","first-page":"772","volume-title":"Proceedings of the Allerton Conference on Communication, Control, and Computing","author":"Sadraddini S.","year":"2015","unstructured":"S. Sadraddini and C. Belta. 2015. Robust temporal logic model predictive control. In Proceedings of the Allerton Conference on Communication, Control, and Computing, 772\u2013779."},{"key":"e_1_3_3_57_2","doi-asserted-by":"crossref","first-page":"109781","DOI":"10.1016\/j.automatica.2021.109781","article-title":"Data-driven verification of stochastic linear systems with signal temporal logic constraints","volume":"131","author":"Salamati A.","year":"2021","unstructured":"A. Salamati, S. Soudjani, and M. Zamani. 2021. Data-driven verification of stochastic linear systems with signal temporal logic constraints. Automatica 131 (2021), 109781.","journal-title":"Automatica"},{"key":"e_1_3_3_58_2","first-page":"2588","volume-title":"Proceedings of the AIAA SCITECH 2023 Forum","author":"Schirmer S.","year":"2023","unstructured":"S. Schirmer, C. Torens, J. C. Dauer, J. Baumeister, B. Finkbeiner, and K. Y. Rozier. 2023. A hierarchy of monitoring properties for autonomous systems. In Proceedings of the AIAA SCITECH 2023 Forum, 2588."},{"key":"e_1_3_3_59_2","doi-asserted-by":"crossref","unstructured":"O. Sch\u00f6n Z. Zhong and S. Soudjani. 2024. Data-driven distributionally robust safety verification using barrier certificates and conditional mean embeddings. arXiv:2403.10497. Retrieved from https:\/\/arxiv.org\/abs\/2403.10497","DOI":"10.23919\/ACC60939.2024.10644349"},{"key":"e_1_3_3_60_2","article-title":"Statistical model checking of black-box probabilistic systems","author":"Sen K.","year":"2004","unstructured":"K. Sen, M. Viswanathan, and G. Agha. 2004. Statistical model checking of black-box probabilistic systems. In Proceedings of the International Conference on Computer Aided Verification (CAV).","journal-title":"Proceedings of the International Conference on Computer Aided Verification (CAV)"},{"issue":"3","key":"e_1_3_3_61_2","first-page":"371","article-title":"A tutorial on conformal prediction","volume":"9","author":"Shafer G.","year":"2008","unstructured":"G. Shafer and V. Vovk. 2008. A tutorial on conformal prediction. JMLR 9, 3 (2008), 371\u2013421.","journal-title":"JMLR"},{"key":"e_1_3_3_62_2","first-page":"276","volume-title":"Proceedings of the International Conference on Runtime Verification (RV)","author":"Sistla A. P.","year":"2011","unstructured":"A. P. Sistla, M. \u017defran, and Y. Feng. 2011. Runtime monitoring of stochastic cyber-physical systems with hybrid state. In Proceedings of the International Conference on Runtime Verification (RV). Springer, 276\u2013293."},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS45743.2020.9340854"},{"key":"e_1_3_3_64_2","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1109\/IV55156.2024.10588828","volume-title":"Proceedings of the 2024 IEEE Intelligent Vehicles Symposium (IV)","author":"Stoler B.","year":"2024","unstructured":"B. Stoler, I. Navarro, M. Jana, S. Hwang, J. Francis, and J. Oh. 2024. SafeShift: Safety-informed distribution shifts for robust trajectory prediction in autonomous driving. In Proceedings of the 2024 IEEE Intelligent Vehicles Symposium (IV). IEEE, 1179\u20131186."},{"key":"e_1_3_3_65_2","article-title":"Attention is all you need","author":"Vaswani A.","year":"2017","unstructured":"A. Vaswani. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3487212.3487344"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.5555\/1062391"},{"key":"e_1_3_3_68_2","doi-asserted-by":"crossref","first-page":"111445","DOI":"10.1016\/j.automatica.2023.111445","article-title":"Model predictive monitoring of dynamical systems for STL specifications","volume":"160","author":"Yu X.","year":"2024","unstructured":"X. Yu, W. Dong, S. Li, and X. Yin. 2024. Model predictive monitoring of dynamical systems for STL specifications. Automatica 160 (2024), 111445.","journal-title":"Automatica"},{"key":"e_1_3_3_69_2","unstructured":"X. Yu Y. Zhao X. Yin and L. Lindemann. 2023. Signal temporal logic control synthesis among uncontrollable dynamic agents with conformal prediction. arXiv:2312.04242. Retrieved from https:\/\/arxiv.org\/abs\/2312.04242"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3365365.3382209"},{"key":"e_1_3_3_71_2","first-page":"169","volume-title":"Proceedings of the ACM\/IEEE 15th International Conference on Cyber-Physical Systems (ICCPS)","author":"Zhao Y.","year":"2024","unstructured":"Y. Zhao, B. Hoxha, G. Fainekos, J. V. Deshmukh, and L. Lindemann. 2024. Robust conformal prediction for STL runtime verification under distribution shift. In Proceedings of the ACM\/IEEE 15th International Conference on Cyber-Physical Systems (ICCPS), 169\u2013179."}],"container-title":["ACM Transactions on Cyber-Physical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3748818","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T14:22:05Z","timestamp":1762266125000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3748818"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,31]]},"references-count":70,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,10,31]]}},"alternative-id":["10.1145\/3748818"],"URL":"https:\/\/doi.org\/10.1145\/3748818","relation":{},"ISSN":["2378-962X","2378-9638"],"issn-type":[{"value":"2378-962X","type":"print"},{"value":"2378-9638","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,31]]},"assertion":[{"value":"2024-09-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}