{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T17:10:26Z","timestamp":1772644226878,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:00:00Z","timestamp":1683590400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","award":["W911NF-20-1-0080"],"award-info":[{"award-number":["W911NF-20-1-0080"]}],"id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]},{"name":"U.S. Army Research Laboratory Cooperative Research Agreement","award":["W911NF-17-2-0196"],"award-info":[{"award-number":["W911NF-17-2-0196"]}]},{"name":"Air Force Research Laboratory and Defense Advanced Research Projects Agency","award":["FA8750-18-C-0090"],"award-info":[{"award-number":["FA8750-18-C-0090"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,5,9]]},"DOI":"10.1145\/3576841.3585931","type":"proceedings-article","created":{"date-parts":[[2023,5,4]],"date-time":"2023-05-04T16:18:19Z","timestamp":1683217099000},"page":"120-131","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["CODiT: Conformal Out-of-Distribution Detection in Time-Series Data for Cyber-Physical Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-7662-3174","authenticated-orcid":false,"given":"Ramneet","family":"Kaur","sequence":"first","affiliation":[{"name":"Computer and Information Science, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7852-7043","authenticated-orcid":false,"given":"Kaustubh","family":"Sridhar","sequence":"additional","affiliation":[{"name":"Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9184-5652","authenticated-orcid":false,"given":"Sangdon","family":"Park","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, Georgia, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3233-1720","authenticated-orcid":false,"given":"Yahan","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5983-9095","authenticated-orcid":false,"given":"Susmit","family":"Jha","sequence":"additional","affiliation":[{"name":"SRI International, Menlo Park, California, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6889-0204","authenticated-orcid":false,"given":"Anirban","family":"Roy","sequence":"additional","affiliation":[{"name":"SRI International, Menlo Park, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5282-0658","authenticated-orcid":false,"given":"Oleg","family":"Sokolsky","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2672-1132","authenticated-orcid":false,"given":"Insup","family":"Lee","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,5,9]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Vineeth Balasubramanian Shen-Shyang Ho and Vladimir Vovk. 2014. Conformal prediction for reliable machine learning: theory adaptations and applications. Newnes.  Vineeth Balasubramanian Shen-Shyang Ho and Vladimir Vovk. 2014. Conformal prediction for reliable machine learning: theory adaptations and applications. Newnes."},{"key":"e_1_3_2_1_2_1","unstructured":"Michele Basseville Igor V Nikiforov etal 1993. Detection of abrupt changes: theory and application. Vol. 104. prentice Hall Englewood Cliffs.  Michele Basseville Igor V Nikiforov et al. 1993. Detection of abrupt changes: theory and application. Vol. 104. prentice Hall Englewood Cliffs."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF03178892"},{"key":"e_1_3_2_1_4_1","volume-title":"Davide Del Testa","author":"Bojarski Mariusz","year":"2016","unstructured":"Mariusz Bojarski , Davide Del Testa , Daniel Dworakowski, Bernhard Firner , Beat Flepp, Prasoon Goyal, Lawrence D Jackel, Mathew Monfort, Urs Muller, Jiakai Zhang, et al. 2016 . End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316 (2016). Mariusz Bojarski, Davide Del Testa, Daniel Dworakowski, Bernhard Firner, Beat Flepp, Prasoon Goyal, Lawrence D Jackel, Mathew Monfort, Urs Muller, Jiakai Zhang, et al. 2016. End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316 (2016)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPS48487.2020.00024"},{"key":"e_1_3_2_1_6_1","volume-title":"Learning Augmentation Distributions using Transformed Risk Minimization. arXiv preprint arXiv:2111.08190","author":"Chatzipantazis Evangelos","year":"2021","unstructured":"Evangelos Chatzipantazis , Stefanos Pertigkiozoglou , Kostas Daniilidis , and Edgar Dobriban . 2021. Learning Augmentation Distributions using Transformed Risk Minimization. arXiv preprint arXiv:2111.08190 ( 2021 ). Evangelos Chatzipantazis, Stefanos Pertigkiozoglou, Kostas Daniilidis, and Edgar Dobriban. 2021. Learning Augmentation Distributions using Transformed Risk Minimization. arXiv preprint arXiv:2111.08190 (2021)."},{"key":"e_1_3_2_1_7_1","first-page":"1","article-title":"A group-theoretic framework for data augmentation","volume":"21","author":"Chen Shuxiao","year":"2020","unstructured":"Shuxiao Chen , Edgar Dobriban , and Jane H Lee . 2020 . A group-theoretic framework for data augmentation . JMLR 21 , 245 (2020), 1 -- 71 . Shuxiao Chen, Edgar Dobriban, and Jane H Lee. 2020. A group-theoretic framework for data augmentation. JMLR 21, 245 (2020), 1--71.","journal-title":"JMLR"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Jeffrey De Fauw Joseph R Ledsam Bernardino Romera-Paredes Stanislav Nikolov Nenad Tomasev Sam Blackwell Harry Askham Xavier Glorot Brendan O'Donoghue Daniel Visentin etal 2018. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nature medicine 24 9 (2018) 1342--1350.  Jeffrey De Fauw Joseph R Ledsam Bernardino Romera-Paredes Stanislav Nikolov Nenad Tomasev Sam Blackwell Harry Askham Xavier Glorot Brendan O'Donoghue Daniel Visentin et al. 2018. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nature medicine 24 9 (2018) 1342--1350.","DOI":"10.1038\/s41591-018-0107-6"},{"key":"e_1_3_2_1_9_1","volume-title":"Conference on robot learning. PMLR, 1--16","author":"Dosovitskiy Alexey","year":"2017","unstructured":"Alexey Dosovitskiy , German Ros , Felipe Codevilla , Antonio Lopez , and Vladlen Koltun . 2017 . CARLA: An open urban driving simulator . In Conference on robot learning. PMLR, 1--16 . Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio Lopez, and Vladlen Koltun. 2017. CARLA: An open urban driving simulator. In Conference on robot learning. PMLR, 1--16."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477026"},{"key":"e_1_3_2_1_11_1","unstructured":"RA Fisher. 1932. Statistical Methods for Research Workers. 4* Edition Oliver & Boyd.  RA Fisher. 1932. Statistical Methods for Research Workers. 4* Edition Oliver & Boyd."},{"key":"e_1_3_2_1_12_1","volume-title":"Robusttad: Robust time series anomaly detection via decomposition and convolutional neural networks. arXiv preprint arXiv:2002.09545","author":"Gao Jingkun","year":"2020","unstructured":"Jingkun Gao , Xiaomin Song , Qingsong Wen , Pichao Wang , Liang Sun , and Huan Xu . 2020 . Robusttad: Robust time series anomaly detection via decomposition and convolutional neural networks. arXiv preprint arXiv:2002.09545 (2020). Jingkun Gao, Xiaomin Song, Qingsong Wen, Pichao Wang, Liang Sun, and Huan Xu. 2020. Robusttad: Robust time series anomaly detection via decomposition and convolutional neural networks. arXiv preprint arXiv:2002.09545 (2020)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.129"},{"key":"e_1_3_2_1_14_1","volume-title":"International Conference on Learning Representations.","author":"Haroush Matan","year":"2021","unstructured":"Matan Haroush , Tzviel Frostig , Ruth Heller , and Daniel Soudry . 2021 . A Statistical Framework for Efficient Out of Distribution Detection in Deep Neural Networks . In International Conference on Learning Representations. Matan Haroush, Tzviel Frostig, Ruth Heller, and Daniel Soudry. 2021. A Statistical Framework for Efficient Out of Distribution Detection in Deep Neural Networks. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_15_1","volume-title":"Dynamic markers of altered gait rhythm in amyotrophic lateral sclerosis. Journal of applied physiology","author":"Hausdorff Jeffrey M","year":"2000","unstructured":"Jeffrey M Hausdorff , Apinya Lertratanakul , Merit E Cudkowicz , Amie L Peterson , David Kaliton , and Ary L Goldberger . 2000. Dynamic markers of altered gait rhythm in amyotrophic lateral sclerosis. Journal of applied physiology ( 2000 ). Jeffrey M Hausdorff, Apinya Lertratanakul, Merit E Cudkowicz, Amie L Peterson, David Kaliton, and Ary L Goldberger. 2000. Dynamic markers of altered gait rhythm in amyotrophic lateral sclerosis. Journal of applied physiology (2000)."},{"key":"e_1_3_2_1_16_1","volume-title":"International Conference on Learning Representations.","author":"Hendrycks Dan","year":"2017","unstructured":"Dan Hendrycks and Kevin Gimpel . 2017 . A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks . In International Conference on Learning Representations. Dan Hendrycks and Kevin Gimpel. 2017. A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00982"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450267.3450535"},{"key":"e_1_3_2_1_19_1","volume-title":"iDECODe: In-distribution Equivariance for Conformal Out-of-distribution Detection","author":"Kaur Ramneet","unstructured":"Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Edgar Dobriban , Oleg Sokolsky , and Insup Lee . 2022. iDECODe: In-distribution Equivariance for Conformal Out-of-distribution Detection , Association for the Advancement of Artificial Intelligence. arXiv:2201.02331 [cs.LG] Ramneet Kaur, Susmit Jha, Anirban Roy, Sangdon Park, Edgar Dobriban, Oleg Sokolsky, and Insup Lee. 2022. iDECODe: In-distribution Equivariance for Conformal Out-of-distribution Detection, Association for the Advancement of Artificial Intelligence. arXiv:2201.02331 [cs.LG]"},{"key":"e_1_3_2_1_20_1","volume-title":"Detecting oods as datapoints with high uncertainty. arXiv preprint arXiv:2108.06380","author":"Kaur Ramneet","year":"2021","unstructured":"Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Oleg Sokolsky , and Insup Lee . 2021. Detecting oods as datapoints with high uncertainty. arXiv preprint arXiv:2108.06380 ( 2021 ). Ramneet Kaur, Susmit Jha, Anirban Roy, Sangdon Park, Oleg Sokolsky, and Insup Lee. 2021. Detecting oods as datapoints with high uncertainty. arXiv preprint arXiv:2108.06380 (2021)."},{"key":"e_1_3_2_1_21_1","volume-title":"Are all outliers alike? On Understanding the Diversity of Outliers for Detecting OODs. arXiv preprint arXiv:2103.12628","author":"Kaur Ramneet","year":"2021","unstructured":"Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , and Insup Lee . 2021. Are all outliers alike? On Understanding the Diversity of Outliers for Detecting OODs. arXiv preprint arXiv:2103.12628 ( 2021 ). Ramneet Kaur, Susmit Jha, Anirban Roy, Oleg Sokolsky, and Insup Lee. 2021. Are all outliers alike? On Understanding the Diversity of Outliers for Detecting OODs. arXiv preprint arXiv:2103.12628 (2021)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10472-013-9381-7"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2017.23"},{"key":"e_1_3_2_1_25_1","volume-title":"DriftNet: Aggressive Driving Behavior Classification using 3D EfficientNet Architecture. arXiv preprint arXiv:2004.11970","author":"Noor Alam","year":"2020","unstructured":"Alam Noor , Bilel Benjdira , Adel Ammar , and Anis Koubaa . 2020. DriftNet: Aggressive Driving Behavior Classification using 3D EfficientNet Architecture. arXiv preprint arXiv:2004.11970 ( 2020 ). Alam Noor, Bilel Benjdira, Adel Ammar, and Anis Koubaa. 2020. DriftNet: Aggressive Driving Behavior Classification using 3D EfficientNet Architecture. arXiv preprint arXiv:2004.11970 (2020)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00822"},{"key":"e_1_3_2_1_27_1","volume-title":"Efficient Out-of-Distribution Detection Using Latent Space of \u03b2-VAE for Cyber-Physical Systems. arXiv preprint:2108.11800","author":"Ramakrishna Shreyas","year":"2021","unstructured":"Shreyas Ramakrishna , Zahra Rahiminasab , Gabor Karsai , Arvind Easwaran , and Abhishek Dubey . 2021. Efficient Out-of-Distribution Detection Using Latent Space of \u03b2-VAE for Cyber-Physical Systems. arXiv preprint:2108.11800 ( 2021 ). Shreyas Ramakrishna, Zahra Rahiminasab, Gabor Karsai, Arvind Easwaran, and Abhishek Dubey. 2021. Efficient Out-of-Distribution Detection Using Latent Space of \u03b2-VAE for Cyber-Physical Systems. arXiv preprint:2108.11800 (2021)."},{"key":"e_1_3_2_1_28_1","unstructured":"Ujjwal Saxena. 2018. Automold. https:\/\/github.com\/UjjwalSaxena\/Automold-Road-Augmentation-Library.  Ujjwal Saxena. 2018. Automold. https:\/\/github.com\/UjjwalSaxena\/Automold-Road-Augmentation-Library."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2012.6247909"},{"key":"e_1_3_2_1_30_1","volume-title":"Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural networks 32","author":"Stallkamp Johannes","year":"2012","unstructured":"Johannes Stallkamp , Marc Schlipsing , Jan Salmen , and Christian Igel . 2012. Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural networks 32 ( 2012 ), 323--332. Johannes Stallkamp, Marc Schlipsing, Jan Salmen, and Christian Igel. 2012. Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural networks 32 (2012), 323--332."},{"key":"e_1_3_2_1_31_1","volume-title":"Csi: Novelty detection via contrastive learning on distributionally shifted instances. Advances in Neural Information Processing Systems 33","author":"Tack Jihoon","year":"2020","unstructured":"Jihoon Tack , Sangwoo Mo , Jongheon Jeong , and Jinwoo Shin . 2020 . Csi: Novelty detection via contrastive learning on distributionally shifted instances. Advances in Neural Information Processing Systems 33 (2020). Jihoon Tack, Sangwoo Mo, Jongheon Jeong, and Jinwoo Shin. 2020. Csi: Novelty detection via contrastive learning on distributionally shifted instances. Advances in Neural Information Processing Systems 33 (2020)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566468.2566483"},{"key":"e_1_3_2_1_33_1","unstructured":"Paolo Toccaceli and Alexander Gammerman. 2017. Combination of conformal predictors for classification. In Conformal and Probabilistic Prediction and Applications. PMLR 39--61.  Paolo Toccaceli and Alexander Gammerman. 2017. Combination of conformal predictors for classification. In Conformal and Probabilistic Prediction and Applications. PMLR 39--61."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00675"},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of the 20th International Conference on Machine Learning (ICML-03)","author":"Vovk Vladimir","year":"2003","unstructured":"Vladimir Vovk , Ilia Nouretdinov , and Alexander Gammerman . 2003 . Testing exchangeability on-line . In Proceedings of the 20th International Conference on Machine Learning (ICML-03) . 768--775. Vladimir Vovk, Ilia Nouretdinov, and Alexander Gammerman. 2003. Testing exchangeability on-line. In Proceedings of the 20th International Conference on Machine Learning (ICML-03). 768--775."},{"key":"e_1_3_2_1_36_1","volume-title":"Interpretable Detection of Distribution Shifts in Learning Enabled Cyber-Physical Systems. In ACMIEEE International Conference on CyberPhysical Systems.","author":"Yang Yahan","year":"2022","unstructured":"Yahan Yang , Ramneet Kaur , Souradeep Dutta , and Insup Lee . 2022 . Interpretable Detection of Distribution Shifts in Learning Enabled Cyber-Physical Systems. In ACMIEEE International Conference on CyberPhysical Systems. Yahan Yang, Ramneet Kaur, Souradeep Dutta, and Insup Lee. 2022. Interpretable Detection of Distribution Shifts in Learning Enabled Cyber-Physical Systems. In ACMIEEE International Conference on CyberPhysical Systems."}],"event":{"name":"ICCPS '23: ACM\/IEEE 14th International Conference on Cyber-Physical Systems (with CPS-IoT Week 2023)","location":"San Antonio TX USA","acronym":"ICCPS '23","sponsor":["SIGBED ACM Special Interest Group on Embedded Systems","IEEE TCRTS"]},"container-title":["Proceedings of the ACM\/IEEE 14th International Conference on Cyber-Physical Systems (with CPS-IoT Week 2023)"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3576841.3585931","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:27Z","timestamp":1750178847000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3576841.3585931"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,9]]},"references-count":36,"alternative-id":["10.1145\/3576841.3585931","10.1145\/3576841"],"URL":"https:\/\/doi.org\/10.1145\/3576841.3585931","relation":{},"subject":[],"published":{"date-parts":[[2023,5,9]]},"assertion":[{"value":"2023-05-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}