{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T02:13:58Z","timestamp":1778638438729,"version":"3.51.4"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"name":"Infosys Foundation and the Department of Science and Technology, Government of India"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Cyber-Phys. Syst."],"published-print":{"date-parts":[[2025,10,31]]},"abstract":"<jats:p>Data-driven models for state estimation using measurements obtained over a wireless network are essential to cyber-physical systems. Learning a data-driven model for an estimator using real wireless network deployments is, however, impractical as it would require data that captures varied wireless network conditions and their impact on estimation. We propose and evaluate a simulation to real-world transfer of a data-driven model for state estimation. Specifically, we train an estimator model using only data generated by a low-fidelity simulation of networks. Our choice of network simulation is a first-come-first-served single server queue, which is a network model with the two parameters of arrival rate of measurement packets into the queue and packet service rates. We employ domain randomization to bridge the gap between simulation and the real world, appropriately randomizing the network model parameters during training. The efficacy of the resulting estimator model is demonstrated by testing it over two deployments of real wireless networks. In one, the estimator model estimates vehicles\u2019 positions and speeds using data from vehicular trajectories received by it over a shared WiFi network, with up to seventy sources sending the measurements. In the other, GPS coordinates are communicated by public transit buses over city-wide cellular networks. The estimator uses the received measurements to estimate locations of the buses.<\/jats:p>","DOI":"10.1145\/3736419","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T13:03:42Z","timestamp":1747746222000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Sim-to-Real Transfer for Estimation over Wireless Networks"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0240-9454","authenticated-orcid":false,"given":"Shivangi","family":"Agarwal","sequence":"first","affiliation":[{"name":"Department of CSE, IIIT-Delhi, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1090-5367","authenticated-orcid":false,"given":"Adi","family":"Asija","sequence":"additional","affiliation":[{"name":"IIIT-Delhi, New Delhi, India and Department of ECE, Johns Hopkins University, Baltimore, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5867-8584","authenticated-orcid":false,"given":"Sanjit","family":"K. Kaul","sequence":"additional","affiliation":[{"name":"Department of ECE, IIIT-Delhi, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6229-3940","authenticated-orcid":false,"given":"Saket","family":"Anand","sequence":"additional","affiliation":[{"name":"Department of CSE and ECE, IIIT-Delhi, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,13]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Open Transit Delhi. 2017\u20132025. Retrieved from https:\/\/otd.delhi.gov.in\/"},{"key":"e_1_3_3_3_2","volume-title":"Second Workshop on Machine Learning and the Physical Sciences (NeurIPS)","author":"Ayed Ibrahim","year":"2019","unstructured":"Ibrahim Ayed, Emmanuel de B\u00e9zenac, Arthur Pajot, Julien Brajard, and Patrick Gallinari. 2019. Learning dynamical systems from partial observations. In Second Workshop on Machine Learning and the Physical Sciences (NeurIPS)."},{"issue":"3","key":"e_1_3_3_4_2","first-page":"1869","article-title":"A hybrid prediction method for realistic network traffic with temporal convolutional network and LSTM","volume":"19","author":"Bi Jing","year":"2021","unstructured":"Jing Bi, Xiang Zhang, Haitao Yuan, Jia Zhang, and MengChu Zhou. 2021. A hybrid prediction method for realistic network traffic with temporal convolutional network and LSTM. IEEE Transactions on Automation Science and Engineering 19, 3 (2021), 1869\u20131879.","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/49.840210"},{"key":"e_1_3_3_6_2","first-page":"27852","article-title":"Online learning and control of complex dynamical systems from sensory input","volume":"34","author":"Bounou Oumayma","year":"2021","unstructured":"Oumayma Bounou, Jean Ponce, and Justin Carpentier. 2021. Online learning and control of complex dynamical systems from sensory input. In Advances in Neural Information Processing Systems, Vol. 34, 27852\u201327864.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460875"},{"key":"e_1_3_3_8_2","unstructured":"Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang and Wojciech Zaremba. 2016. OpenAI Gym. arXiv:1606.01540. Retrieved from https:\/\/arxiv.org\/abs\/1606.01540"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/iros47612.2022.9981565"},{"key":"e_1_3_3_10_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/ICCA51439.2020.9264552","volume-title":"2020 IEEE 16th International Conference on Control & Automation (ICCA)","author":"Chalaki Behdad","year":"2020","unstructured":"Behdad Chalaki, Logan E. Beaver, Ben Remer, Kathy Jang, Eugene Vinitsky, Alexandre M. Bayen, and Andreas A. Malikopoulos. 2020. Zero-shot autonomous vehicle policy transfer: From simulation to real-world via adversarial learning. In 2020 IEEE 16th International Conference on Control & Automation (ICCA). IEEE, 35\u201340."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOMW.2018.8406909"},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Hao Dong Zihan Ding and Shanghang Zhang. 2020. Deep Reinforcement Learning: Fundamentals Research and Applications. Springer Nature Singapore. Retrieved from http:\/\/www.deepreinforcementlearningbook.org","DOI":"10.1007\/978-981-15-4095-0"},{"key":"e_1_3_3_13_2","first-page":"1","article-title":"Age of information minimization using multi-agent UAVs based on AI-enhanced mean field resource allocation","volume":"73","author":"Emami Yousef","year":"2024","unstructured":"Yousef Emami, Hao Gao, Kai Li, Luis Almeida, Eduardo Tovar, and Zhu Han. 2024. Age of information minimization using multi-agent UAVs based on AI-enhanced mean field resource allocation. IEEE Transactions on Vehicular Technology 73 (2024), 1\u201314.","journal-title":"IEEE Transactions on Vehicular Technology"},{"issue":"2","key":"e_1_3_3_14_2","doi-asserted-by":"crossref","first-page":"11847","DOI":"10.1016\/j.ifacol.2023.10.588","article-title":"Control of the cart-pole system: Model-based vs. model-free learning","volume":"56","author":"Fu Minyue","year":"2023","unstructured":"Minyue Fu. 2023. Control of the cart-pole system: Model-based vs. model-free learning. IFAC-PapersOnLine 56, 2 (2023), 11847\u201311852.","journal-title":"IFAC-PapersOnLine"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s43154-022-00090-9"},{"key":"e_1_3_3_16_2","doi-asserted-by":"crossref","first-page":"2415","DOI":"10.1109\/BigData52589.2021.9671488","volume-title":"2021 IEEE International Conference on Big Data (Big Data)","author":"Gopali Saroj","year":"2021","unstructured":"Saroj Gopali, Faranak Abri, Sima Siami-Namini, and Akbar Siami Namin. 2021. A comparison of TCN and LSTM models in detecting anomalies in time series data. In 2021 IEEE International Conference on Big Data (Big Data). IEEE, 2415\u20132420."},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2012.2183366"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2006.887288"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"issue":"2","key":"e_1_3_3_20_2","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1109\/TRO.2022.3207619","article-title":"Object detection using sim2real domain randomization for robotic applications","volume":"39","author":"Horv\u00e1th D\u00e1niel","year":"2022","unstructured":"D\u00e1niel Horv\u00e1th, G\u00e1bor Erd\u0151s, Zolt\u00e1n Istenes, Tom\u00e1\u0161 Horv\u00e1th, and S\u00e1ndor F\u00f6ldi. 2022. Object detection using sim2real domain randomization for robotic applications. IEEE Transactions on Robotics 39, 2 (2022), 1225\u20131243.","journal-title":"IEEE Transactions on Robotics"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2019.8814179"},{"issue":"1","key":"e_1_3_3_22_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/TIV.2017.2788208","article-title":"Automated driving in uncertain environments: Planning with interaction and uncertain maneuver prediction","volume":"3","author":"Hubmann Constantin","year":"2018","unstructured":"Constantin Hubmann, Jens Schulz, Marvin Becker, Daniel Althoff, and Christoph Stiller. 2018. Automated driving in uncertain environments: Planning with interaction and uncertain maneuver prediction. IEEE Transactions on Intelligent Vehicles 3, 1 (2018), 5\u201317.","journal-title":"IEEE Transactions on Intelligent Vehicles"},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","first-page":"6793","DOI":"10.1109\/CDC40024.2019.9029214","volume-title":"2019 IEEE 58th Conference on Decision and Control (CDC)","author":"Ikemoto Junya","year":"2019","unstructured":"Junya Ikemoto and Toshimitsu Ushio. 2019. Networked control of nonlinear systems under partial observation using continuous deep Q-learning. In 2019 IEEE 58th Conference on Decision and Control (CDC). IEEE, 6793\u20136798."},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3302509.3313784"},{"key":"e_1_3_3_25_2","first-page":"1072","volume-title":"5th Annual Learning for Dynamics and Control Conference","author":"Kesper Lukas","year":"2023","unstructured":"Lukas Kesper, Sebastian Trimpe, and Dominik Baumann. 2023. Toward multi-agent reinforcement learning for distributed event-triggered control. In 5th Annual Learning for Dynamics and Control Conference. Nikolai Matni, Manfred Morari, and George J. Pappas (Eds.), Proceedings of Machine Learning Research, Vol. 211, PMLR, University of Pennsylvania, 1072\u20131085. Retrieved from https:\/\/proceedings.mlr.press\/v211\/kesper23a.html"},{"issue":"2023","key":"e_1_3_3_26_2","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1613\/jair.1.14174","article-title":"A survey of zero-shot generalisation in deep reinforcement learning","volume":"76","author":"Kirk Robert","year":"2023","unstructured":"Robert Kirk, Amy Zhang, Edward Grefenstette, and Tim Rockt\u00e4schel. 2023. A survey of zero-shot generalisation in deep reinforcement learning. Journal of Artificial Intelligence Research 76 (2023), 201\u2013264.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"e_1_3_3_27_2","first-page":"3","article-title":"Recent development and applications of SUMO-Simulation of Urban MObility","volume":"5","author":"Krajzewicz Daniel","year":"2012","unstructured":"Daniel Krajzewicz, Jakob Erdmann, Michael Behrisch, and Laura Bieker. 2012. Recent development and applications of SUMO-Simulation of Urban MObility. International Journal on Advances in Systems and Measurements 5 (2012), 3 and 4.","journal-title":"International Journal on Advances in Systems and Measurements"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC45102.2020.9294589"},{"issue":"6","key":"e_1_3_3_29_2","first-page":"4179","article-title":"LSTM-characterized deep reinforcement learning for continuous flight control and resource allocation in UAV-assisted sensor network","volume":"9","author":"Li Kai","year":"2021","unstructured":"Kai Li, Wei Ni, and Falko Dressler. 2021. LSTM-characterized deep reinforcement learning for continuous flight control and resource allocation in UAV-assisted sensor network. IEEE Internet of Things Journal 9, 6 (2021), 4179\u20134189.","journal-title":"IEEE Internet of Things Journal"},{"issue":"5","key":"e_1_3_3_30_2","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1016\/j.automatica.2012.02.014","article-title":"Stochastic stability of the unscented Kalman filter with intermittent observations","volume":"48","author":"Li Li","year":"2012","unstructured":"Li Li and Yuanqing Xia. 2012. Stochastic stability of the unscented Kalman filter with intermittent observations. Automatica 48, 5 (2012), 978\u2013981.","journal-title":"Automatica"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS51168.2021.9636140"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra and Martin Riedmiller. 2013. Playing Atari with deep reinforcement learning. arXiv:1312.5602. Retrieved from 10.48550\/arXiv.1312.5602","DOI":"10.48550\/arXiv.1312.5602"},{"issue":"11","key":"e_1_3_3_33_2","doi-asserted-by":"crossref","first-page":"20473","DOI":"10.1109\/JIOT.2024.3371385","article-title":"Efficient data collection and training for deep learning-based indoor vehicle navigation","volume":"11","author":"Park Pangun","year":"2024","unstructured":"Pangun Park, Piergiuseppe Di Marco, and Fortunato Santucci. 2024. Efficient data collection and training for deep learning-based indoor vehicle navigation. IEEE Internet of Things Journal 11, 11 (2024), 20473\u201320485.","journal-title":"IEEE Internet of Things Journal"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2017.2780114"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/icra.2018.8460528"},{"key":"e_1_3_3_36_2","first-page":"1804","volume-title":"21st International Conference on Autonomous Agents and Multiagent Systems (AAMAS \u201922)","author":"Prorok Amanda","year":"2022","unstructured":"Amanda Prorok, Jan Blumenkamp, Qingbiao Li, Ryan Kortvelesy, Zhe Liu, and Ethan Stump. 2022. The holy grail of multi-robot planning: Learning to generate online-scalable solutions from offline-optimal experts. In 21st International Conference on Autonomous Agents and Multiagent Systems (AAMAS \u201922). International Foundation for Autonomous Agents and Multiagent Systems, 1804\u20131808."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2008.921012"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2006.887306"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","unstructured":"Jonah Siekmann Srikar Valluri Jeremy Dao Lorenzo Bermillo Helei Duan Alan Fern and Jonathan Hurst . 2020. Learning memory-based control for human-scale bipedal locomotion. arXiv:2006.02402. Retrieved from 10.48550\/arXiv.2006.02402","DOI":"10.48550\/arXiv.2006.02402"},{"issue":"1","key":"e_1_3_3_40_2","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1109\/TITS.2019.2954952","article-title":"Memory-based deep reinforcement learning for obstacle avoidance in UAV with limited environment knowledge","volume":"22","author":"Singla Abhik","year":"2019","unstructured":"Abhik Singla, Sindhu Padakandla, and Shalabh Bhatnagar. 2019. Memory-based deep reinforcement learning for obstacle avoidance in UAV with limited environment knowledge. IEEE Transactions on Intelligent Transportation Systems 22, 1 (2019), 107\u2013118.","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"e_1_3_3_41_2","unstructured":"Kshitij\u00a0Srivastava Atul\u00a0Jain Rajan\u00a0Girsa \u00a0and Pravesh\u00a0Biyani. 2022.\u00a0Lessons in building an open transit data platform for Delhi India: A case study for the developing world. In\u00a0Transportation Research Board 101st Annual Meeting."},{"key":"e_1_3_3_42_2","unstructured":"R. F. Stengel. 1994. Optimal Control and Estimation. Dover Publications. Retrieved from https:\/\/books.google.co.in\/books?id=jDjPxqm7Lw0C"},{"issue":"2","key":"e_1_3_3_43_2","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1109\/TIT.2019.2937336","article-title":"Sampling of the Wiener process for remote estimation over a channel with random delay","volume":"66","author":"Sun Yin","year":"2019","unstructured":"Yin Sun, Yury Polyanskiy, and Elif Uysal. 2019. Sampling of the Wiener process for remote estimation over a channel with random delay. IEEE Transactions on Information Theory 66, 2 (2019), 1118\u20131135.","journal-title":"IEEE Transactions on Information Theory"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS55552.2023.10342537"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.62.1805"},{"key":"e_1_3_3_46_2","doi-asserted-by":"crossref","first-page":"5372","DOI":"10.1109\/IROS45743.2020.9341617","volume-title":"2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"Valassakis Eugene","year":"2020","unstructured":"Eugene Valassakis, Zihan Ding, and Edward Johns. 2020. Crossing the gap: A deep dive into zero-shot sim-to-real transfer for dynamics. In 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 5372\u20135379."},{"key":"e_1_3_3_47_2","unstructured":"Cathy Wu Aboudy Kreidieh Kanaad Parvate Eugene Vinitsky and Alexandre M. Bayen. 2017. Flow: Architecture and benchmarking for reinforcement learning in traffic control. arXiv:1710.05465. Retrieved from https:\/\/arxiv.org\/pdf\/1710.05465v1.pdf"},{"key":"e_1_3_3_48_2","first-page":"317","volume-title":"Conference on Robot Learning","author":"Xie Zhaoming","year":"2020","unstructured":"Zhaoming Xie, Patrick Clary, Jeremy Dao, Pedro Morais, Jonanthan Hurst, and Michiel Panne. 2020. Learning locomotion skills for cassie: Iterative design and sim-to-real. In Conference on Robot Learning. PMLR, Massachusetts Institute of Technology, 317\u2013329."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48506.2021.9560837"},{"key":"e_1_3_3_50_2","first-page":"1042","volume-title":"2006 IEEE International Joint Conference on Neural Network Proceedings","author":"Yadaiah Narri","year":"2006","unstructured":"Narri Yadaiah and G. Sowmya. 2006. Neural network based state estimation of dynamical systems. In 2006 IEEE International Joint Conference on Neural Network Proceedings. IEEE, 1042\u20131049."},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2021.3065072"},{"issue":"1","key":"e_1_3_3_52_2","doi-asserted-by":"crossref","first-page":"13216","DOI":"10.1016\/j.ifacol.2017.08.1954","article-title":"Learning communication delay patterns for remotely controlled UAV networks","volume":"50","author":"Yoo Jaehyun","year":"2017","unstructured":"Jaehyun Yoo and Karl H. Johansson. 2017. Learning communication delay patterns for remotely controlled UAV networks. IFAC-PapersOnLine 50, 1 (2017), 13216\u201313221.","journal-title":"IFAC-PapersOnLine"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3116700"},{"issue":"3","key":"e_1_3_3_54_2","doi-asserted-by":"crossref","first-page":"4535","DOI":"10.1109\/JIOT.2023.3300074","article-title":"Deep learning for wireless networked systems: A joint estimation-control-scheduling approach","volume":"11","author":"Zhao Zihuai","year":"2023","unstructured":"Zihuai Zhao, Wanchun Liu, Daniel E. Quevedo, Yonghui Li, and Branka Vucetic. 2023. Deep learning for wireless networked systems: A joint estimation-control-scheduling approach. IEEE Internet of Things Journal 11, 3 (2023), 4535\u20134550.","journal-title":"IEEE Internet of Things Journal"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3292075"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.3004555"}],"container-title":["ACM Transactions on Cyber-Physical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3736419","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:53:31Z","timestamp":1760363611000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3736419"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,13]]},"references-count":55,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,10,31]]}},"alternative-id":["10.1145\/3736419"],"URL":"https:\/\/doi.org\/10.1145\/3736419","relation":{"has-preprint":[{"id-type":"doi","id":"10.36227\/techrxiv.24332269.v1","asserted-by":"object"}]},"ISSN":["2378-962X","2378-9638"],"issn-type":[{"value":"2378-962X","type":"print"},{"value":"2378-9638","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,13]]},"assertion":[{"value":"2024-01-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}