{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:24:26Z","timestamp":1777656266953,"version":"3.51.4"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,12,27]]},"abstract":"<jats:p>The proliferation of sensors powered by state-of-the-art machine learning techniques can now infer context, recognize activities and enable interactions. A key component required to build these automated sensing systems is labeled training data. However, the cost of collecting and labeling new data impedes our ability to deploy new sensors to recognize human activities. We tackle this challenge using domain adaptation i.e., using existing labeled data in a different domain to aid the training of a machine learning model for a new sensor. In this paper, we use off-the-shelf smartwatch IMU datasets to train an activity recognition system for mmWave radar sensor with minimally labeled data. We demonstrate that despite the lack of extensive datasets for mmWave radar, we are able to use our domain adaptation approach to build an activity recognition system that classifies between 10 activities with an accuracy of 70% with only 15 seconds of labeled doppler data. We also present results for a range of available labeled data (10 - 30 seconds) and show that our approach outperforms the baseline in every single scenario. We take our approach a step further and show that multiple IMU datasets can be combined together to act as a single source for our domain adaptation approach. Lastly, we discuss the limitations of our work and how it can impact future research directions.<\/jats:p>","DOI":"10.1145\/3494994","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T17:40:33Z","timestamp":1640886033000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["IMU2Doppler"],"prefix":"10.1145","volume":"5","author":[{"given":"Sejal","family":"Bhalla","sequence":"first","affiliation":[{"name":"University of Toronto, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mayank","family":"Goel","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rushil","family":"Khurana","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445138"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2753232"},{"key":"e_1_2_1_3_1","volume-title":"Soundnet: Learning sound representations from unlabeled video. Advances in neural information processing systems 29","author":"Aytar Yusuf","year":"2016","unstructured":"Yusuf Aytar , Carl Vondrick , and Antonio Torralba . 2016 . Soundnet: Learning sound representations from unlabeled video. Advances in neural information processing systems 29 (2016), 892--900. Yusuf Aytar, Carl Vondrick, and Antonio Torralba. 2016. Soundnet: Learning sound representations from unlabeled video. Advances in neural information processing systems 29 (2016), 892--900."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376869"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5152-4"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1610075.1610094"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/LGRS.2015.2452946"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432224"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/LGRS.2019.2942097"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/RADAR.2018.8557324"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAES.2006.1603402"},{"key":"e_1_2_1_12_1","unstructured":"Francois Chollet et al. 2015. Keras. https:\/\/github.com\/fchollet\/keras  Francois Chollet et al. 2015. Keras. https:\/\/github.com\/fchollet\/keras"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 21st International Conference on Neural Information Processing Systems (NIPS'08)","author":"Dai Wenyuan","year":"2008","unstructured":"Wenyuan Dai , Yuqiang Chen , Gui-Rong Xue , Qiang Yang , and Yong Yu . 2008 . Translated Learning: Transfer Learning across Different Feature Spaces . In Proceedings of the 21st International Conference on Neural Information Processing Systems (NIPS'08) . Curran Associates Inc., Red Hook, NY, USA, 353--360. event-place: Vancouver, British Columbia, Canada. Wenyuan Dai, Yuqiang Chen, Gui-Rong Xue, Qiang Yang, and Yong Yu. 2008. Translated Learning: Transfer Learning across Different Feature Spaces. In Proceedings of the 21st International Conference on Neural Information Processing Systems (NIPS'08). Curran Associates Inc., Red Hook, NY, USA, 353--360. event-place: Vancouver, British Columbia, Canada."},{"key":"e_1_2_1_14_1","volume-title":"Advances in financial machine learning","author":"De Prado Marcos Lopez","unstructured":"Marcos Lopez De Prado . 2018. Advances in financial machine learning . John Wiley & Sons . Marcos Lopez De Prado. 2018. Advances in financial machine learning. John Wiley & Sons."},{"key":"e_1_2_1_15_1","volume-title":"Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers. 301--304","author":"Dogan Gulustan","year":"2020","unstructured":"Gulustan Dogan , Iremnaz Cay , Sinem Sena Ertas , \u015eeref Recep Keskin , Nouran Alotaibi , and Elif Sahin . 2020 . Where are you? Human activity recognition with smartphone sensor data . In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers. 301--304 . Gulustan Dogan, Iremnaz Cay, Sinem Sena Ertas, \u015eeref Recep Keskin, Nouran Alotaibi, and Elif Sahin. 2020. Where are you? Human activity recognition with smartphone sensor data. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers. 301--304."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 31st International Conference on International Conference on Machine Learning -","volume":"32","author":"Donahue Jeff","year":"2014","unstructured":"Jeff Donahue , Yangqing Jia , Oriol Vinyals , Judy Hoffman , Ning Zhang , Eric Tzeng , and Trevor Darrell . 2014 . DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition . In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32 (ICML '14). JMLR.org, I-647-I-655. event-place: Beijing, China. Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2014. DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32 (ICML '14). JMLR.org, I-647-I-655. event-place: Beijing, China."},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 29th International Coference on International Conference on Machine Learning (ICML '12)","author":"Duan Lixin","unstructured":"Lixin Duan , Dong Xu , and Ivor W. Tsang . 2012. Learning with Augmented Features for Heterogeneous Domain Adaptation . In Proceedings of the 29th International Coference on International Conference on Machine Learning (ICML '12) . Omnipress, Madison, WI, USA, 667--674. event-place: Edinburgh, Scotland. Lixin Duan, Dong Xu, and Ivor W. Tsang. 2012. Learning with Augmented Features for Heterogeneous Domain Adaptation. In Proceedings of the 29th International Coference on International Conference on Machine Learning (ICML '12). Omnipress, Madison, WI, USA, 667--674. event-place: Edinburgh, Scotland."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAES.2015.130595"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.06.070"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Arthur Gretton Karsten Borgwardt Malte Rasch Bernhard Sch\u00f6lkopf and Alexander Smola. 2006. A Kernel Method for the Two-Sample-Problem. Arxiv preprint arXiv:0805.2368 513--520.  Arthur Gretton Karsten Borgwardt Malte Rasch Bernhard Sch\u00f6lkopf and Alexander Smola. 2006. A Kernel Method for the Two-Sample-Problem. Arxiv preprint arXiv:0805.2368 513--520.","DOI":"10.7551\/mitpress\/7503.003.0069"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML '11)","author":"Harel Maayan","year":"2011","unstructured":"Maayan Harel and Shie Mannor . 2011 . Learning from Multiple Outlooks . In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML '11) . Omnipress, Madison, WI, USA, 401--408. event-place: Bellevue, Washington, USA. Maayan Harel and Shie Mannor. 2011. Learning from Multiple Outlooks. In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML '11). Omnipress, Madison, WI, USA, 401--408. event-place: Bellevue, Washington, USA."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2938725"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.23919\/EuRAD.2018.8546615"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3390\/computers2020088"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287063"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376822"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376761"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/LGRS.2015.2491329"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411841"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2012.110112.00192"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/JTEHM.2018.2791609"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314404"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2018.2872849"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.04.124"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2020.3019915"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369818"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351242"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161162"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328932"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9040588"},{"key":"e_1_2_1_42_1","unstructured":"Burr Settles. 2009. Active learning literature survey. (2009).  Burr Settles. 2009. Active learning literature survey. (2009)."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090082"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3349624.3356768"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412060.3418430"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/3016100.3016186"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298614"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/RADAR42522.2020.9114643"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.549"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSENS.2020.2991367"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267242.3267276"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence -","volume":"1546","author":"Wang Chang","year":"2011","unstructured":"Chang Wang and Sridhar Mahadevan . 2011 . Heterogeneous Domain Adaptation Using Manifold Alignment . In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence - Volume Volume Two (IJCAI'11). AAAI Press, 1541-- 1546 . event-place: Barcelona, Catalonia, Spain. Chang Wang and Sridhar Mahadevan. 2011. Heterogeneous Domain Adaptation Using Manifold Alignment. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence - Volume Volume Two (IJCAI'11). AAAI Press, 1541--1546. event-place: Barcelona, Catalonia, Spain."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2014.2319333"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2940729"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3213344.3213351"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/1735835.1735838"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2009.2012849"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.2228397"},{"key":"e_1_2_1_59_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3090095","article-title":"Soundtrak: Continuous 3d tracking of a finger using active acoustics","volume":"1","author":"Zhang Cheng","year":"2017","unstructured":"Cheng Zhang , Qiuyue Xue , Anandghan Waghmare , Sumeet Jain , Yiming Pu , Sinan Hersek , Kent Lyons , Kenneth A Cunefare , Omer T Inan , and Gregory D Abowd . 2017 . Soundtrak: Continuous 3d tracking of a finger using active acoustics . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 , 2 (2017), 1 -- 25 . Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Sumeet Jain, Yiming Pu, Sinan Hersek, Kent Lyons, Kenneth A Cunefare, Omer T Inan, and Gregory D Abowd. 2017. Soundtrak: Continuous 3d tracking of a finger using active acoustics. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 1--25.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971763.2971775"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSENS.2018.2889060"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973762"},{"key":"e_1_2_1_63_1","volume-title":"Multi-source domain adaptation in the deep learning era: A systematic survey. arXiv preprint arXiv:2002.12169","author":"Zhao Sicheng","year":"2020","unstructured":"Sicheng Zhao , Bo Li , Pengfei Xu , and Kurt Keutzer . 2020. Multi-source domain adaptation in the deep learning era: A systematic survey. arXiv preprint arXiv:2002.12169 ( 2020 ). Sicheng Zhao, Bo Li, Pengfei Xu, and Kurt Keutzer. 2020. Multi-source domain adaptation in the deep learning era: A systematic survey. arXiv preprint arXiv:2002.12169 (2020)."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/SECON48991.2020.9158431"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900630"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494994","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3494994","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:59Z","timestamp":1750191539000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494994"}},"subtitle":["Cross-Modal Domain Adaptation for Doppler-based Activity Recognition Using IMU Data"],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":65,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,27]]}},"alternative-id":["10.1145\/3494994"],"URL":"https:\/\/doi.org\/10.1145\/3494994","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]},"assertion":[{"value":"2021-12-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}