{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T15:10:10Z","timestamp":1755789010185,"version":"3.44.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000050","name":"National Heart Lung and Blood Institute","doi-asserted-by":"crossref","award":["1R01HL172291-01, 5R01HL172291-02"],"award-info":[{"award-number":["1R01HL172291-01, 5R01HL172291-02"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,8,22]]},"abstract":"<jats:p>In automated sleep monitoring systems, bed occupancy detection is the foundation or the first step before other downstream tasks, such as inferring sleep activities and vital signs. The existing methods do not generalize well to real-world environments due to single environment settings and rely on threshold-based approaches. Manually selecting thresholds requires observing a large amount of data and may not yield optimal results. In contrast, acquiring extensive labeled sensory data poses significant challenges regarding cost and time. Hence, developing models capable of generalizing across diverse environments with limited data is imperative. This paper introduces SeismoDot, which consists of a self-supervised learning module and a spectral-temporal feature fusion module for bed occupancy detection. Unlike conventional methods that require separate pre-training and fine-tuning, our self-supervised learning module is co-optimized with the primary target task, which directs learned representations toward a task-relevant embedding space while expanding the feature space. The proposed feature fusion module enables the simultaneous exploitation of temporal and spectral features, enhancing the diversity of information from both domains. By combining these techniques, SeismoDot expands the diversity of embedding space for both the temporal and spectral domains to enhance its generalizability across different environments. SeismoDot not only achieves high accuracy (98.49%) and F1 scores (98.08%) across 13 diverse environments, but it also maintains high performance (97.01% accuracy and 96.54% F1 score) even when trained with just 20% (4 days) of the total data. This demonstrates its exceptional ability to generalize across various environmental settings, even with limited data availability.<\/jats:p>","DOI":"10.1145\/3678514","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T14:36:21Z","timestamp":1725892581000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Self-Supervised Representation Learning and Temporal-Spectral Feature Fusion for Bed Occupancy Detection"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-5601-4465","authenticated-orcid":false,"given":"Yingjian","family":"Song","sequence":"first","affiliation":[{"name":"The University of Georgia, USA, Athens, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0126-9244","authenticated-orcid":false,"given":"Zaid Farooq","family":"Pitafi","sequence":"additional","affiliation":[{"name":"The University of Georgia, USA, Athens, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4246-8616","authenticated-orcid":false,"given":"Fei","family":"Dou","sequence":"additional","affiliation":[{"name":"The University of Georgia, USA, Athens, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2926-4023","authenticated-orcid":false,"given":"Jin","family":"Sun","sequence":"additional","affiliation":[{"name":"The University of Georgia, USA, Athens, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5097-2113","authenticated-orcid":false,"given":"Xiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of North Carolina at Charlotte, USA, Athens, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1627-6549","authenticated-orcid":false,"given":"Bradley G.","family":"Phillips","sequence":"additional","affiliation":[{"name":"The University of Georgia, USA, Athens, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8174-1772","authenticated-orcid":false,"given":"WenZhan","family":"Song","sequence":"additional","affiliation":[{"name":"The University of Georgia, USA, Athens, Georgia"}]}],"member":"320","published-online":{"date-parts":[[2024,9,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39862-4_3"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3233\/AIS-150324"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351237"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerCom45495.2020.9127369"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550316"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3308189"},{"key":"e_1_2_1_7_1","volume-title":"Self-supervised time series representation learning by inter-intra relational reasoning. arXiv preprint arXiv:2011.13548","author":"Fan Haoyi","year":"2020","unstructured":"Haoyi Fan, Fengbin Zhang, and Yue Gao. 2020. Self-supervised time series representation learning by inter-intra relational reasoning. arXiv preprint arXiv:2011.13548 (2020)."},{"key":"e_1_2_1_8_1","volume-title":"A kernel method for the two-sample-problem. Advances in neural information processing systems 19","author":"Gretton Arthur","year":"2006","unstructured":"Arthur Gretton, Karsten Borgwardt, Malte Rasch, Bernhard Sch\u00f6lkopf, and Alex Smola. 2006. A kernel method for the two-sample-problem. Advances in neural information processing systems 19 (2006)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517246"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPSN.2016.7460676"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131672.3131679"},{"key":"e_1_2_1_13_1","volume-title":"International Conference on Machine Learning. PMLR, 5606--5615","author":"Kiyasseh Dani","year":"2021","unstructured":"Dani Kiyasseh, Tingting Zhu, and David A Clifton. 2021. Clocs: Contrastive learning of cardiac signals across space, time, and patients. In International Conference on Machine Learning. PMLR, 5606--5615."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.3013435"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351254"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3390\/s16050750"},{"key":"e_1_2_1_17_1","volume-title":"Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748","author":"van den Oord Aaron","year":"2018","unstructured":"Aaron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3261557"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411843"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2012.6347315"},{"key":"e_1_2_1_21_1","volume-title":"Generalizable Low-Resource Activity Recognition with Diverse and Discriminative Representation Learning. arXiv preprint arXiv:2306.04641","author":"Qin Xin","year":"2023","unstructured":"Xin Qin, Jindong Wang, Shuo Ma, Wang Lu, Yongchun Zhu, Xing Xie, and Yiqiang Chen. 2023. Generalizable Low-Resource Activity Recognition with Diverse and Discriminative Representation Learning. arXiv preprint arXiv:2306.04641 (2023)."},{"key":"e_1_2_1_22_1","unstructured":"Racotech. 2024. RGI-4.5Hz Geophone. http:\/\/www.racotech.biz\/parameter\/RGI-4.5Hz%20Geophone.pdf"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328932"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2020.3014842"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Narayan Sch\u00fctz Hugo Saner Angela Botros Bruno Pais Val\u00e9rie Santschi Philipp Buluschek Daniel Gatica-Perez Prabitha Urwyler Ren\u00e9 M M\u00fcri Tobias Nef et al. 2021. Contactless sleep monitoring for early detection of health deteriorations in community-dwelling older adults: Exploratory study. JMIR mHealth and uHealth 9 6 (2021) e24666.","DOI":"10.2196\/24666"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2023.3316674"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/MeMeA.2013.6549721"},{"key":"e_1_2_1_28_1","volume-title":"Unsupervised representation learning for time series with temporal neighborhood coding. arXiv preprint arXiv:2106.00750","author":"Tonekaboni Sana","year":"2021","unstructured":"Sana Tonekaboni, Danny Eytan, and Anna Goldenberg. 2021. Unsupervised representation learning for time series with temporal neighborhood coding. arXiv preprint arXiv:2106.00750 (2021)."},{"key":"e_1_2_1_29_1","volume-title":"Health and sleep nursing assistant for real-time, contactless, and non-invasive monitoring. Pervasive and mobile computing 75","author":"Valero Maria","year":"2021","unstructured":"Maria Valero, Jose Clemente, Fangyu Li, and WenZhan Song. 2021. Health and sleep nursing assistant for real-time, contactless, and non-invasive monitoring. Pervasive and mobile computing 75 (2021), 101422."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161188"},{"key":"e_1_2_1_31_1","volume-title":"International Conference on Machine Learning. PMLR, 25038--25054","author":"Yang Ling","year":"2022","unstructured":"Ling Yang and Shenda Hong. 2022. Unsupervised time-series representation learning with iterative bilinear temporal-spectral fusion. In International Conference on Machine Learning. PMLR, 25038--25054."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397311"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i8.20881"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569489"},{"key":"e_1_2_1_35_1","volume-title":"NeurIPS 2022 Workshop: Self-Supervised Learning-Theory and Practice.","author":"Zhang Kexin","year":"2022","unstructured":"Kexin Zhang, Qingsong Wen, Chaoli Zhang, Liang Sun, and Yong Liu. 2022. Time Series Anomaly Detection using Skip-Step Contrastive Predictive Coding. In NeurIPS 2022 Workshop: Self-Supervised Learning-Theory and Practice."},{"key":"e_1_2_1_36_1","first-page":"3988","article-title":"Self-supervised contrastive pre-training for time series via time-frequency consistency","volume":"35","author":"Zhang Xiang","year":"2022","unstructured":"Xiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, and Marinka Zitnik. 2022. Self-supervised contrastive pre-training for time series via time-frequency consistency. Advances in Neural Information Processing Systems 35 (2022), 3988--4003.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_37_1","volume-title":"The Eleventh International Conference on Learning Representations.","author":"Zhang Yunhao","year":"2022","unstructured":"Yunhao Zhang and Junchi Yan. 2022. Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643549"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359427.3361911"},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3534587","article-title":"Learning on the Rings: Self-Supervised 3D Finger Motion Tracking Using Wearable Sensors","volume":"6","author":"Zhou Hao","year":"2022","unstructured":"Hao Zhou, Taiting Lu, Yilin Liu, Shijia Zhang, and Mahanth Gowda. 2022. Learning on the Rings: Self-Supervised 3D Finger Motion Tracking Using Wearable Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--31.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678514","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3678514","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T14:44:43Z","timestamp":1755787483000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678514"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"references-count":40,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,8,22]]}},"alternative-id":["10.1145\/3678514"],"URL":"https:\/\/doi.org\/10.1145\/3678514","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2024,8,22]]},"assertion":[{"value":"2024-09-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}