{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T19:16:07Z","timestamp":1765307767099,"version":"3.46.0"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","funder":[{"name":"National Natural Science Foundation of China","award":["62432003, 62072089"],"award-info":[{"award-number":["62432003, 62072089"]}]},{"name":"Fundamental Research Funds for Central Universities","award":["N2424010-19"],"award-info":[{"award-number":["N2424010-19"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,10,27]]},"DOI":"10.1145\/3746027.3755558","type":"proceedings-article","created":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T05:44:48Z","timestamp":1761371088000},"page":"1967-1976","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["ElaSleepNet: Exploring an Elastic Multimodal Neural Network for Sleep Staging via Temporal and Contextual Consistency Learning"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7096-3732","authenticated-orcid":false,"given":"Qi","family":"Shen","sequence":"first","affiliation":[{"name":"Northeastern University, Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2077-8269","authenticated-orcid":false,"given":"Junchang","family":"Xin","sequence":"additional","affiliation":[{"name":"Northeastern University, Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7245-7021","authenticated-orcid":false,"given":"Bing Tian","family":"Dai","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0629-1296","authenticated-orcid":false,"given":"Shudi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Northeastern University, Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3694-8939","authenticated-orcid":false,"given":"Xinyao","family":"Liu","sequence":"additional","affiliation":[{"name":"Northeastern University, Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0095-0378","authenticated-orcid":false,"given":"Zhiqiong","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,27]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"2012","article-title":"The AASM manual for the scoring of sleep and associated events. Rules, Terminology and Technical Specifications, Darien, Illinois","volume":"176","author":"Berry Richard B","year":"2012","unstructured":"Richard B Berry, Rita Brooks, Charlene E Gamaldo, Susan M Harding, C Marcus, Bradley V Vaughn, et al., 2012. The AASM manual for the scoring of sleep and associated events. Rules, Terminology and Technical Specifications, Darien, Illinois, American Academy of Sleep Medicine, Vol. 176 (2012), 2012.","journal-title":"American Academy of Sleep Medicine"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01016-9"},{"key":"e_1_3_2_1_3_1","volume-title":"A general survey on attention mechanisms in deep learning","author":"Brauwers Gianni","year":"2021","unstructured":"Gianni Brauwers and Flavius Frasincar. 2021. A general survey on attention mechanisms in deep learning. IEEE Transactions on Knowledge and Data Engineering (2021)."},{"key":"e_1_3_2_1_4_1","volume-title":"Transfuser: Imitation with transformer-based sensor fusion for autonomous driving","author":"Chitta Kashyap","year":"2022","unstructured":"Kashyap Chitta, Aditya Prakash, Bernhard Jaeger, Zehao Yu, Katrin Renz, and Andreas Geiger. 2022. Transfuser: Imitation with transformer-based sensor fusion for autonomous driving. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2022.3147833"},{"key":"e_1_3_2_1_6_1","volume-title":"A review on current trends in automatic sleep staging through bio-signal recordings and future challenges. Sleep medicine reviews","author":"Chriskos Panteleimon","year":"2021","unstructured":"Panteleimon Chriskos, Christos A Frantzidis, Christiane M Nday, Polyxeni T Gkivogkli, Panagiotis D Bamidis, and Chrysoula Kourtidou-Papadeli. 2021. A review on current trends in automatic sleep staging through bio-signal recordings and future challenges. Sleep medicine reviews, Vol. 55 (2021), 101377."},{"volume-title":"Elements of information theory","author":"Cover Thomas M","key":"e_1_3_2_1_7_1","unstructured":"Thomas M Cover. 1999. Elements of information theory. John Wiley & Sons."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2022.12.014"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2021.3076234"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2021.3076234"},{"key":"e_1_3_2_1_11_1","volume-title":"Xi Long, and Ronald M Aarts.","author":"Fonseca Pedro","year":"2016","unstructured":"Pedro Fonseca, Niek Den Teuling, Xi Long, and Ronald M Aarts. 2016. Cardiorespiratory sleep stage detection using conditional random fields. IEEE journal of biomedical and health informatics, Vol. 21, 4 (2016), 956-966."},{"key":"e_1_3_2_1_12_1","volume-title":"Leon Glass, Jeffrey M Hausdorff, Plamen Ch Ivanov, Roger G Mark, Joseph E Mietus, George B Moody, Chung-Kang Peng, and H Eugene Stanley.","author":"Goldberger Ary L","year":"2000","unstructured":"Ary L Goldberger, Luis AN Amaral, Leon Glass, Jeffrey M Hausdorff, Plamen Ch Ivanov, Roger G Mark, Joseph E Mietus, George B Moody, Chung-Kang Peng, and H Eugene Stanley. 2000. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. circulation, Vol. 101, 23 (2000), e215-e220."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.649"},{"key":"e_1_3_2_1_14_1","first-page":"4447","article-title":"Dual contrastive prediction for incomplete multi-view representation learning","volume":"45","author":"Lin Yijie","year":"2022","unstructured":"Yijie Lin, Yuanbiao Gou, Xiaotian Liu, Jinfeng Bai, Jiancheng Lv, and Xi Peng. 2022. Dual contrastive prediction for incomplete multi-view representation learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 4 (2022), 4447-4461.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/3692070.3693362"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3612277"},{"key":"e_1_3_2_1_17_1","first-page":"3109","article-title":"AttnSense: Multi-level attention mechanism for multimodal human activity recognition","author":"Ma Haojie","year":"2019","unstructured":"Haojie Ma, Wenzhong Li, Xiao Zhang, Songcheng Gao, and Sanglu Lu. 2019. AttnSense: Multi-level attention mechanism for multimodal human activity recognition.. In IJCAI. 3109-3115.","journal-title":"IJCAI."},{"volume-title":"The Thirteenth International Conference on Learning Representations.","author":"Ma Shuo","key":"e_1_3_2_1_18_1","unstructured":"Shuo Ma, Yingwei Zhang, Yiqiang Chen, Hualei Wang, Yuan Jin, Wei Zhang, and Ziyu Jia. [n.d.]. SleepSMC: Ubiquitous Sleep Staging via Supervised Multimodal Coordination. In The Thirteenth International Conference on Learning Representations."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3664647.3680854"},{"key":"e_1_3_2_1_20_1","volume-title":"Multimodal information bottleneck: Learning minimal sufficient unimodal and multimodal representations","author":"Mai Sijie","year":"2022","unstructured":"Sijie Mai, Ying Zeng, and Haifeng Hu. 2022. Multimodal information bottleneck: Learning minimal sufficient unimodal and multimodal representations. IEEE Transactions on Multimedia (2022)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5664\/jcsm.7234"},{"key":"e_1_3_2_1_22_1","volume-title":"A mattress system of recognizing sleep postures based on BCG signal. Chinese journal of medical instrumentation","author":"Mengxing LIU","year":"2019","unstructured":"LIU Mengxing, QIN Liping, and YE Shuming. 2019. A mattress system of recognizing sleep postures based on BCG signal. Chinese journal of medical instrumentation, Vol. 43, 4 (2019), 243-247."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2022.3187945"},{"key":"e_1_3_2_1_24_1","volume-title":"Deep clustering with sample-assignment invariance prior","author":"Peng Xi","year":"2019","unstructured":"Xi Peng, Hongyuan Zhu, Jiashi Feng, Chunhua Shen, Haixian Zhang, and Joey Tianyi Zhou. 2019. Deep clustering with sample-assignment invariance prior. IEEE transactions on neural networks and learning systems, Vol. 31, 11 (2019), 4857-4868."},{"key":"e_1_3_2_1_25_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Perslev Mathias","year":"2019","unstructured":"Mathias Perslev, Michael Jensen, Sune Darkner, Poul J\u00f8rgen Jennum, and Christian Igel. 2019. U-time: A fully convolutional network for time series segmentation applied to sleep staging. Advances in Neural Information Processing Systems, Vol. 32 (2019)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2018.2872652"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2019.2896659"},{"key":"e_1_3_2_1_28_1","first-page":"5903","article-title":"XSleepNet: Multi-view sequential model for automatic sleep staging","volume":"44","author":"Phan Huy","year":"2021","unstructured":"Huy Phan, Oliver Y Ch\u00e9n, Minh C Tran, Philipp Koch, Alfred Mertins, and Maarten De Vos. 2021. XSleepNet: Multi-view sequential model for automatic sleep staging. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, 9 (2021), 5903-5915.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2022.3147187"},{"key":"e_1_3_2_1_30_1","volume-title":"TransSleep: Transitioning-Aware attention-based deep neural network for sleep staging","author":"Phyo Jaeun","year":"2022","unstructured":"Jaeun Phyo, Wonjun Ko, Eunjin Jeon, and Heung-Il Suk. 2022. TransSleep: Transitioning-Aware attention-based deep neural network for sleep staging. IEEE Transactions on Cybernetics (2022)."},{"key":"e_1_3_2_1_31_1","volume-title":"Intra-and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG. Biomedical signal processing and control","author":"Seo Hogeon","year":"2020","unstructured":"Hogeon Seo, Seunghyeok Back, Seongju Lee, Deokhwan Park, Tae Kim, and Kyoobin Lee. 2020. Intra-and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG. Biomedical signal processing and control, Vol. 61 (2020), 102037."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2022.01.039"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2023.3298639","article-title":"LGSleepNet: an automatic sleep staging model based on local and global representation learning","volume":"72","author":"Shen Qi","year":"2023","unstructured":"Qi Shen, Junchang Xin, Xinyao Liu, Zhongyang Wang, Chuangang Li, Zhihong Huang, and Zhiqiong Wang. 2023. LGSleepNet: an automatic sleep staging model based on local and global representation learning. IEEE Transactions on Instrumentation and Measurement, Vol. 72 (2023), 1-14.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_3_2_1_34_1","volume-title":"Fusion analysis of EEG-fNIRS multimodal brain signals: a multitask classification algorithm incorporating spatial-temporal convolution and dual attention mechanisms","author":"Shi Xingbin","year":"2025","unstructured":"Xingbin Shi, Haiyan Wang, Baojiang Li, Yuxin Qin, Cheng Peng, and Yifan Lu. 2025. Fusion analysis of EEG-fNIRS multimodal brain signals: a multitask classification algorithm incorporating spatial-temporal convolution and dual attention mechanisms. IEEE Transactions on Instrumentation and Measurement (2025)."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3664647.3680633"},{"key":"e_1_3_2_1_36_1","article-title":"Visualizing data using t-SNE","volume":"9","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research, Vol. 9, 11 (2008).","journal-title":"Journal of machine learning research"},{"key":"e_1_3_2_1_37_1","volume-title":"Attention is all you need. Advances in neural information processing systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017)."},{"key":"e_1_3_2_1_38_1","volume-title":"Sleep","volume":"42","author":"Walch Olivia","year":"2019","unstructured":"Olivia Walch, Yitong Huang, Daniel Forger, and Cathy Goldstein. 2019. Sleep stage prediction with raw acceleration and photoplethysmography heart rate data derived from a consumer wearable device. Sleep, Vol. 42, 12 (2019), zsz180."},{"key":"e_1_3_2_1_39_1","first-page":"759","article-title":"Recent advances in radar-based sleep monitoring-A review. In 2021 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC\/PiCom\/CBDCom\/CyberSciTech)","author":"Walid Brahim","year":"2021","unstructured":"Brahim Walid, Jianhua Ma, Muxin Ma, Alex Qi, Yunlong Luo, and Yihong Qi. 2021. Recent advances in radar-based sleep monitoring-A review. In 2021 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC\/PiCom\/CBDCom\/CyberSciTech). IEEE, 759-766.","journal-title":"IEEE"},{"key":"e_1_3_2_1_40_1","volume-title":"CareSleepNet: a hybrid deep learning network for automatic sleep staging","author":"Wang Jiquan","year":"2024","unstructured":"Jiquan Wang, Sha Zhao, Haiteng Jiang, Yangxuan Zhou, Zhenghe Yu, Tao Li, Shijian Li, and Gang Pan. 2024b. CareSleepNet: a hybrid deep learning network for automatic sleep staging. IEEE Journal of Biomedical and Health Informatics (2024)."},{"key":"e_1_3_2_1_41_1","volume-title":"Video-psg: An intelligent contactless monitoring system for sleep staging","author":"Wang Qiongyan","year":"2024","unstructured":"Qiongyan Wang, Hanrong Cheng, and Wenjin Wang. 2024a. Video-psg: An intelligent contactless monitoring system for sleep staging. IEEE Transactions on Biomedical Engineering (2024)."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00308"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2022.3220285"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i15.29578"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2022.973761"},{"key":"e_1_3_2_1_46_1","volume-title":"Research and application of deep learning-based sleep staging: Data, modeling, validation, and clinical practice. Sleep Medicine Reviews","author":"Yue Huijun","year":"2024","unstructured":"Huijun Yue, Zhuqi Chen, Wenbin Guo, Lin Sun, Yidan Dai, Yiming Wang, Wenjun Ma, Xiaomao Fan, Weiping Wen, and Wenbin Lei. 2024. Research and application of deep learning-based sleep staging: Data, modeling, validation, and clinical practice. Sleep Medicine Reviews (2024), 101897."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy064"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2023.3235935"},{"key":"e_1_3_2_1_49_1","volume-title":"Dynamic alignment and fusion of multimodal physiological patterns for stress recognition","author":"Zhang Xiaowei","year":"2023","unstructured":"Xiaowei Zhang, Xiangyu Wei, Zhongyi Zhou, Qiqi Zhao, Sipo Zhang, Yikun Yang, Rui Li, and Bin Hu. 2023b. Dynamic alignment and fusion of multimodal physiological patterns for stress recognition. IEEE Transactions on Affective Computing (2023)."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3253728"}],"event":{"name":"MM '25: The 33rd ACM International Conference on Multimedia","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Dublin Ireland","acronym":"MM '25"},"container-title":["Proceedings of the 33rd ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3746027.3755558","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T19:13:32Z","timestamp":1765307612000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3746027.3755558"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,27]]},"references-count":50,"alternative-id":["10.1145\/3746027.3755558","10.1145\/3746027"],"URL":"https:\/\/doi.org\/10.1145\/3746027.3755558","relation":{},"subject":[],"published":{"date-parts":[[2025,10,27]]},"assertion":[{"value":"2025-10-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}