{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T15:38:52Z","timestamp":1769009932094,"version":"3.49.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T00:00:00Z","timestamp":1664496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100011038","name":"Office of the Director of National Intelligence","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100011038","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100011039","name":"Intelligence Advanced Research Projects Activity","doi-asserted-by":"crossref","award":["2017-17042800007"],"award-info":[{"award-number":["2017-17042800007"]}],"id":[{"id":"10.13039\/100011039","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>\n            The prevalence of wearable sensors (e.g., smart wristband) is creating unprecedented opportunities to not only inform health and wellness states of individuals, but also assess and infer personal attributes, including demographic and personality attributes. However, the data captured from wearables, such as heart rate or number of steps, present two key challenges: (1) the time series is often of variable length and incomplete due to different data collection periods (e.g., wearing behavior varies by person); and (2) there is inter-individual variability to external factors like stress and environment. This article addresses these challenges and brings us closer to the potential of personalized insights about an individual, taking the leap from quantified self to qualified self. Specifically,\n            <jats:italic>HeartSpace<\/jats:italic>\n            proposed in this article learns embedding of the time-series data with variable length and missing values via the integration of a time-series encoding module and a pattern aggregation network. Additionally,\n            <jats:italic>HeartSpace<\/jats:italic>\n            implements a Siamese-triplet network to optimize representations by jointly capturing intra- and inter-series correlations during the embedding learning process. The empirical evaluation over two different real-world data presents significant performance gains over state-of-the-art baselines in a variety of applications, including user identification, personality prediction, demographics inference, job performance prediction, and sleep duration estimation.\n          <\/jats:p>","DOI":"10.1145\/3531228","type":"journal-article","created":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T09:03:57Z","timestamp":1657271037000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Representation Learning on Variable Length and Incomplete Wearable-Sensory Time Series"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0840-5857","authenticated-orcid":false,"given":"Xian","family":"Wu","sequence":"first","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3800-5766","authenticated-orcid":false,"given":"Chao","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0604-7187","authenticated-orcid":false,"given":"Pablo","family":"Robles-Granda","sequence":"additional","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3932-5956","authenticated-orcid":false,"given":"Nitesh V.","family":"Chawla","sequence":"additional","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,30]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"4776","volume-title":"EMBC","author":"Amiriparian Shahin","year":"2018","unstructured":"Shahin Amiriparian, Maximilian Schmitt, Nicholas Cummins, Kun Qian, Fengquan Dong, and Bj\u00f6rn Schuller. 2018. Deep unsupervised representation learning for abnormal heart sound classification. In EMBC. IEEE, 4776\u20134779."},{"key":"e_1_3_2_3_2","first-page":"43","volume-title":"KDD","author":"Bai Tian","year":"2018","unstructured":"Tian Bai, Shanshan Zhang, Brian L. Egleston, and Slobodan Vucetic. 2018. Interpretable representation learning for healthcare via capturing disease progression through time. In KDD. ACM, 43\u201351."},{"key":"e_1_3_2_4_2","volume-title":"IJCAI","year":"2018","unstructured":"Xian Wu, Chao Huang, Pablo Robles Granda, and Nitesh V. Chawla. 2018. DeepHeart: Semi-supervised sequence learning for cardiovascular risk prediction. In IJCAI."},{"key":"e_1_3_2_5_2","first-page":"427","volume-title":"SSPR","author":"Bascol Kevin","year":"2016","unstructured":"Kevin Bascol, R\u00e9mi Emonet, et\u00a0al. 2016. Unsupervised interpretable pattern discovery in time series using autoencoders. In SSPR. Springer, 427\u2013438."},{"key":"e_1_3_2_6_2","first-page":"3572","volume-title":"EMBC","author":"Bhattacharjee Tanuka","year":"2018","unstructured":"Tanuka Bhattacharjee, Shreyasi Datta, Deepan Das, Anirban Dutta Choudhury, Arpan Pal, and Prasanta Kumar Ghosh. 2018. A heart rate driven Kalman filter for continuous arousal trend monitoring. In EMBC. IEEE, 3572\u20133577."},{"key":"e_1_3_2_7_2","first-page":"747","volume-title":"KDD","author":"Cao Bokai","year":"2017","unstructured":"Bokai Cao, Lei Zheng, Chenwei Zhang, Philip S. Yu, Andrea Piscitello, John Zulueta, Olu Ajilore, Kelly Ryan, and Alex D. Leow. 2017. Deepmood: Modeling mobile phone typing dynamics for mood detection. In KDD. ACM, 747\u2013755."},{"key":"e_1_3_2_8_2","first-page":"199","volume-title":"CSE","author":"Cheng Maowei","year":"2017","unstructured":"Maowei Cheng, Worku J. Sori, Feng Jiang, Adil Khan, and Shaohui Liu. 2017. Recurrent neural network based classification of ECG signal features for obstruction of sleep apnea detection. In CSE, Vol. 2. IEEE, 199\u2013202."},{"key":"e_1_3_2_9_2","first-page":"787","volume-title":"KDD","author":"Choi Edward","year":"2017","unstructured":"Edward Choi, Mohammad Taha Bahadori, et\u00a0al. 2017. GRAM: Graph-based attention model for healthcare representation learning. In KDD. ACM, 787\u2013795."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.84.1.3"},{"key":"e_1_3_2_11_2","unstructured":"Patrick Doetsch Pavel Golik and Hermann Ney. 2017. A comprehensive study of batch construction strategies for recurrent neural networks in MXNet. arXiv:1705.02414. https:\/\/arxiv.org\/abs\/1705.02414."},{"key":"e_1_3_2_12_2","first-page":"15","volume-title":"KDD","author":"Dong Yuxiao","year":"2014","unstructured":"Yuxiao Dong, Yang Yang, Jie Tang, et\u00a0al. 2014. Inferring user demographics and social strategies in mobile social networks. In KDD. ACM, 15\u201324."},{"key":"e_1_3_2_13_2","first-page":"249","volume-title":"AISTATS","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS. 249\u2013256."},{"key":"e_1_3_2_14_2","first-page":"4086","volume-title":"ICCV","author":"Goroshin Ross","year":"2015","unstructured":"Ross Goroshin, Joan Bruna, Jonathan Tompson, et\u00a0al. 2015. Unsupervised learning of spatiotemporally coherent metrics. In ICCV. 4086\u20134093."},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1145\/2939672.2939754","volume-title":"KDD","author":"Grover Aditya","year":"2016","unstructured":"Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In KDD. ACM, 855\u2013864."},{"key":"e_1_3_2_16_2","first-page":"7132","volume-title":"CVPR","author":"Hu Jie","year":"2018","unstructured":"Jie Hu, Li Shen, and Gang Sun. 2018. Squeeze-and-excitation networks. In CVPR. 7132\u20137141."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2779939"},{"key":"e_1_3_2_18_2","first-page":"571","volume-title":"MLHC","author":"Lehman Eric P.","year":"2018","unstructured":"Eric P. Lehman, Rahul G. Krishnan, Xiaopeng Zhao, Roger G. Mark, and H. Lehman Li-wei. 2018. Representation learning approaches to detect false arrhythmia alarms from ECG dynamics. In MLHC. 571\u2013586."},{"issue":"3","key":"e_1_3_2_19_2","first-page":"583","article-title":"Efficient motif discovery for large-scale time series in healthcare","volume":"11","author":"Liu Bo","year":"2015","unstructured":"Bo Liu, Jianqiang Li, Cheng Chen, et\u00a0al. 2015. Efficient motif discovery for large-scale time series in healthcare. TII 11, 3 (2015), 583\u2013590.","journal-title":"TII"},{"key":"e_1_3_2_20_2","first-page":"24","volume-title":"ICHI","author":"Liu Xi","year":"2016","unstructured":"Xi Liu, Lei Liu, Steven J. Simske, et\u00a0al. 2016. Human daily activity recognition for healthcare using wearable and visual sensing data. In ICHI. IEEE, 24\u201331."},{"key":"e_1_3_2_21_2","first-page":"1903","volume-title":"KDD","author":"Ma Fenglong","year":"2017","unstructured":"Fenglong Ma, Radha Chitta, Jing Zhou, Quanzeng You, Tong Sun, and Jing Gao. 2017. Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. In KDD. ACM, 1903\u20131911."},{"key":"e_1_3_2_22_2","first-page":"1910","volume-title":"KDD","author":"Ma Fenglong","year":"2018","unstructured":"Fenglong Ma, Jing Gao, et\u00a0al. 2018. Risk prediction on electronic health records with prior medical knowledge. In KDD. ACM, 1910\u20131919."},{"key":"e_1_3_2_23_2","article-title":"A concise temporal data representation model for prediction in biomedical wearable devices","author":"Manashty Alireza","year":"2018","unstructured":"Alireza Manashty, Janet Light, and Hamid Soleimani. 2018. A concise temporal data representation model for prediction in biomedical wearable devices. Internet of Things Journal (2018).","journal-title":"Internet of Things Journal"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-6494.1992.tb00970.x"},{"key":"e_1_3_2_25_2","first-page":"3111","volume-title":"NIPS","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Ilya Sutskever, Kai Chen, et\u00a0al. 2013. Distributed representations of words and phrases and their compositionality. In NIPS. 3111\u20133119."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-26892-6"},{"key":"e_1_3_2_27_2","unstructured":"Jianmo Ni Larry Muhlstein and Julian McAuley. 2019. Modeling heart rate and activity data for personalized fitness recommendation."},{"key":"e_1_3_2_28_2","article-title":"Learning to exploit invariances in clinical time-series data using sequence transformer networks","author":"Oh Jeeheh","year":"2018","unstructured":"Jeeheh Oh, Jiaxuan Wang, and Jenna Wiens. 2018. Learning to exploit invariances in clinical time-series data using sequence transformer networks. Machine Learning for Healthcare (2018).","journal-title":"Machine Learning for Healthcare"},{"key":"e_1_3_2_29_2","first-page":"606","volume-title":"KDD","author":"Be\u00e9ck Tim Op De","year":"2018","unstructured":"Tim Op De Be\u00e9ck, Wannes Meert, et\u00a0al. 2018. Fatigue prediction in outdoor runners via machine learning and sensor fusion. In KDD. ACM, 606\u2013615."},{"key":"e_1_3_2_30_2","first-page":"1532","volume-title":"EMNLP","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In EMNLP. 1532\u20131543."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep20382"},{"key":"e_1_3_2_32_2","first-page":"4471","volume-title":"ICCV","author":"Ramanathan Vignesh","year":"2015","unstructured":"Vignesh Ramanathan, Kevin Tang, Greg Mori, and Li Fei-Fei. 2015. Learning temporal embeddings for complex video analysis. In ICCV. 4471\u20134479."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2627446"},{"key":"e_1_3_2_34_2","first-page":"2377","volume-title":"NIPS","author":"Srivastava Rupesh K.","year":"2015","unstructured":"Rupesh K. Srivastava, Klaus Greff, and J\u00fcrgen Schmidhuber. 2015. Training very deep networks. In NIPS. 2377\u20132385."},{"key":"e_1_3_2_35_2","first-page":"715","volume-title":"WWW","author":"Suhara Yoshihiko","year":"2017","unstructured":"Yoshihiko Suhara, Yinzhan Xu, and Alex\u2018Sandy\u2019 Pentland. 2017. Deepmood: Forecasting depressed mood based on self-reported histories via recurrent neural networks. In WWW. ACM, 715\u2013724."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.03.085"},{"key":"e_1_3_2_37_2","first-page":"2357","volume-title":"KDD","author":"Tu Ke","year":"2018","unstructured":"Ke Tu, Peng Cui, Xiao Wang, Philip S. Yu, and Wenwu Zhu. 2018. Deep recursive network embedding with regular equivalence. In KDD. ACM, 2357\u20132366."},{"key":"e_1_3_2_38_2","first-page":"6260","volume-title":"ICASSP","author":"Ukil Arijit","year":"2016","unstructured":"Arijit Ukil, Soma Bandyopadhyay, Chetanya Puri, and Arpan Pal. 2016. Heart-trend: An affordable heart condition monitoring system exploiting morphological pattern. In ICASSP. IEEE, 6260\u20136264."},{"issue":"11","key":"e_1_3_2_39_2","article-title":"Visualizing data using t-SNE.","volume":"9","author":"Maaten Laurens Van der","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 11 (2008).","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_40_2","first-page":"5998","volume-title":"NIPS","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, et\u00a0al. 2017. Attention is all you need. In NIPS. 5998\u20136008."},{"key":"e_1_3_2_41_2","first-page":"2447","volume-title":"KDD","author":"Wang Lu","year":"2018","unstructured":"Lu Wang, Wei Zhang, Xiaofeng He, and Hongyuan Zha. 2018. Supervised reinforcement learning with recurrent neural network for dynamic treatment recommendation. In KDD. ACM, 2447\u20132456."},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1145\/2835776.2835783","volume-title":"WSDM","author":"Wang Pengfei","year":"2016","unstructured":"Pengfei Wang, Jiafeng Guo, Yanyan Lan, and Jun Xu. 2016. Your cart tells you: Inferring demographic attributes from purchase data. In WSDM. ACM, 173\u2013182."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2006.877107"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.03.074"},{"key":"e_1_3_2_45_2","article-title":"GaAN: Gated attention networks for learning on large and spatiotemporal graphs","author":"Zhang Jiani","year":"2018","unstructured":"Jiani Zhang, Xingjian Shi, Junyuan Xie, et\u00a0al. 2018. GaAN: Gated attention networks for learning on large and spatiotemporal graphs. In UAI.","journal-title":"UAI"},{"key":"e_1_3_2_46_2","first-page":"837","volume-title":"ICDM","author":"Zhu Yan","year":"2018","unstructured":"Yan Zhu, Chin-Chia Michael Yeh, Zachary Zimmerman, et\u00a0al. 2018. Matrix profile XI: SCRIMP++: Time series motif discovery at interactive speeds. In ICDM. IEEE, 837\u2013846."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3531228","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3531228","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:31Z","timestamp":1750188691000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3531228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,30]]},"references-count":45,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3531228"],"URL":"https:\/\/doi.org\/10.1145\/3531228","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,30]]},"assertion":[{"value":"2020-08-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-11","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}