{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T22:20:35Z","timestamp":1783117235351,"version":"3.54.6"},"reference-count":118,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T00:00:00Z","timestamp":1673395200000},"content-version":"vor","delay-in-days":21,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100007812","name":"University of Washington","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007812","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the National Science Foundation","award":["EDA-2009977, CHS-2016365, CHS1941537, IIS1816687, IIS7974751"],"award-info":[{"award-number":["EDA-2009977, CHS-2016365, CHS1941537, IIS1816687, IIS7974751"]}]},{"name":"the National Institute on Disability, Independent Living and Rehabilitation Research","award":["90DPGE0003-01"],"award-info":[{"award-number":["90DPGE0003-01"]}]},{"name":"Samsung Research America"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,12,21]]},"abstract":"<jats:p>There is a growing body of research revealing that longitudinal passive sensing data from smartphones and wearable devices can capture daily behavior signals for human behavior modeling, such as depression detection. Most prior studies build and evaluate machine learning models using data collected from a single population. However, to ensure that a behavior model can work for a larger group of users, its generalizability needs to be verified on multiple datasets from different populations. We present the first work evaluating cross-dataset generalizability of longitudinal behavior models, using depression detection as an application. We collect multiple longitudinal passive mobile sensing datasets with over 500 users from two institutes over a two-year span, leading to four institute-year datasets. Using the datasets, we closely re-implement and evaluated nine prior depression detection algorithms. Our experiment reveals the lack of model generalizability of these methods. We also implement eight recently popular domain generalization algorithms from the machine learning community. Our results indicate that these methods also do not generalize well on our datasets, with barely any advantage over the naive baseline of guessing the majority. We then present two new algorithms with better generalizability. Our new algorithm, Reorder, significantly and consistently outperforms existing methods on most cross-dataset generalization setups. However, the overall advantage is incremental and still has great room for improvement. Our analysis reveals that the individual differences (both within and between populations) may play the most important role in the cross-dataset generalization challenge. Finally, we provide an open-source benchmark platform GLOBEM- short for Generalization of Longitudinal BEhavior Modeling - to consolidate all 19 algorithms. GLOBEM can support researchers in using, developing, and evaluating different longitudinal behavior modeling methods. We call for researchers' attention to model generalizability evaluation for future longitudinal human behavior modeling studies.<\/jats:p>","DOI":"10.1145\/3569485","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T15:34:01Z","timestamp":1673451241000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":90,"title":["GLOBEM"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5930-3899","authenticated-orcid":false,"given":"Xuhai","family":"Xu","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9279-5386","authenticated-orcid":false,"given":"Xin","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1377-1168","authenticated-orcid":false,"given":"Han","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6738-9944","authenticated-orcid":false,"given":"Weichen","family":"Wang","sequence":"additional","affiliation":[{"name":"Dartmouth College, Hanover, NH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4314-9505","authenticated-orcid":false,"given":"Subigya","family":"Nepal","sequence":"additional","affiliation":[{"name":"Dartmouth College, Hanover, NH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8990-699X","authenticated-orcid":false,"given":"Yasaman","family":"Sefidgar","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1316-4341","authenticated-orcid":false,"given":"Woosuk","family":"Seo","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7985-613X","authenticated-orcid":false,"given":"Kevin S.","family":"Kuehn","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0106-7808","authenticated-orcid":false,"given":"Jeremy F.","family":"Huckins","sequence":"additional","affiliation":[{"name":"Dartmouth College, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8925-9718","authenticated-orcid":false,"given":"Margaret E.","family":"Morris","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5091-6349","authenticated-orcid":false,"given":"Paula S.","family":"Nurius","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8813-6521","authenticated-orcid":false,"given":"Eve A.","family":"Riskin","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6300-4389","authenticated-orcid":false,"given":"Shwetak","family":"Patel","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4793-2289","authenticated-orcid":false,"given":"Tim","family":"Althoff","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7394-7682","authenticated-orcid":false,"given":"Andrew","family":"Campbell","sequence":"additional","affiliation":[{"name":"Dartmouth College, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3004-0770","authenticated-orcid":false,"given":"Anind K.","family":"Dey","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9235-5324","authenticated-orcid":false,"given":"Jennifer","family":"Mankoff","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Machine learning for passive mental health symptom prediction: Generalization across different longitudinal mobile sensing studies. PLOS ONE","author":"Adler Daniel A","year":"2022","unstructured":"Daniel A Adler, Fei Wang, David C Mohr, and Tanzeem Choudhury. 2022. Machine learning for passive mental health symptom prediction: Generalization across different longitudinal mobile sensing studies. PLOS ONE (2022), 20."},{"key":"e_1_2_2_2_1","volume-title":"Invariant Risk Minimization. arXiv:1907.02893 [cs, stat] (March","author":"Arjovsky Martin","year":"2020","unstructured":"Martin Arjovsky, L\u00e9on Bottou, Ishaan Gulrajani, and David Lopez-Paz. 2020. Invariant Risk Minimization. arXiv:1907.02893 [cs, stat] (March 2020). http:\/\/arxiv.org\/abs\/1907.02893 arXiv: 1907.02893."},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association et al. 2013. Diagnostic and statistical manual of mental disorders (dsm-5\u00ae). American Psychiatric Pub.","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2016.2565381"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090051"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7284869"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858557"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kxy059"},{"key":"e_1_2_2_9_1","first-page":"490","article-title":"Beck depression inventory-ii","volume":"78","author":"Beck Aaron T.","year":"1996","unstructured":"Aaron T. Beck, Robert A. Steer, and Gregory K. Brown. 1996. Beck depression inventory-ii. San Antonio 78, 2 (1996), 490--498.","journal-title":"San Antonio"},{"key":"e_1_2_2_10_1","volume-title":"Michael Merrill, Vincent WS Tseng, Tanzeem Choudhury, Marta Hauser, et al.","author":"Ben-Zeev Dror","year":"2017","unstructured":"Dror Ben-Zeev, Rachel Brian, Rui Wang, Weichen Wang, Andrew T Campbell, Min SH Aung, Michael Merrill, Vincent WS Tseng, Tanzeem Choudhury, Marta Hauser, et al. 2017. CrossCheck: Integrating self-report, behavioral sensing, and smartphone use to identify digital indicators of psychotic relapse. Psychiatric rehabilitation journal 40, 3 (2017), 266."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1037\/prj0000130"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.764"},{"key":"e_1_2_2_13_1","volume-title":"Physical activity and depression: evidence from the Alameda County Study. American journal of epidemiology 134, 2","author":"Camacho Terry C","year":"1991","unstructured":"Terry C Camacho, Robert E Roberts, Nancy B Lazarus, George A Kaplan, and Richard D Cohen. 1991. Physical activity and depression: evidence from the Alameda County Study. American journal of epidemiology 134, 2 (1991), 220--231."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805845"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539875"},{"key":"e_1_2_2_16_1","volume-title":"Domain Generalization by Solving Jigsaw Puzzles. arXiv:1903.06864 [cs] (April","author":"Carlucci Fabio Maria","year":"2019","unstructured":"Fabio Maria Carlucci, Antonio D'Innocente, Silvia Bucci, Barbara Caputo, and Tatiana Tommasi. 2019. Domain Generalization by Solving Jigsaw Puzzles. arXiv:1903.06864 [cs] (April 2019). http:\/\/arxiv.org\/abs\/1903.06864 arXiv: 1903.06864."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.pervasivehealth.2013.252148"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3422821"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20072034"},{"key":"e_1_2_2_21_1","volume-title":"Cultural diversity in organizations: Theory, research and practice","author":"Cox Taylor","unstructured":"Taylor Cox. 1994. Cultural diversity in organizations: Theory, research and practice. Berrett-Koehler Publishers."},{"key":"e_1_2_2_22_1","volume-title":"The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British journal of clinical psychology 43, 3","author":"Crawford John R","year":"2004","unstructured":"John R Crawford and Julie D Henry. 2004. The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British journal of clinical psychology 43, 3 (2004), 245--265."},{"key":"e_1_2_2_23_1","first-page":"07","volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics. Association for Computational Linguistics, Prague, Czech Republic, 256--263","author":"Hal Daum\u00e9","year":"2007","unstructured":"Hal Daum\u00e9 III. 2007. Frustratingly Easy Domain Adaptation. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics. Association for Computational Linguistics, Prague, Czech Republic, 256--263. https:\/\/www.aclweb.org\/anthology\/P07-1033"},{"key":"e_1_2_2_24_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 [cs] (May","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 [cs] (May 2019). http:\/\/arxiv.org\/abs\/1810.04805 arXiv: 1810.04805."},{"key":"e_1_2_2_25_1","volume-title":"Extraction of behavioral features from smartphone and wearable data. arXiv preprint arXiv:1812.10394","author":"Doryab Afsaneh","year":"2018","unstructured":"Afsaneh Doryab, Prerna Chikarsel, Xinwen Liu, and Anind K Dey. 2018. Extraction of behavioral features from smartphone and wearable data. arXiv preprint arXiv:1812.10394 (2018)."},{"key":"e_1_2_2_26_1","volume-title":"Domain Generalization via Model-Agnostic Learning of Semantic Features. arXiv:1910.13580 [cs] (Oct","author":"Dou Qi","year":"2019","unstructured":"Qi Dou, Daniel C. Castro, Konstantinos Kamnitsas, and Ben Glocker. 2019. Domain Generalization via Model-Agnostic Learning of Semantic Features. arXiv:1910.13580 [cs] (Oct. 2019). http:\/\/arxiv.org\/abs\/1910.13580 arXiv: 1910.13580."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/WH.2016.7764553"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.79"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.3389\/fict.2015.00006"},{"key":"e_1_2_2_30_1","volume-title":"Revisiting the theoretical and methodological foundations of depression measurement. Nature Reviews Psychology","author":"Fried Eiko I","year":"2022","unstructured":"Eiko I Fried, Jessica K Flake, and Donald J Robinaugh. 2022. Revisiting the theoretical and methodological foundations of depression measurement. Nature Reviews Psychology (2022), 1--11."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-58347-1_10"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-58347-1_10"},{"key":"e_1_2_2_33_1","volume-title":"Jinwoo Shin, and Sung-Ju Lee.","author":"Gong Taesik","year":"2021","unstructured":"Taesik Gong, Yewon Kim, Adiba Orzikulova, Yunxin Liu, Sung Ju Hwang, Jinwoo Shin, and Sung-Ju Lee. 2021. DAPPER: Performance Estimation of Domain Adaptation in Mobile Sensing. arXiv preprint arXiv:2111.11053 (2021)."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356250.3360020"},{"key":"e_1_2_2_35_1","volume-title":"Cognition and depression: current status and future directions. Annual review of clinical psychology 6","author":"Gotlib Ian H","year":"2010","unstructured":"Ian H Gotlib and Jutta Joormann. 2010. Cognition and depression: current status and future directions. Annual review of clinical psychology 6 (2010), 285--312."},{"key":"e_1_2_2_36_1","unstructured":"Ishaan Gulrajani and David Lopez-Paz. 2021. In Search of Lost Domain Generalization. (2021) 29."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11503"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70096-0_39"},{"key":"e_1_2_2_39_1","volume-title":"Assessing the relationship between routine and schizophrenia symptoms with passively sensed measures of behavioral stability. NPJ schizophrenia 6, 1","author":"He-Yueya Joy","year":"2020","unstructured":"Joy He-Yueya, Benjamin Buck, Andrew Campbell, Tanzeem Choudhury, John M Kane, Dror Ben-Zeev, and Tim Althoff. 2020. Assessing the relationship between routine and schizophrenia symptoms with passively sensed measures of behavioral stability. NPJ schizophrenia 6, 1 (2020), 1--8."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordjournals.cje.a013692"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2018.00213"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2523503"},{"key":"e_1_2_2_43_1","doi-asserted-by":"crossref","unstructured":"Jeremy F Huckins Alex W DaSilva Elin L Hedlund Eilis I Murphy Courtney Rogers Weichen Wang Mikio Obuchi Paul E Holtzheimer Dylan D Wagner and Andrew T Campbell. 2020. Causal factors of anxiety and depression in college students: longitudinal ecological momentary assessment and causal analysis using Peter and Clark momentary conditional independence. JMIR mental health 7 6 (2020) e16684.","DOI":"10.2196\/16684"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.2196\/20185"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00525"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00948"},{"key":"e_1_2_2_47_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning","author":"Koch Gregory","year":"2015","unstructured":"Gregory Koch, Richard Zemel, and Ruslan Salakhutdinov. 2015. Siamese Neural Networks for One-shot Image Recognition. Proceedings of the 32nd International Conference on Machine Learning (2015), 8."},{"key":"e_1_2_2_48_1","volume-title":"International Conference on Machine Learning. PMLR, 5637--5664","author":"Koh Pang Wei","year":"2021","unstructured":"Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Irena Gao, et al. 2021. Wilds: A benchmark of in-the-wild distribution shifts. In International Conference on Machine Learning. PMLR, 5637--5664."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2010.5560598"},{"key":"e_1_2_2_50_1","volume-title":"Hospedales","author":"Li Da","year":"2017","unstructured":"Da Li, Yongxin Yang, Yi-Zhe Song, and Timothy M. Hospedales. 2017. Learning to Generalize: Meta-Learning for Domain Generalization. arXiv:1710.03463 [cs] (Oct. 2017). http:\/\/arxiv.org\/abs\/1710.03463 arXiv: 1710.03463."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450439.3451870"},{"key":"e_1_2_2_53_1","volume-title":"Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983","author":"Loshchilov Ilya","year":"2016","unstructured":"Ilya Loshchilov and Frank Hutter. 2016. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 (2016)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2009.06.019"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191753"},{"key":"e_1_2_2_56_1","volume-title":"Cognitive impairment in major depression. European journal of pharmacology 626, 1","author":"Marazziti Donatella","year":"2010","unstructured":"Donatella Marazziti, Giorgio Consoli, Michela Picchetti, Marina Carlini, and Luca Faravelli. 2010. Cognitive impairment in major depression. European journal of pharmacology 626, 1 (2010), 83--86."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3299041"},{"key":"e_1_2_2_58_1","volume-title":"Reproducibility in machine learning for health research: Still a ways to go. Science Translational Medicine 13, 586","author":"McDermott Matthew BA","year":"2021","unstructured":"Matthew BA McDermott, Shirly Wang, Nikki Marinsek, Rajesh Ranganath, Luca Foschini, and Marzyeh Ghassemi. 2021. Reproducibility in machine learning for health research: Still a ways to go. Science Translational Medicine 13, 586 (2021), eabb1655."},{"key":"e_1_2_2_59_1","volume-title":"Searching for common threads: Understanding the multiple effects of diversity in organizational groups","author":"Milliken Frances J","year":"1996","unstructured":"Frances J Milliken and Luis L Martins. 1996. Searching for common threads: Understanding the multiple effects of diversity in organizational groups. Academy of management review 21, 2 (1996), 402--433."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557220"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328908"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432220"},{"key":"e_1_2_2_63_1","volume-title":"Machine learning","author":"Mitchell Tom M","unstructured":"Tom M Mitchell and Tom M Mitchell. 1997. Machine learning. Vol. 1. McGraw-hill New York."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12160-016-9830-8"},{"key":"e_1_2_2_65_1","volume-title":"Ubilung: Multi-Modal Passive-Based Lung Health Assessment. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 551--555","author":"Nemati Ebrahim","year":"2022","unstructured":"Ebrahim Nemati, Xuhai Xu, Viswam Nathan, Korosh Vatanparvar, Tousif Ahmed, Md Mahbubur Rahman, Dan McCaffrey, Jilong Kuang, and Alex Gao. 2022. Ubilung: Multi-Modal Passive-Based Lung Health Assessment. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 551--555."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502043"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.61.6.622"},{"key":"e_1_2_2_68_1","volume-title":"Exploring generalization in deep learning. Advances in neural information processing systems 30","author":"Neyshabur Behnam","year":"2017","unstructured":"Behnam Neyshabur, Srinadh Bhojanapalli, David McAllester, and Nati Srebro. 2017. Exploring generalization in deep learning. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_2_69_1","doi-asserted-by":"crossref","unstructured":"Stefanie Nickels Matthew D Edwards Sarah F Poole Dale Winter Jessica Gronsbell Bella Rozenkrants David P Miller Mathias Fleck Alan McLean Bret Peterson et al. 2021. Toward a mobile platform for real-world digital measurement of depression: User-centered design data quality and behavioral and clinical modeling. JMIR mental health 8 8 (2021) e27589.","DOI":"10.2196\/27589"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","unstructured":"Shirin Nilizadeh Hojjat Aghakhani Eric Gustafson Christopher Kruegel and Giovanni Vigna. 2019. Think Outside the Dataset: Finding Fraudulent Reviews using Cross-Dataset Analysis. (2019) 3108--3115. https:\/\/doi.org\/10.1145\/3308558.3313647 ISBN: 9781450366748.","DOI":"10.1145\/3308558.3313647"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46466-4_5"},{"key":"e_1_2_2_72_1","volume-title":"the national survey on drug use and health - survey report","author":"NSDUH","year":"2018","unstructured":"NSDUH 2018. the national survey on drug use and health - survey report in 2018. https:\/\/www.samhsa.gov\/data\/sites\/default\/files\/cbhsq-reports\/NSDUHNationalFindingsReport2018\/NSDUHNationalFindingsReport2018.pdf."},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsych.2019.07.023"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_2_2_75_1","volume-title":"Learning explanations that are hard to vary. arXiv preprint arXiv:2009.00329","author":"Parascandolo Giambattista","year":"2020","unstructured":"Giambattista Parascandolo, Alexander Neitz, Antonio Orvieto, Luigi Gresele, and Bernhard Sch\u00f6lkopf. 2020. Learning explanations that are hard to vary. arXiv preprint arXiv:2009.00329 (2020)."},{"key":"e_1_2_2_76_1","volume-title":"Efficient Domain Generalization via Common-Specific Low-Rank Decomposition. arXiv:2003.12815 [cs, stat] (April","author":"Piratla Vihari","year":"2020","unstructured":"Vihari Piratla, Praneeth Netrapalli, and Sunita Sarawagi. 2020. Efficient Domain Generalization via Common-Specific Low-Rank Decomposition. arXiv:2003.12815 [cs, stat] (April 2020). http:\/\/arxiv.org\/abs\/2003.12815 arXiv: 2003.12815."},{"key":"e_1_2_2_77_1","volume-title":"Neural Unsupervised Domain Adaptation in NLP---A Survey. arXiv:2006.00632","author":"Ramponi Alan","year":"2020","unstructured":"Alan Ramponi and Barbara Plank. 2020. Neural Unsupervised Domain Adaptation in NLP---A Survey. arXiv:2006.00632 (2020)."},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/dju048"},{"key":"e_1_2_2_79_1","volume-title":"The longitudinal effects of depression on physical activity. General hospital psychiatry 31, 4","author":"Roshanaei-Moghaddam Babak","year":"2009","unstructured":"Babak Roshanaei-Moghaddam, Wayne J Katon, and Joan Russo. 2009. The longitudinal effects of depression on physical activity. General hospital psychiatry 31, 4 (2009), 306--315."},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4273"},{"key":"e_1_2_2_81_1","volume-title":"Tatsunori B Hashimoto, and Percy Liang.","author":"Sagawa Shiori","year":"2019","unstructured":"Shiori Sagawa, Pang Wei Koh, Tatsunori B Hashimoto, and Percy Liang. 2019. Distributionally robust neural networks for group shifts: On the importance of regularization for worst-case generalization. arXiv preprint arXiv:1911.08731 (2019)."},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359216"},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.127.2.161"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49409-8_35"},{"key":"e_1_2_2_85_1","volume-title":"sleep, and antidepressants. The Journal of Clinical Psychiatry","author":"Thase Michael E.","year":"1998","unstructured":"Michael E. Thase. 1998. Depression, sleep, and antidepressants. The Journal of Clinical Psychiatry (1998)."},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995347"},{"key":"e_1_2_2_87_1","volume-title":"Sleep and depression. The Journal of Clinical Psychiatry","author":"Tsuno Norifumi","year":"2005","unstructured":"Norifumi Tsuno, Alain Besset, and Karen Ritchie. 2005. Sleep and depression. The Journal of Clinical Psychiatry (2005)."},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.463"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.788640"},{"key":"e_1_2_2_90_1","doi-asserted-by":"crossref","unstructured":"Julio Vega Beth T Bell Caitlin Taylor Jue Xie Heidi Ng Mahsa Honary Roisin McNaney et al. 2022. Detecting Mental Health Behaviors Using Mobile Interactions: Exploratory Study Focusing on Binge Eating. JMIR mental health 9 4 (2022) e32146.","DOI":"10.2196\/32146"},{"key":"e_1_2_2_91_1","volume-title":"Reproducible Analysis Pipeline for Data Streams: Open-Source Software to Process Data Collected With Mobile Devices. Frontiers in Digital Health 3","author":"Vega Julio","year":"2021","unstructured":"Julio Vega, Meng Li, Kwesi Aguillera, Nikunj Goel, Echhit Joshi, Kirtiraj Khandekar, Krina C Durica, Abhineeth R Kunta, and Carissa A Low. 2021. Reproducible Analysis Pipeline for Data Streams: Open-Source Software to Process Data Collected With Mobile Devices. Frontiers in Digital Health 3 (2021)."},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(16)31678-6"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.5960"},{"key":"e_1_2_2_94_1","volume-title":"Yu","author":"Wang Jindong","year":"2021","unstructured":"Jindong Wang, Cuiling Lan, Chang Liu, Yidong Ouyang, Tao Qin, Wang Lu, Yiqiang Chen, Wenjun Zeng, and Philip S. Yu. 2021. Generalizing to Unseen Domains: A Survey on Domain Generalization. arXiv:2103.03097 [cs] (Dec. 2021). http:\/\/arxiv.org\/abs\/2103.03097 arXiv: 2103.03097."},{"key":"e_1_2_2_95_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.05.083"},{"key":"e_1_2_2_96_1","volume-title":"Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 3--14","author":"Wang Rui","unstructured":"Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. 2014. StudentLife: Assessing mental health, academic performance and behavioral trends of college students using smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 3--14."},{"key":"e_1_2_2_97_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804251"},{"key":"e_1_2_2_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191775"},{"key":"e_1_2_2_99_1","volume-title":"Proceedings of the 33 rd International Conference on Machine Learning","author":"Xie Junyuan","year":"2016","unstructured":"Junyuan Xie, Ross Girshick, and Ali Farhadi. 2016. Unsupervised Deep Embedding for Clustering Analysis. Proceedings of the 33 rd International Conference on Machine Learning (2016), 10."},{"key":"e_1_2_2_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351274"},{"key":"e_1_2_2_101_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448107"},{"key":"e_1_2_2_102_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501904"},{"key":"e_1_2_2_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380071"},{"key":"e_1_2_2_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448124"},{"key":"e_1_2_2_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376836"},{"key":"e_1_2_2_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381011"},{"key":"e_1_2_2_107_1","volume-title":"Mike A Merrill, Paula S Nurius, Shwetak Patel, Tim Althoff, Margaret E Morris, Eve A. Riskin, Jennifer Mankoff, and Anind Dey.","author":"Xu Xuhai","year":"2022","unstructured":"Xuhai Xu, Han Zhang, Yasaman S Sefidgar, Yiyi Ren, Xin Liu, Woosuk Seo, Jennifer Brown, Kevin Scott Kuehn, Mike A Merrill, Paula S Nurius, Shwetak Patel, Tim Althoff, Margaret E Morris, Eve A. Riskin, Jennifer Mankoff, and Anind Dey. 2022. GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalization. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track. https:\/\/openreview.net\/forum?id=GKOa7yNH8Uh"},{"key":"e_1_2_2_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517476"},{"key":"e_1_2_2_109_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2022.02.010"},{"key":"e_1_2_2_110_1","volume-title":"Andrew AS Soltan, and David A Clifton","author":"Yang Jenny","year":"2022","unstructured":"Jenny Yang, Andrew AS Soltan, and David A Clifton. 2022. Machine learning generalizability across healthcare settings: insights from multi-site COVID-19 screening. npj Digital Medicine 5, 1 (2022), 1--8."},{"key":"e_1_2_2_111_1","volume-title":"IEEE","author":"Yao Yi","year":"2010","unstructured":"Yi Yao and Gianfranco Doretto. 2010. Boosting for transfer learning with multiple sources. In 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, 1855--1862."},{"key":"e_1_2_2_112_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00365-006-0663-2"},{"key":"e_1_2_2_113_1","volume-title":"mixup: Beyond Empirical Risk Minimization. arXiv:1710.09412 [cs, stat] (April","author":"Zhang Hongyi","year":"2018","unstructured":"Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, and David Lopez-Paz. 2018. mixup: Beyond Empirical Risk Minimization. arXiv:1710.09412 [cs, stat] (April 2018). http:\/\/arxiv.org\/abs\/1710.09412 arXiv: 1710.09412."},{"key":"e_1_2_2_114_1","volume-title":"Impact of Online Learning in the Context of COVID-19 on Undergraduates with Disabilities and Mental Health Concerns. ACM Transactions on Accessible Computing (July","author":"Zhang Han","year":"2022","unstructured":"Han Zhang, Margaret E. Morris, Paula S. Nurius, Kelly Mack, Jennifer Brown, Kevin S. Kuehn, Yasaman S. Sefidgar, Xuhai Xu, Eve A. Riskin, Anind K. Dey, and Jennifer Mankoff. 2022. Impact of Online Learning in the Context of COVID-19 on Undergraduates with Disabilities and Mental Health Concerns. ACM Transactions on Accessible Computing (July 2022), 3538514."},{"key":"e_1_2_2_115_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291124"},{"key":"e_1_2_2_116_1","volume-title":"2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Zhang Xu","year":"2019","unstructured":"Xu Zhang, Junghyun Kim, Qingwei Lin, Keunhak Lim, Shobhit O Kanaujia, Yong Xu, Kyle Jamieson, Aws Albarghouthi, Si Qin, Michael J Freedman, et al. 2019. Cross-dataset time series anomaly detection for cloud systems. In 2019 USENIX Annual Technical Conference (USENIX ATC 19). 1063--1076."},{"key":"e_1_2_2_117_1","doi-asserted-by":"publisher","DOI":"10.3115\/1687878.1687932"},{"key":"e_1_2_2_118_1","volume-title":"Domain Generalization in Vision: A Survey. arXiv:2103.02503 [cs] (July","author":"Zhou Kaiyang","year":"2021","unstructured":"Kaiyang Zhou, Ziwei Liu, Yu Qiao, Tao Xiang, and Chen Change Loy. 2021. Domain Generalization in Vision: A Survey. arXiv:2103.02503 [cs] (July 2021). http:\/\/arxiv.org\/abs\/2103.02503 arXiv: 2103.02503."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569485","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3569485","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3569485","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T20:55:09Z","timestamp":1752612909000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569485"}},"subtitle":["Cross-Dataset Generalization of Longitudinal Human Behavior Modeling"],"short-title":[],"issued":{"date-parts":[[2022,12,21]]},"references-count":118,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,21]]}},"alternative-id":["10.1145\/3569485"],"URL":"https:\/\/doi.org\/10.1145\/3569485","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,21]]},"assertion":[{"value":"2023-01-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}