{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T06:29:54Z","timestamp":1773901794104,"version":"3.50.1"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,12,11]],"date-time":"2019-12-11T00:00:00Z","timestamp":1576022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,12,11]]},"abstract":"<jats:p>Estimating the category and quality of interpersonal relationships from ubiquitous phone sensor data matters for studying mental well-being and social support. Prior work focused on using communication volume to estimate broad relationship categories, often with small samples. Here we contextualize communications by combining phone logs with demographic and location data to predict interpersonal relationship roles on a varied sample population using automated machine learning methods, producing better performance (F1 = 0.68) than using communication features alone (F1 = 0.62). We also explore the effect of age variation in the underlying training sample on interpersonal relationship prediction and find that models trained on younger subgroups, which is popular in the field via student participation and recruitment, generalize poorly to the wider population. Our results not only illustrate the value of using data across demographics, communication patterns and semantic locations for relationship prediction, but also underscore the importance of considering population heterogeneity in phone-based personal sensing studies.<\/jats:p>","DOI":"10.1145\/3369820","type":"journal-article","created":{"date-parts":[[2019,12,12]],"date-time":"2019-12-12T13:16:03Z","timestamp":1576156563000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Machine Learning for Phone-Based Relationship Estimation"],"prefix":"10.1145","volume":"3","author":[{"given":"Tony","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA"}]},{"given":"Jennifer","family":"Nicholas","sequence":"additional","affiliation":[{"name":"Center for Behavioral Intervention Technologies, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA"}]},{"given":"Max M.","family":"Theilig","sequence":"additional","affiliation":[{"name":"Center for Behavioral Intervention Technologies, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA"}]},{"given":"Sharath C.","family":"Guntuku","sequence":"additional","affiliation":[{"name":"Penn Medicine Center for Digital Health, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA"}]},{"given":"Konrad","family":"Kording","sequence":"additional","affiliation":[{"name":"Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA"}]},{"given":"David C.","family":"Mohr","sequence":"additional","affiliation":[{"name":"Center for Behavioral Intervention Technologies, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA"}]},{"given":"Lyle","family":"Ungar","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,9,14]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MDM.2015.61"},{"key":"e_1_2_1_2_1","volume-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal statistical society: series B (Methodological), 57(1):289--300","author":"Benjamini Yoav","year":"1995"},{"key":"e_1_2_1_3_1","volume-title":"A tutorial on bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv preprint arXiv:1012.2599","author":"Brochu Eric","year":"2010"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805845"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441811"},{"key":"e_1_2_1_6_1","volume-title":"Robust locally weighted regression and smoothing scatterplots. Journal of the American statistical association, 74(368):829--836","author":"Cleveland William S","year":"1979"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0184604"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02734142"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/MobServ.2016.18"},{"key":"e_1_2_1_10_1","volume-title":"Reality mining: sensing complex social systems. Personal and ubiquitous computing, 10(4):255--268","author":"Eagle Nathan","year":"2006"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0900282106"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jadohealth.2012.07.012"},{"key":"e_1_2_1_13_1","first-page":"2962","volume-title":"Advances in Neural Information Processing Systems","author":"Feurer Matthias","year":"2015"},{"key":"e_1_2_1_14_1","volume-title":"Purple robot. https:\/\/tech.cbits.northwestern.edu\/purple-robot\/","author":"Center for Behavioral Intervention Technologies.","year":"2015"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.bp.115.169094"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.154.4.478"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/pra2.2018.14505501015"},{"key":"e_1_2_1_18_1","volume-title":"Interpersonal processes in depression. Annual review of clinical psychology, 9:355--377","author":"Hames Jennifer L","year":"2013"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2017.07.018"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2567948.2577365"},{"key":"e_1_2_1_21_1","first-page":"222","volume-title":"Affective computing and intelligent interaction (ACII)","author":"Jaques Natasha","year":"2015"},{"key":"e_1_2_1_22_1","volume-title":"Student counseling services: Using text messaging to lower barriers to help seeking. Innovations in education and teaching international, 48(3):287--299","author":"Joyce David","year":"2011"},{"key":"e_1_2_1_23_1","volume-title":"A survey of mobile phone sensing","author":"Lane Nicholas D","year":"2010"},{"issue":"1","key":"e_1_2_1_24_1","first-page":"21","article-title":"Joint modeling of heterogeneous sensing data for depression assessment via multi-task learning. Proceedings of the ACM on Interactive, Mobile","volume":"2","author":"Lu Jin","year":"2018","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_25_1","first-page":"4765","volume-title":"Advances in Neural Information Processing Systems","author":"Lundberg Scott M","year":"2017"},{"key":"e_1_2_1_26_1","volume-title":"Sara Van De Geer, and Peter B\u00fchlmann. The group lasso for logistic regression. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 70(1):53--71","author":"Meier Lukas","year":"2008"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441810"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANCOM.2010.5563332"},{"key":"e_1_2_1_29_1","volume-title":"Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annual review of clinical psychology, 13:23--47","author":"Mohr David C","year":"2017"},{"key":"e_1_2_1_30_1","unstructured":"United States Department of Agriculture Economic Research Service. Rural-urban continuum codes. https:\/\/www.ers.usda.gov\/data-products\/rural-urban-continuum-codes.aspx. Accessed: 2019-07-25.  United States Department of Agriculture Economic Research Service. Rural-urban continuum codes. https:\/\/www.ers.usda.gov\/data-products\/rural-urban-continuum-codes.aspx. Accessed: 2019-07-25."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196787"},{"key":"e_1_2_1_32_1","volume-title":"Combating loneliness among persons with severe mental illness: Social network interventions'characteristics, effectiveness, and applicability. Issues in mental health nursing, 26(6):591--609","author":"Perese Eris F","year":"2005"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2836041.2836048"},{"key":"e_1_2_1_34_1","volume-title":"Mobile phone detection of semantic location and its relationship to depression and anxiety. JMIR mHealth and uHealth, 5(8)","author":"Saeb Sohrab","year":"2017"},{"key":"e_1_2_1_35_1","volume-title":"Voodoo machine learning for clinical predictions. Biorxiv, page 059774","author":"Saeb Sohrab","year":"2016"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0920-9964(00)00063-3"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1086\/267075"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0265407503206003"},{"key":"e_1_2_1_39_1","volume-title":"A review of social participation interventions for people with mental health problems. Social psychiatry and psychiatric epidemiology, 52(4):369--380","author":"Webber Martin","year":"2017"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675143"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5172\/jamh.2011.10.1.29"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2016.11.027"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2004.2970"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3369820","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3369820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:27Z","timestamp":1750203867000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3369820"}},"subtitle":["The Need to Consider Population Heterogeneity"],"short-title":[],"issued":{"date-parts":[[2019,12,11]]},"references-count":43,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,12,11]]}},"alternative-id":["10.1145\/3369820"],"URL":"https:\/\/doi.org\/10.1145\/3369820","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,11]]},"assertion":[{"value":"2020-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}