{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T03:41:18Z","timestamp":1768966878062,"version":"3.49.0"},"reference-count":84,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01MH113752"],"award-info":[{"award-number":["R01MH113752"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,9,4]]},"abstract":"<jats:p>Exploiting the capabilities of smartphones for monitoring social anxiety shows promise for advancing our ability to both identify indicators of and treat social anxiety in natural settings. Smart devices allow researchers to collect passive data unobtrusively through built-in sensors and active data using subjective, self-report measures with Ecological Momentary Assessment (EMA) studies. Prior work has established the potential to predict subjective measures from passive data. However, the majority of the past work on social anxiety has focused on a limited subset of self-reported measures. Furthermore, the data collected in real-world studies often results in numerous missing values in one or more data streams, which ultimately reduces the usable data for analysis and limits the potential of machine learning algorithms. We explore several approaches for addressing these problems in a smartphone based monitoring and intervention study of eighty socially anxious participants over a five week period. Our work complements and extends prior work in two directions: (i) we show the predictability of seven different self-reported dimensions of social anxiety, and (ii) we explore four imputation methods to handle missing data and evaluate their effectiveness in the prediction of subjective measures from the passive data. Our evaluation shows imputation of missing data reduces prediction error by as much as 22%. We discuss the implications of these results for future research.<\/jats:p>","DOI":"10.1145\/3411823","type":"journal-article","created":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T21:39:45Z","timestamp":1599255585000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Predicting Subjective Measures of Social Anxiety from Sparsely Collected Mobile Sensor Data"],"prefix":"10.1145","volume":"4","author":[{"given":"Haroon","family":"Rashid","sequence":"first","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}]},{"given":"Sanjana","family":"Mendu","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, USA"}]},{"given":"Katharine E.","family":"Daniel","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, USA"}]},{"given":"Miranda L.","family":"Beltzer","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, USA"}]},{"given":"Bethany A.","family":"Teachman","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, USA"}]},{"given":"Mehdi","family":"Boukhechba","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, USA"}]},{"given":"Laura E.","family":"Barnes","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"ADAA. [n.d.]. Social Anxiety Disorder. https:\/\/adaa.org\/understanding-anxiety\/social-anxiety-disorder  ADAA. [n.d.]. Social Anxiety Disorder. https:\/\/adaa.org\/understanding-anxiety\/social-anxiety-disorder"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/09540121.2016.1192577"},{"key":"e_1_2_1_3_1","volume-title":"Robert J Brychta, Paolo Caserotti, Gudny Eiriksdottir, Johanna Eyrun Sverrisdottir, Lenore J Launer, Vilmundur Gudnason, Erlingur Johannsson, and T.B. Harris.","author":"Arnardottir Nanna Yr","year":"2012"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5505"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association et al. 2013. Diagnostic and statistical manual of mental disorders (DSM-5\u00ae). American Psychiatric Pub.  American Psychiatric Association et al. 2013. Diagnostic and statistical manual of mental disorders (DSM-5\u00ae). American Psychiatric Pub.","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_2_1_6_1","volume-title":"Multiple imputation by chained equations: what is it and how does it work? International journal of methods in psychiatric research 20, 1","author":"Azur Melissa J","year":"2011"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481364"},{"key":"e_1_2_1_8_1","volume-title":"R Package for Baylor University educational psychology quantitative courses [Internet]. CRAN","author":"Beaujean AA","year":"2012"},{"key":"e_1_2_1_9_1","volume-title":"acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophrenia bulletin 40, 6","author":"Ben-Zeev Dror","year":"2014"},{"key":"e_1_2_1_10_1","volume-title":"Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. Psychiatric rehabilitation journal 38, 3","author":"Ben-Zeev Dror","year":"2015"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654933"},{"key":"e_1_2_1_12_1","volume-title":"Predicting Social Anxiety From Global Positioning System Traces of College Students: Feasibility Study. JMIR mental health 5, 3","author":"Boukhechba Mehdi","year":"2018"},{"key":"e_1_2_1_13_1","volume-title":"DemonicSalmon: Monitoring mental health and social interactions of college students using smartphones. Smart Health","author":"Boukhechba Mehdi","year":"2018"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (UbiComp '17)","author":"Boukhechba Mehdi"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1838"},{"key":"e_1_2_1_16_1","volume-title":"Exact matrix completion via convex optimization. Foundations of Computational mathematics 9, 6","author":"Cand\u00e8s Emmanuel J","year":"2009"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805845"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191735"},{"key":"e_1_2_1_19_1","volume-title":"SAD: Social anxiety and depression monitoring system for college students.","author":"Chow Philip","year":"2016"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6820"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291715000410"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000311"},{"key":"e_1_2_1_23_1","volume-title":"Response bias, social desirability and dissimulation. Personality and individual differences 7, 3","author":"Furnham Adrian","year":"1986"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.2197"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2018.07.009"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.09.002"},{"key":"e_1_2_1_27_1","volume-title":"Missing data analysis: Making it work in the real world. Annual review of psychology 60","author":"Graham John W","year":"2009"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/00949655.2012.741599"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807551"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691616650285"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.3109\/09638237.2011.608746"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1093\/jpepsy\/jsx078"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3089341.3089343"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2015.7344575"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10488-017-0833-y"},{"key":"e_1_2_1_36_1","first-page":"2057","article-title":"Matrix completion from noisy entries","author":"Keshavan Raghunandan H","year":"2010","journal-title":"Journal of Machine Learning Research 11"},{"key":"e_1_2_1_37_1","volume-title":"Olga Demler, and Ellen E Walters.","author":"Kessler Ronald C","year":"2005"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerCom.2014.6813950"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2010.5560598"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.2165\/00019053-200018010-00003"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1988.10478722"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2015.58"},{"key":"e_1_2_1_43_1","volume-title":"Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour research and therapy 36, 4","author":"Mattick Richard P","year":"1998"},{"key":"e_1_2_1_44_1","first-page":"2287","article-title":"Spectral regularization algorithms for learning large incomplete matrices","author":"Mazumder Rahul","year":"2010","journal-title":"Journal of machine learning research 11"},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Kathryn A McGurk Arianna Dagliati Davide Chiasserini Dave Lee Darren Plant Ivona Baricevic-Jones Janet Kelsall Rachael Eineman Rachel Reed Bethany Geary etal 2019. The use of missing values in proteomic data-independent acquisition mass spectrometry to enable disease activity discrimination. Bioinformatics (2019).  Kathryn A McGurk Arianna Dagliati Davide Chiasserini Dave Lee Darren Plant Ivona Baricevic-Jones Janet Kelsall Rachael Eineman Rachel Reed Bethany Geary et al. 2019. The use of missing values in proteomic data-independent acquisition mass spectrometry to enable disease activity discrimination. Bioinformatics (2019).","DOI":"10.1093\/bioinformatics\/btz898"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968299"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676690.2676694"},{"key":"e_1_2_1_48_1","volume-title":"Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annual review of clinical psychology 13","author":"Mohr David C","year":"2017"},{"key":"e_1_2_1_49_1","first-page":"201","article-title":"A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever","volume":"2","author":"Molenaar Peter CM","year":"2004","journal-title":"Measurement"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351233"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.60.4.518"},{"key":"e_1_2_1_53_1","volume-title":"Marc-Phillip Hitz, and Enrique Audain.","author":"Perez-Riverol Yasset","year":"2017"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the ECMLPKDD","author":"Pires Ivan Miguel","year":"2015"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6678"},{"key":"e_1_2_1_56_1","volume-title":"Anna Veronika Dorogush, and Andrey Gulin","author":"Prokhorenkova Liudmila","year":"2018"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030164"},{"key":"e_1_2_1_58_1","volume-title":"Ghost Imputation: Accurately Reconstructing Missing Data of the Off Period","author":"Rawassizadeh Reza","year":"2019"},{"key":"e_1_2_1_59_1","volume-title":"The rise of multiple imputation: a review of the reporting and implementation of the method in medical research. BMC medical research methodology 15, 1","author":"Rezvan Panteha Hayati","year":"2015"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4273"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130960"},{"key":"e_1_2_1_62_1","volume-title":"Imputing Missing Social Media Data Stream in Multisensor Studies of Human Behavior. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 178--184","author":"Saha Koustuv","year":"2019"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2015.7319954"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9410"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858218"},{"key":"e_1_2_1_66_1","volume-title":"Missing data: our view of the state of the art. Psychological methods 7, 2","author":"Schafer Joseph L","year":"2002"},{"key":"e_1_2_1_67_1","volume-title":"Diener","author":"Scollon Christie Napa","year":"2009"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"key":"e_1_2_1_69_1","volume-title":"The use of multiple imputation for the analysis of missing data. Psychological methods 6, 4","author":"Sinharay Sandip","year":"2001"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.b2393"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2014.04.039"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858448"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/17.6.520"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0887-6185(02)00228-1"},{"key":"e_1_2_1_75_1","first-page":"40","article-title":"Faking it: social desirability response bias in self-report research. Australian Journal of Advanced Nursing","volume":"25","author":"Van de Mortel Thea F","year":"2008","journal-title":"The"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971740"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632054"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130976"},{"key":"e_1_2_1_79_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3191775","article-title":"Tracking depression dynamics in college students using mobile phone and wearable sensing","volume":"2","author":"Wang Rui","year":"2018","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_80_1","volume-title":"Multiple imputation using chained equations: issues and guidance for practice. Statistics in medicine 30, 4","author":"White Ian R","year":"2011"},{"key":"e_1_2_1_81_1","first-page":"1","article-title":"Leveraging Routine Behavior and Contextually-Filtered Features for Depression Detection among College Students","volume":"3","author":"Xu Xuhai","year":"2019","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2019.8904691"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2877847"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2010.99"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411823","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411823","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:48Z","timestamp":1750195488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411823"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":84,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9,4]]}},"alternative-id":["10.1145\/3411823"],"URL":"https:\/\/doi.org\/10.1145\/3411823","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]},"assertion":[{"value":"2020-09-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}