{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T16:26:44Z","timestamp":1780590404078,"version":"3.54.1"},"reference-count":56,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2020,1,24]],"date-time":"2020-01-24T00:00:00Z","timestamp":1579824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Depression is currently the second most significant contributor to non-fatal disease burdens globally. While it is treatable, depression remains undiagnosed in many cases. As mobile phones have now become an integral part of daily life, this study examines the possibility of screening for depressive symptoms continuously based on patients\u2019 mobile usage patterns.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>412 research participants reported a range of their mobile usage statistics. Beck Depression Inventory\u20142nd ed (BDI-II) was used to measure the severity of depression among participants. A wide array of machine learning classification algorithms was trained to detect participants with depression symptoms (ie, BDI-II score \u2265 14). The relative importance of individual variables was additionally quantified.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Participants with depression were found to have fewer saved contacts on their devices, spend more time on their mobile devices to make and receive fewer and shorter calls, and send more text messages than participants without depression. The best model was a random forest classifier, which had an out-of-sample balanced accuracy of 0.768. The balanced accuracy increased to 0.811 when participants\u2019 age and gender were included.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussions\/Conclusion<\/jats:title>\n                  <jats:p>The significant predictive power of mobile usage attributes implies that, by collecting mobile usage statistics, mental health mobile applications can continuously screen for depressive symptoms for initial diagnosis or for monitoring the progress of ongoing treatments. Moreover, the input variables used in this study were aggregated mobile usage metadata attributes, which has low privacy sensitivity making it more likely for patients to grant required application permissions.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz221","type":"journal-article","created":{"date-parts":[[2019,12,15]],"date-time":"2019-12-15T20:06:51Z","timestamp":1576440411000},"page":"522-530","source":"Crossref","is-referenced-by-count":76,"title":["Depression screening using mobile phone usage metadata: a machine learning approach"],"prefix":"10.1093","volume":"27","author":[{"given":"Rouzbeh","family":"Razavi","sequence":"first","affiliation":[{"name":"Department of Management and Information Systems, Kent State University, Kent, OH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amin","family":"Gharipour","sequence":"additional","affiliation":[{"name":"School of Information Technology, Griffith University, Gold Coast, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mojgan","family":"Gharipour","sequence":"additional","affiliation":[{"name":"Isfahan Cardiovascular Research Center, Isfahan University of Medical Sciences, Isfahan, Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,1,24]]},"reference":[{"issue":"6","key":"2020110613091077500_ocz221-B1","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1136\/amiajnl-2014-002733","article-title":"Toward personalizing treatment for depression: predicting diagnosis and severity","volume":"21","author":"Huang","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"9690","key":"2020110613091077500_ocz221-B2","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1016\/S0140-6736(09)60879-5","article-title":"Clinical diagnosis of depression in primary care: a meta-analysis","volume":"374","author":"Mitchell","year":"2009","journal-title":"Lancet"},{"issue":"7","key":"2020110613091077500_ocz221-B3","doi-asserted-by":"crossref","first-page":"e175","DOI":"10.2196\/jmir.4273","article-title":"Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study","volume":"17","author":"Saeb","year":"2015","journal-title":"J Med Internet Res"},{"issue":"3","key":"2020110613091077500_ocz221-B4","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1016\/j.pop.2007.05.006","article-title":"Navigating the sequenced treatment alternatives to relieve depression (STAR*D) study: practical outcomes and implications for depression treatment in primary care","volume":"34","author":"Cain","year":"2007","journal-title":"Prim Care"},{"key":"2020110613091077500_ocz221-B5","doi-asserted-by":"crossref","first-page":"b934","DOI":"10.1136\/bmj.b934","article-title":"Treatment of depression in primary care","volume":"338","author":"Weel","year":"2009","journal-title":"BMJ"},{"issue":"6","key":"2020110613091077500_ocz221-B6","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1017\/S0033291703001843","article-title":"How accurate is recall of key symptoms of depression? A comparison of recall and longitudinal reports","volume":"34","author":"Wells","year":"2004","journal-title":"Psychol Med"},{"issue":"1","key":"2020110613091077500_ocz221-B7","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1111\/j.1467-9280.1992.tb00260.x","article-title":"Cognitive biases and the emotional disorders","volume":"3","author":"Mineka","year":"1992","journal-title":"Psychol Sci"},{"key":"2020110613091077500_ocz221-B8","first-page":"16","article-title":"Does recognition of depression in primary care affect outcome?","volume":"21","author":"Kamphuis","year":"2011","journal-title":"Fam Pract"},{"key":"2020110613091077500_ocz221-B9","author":"Taylor","year":"2019"},{"key":"2020110613091077500_ocz221-B10","year":"2016"},{"issue":"2","key":"2020110613091077500_ocz221-B11","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/s00779-014-0829-5","article-title":"Mobile phones as medical devices in mental disorder treatment: an overview","volume":"19","author":"Gravenhorst","year":"2015","journal-title":"Pers Ubiquit Comput"},{"issue":"1","key":"2020110613091077500_ocz221-B12","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1136\/amiajnl-2014-002840","article-title":"Depression screening via a smartphone app: cross-country user characteristics and feasibility","volume":"22","author":"BinDhim","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613091077500_ocz221-B13","doi-asserted-by":"crossref","first-page":"e2","DOI":"10.2196\/mhealth.2994","article-title":"Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions","volume":"21","author":"Torous","year":"2014","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2020110613091077500_ocz221-B14","doi-asserted-by":"crossref","first-page":"e55","DOI":"10.2196\/jmir.1838","article-title":"Harnessing context sensing to develop a mobile intervention for depression","volume":"13","author":"Burns","year":"2011","journal-title":"J Med Internet Res"},{"issue":"4","key":"2020110613091077500_ocz221-B15","doi-asserted-by":"crossref","first-page":"e697","DOI":"10.3390\/ijerph15040697","article-title":"Relationship between the manner of mobile phone use and depression, anxiety, and stress in university students","volume":"15","author":"Snjic","year":"2018","journal-title":"Int J Environ Res Public Health"},{"key":"2020110613091077500_ocz221-B16","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.chb.2014.02.006","article-title":"Constantly connected \u2013 the effects of smart-devices on mental health","volume":"34","author":"Harwood","year":"2014","journal-title":"Comput Human Behav"},{"issue":"6","key":"2020110613091077500_ocz221-B17","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1093\/jamia\/ocv056","article-title":"Center of excellence for mobile sensor data-to-knowledge (MD2K)","volume":"22","author":"Kumar","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613091077500_ocz221-B18","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1186\/1471-2458-11-66","article-title":"Mobile phone use and stress, sleep disturbances, and symptoms of depression among young adults: a prospective cohort study","volume":"11","author":"Thomee","year":"2011","journal-title":"BMC Public Health"},{"key":"2020110613091077500_ocz221-B19","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1186\/1471-2458-10-66","article-title":"Perceived connections between information and communication technology use and mental symptoms among young adults: a qualitative study","volume":"10","author":"Thomee","year":"2010","journal-title":"BMC Public Health"},{"key":"2020110613091077500_ocz221-B20","author":"De Choudhury","year":"2013"},{"issue":"1","key":"2020110613091077500_ocz221-B21","doi-asserted-by":"crossref","first-page":"e8","DOI":"10.2196\/mhealth.3672","article-title":"Exploring the far side of mobile health: information security and privacy of mobile health apps on iOS and Android","volume":"3","author":"Dehling","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2020110613091077500_ocz221-B22","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/1745691610393980","article-title":"Amazon\u2019s Mechanical Turk: a new source of inexpensive, yet high-quality data?","volume":"6","author":"Kwang","year":"2011","journal-title":"Perspect Psychol Sci"},{"key":"2020110613091077500_ocz221-B23","first-page":"82","author":"Beck","year":"1996"},{"issue":"2","key":"2020110613091077500_ocz221-B24","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1037\/1040-3590.16.2.120","article-title":"Reliability and validity of the Beck depression inventory\u2013II with adolescent psychiatric inpatients","volume":"16","author":"Osman","year":"2004","journal-title":"Psychol Assess"},{"issue":"1","key":"2020110613091077500_ocz221-B25","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/0145445507303833","article-title":"Psychometric properties of the Beck Depression Inventory\u2014II (BDI-II) among community-dwelling older adults","volume":"32","author":"Segal","year":"2008","journal-title":"Behav Modif"},{"key":"2020110613091077500_ocz221-B26","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/S0165-1781(02)00106-3","article-title":"Cross-cultural validation of the Beck Depression Inventory-II in Japan","volume":"3","author":"Kojima","year":"2002","journal-title":"Psychiatry Res"},{"issue":"4","key":"2020110613091077500_ocz221-B27","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1002\/da.20070","article-title":"Psychometric properties of a Persian-language version of the Beck Depression Inventory-Second edition: BDI-II-Persian","volume":"21","author":"Ghassemzadeh","year":"2005","journal-title":"Depress Anxiety"},{"issue":"4","key":"2020110613091077500_ocz221-B28","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1111\/ene.12932","article-title":"Psychometric properties and validity of Beck Depression Inventory II in multiple sclerosis","volume":"23","author":"Sacco","year":"2016","journal-title":"Eur J Neurol"},{"issue":"3","key":"2020110613091077500_ocz221-B29","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1111\/j.1365-2354.2006.00728.x","article-title":"Beck Depression Inventory: exploring its psychometric properties in a palliative care population of advanced cancer patients","volume":"16","author":"Mystakidou","year":"2007","journal-title":"Eur J Cancer Care"},{"key":"2020110613091077500_ocz221-B30","author":"Hautamaki"},{"issue":"2","key":"2020110613091077500_ocz221-B31","doi-asserted-by":"crossref","first-page":"186","DOI":"10.3102\/1076998610366263","article-title":"Outliers in questionnaire data: can they be detected and should they be removed?","volume":"36","author":"Zijlstra","year":"2011","journal-title":"J Educ Behav Stat"},{"key":"2020110613091077500_ocz221-B32","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1007\/978-1-4614-6849-3","volume-title":"Applied Predictive Modeling","author":"Kuhn","year":"2013"},{"issue":"6","key":"2020110613091077500_ocz221-B33","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1016\/j.tele.2018.04.011","article-title":"Re-examining the relationship between social media and happiness: the effects of various social media platforms on re-conceptualized happiness","volume":"35","author":"Chae","year":"2018","journal-title":"Telematics Inform"},{"issue":"3","key":"2020110613091077500_ocz221-B34","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1093\/jurban\/78.3.458","article-title":"Social ties and mental health","volume":"78","author":"Kawachi","year":"2001","journal-title":"J Urban Health"},{"key":"2020110613091077500_ocz221-B35","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1016\/j.chb.2015.05.030","article-title":"Alleviating depression only to become problematic mobile phone users: can face-to-face communication be the antidote?","volume":"51","author":"Kim","year":"2015","journal-title":"Comput Hum Behav"},{"key":"2020110613091077500_ocz221-B36","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.jad.2018.08.077","article-title":"The association between socioeconomic status and depression among older adults in Finland, Poland and Spain: a comparative cross-sectional study of distinct measures and pathways","volume":"241","author":"Domenech-Abella Mundo","year":"2018","journal-title":"J Affect Disord"},{"issue":"1","key":"2020110613091077500_ocz221-B37","doi-asserted-by":"crossref","first-page":"1098","DOI":"10.1186\/s12889-016-3638-0","article-title":"The role of socio-economic status in depression: results from the courage","volume":"16","author":"Freeman","year":"2016","journal-title":"BMC Public Health"},{"issue":"4","key":"2020110613091077500_ocz221-B38","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1503\/jpn.150205","article-title":"Why is depression more prevalent in women?","volume":"40","author":"Albert","year":"2015","journal-title":"J Psychiatry Neurosci"},{"key":"2020110613091077500_ocz221-B39","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-7138-7","volume-title":"An Introduction to Statistical Learning","author":"James","year":"2013"},{"key":"2020110613091077500_ocz221-B40","author":"Atkinson","year":"2015"},{"key":"2020110613091077500_ocz221-B41","author":"Malmi"},{"issue":"1","key":"2020110613091077500_ocz221-B42","doi-asserted-by":"crossref","first-page":"e11334","DOI":"10.2196\/11334","article-title":"Adoption of mobile apps for depression and anxiety: cross-sectional survey study on patient interest and barriers to engagement","volume":"6","author":"Lipschitz","year":"2019","journal-title":"JMIR Ment Health"},{"issue":"2","key":"2020110613091077500_ocz221-B43","doi-asserted-by":"crossref","first-page":"e57447","DOI":"10.1371\/journal.pone.0057447","article-title":"The effectiveness of internet cognitive behavioural therapy (iCBT) for depression in primary care: a quality assurance study","volume":"8","author":"Williams","year":"2013","journal-title":"PloS One"},{"issue":"4","key":"2020110613091077500_ocz221-B44","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1080\/16506073.2011.616531","article-title":"Internet-based treatment of depression: a randomized controlled trial comparing guided with unguided self-help","volume":"40","author":"Berger","year":"2011","journal-title":"Cogn Behav Ther"},{"issue":"6","key":"2020110613091077500_ocz221-B45","doi-asserted-by":"crossref","first-page":"e10939","DOI":"10.1371\/journal.pone.0010939","article-title":"Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance","volume":"5","author":"Titov","year":"2010","journal-title":"PloS One"},{"issue":"1","key":"2020110613091077500_ocz221-B46","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1177\/2167702614560746","article-title":"Positive imagery-based cognitive bias modification as a web-based treatment tool for depressed adults: a randomized controlled trial","volume":"3","author":"Blackwell","year":"2015","journal-title":"Clin Psychol Sci"},{"issue":"1","key":"2020110613091077500_ocz221-B47","doi-asserted-by":"crossref","first-page":"e003440","DOI":"10.1136\/bmjopen-2013-003440","article-title":"Behavioural activation versus mindfulness-based guided self-help treatment administered through a smartphone application: a randomised controlled trial","volume":"4","author":"Ly","year":"2014","journal-title":"BMJ Open"},{"issue":"2\u20133","key":"2020110613091077500_ocz221-B48","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/j.jad.2012.12.020","article-title":"Internet-based behavioral activation and acceptance-based treatment for depression: a randomized controlled trial","volume":"148","author":"Carlbring","year":"2013","journal-title":"J Affect Disord"},{"key":"2020110613091077500_ocz221-B49","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.jad.2017.07.021","article-title":"Internet-and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis","volume":"223","author":"Josephine","year":"2017","journal-title":"J Affect Disord"},{"key":"2020110613091077500_ocz221-B50","author":"Kelley"},{"issue":"1","key":"2020110613091077500_ocz221-B51","doi-asserted-by":"crossref","first-page":"13","DOI":"10.2307\/25148715","article-title":"The personalization privacy paradox: An empirical evaluation of information transparency and the willingness to be profiled online for personalization","volume":"30","author":"Awad","year":"2006","journal-title":"MIS Quarterly"},{"key":"2020110613091077500_ocz221-B52","author":"Bettini"},{"key":"2020110613091077500_ocz221-B53","author":"Hong"},{"key":"2020110613091077500_ocz221-B54","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-306-47630-3","volume-title":"Principles of Forecasting: A Handbook for Researchers and Practitioners","author":"Armstrong","year":"2001"},{"key":"2020110613091077500_ocz221-B55","first-page":"1","article-title":"The impact of measurement differences on cross-country depression prevalence estimates: a latent transition analysis","volume":"23","author":"Scorza","year":"2018","journal-title":"Plos One"},{"issue":"12","key":"2020110613091077500_ocz221-B56","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1080\/10447318.2018.1428262","article-title":"Understanding the intention of using mobile social networking apps across cultures","volume":"34","author":"Qin","year":"2018","journal-title":"Int J Human Comput Interact"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/4\/522\/34152314\/ocz221.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/4\/522\/34152314\/ocz221.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:25:34Z","timestamp":1604690734000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/4\/522\/5715569"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,24]]},"references-count":56,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,1,24]]},"published-print":{"date-parts":[[2020,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz221","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,4]]},"published":{"date-parts":[[2020,1,24]]}}}