{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:12:09Z","timestamp":1776093129183,"version":"3.50.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T00:00:00Z","timestamp":1505088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"crossref","award":["R01MH103148"],"award-info":[{"award-number":["R01MH103148"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2017,9,11]]},"abstract":"<jats:p>Continuously monitoring schizophrenia patients\u2019 psychiatric symptoms is crucial for in-time intervention and treatment adjustment. The Brief Psychiatric Rating Scale (BPRS) is a survey administered by clinicians to evaluate symptom severity in schizophrenia. The CrossCheck symptom prediction system is capable of tracking schizophrenia symptoms based on BPRS using passive sensing from mobile phones. We present results from an ongoing randomized control trial, where passive sensing data, self-reports, and clinician administered 7-item BPRS surveys are collected from 36 outpatients with schizophrenia recently discharged from hospital over a period ranging from 2-12 months. We show that our system can predict a symptom scale score based on a 7-item BPRS within \u00b11.45 error on average using automatically tracked behavioral features from phones (e.g., mobility, conversation, activity, smartphone usage, the ambient acoustic environment) and user supplied self-reports. Importantly, we show our system is also capable of predicting an individual BPRS score within \u00b11.59 error purely based on passive sensing from phones without any self-reported information from outpatients. Finally, we discuss how well our predictive system reflects symptoms experienced by patients by reviewing a number of case studies.<\/jats:p>","DOI":"10.1145\/3130976","type":"journal-article","created":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T12:12:26Z","timestamp":1505131946000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":73,"title":["Predicting Symptom Trajectories of Schizophrenia using Mobile Sensing"],"prefix":"10.1145","volume":"1","author":[{"given":"Rui","family":"Wang","sequence":"first","affiliation":[{"name":"Dartmouth College"}]},{"given":"Weichen","family":"Wang","sequence":"additional","affiliation":[{"name":"Dartmouth College"}]},{"given":"Min S. H.","family":"Aung","sequence":"additional","affiliation":[{"name":"Cornell University"}]},{"given":"Dror","family":"Ben-Zeev","sequence":"additional","affiliation":[{"name":"University of Washington"}]},{"given":"Rachel","family":"Brian","sequence":"additional","affiliation":[{"name":"Dartmouth College"}]},{"given":"Andrew T.","family":"Campbell","sequence":"additional","affiliation":[{"name":"Dartmouth College"}]},{"given":"Tanzeem","family":"Choudhury","sequence":"additional","affiliation":[{"name":"Cornell University"}]},{"given":"Marta","family":"Hauser","sequence":"additional","affiliation":[{"name":"Hofstra Northwell School of Medicine"}]},{"given":"John","family":"Kane","sequence":"additional","affiliation":[{"name":"Hofstra Northwell School of Medicine"}]},{"given":"Emily A.","family":"Scherer","sequence":"additional","affiliation":[{"name":"Dartmouth College"}]},{"given":"Megan","family":"Walsh","sequence":"additional","affiliation":[{"name":"Northwell Health"}]}],"member":"320","published-online":{"date-parts":[[2017,9,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocv200"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2016.2565381"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerComW.2012.6197525"},{"key":"e_1_2_1_4_1","volume-title":"Behavioral Sensing, and Smartphone Use to Identify Digital Indicators of Psychotic Relapse. Psychiatric rehabilitation journal","author":"Ben-Zeev D","year":"2017","unstructured":"D Ben-Zeev , R Brian , R Wang , W Wang , AT Campbell , MS Aung , M Merrill , VW Tseng , T Choudhury , M Hauser , and others. 2017. CrossCheck: Integrating Self-Report , Behavioral Sensing, and Smartphone Use to Identify Digital Indicators of Psychotic Relapse. Psychiatric rehabilitation journal ( 2017 ). D Ben-Zeev, R Brian, R Wang, W Wang, AT Campbell, MS Aung, M Merrill, VW Tseng, T Choudhury, M Hauser, and others. 2017. CrossCheck: Integrating Self-Report, Behavioral Sensing, and Smartphone Use to Identify Digital Indicators of Psychotic Relapse. Psychiatric rehabilitation journal (2017)."},{"key":"e_1_2_1_5_1","volume-title":"Comparing retrospective reports to real-time\/real-place mobile assessments in individuals with schizophrenia and a nonclinical comparison group. Schizophrenia bulletin 38, 3","author":"Ben-Zeev Dror","year":"2012","unstructured":"Dror Ben-Zeev , Gregory J McHugo , Haiyi Xie , Katy Dobbins , and Michael A Young . 2012. Comparing retrospective reports to real-time\/real-place mobile assessments in individuals with schizophrenia and a nonclinical comparison group. Schizophrenia bulletin 38, 3 ( 2012 ), 396--404. Dror Ben-Zeev, Gregory J McHugo, Haiyi Xie, Katy Dobbins, and Michael A Young. 2012. Comparing retrospective reports to real-time\/real-place mobile assessments in individuals with schizophrenia and a nonclinical comparison group. Schizophrenia bulletin 38, 3 (2012), 396--404."},{"key":"e_1_2_1_6_1","volume-title":"Mobile behavioral sensing for outpatients and inpatients with schizophrenia. Psychiatric services 67, 5","author":"Ben-Zeev Dror","year":"2015","unstructured":"Dror Ben-Zeev , Rui Wang , Saeed Abdullah , Rachel Brian , Emily A Scherer , Lisa A Mistler , Marta Hauser , John M Kane , Andrew Campbell , and Tanzeem Choudhury . 2015. Mobile behavioral sensing for outpatients and inpatients with schizophrenia. Psychiatric services 67, 5 ( 2015 ), 558--561. Dror Ben-Zeev, Rui Wang, Saeed Abdullah, Rachel Brian, Emily A Scherer, Lisa A Mistler, Marta Hauser, John M Kane, Andrew Campbell, and Tanzeem Choudhury. 2015. Mobile behavioral sensing for outpatients and inpatients with schizophrenia. Psychiatric services 67, 5 (2015), 558--561."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291700024247"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654933"},{"key":"e_1_2_1_9_1","unstructured":"BPRS 2017. Brief Psychiatric Rating Scale (BPRS) Expanded Version (4.0). (2017). http:\/\/www.public-health.uiowa.edu\/icmha\/outreach\/documents\/bprs_expanded.pdf  BPRS 2017. Brief Psychiatric Rating Scale (BPRS) Expanded Version (4.0). (2017). http:\/\/www.public-health.uiowa.edu\/icmha\/outreach\/documents\/bprs_expanded.pdf"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"P Burton L Gurrin and P Sly. 1998. Extending the simple linear regression model to account for correlated responses: an introduction to generalized estimating equations and multi-level mixed modelling. Statistics in medicine 17 11 (jun 1998) 1261--91. http:\/\/www.ncbi. nlm.nih.gov\/pubmed\/9670414  P Burton L Gurrin and P Sly. 1998. Extending the simple linear regression model to account for correlated responses: an introduction to generalized estimating equations and multi-level mixed modelling. Statistics in medicine 17 11 (jun 1998) 1261--91. http:\/\/www.ncbi. nlm.nih.gov\/pubmed\/9670414","DOI":"10.1002\/(SICI)1097-0258(19980615)17:11<1261::AID-SIM846>3.0.CO;2-Z"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805845"},{"key":"e_1_2_1_12_1","volume-title":"A method for assessing the quality of a randomized control trial. Controlled clinical trials 2, 1","author":"Chalmers Thomas C","year":"1981","unstructured":"Thomas C Chalmers , Harry Smith , Bradley Blackburn , Bernard Silverman , Biruta Schroeder , Dinah Reitman , and Alexander Ambroz . 1981. A method for assessing the quality of a randomized control trial. Controlled clinical trials 2, 1 ( 1981 ), 31--49. Thomas C Chalmers, Harry Smith, Bradley Blackburn, Bernard Silverman, Biruta Schroeder, Dinah Reitman, and Alexander Ambroz. 1981. A method for assessing the quality of a randomized control trial. Controlled clinical trials 2, 1 (1981), 31--49."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.pervasivehealth.2013.252148"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968300"},{"key":"e_1_2_1_16_1","volume-title":"Paranoid ideation and violence: meta-analysis of individual subject data of 7 population surveys. Schizophrenia bulletin 42, 4","author":"Coid Jeremy W","year":"2016","unstructured":"Jeremy W Coid , Simone Ullrich , Paul Bebbington , Seena Fazel , and Robert Keers . 2016. Paranoid ideation and violence: meta-analysis of individual subject data of 7 population surveys. Schizophrenia bulletin 42, 4 ( 2016 ), 907--915. Jeremy W Coid, Simone Ullrich, Paul Bebbington, Seena Fazel, and Robert Keers. 2016. Paranoid ideation and violence: meta-analysis of individual subject data of 7 population surveys. Schizophrenia bulletin 42, 4 (2016), 907--915."},{"key":"e_1_2_1_17_1","unstructured":"Peter Diggle Patrick Heagerty Kung-Yee Liang and Scott Zeger. 2013. Analysis of longitudinal data. OUP Oxford.  Peter Diggle Patrick Heagerty Kung-Yee Liang and Scott Zeger. 2013. Analysis of longitudinal data. OUP Oxford."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1176\/ajp.148.2.224","article-title":"Drug abuse in schizophrenic patients: clinical correlates and reasons for use","volume":"148","author":"Dixon Lisa","year":"1991","unstructured":"Lisa Dixon , Gretchen Haas , Peter J Weiden , John Sweeney , and Allen J Frances . 1991 . Drug abuse in schizophrenic patients: clinical correlates and reasons for use . Am J Psychiatry 148 , 2 (1991), 224 -- 230 . Lisa Dixon, Gretchen Haas, Peter J Weiden, John Sweeney, and Allen J Frances. 1991. Drug abuse in schizophrenic patients: clinical correlates and reasons for use. Am J Psychiatry 148, 2 (1991), 224--230.","journal-title":"Am J Psychiatry"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2016.09.008"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2656.2008.01390.x"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/WH.2016.7764553"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968306"},{"key":"e_1_2_1_24_1","unstructured":"Google Activity Recognition Api. 2017. Google Activity Recognition Api. https:\/\/developers.google.com\/android\/reference\/com\/google\/android\/gms\/location\/ActivityRecognitionApi. (2017).  Google Activity Recognition Api. 2017. Google Activity Recognition Api. https:\/\/developers.google.com\/android\/reference\/com\/google\/android\/gms\/location\/ActivityRecognitionApi. (2017)."},{"key":"e_1_2_1_25_1","volume-title":"Mar","author":"Guyon Isabelle","year":"2003","unstructured":"Isabelle Guyon and Andr\u00e9 Elisseeff . 2003. An introduction to variable and feature selection. Journal of machine learning research 3 , Mar ( 2003 ), 1157--1182. Isabelle Guyon and Andr\u00e9 Elisseeff. 2003. An introduction to variable and feature selection. Journal of machine learning research 3, Mar (2003), 1157--1182."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968305"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0924-9338(15)30442-9"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0006-3223(93)90307-Y"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.201000505"},{"key":"e_1_2_1_30_1","unstructured":"James Hedlund. 1980. The brief psychiatric rating scale (BPRS): A comprehensive review.  James Hedlund. 1980. The brief psychiatric rating scale (BPRS): A comprehensive review."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/1359786810385490"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807526"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177703732"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2971419"},{"key":"e_1_2_1_35_1","volume-title":"Ijcai","author":"Kohavi Ron","unstructured":"Ron Kohavi and others. 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection . In Ijcai , Vol. 14 . Stanford , CA , 1137--1145. Ron Kohavi and others. 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Ijcai, Vol. 14. Stanford, CA, 1137--1145."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2971348"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1159\/000111551"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0145533"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3928\/0048-5713-20020901-06"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1525-1497.2001.016009606.x"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2010.5560598"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.pervasivehealth.2011.246161"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/73.1.13"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370270"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2971397"},{"key":"e_1_2_1_46_1","volume-title":"Hans-Peter Kriegel and Xiaowei Xu","author":"Martin Ester J\u00f6rg Sander","year":"1996","unstructured":"J\u00f6rg Sander Martin Ester , Hans-Peter Kriegel and Xiaowei Xu . 1996 . A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD \u201996. AAAI Press , 226--231. J\u00f6rg Sander Martin Ester, Hans-Peter Kriegel and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD \u201996. AAAI Press, 226--231."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2016.01.008"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968299"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2015.54"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2536853.2536882"},{"key":"e_1_2_1_51_1","volume-title":"The brief psychiatric rating scale. Psychological reports 10, 3","author":"Overall John E","year":"1962","unstructured":"John E Overall and Donald R Gorham . 1962. The brief psychiatric rating scale. Psychological reports 10, 3 ( 1962 ), 799--812. John E Overall and Donald R Gorham. 1962. The brief psychiatric rating scale. Psychological reports 10, 3 (1962), 799--812."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030164"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.mobihealth.2014.257423"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.2537"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4273"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.117"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807537"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.282.18.1737"},{"key":"e_1_2_1_60_1","doi-asserted-by":"crossref","unstructured":"Marie Stentebjerg-Olesen Stephen J Ganocy Robert L Findling Kiki Chang Melissa P DelBello John M Kane Mauricio Tohen Pia Jeppesen and Christoph U Correll. 2015. Early response or nonresponse at week 2 and week 3 predict ultimate response or nonresponse in adolescents with schizophrenia treated with olanzapine: results from a 6-week randomized placebo-controlled trial. European child 8 adolescent psychiatry 24 12 (2015) 1485--1496.  Marie Stentebjerg-Olesen Stephen J Ganocy Robert L Findling Kiki Chang Melissa P DelBello John M Kane Mauricio Tohen Pia Jeppesen and Christoph U Correll. 2015. Early response or nonresponse at week 2 and week 3 predict ultimate response or nonresponse in adolescents with schizophrenia treated with olanzapine: results from a 6-week randomized placebo-controlled trial. European child 8 adolescent psychiatry 24 12 (2015) 1485--1496.","DOI":"10.1007\/s00787-015-0725-1"},{"key":"e_1_2_1_61_1","volume-title":"Periods of recovery in deficit syndrome Schizophrenia: a 20-year multi--follow-up longitudinal study. Schizophrenia bulletin 36, 4","author":"Strauss Gregory P","year":"2010","unstructured":"Gregory P Strauss , Martin Harrow , Linda S Grossman , and Cherise Rosen . 2010. Periods of recovery in deficit syndrome Schizophrenia: a 20-year multi--follow-up longitudinal study. Schizophrenia bulletin 36, 4 ( 2010 ), 788--799. Gregory P Strauss, Martin Harrow, Linda S Grossman, and Cherise Rosen. 2010. Periods of recovery in deficit syndrome Schizophrenia: a 20-year multi--follow-up longitudinal study. Schizophrenia bulletin 36, 4 (2010), 788--799."},{"key":"e_1_2_1_62_1","volume-title":"Substance use: a powerful predictor of relapse in schizophrenia. Schizophrenia research 20, 1","author":"Swofford Cheryl D","year":"1996","unstructured":"Cheryl D Swofford , John W Kasckow , Geri Scheller-Gilkey , and Lawrence B Inderbitzin . 1996. Substance use: a powerful predictor of relapse in schizophrenia. Schizophrenia research 20, 1 ( 1996 ), 145--151. Cheryl D Swofford, John W Kasckow, Geri Scheller-Gilkey, and Lawrence B Inderbitzin. 1996. Substance use: a powerful predictor of relapse in schizophrenia. Schizophrenia research 20, 1 (1996), 145--151."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971740"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632054"},{"key":"e_1_2_1_65_1","volume-title":"Lutz","author":"Wilkinson Gary S","year":"2006","unstructured":"Gary S Wilkinson and GJ Robertson . 2006. Wide range achievement test (WRAT4). Psychological Assessment Resources , Lutz ( 2006 ). Gary S Wilkinson and GJ Robertson. 2006. Wide range achievement test (WRAT4). Psychological Assessment Resources, Lutz (2006)."},{"key":"e_1_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Danny Wyatt Tanzeem Choudhury and Jeff A Bilmes. 2007. Conversation detection and speaker segmentation in privacy-sensitive situated speech data.. In INTERSPEECH. 586--589.  Danny Wyatt Tanzeem Choudhury and Jeff A Bilmes. 2007. Conversation detection and speaker segmentation in privacy-sensitive situated speech data.. In INTERSPEECH. 586--589.","DOI":"10.21437\/Interspeech.2007-256"},{"key":"e_1_2_1_67_1","first-page":"1769","article-title":"A Privacy-Sensitive Approach to Modeling Multi-Person Conversations","volume":"7","author":"Wyatt Danny","year":"2007","unstructured":"Danny Wyatt , Tanzeem Choudhury , Jeff A Bilmes , and Henry A Kautz . 2007 . A Privacy-Sensitive Approach to Modeling Multi-Person Conversations .. In IJCAI , Vol. 7. 1769 -- 1775 . Danny Wyatt, Tanzeem Choudhury, Jeff A Bilmes, and Henry A Kautz. 2007. A Privacy-Sensitive Approach to Modeling Multi-Person Conversations.. In IJCAI, Vol. 7. 1769--1775.","journal-title":"IJCAI"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2007.367201"},{"key":"e_1_2_1_69_1","volume-title":"An overview of methods for the analysis of longitudinal data. Statistics in medicine 11, 14-15 (Jan","author":"Zeger S L","year":"1992","unstructured":"S L Zeger and K Y Liang . 1992. An overview of methods for the analysis of longitudinal data. Statistics in medicine 11, 14-15 (Jan 1992 ), 1825--39. http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/1480876 S L Zeger and K Y Liang. 1992. An overview of methods for the analysis of longitudinal data. Statistics in medicine 11, 14-15 (Jan 1992), 1825--39. http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/1480876"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130976","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130976","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:20Z","timestamp":1750212800000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130976"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,11]]},"references-count":69,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,11]]}},"alternative-id":["10.1145\/3130976"],"URL":"https:\/\/doi.org\/10.1145\/3130976","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,11]]},"assertion":[{"value":"2017-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}