{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T17:09:54Z","timestamp":1772557794239,"version":"3.50.1"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2020,5,6]],"date-time":"2020-05-06T00:00:00Z","timestamp":1588723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000056","name":"National Institute for Nursing Research","doi-asserted-by":"crossref","award":["R01NR012213"],"award-info":[{"award-number":["R01NR012213"]}],"id":[{"id":"10.13039\/100000056","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The goal of this study was to explore whether features of recorded and transcribed audio communication data extracted by machine learning algorithms can be used to train a classifier for anxiety.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We used a secondary data set generated by a clinical trial examining problem-solving therapy for hospice caregivers consisting of 140 transcripts of multiple, sequential conversations between an interviewer and a family caregiver along with standardized assessments of anxiety prior to each session; 98 of these transcripts (70%) served as the training set, holding the remaining 30% of the data for evaluation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>A classifier for anxiety was developed relying on language-based features. An 86% precision, 78% recall, 81% accuracy, and 84% specificity were achieved with the use of the trained classifiers. High anxiety inflections were found among recently bereaved caregivers and were usually connected to issues related to transitioning out of the caregiving role. This analysis highlighted the impact of lowering anxiety by increasing reciprocity between interviewers and caregivers.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Verbal communication can provide a platform for machine learning tools to highlight and predict behavioral health indicators and trends.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa049","type":"journal-article","created":{"date-parts":[[2020,4,4]],"date-time":"2020-04-04T04:37:04Z","timestamp":1585975024000},"page":"929-933","source":"Crossref","is-referenced-by-count":16,"title":["Spoken words as biomarkers: using machine learning to gain insight into communication as a predictor of anxiety"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6318-5829","authenticated-orcid":false,"given":"George","family":"Demiris","sequence":"first","affiliation":[{"name":"School of Nursing, University of Pennsylvania, Philadelphia, Pennsylvania, USA"}]},{"given":"Kristin L","family":"Corey Magan","sequence":"additional","affiliation":[{"name":"School of Nursing, University of Pennsylvania, Philadelphia, Pennsylvania, USA"}]},{"given":"Debra","family":"Parker Oliver","sequence":"additional","affiliation":[{"name":"Family Medicine, School of Medicine, University of Missouri, Columbia, Missouri, USA"}]},{"given":"Karla T","family":"Washington","sequence":"additional","affiliation":[{"name":"Family Medicine, School of Medicine, University of Missouri, Columbia, Missouri, USA"}]},{"given":"Chad","family":"Chadwick","sequence":"additional","affiliation":[{"name":"Live Circle Inc, Ridgewood, New Jersey, USA"}]},{"given":"Jeffrey D","family":"Voigt","sequence":"additional","affiliation":[{"name":"Live Circle Inc, Ridgewood, New Jersey, USA"}]},{"given":"Sam","family":"Brotherton","sequence":"additional","affiliation":[{"name":"Live Circle Inc, Ridgewood, New Jersey, USA"}]},{"given":"Mary D","family":"Naylor","sequence":"additional","affiliation":[{"name":"School of Nursing, University of Pennsylvania, Philadelphia, Pennsylvania, USA"}]}],"member":"286","published-online":{"date-parts":[[2020,5,6]]},"reference":[{"issue":"5","key":"2020110613104609100_ocaa049-B1","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1109\/JPROC.2012.2236291","article-title":"Behavioral signal processing: deriving human behavioral informatics from speech and language","volume":"101","author":"Narayanan","year":"2013","journal-title":"Proc IEEE"},{"issue":"4","key":"2020110613104609100_ocaa049-B2","doi-asserted-by":"crossref","first-page":"361","DOI":"10.3390\/ijerph14040361","article-title":"The promise and the challenge of technology-facilitated methods for assessing behavioral and cognitive markers of risk for suicide among U.S. Army National Guard Personnel","volume":"14","author":"Baucom","year":"2017","journal-title":"Int J Environ Res Public Health"},{"issue":"1","key":"2020110613104609100_ocaa049-B3","doi-asserted-by":"crossref","first-page":"15030","DOI":"10.1038\/npjschz.2015.30","article-title":"Automated analysis of free speech predicts psychosis onset in high-risk youths","volume":"1","author":"Bedi","year":"2015","journal-title":"NPJ Schizophr"},{"issue":"1","key":"2020110613104609100_ocaa049-B4","first-page":"112","article-title":"Automatic speech analysis for the assessment of patients with predementia and Alzheimer\u2019s disease","volume":"1","author":"Konig","year":"2015","journal-title":"Alzheimers Dement"},{"issue":"9","key":"2020110613104609100_ocaa049-B5","doi-asserted-by":"crossref","first-page":"e0185123","DOI":"10.1371\/journal.pone.0185123","article-title":"Predicting couple therapy outcomes based on speech acoustic features","volume":"12","author":"Nasir","year":"2017","journal-title":"PLoS ONE"},{"issue":"23","key":"2020110613104609100_ocaa049-B6","doi-asserted-by":"crossref","first-page":"2215","DOI":"10.1001\/jama.282.23.2215","article-title":"Caregiving as a risk factor for mortality: the caregiver health effects study","volume":"282","author":"Schulz","year":"1999","journal-title":"JAMA"},{"key":"2020110613104609100_ocaa049-B7","author":"Reinhard"},{"key":"2020110613104609100_ocaa049-B8","author":"Feinberg"},{"issue":"2","key":"2020110613104609100_ocaa049-B9","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1177\/1049909117703643","article-title":"Sleep problems, anxiety, and global self-rated health among hospice family caregivers","volume":"35","author":"Washington","year":"2018","journal-title":"Am J Hosp Palliat Care"},{"issue":"7","key":"2020110613104609100_ocaa049-B10","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1111\/jgs.15894","article-title":"A problem-solving intervention for hospice family caregivers: a randomized clinical trial","volume":"67","author":"Demiris","year":"2019","journal-title":"J Am Geriatr Soc"},{"issue":"10","key":"2020110613104609100_ocaa049-B11","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1001\/archinte.166.10.1092","article-title":"A brief measure for assessing generalized anxiety disorder: the GAD-7","volume":"166","author":"Spitzer","year":"2006","journal-title":"Arch Intern Med"},{"key":"2020110613104609100_ocaa049-B12"},{"key":"2020110613104609100_ocaa049-B13"},{"key":"2020110613104609100_ocaa049-B14","author":"Loria"},{"key":"2020110613104609100_ocaa049-B15","author":"Pennington"},{"key":"2020110613104609100_ocaa049-B16","article-title":"Lexical comparison between wikipedia and twitter corpora by using word embeddings","author":"Tan","year":", 2015; ,","journal-title":"proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing"},{"key":"2020110613104609100_ocaa049-B17","author":"Rothe","year":"2016"},{"issue":"1-3","key":"2020110613104609100_ocaa049-B18","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/BF01589116","article-title":"On the limited memory BFGS method for large scale optimization","volume":"45","author":"Liu","year":"1989","journal-title":"Math Program"},{"issue":"4","key":"2020110613104609100_ocaa049-B19","first-page":"648","article-title":"Challenges and strategies for hospice caregivers: a qualitative analysis","volume":"57","author":"Oliver","year":"2017","journal-title":"Gerontologist"},{"issue":"8","key":"2020110613104609100_ocaa049-B20","doi-asserted-by":"crossref","first-page":"1018","DOI":"10.1177\/0269216311427191","article-title":"Qualitative evaluation of a problem-solving intervention for informal hospice caregivers","volume":"26","author":"Washington","year":"2012","journal-title":"Palliat Med"},{"key":"2020110613104609100_ocaa049-B21","volume-title":"Problem-Solving Therapy: A Positive Approach to Clinical Intervention","author":"D\u2019Zurilla","year":"2007","edition":"3rd"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/6\/929\/34153157\/ocaa049.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/6\/929\/34153157\/ocaa049.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:35:00Z","timestamp":1604691300000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/6\/929\/5831105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,6]]},"references-count":21,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,5,6]]},"published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa049","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,6]]},"published":{"date-parts":[[2020,5,6]]}}}