{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:41:52Z","timestamp":1770918112343,"version":"3.50.1"},"reference-count":29,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T00:00:00Z","timestamp":1645574400000},"content-version":"vor","delay-in-days":53,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["alz-journals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Alz &amp; Dem Diag Ass &amp; Dis Mo"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We developed and evaluated an automatically extracted measure of cognition (semantic relevance) using automated and manual transcripts of audio recordings from healthy and cognitively impaired participants describing the Cookie Theft picture from the Boston Diagnostic Aphasia Examination. We describe the rationale and metric validation. We developed the measure on one dataset and evaluated it on a large database (&gt;2000 samples) by comparing accuracy against a manually calculated metric and evaluating its clinical relevance. The fully automated measure was accurate (r\u00a0=\u00a0.84), had moderate to good reliability (intra\u2010class correlation =\u00a0.73), correlated with Mini\u2010Mental State Examination and improved the fit in the context of other automatic language features (r\u00a0=\u00a0.65), and longitudinally declined with age and level of cognitive impairment. This study demonstrates the use of a rigorous analytical and clinical framework for validating automatic measures of speech, and applied it to a measure that is accurate and clinically relevant.<\/jats:p>","DOI":"10.1002\/dad2.12294","type":"journal-article","created":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T13:55:46Z","timestamp":1645624546000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Automated semantic relevance as an indicator of cognitive decline: Out\u2010of\u2010sample validation on a large\u2010scale longitudinal dataset"],"prefix":"10.1002","volume":"14","author":[{"given":"Gabriela","family":"Stegmann","sequence":"first","affiliation":[{"name":"Arizona State University  Phoenix Arizona USA"},{"name":"Aural Analytics  Scottsdale Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shira","family":"Hahn","sequence":"additional","affiliation":[{"name":"Arizona State University  Phoenix Arizona USA"},{"name":"Aural Analytics  Scottsdale Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samarth","family":"Bhandari","sequence":"additional","affiliation":[{"name":"Aural Analytics  Scottsdale Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kan","family":"Kawabata","sequence":"additional","affiliation":[{"name":"Aural Analytics  Scottsdale Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeremy","family":"Shefner","sequence":"additional","affiliation":[{"name":"Barrow Neurological Institute  Phoenix Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cayla Jessica","family":"Duncan","sequence":"additional","affiliation":[{"name":"Barrow Neurological Institute  Phoenix Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julie","family":"Liss","sequence":"additional","affiliation":[{"name":"Arizona State University  Phoenix Arizona USA"},{"name":"Aural Analytics  Scottsdale Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Visar","family":"Berisha","sequence":"additional","affiliation":[{"name":"Arizona State University  Phoenix Arizona USA"},{"name":"Aural Analytics  Scottsdale Arizona USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kimberly","family":"Mueller","sequence":"additional","affiliation":[{"name":"Wisconsin Alzheimer's Disease Research Center University of Wisconsin\u2013Madison School of Medicine and Public Health  Madison Wisconsin USA"},{"name":"Department of Communication Sciences and Disorders University of Wisconsin\u2013Madison  Madison Wisconsin USA"},{"name":"Wisconsin Alzheimer's Institute University of Wisconsin\u2013Madison School of Medicine and Public Health  Madison Wisconsin USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2022,2,23]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnagi.2017.00437"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1041610201007682"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.3233\/JAD\u2010160252"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1075\/ps.17011.cum"},{"key":"e_1_2_8_6_1","volume-title":"Boston Diagnostic Aphasia Examination","author":"Goodglass H","year":"2001"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/13803395.2018.1446513"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.3233\/JAD-170881"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3602.338"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1006\/brln.1996.0033"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awt269"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746\u2010020\u20100260\u20104"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1001\/archneur.1994.00540180063015"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-3956(75)90026-6"},{"key":"e_1_2_8_15_1","unstructured":"Google Cloud.2021.https:\/\/cloud.google.com\/speech\u2010to\u2010text\/docs\/boost"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40536-018-0061-2"},{"key":"e_1_2_8_17_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen J","year":"1988"},{"key":"e_1_2_8_18_1","volume-title":"Foundations of Clinical Research: Applications to Practice","author":"Portney L","year":"2015"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118032923"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1159\/000511671"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2017.09.004"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/0093-934X(91)90117-J"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1212\/01.wnl.0000210435.72614.38"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.01485"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/arclin\/acu010"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11065-020-09428-6"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0212342"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.620251"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocaa174"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00521-5"}],"container-title":["Alzheimer's &amp; Dementia: Diagnosis, Assessment &amp; Disease Monitoring"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/dad2.12294","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/dad2.12294","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/alz-journals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/dad2.12294","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T17:50:42Z","timestamp":1760377842000},"score":1,"resource":{"primary":{"URL":"https:\/\/alz-journals.onlinelibrary.wiley.com\/doi\/10.1002\/dad2.12294"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1002\/dad2.12294"],"URL":"https:\/\/doi.org\/10.1002\/dad2.12294","archive":["Portico"],"relation":{},"ISSN":["2352-8729","2352-8729"],"issn-type":[{"value":"2352-8729","type":"print"},{"value":"2352-8729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1]]},"assertion":[{"value":"2021-09-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-18","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e12294"}}