{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T06:46:43Z","timestamp":1790318803123,"version":"4.1.0"},"reference-count":67,"publisher":"BMJ","issue":"11","license":[{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"unspecified","delay-in-days":22,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EPSRC SPHERE Interdisciplinary Research Collaboration","award":["EP\/K031910\/1"],"award-info":[{"award-number":["EP\/K031910\/1"]}]},{"name":"EPSRC Centre for Doctoral Training in Digital Health and Care, University of Bristol","award":["EP\/S023704\/1"],"award-info":[{"award-number":["EP\/S023704\/1"]}]},{"name":"MRC Momentum award","award":["MC\/PC\/16029"],"award-info":[{"award-number":["MC\/PC\/16029"]}]},{"name":"UKRI Turing AI Fellowship","award":["EP\/V024817\/1"],"award-info":[{"award-number":["EP\/V024817\/1"]}]},{"DOI":"10.13039\/100011699","name":"BRACE","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100011699","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2022,11,7]]},"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Limitations in effective dementia therapies mean that early diagnosis and monitoring are critical for disease management, but current clinical tools are impractical and\/or unreliable, and disregard short-term symptom variability. Behavioural biomarkers of cognitive decline, such as speech, sleep and activity patterns, can manifest prodromal pathological changes. They can be continuously measured at home with smart sensing technologies, and permit leveraging of interpersonal interactions for optimising diagnostic and prognostic performance. Here we describe the ContinUous behavioural Biomarkers Of cognitive Impairment (CUBOId) study, which explores the feasibility of multimodal data fusion for in-home monitoring of mild cognitive impairment (MCI) and early Alzheimer\u2019s disease (AD). The report focuses on a subset of CUBOId participants who perform a novel speech task, the \u2018TV task\u2019, designed to track changes in ecologically valid conversations with disease progression.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and analysis<\/jats:title>\n                    <jats:p>CUBOId is a longitudinal observational study. Participants have diagnoses of MCI or AD, and controls are their live-in partners with no such diagnosis. Multimodal activity data were passively acquired from wearables and in-home fixed sensors over timespans of 8\u201325 months. At two time points participants completed the TV task over 5\u2009days by recording audio of their conversations as they watched a favourite TV programme, with further testing to be completed after removal of the sensor installations. Behavioural testing is supported by neuropsychological assessment for deriving ground truths on cognitive status. Deep learning will be used to generate fused multimodal activity-speech embeddings for optimisation of diagnostic and predictive performance from speech alone.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Ethics and dissemination<\/jats:title>\n                    <jats:p>CUBOId was approved by an NHS Research Ethics Committee (Wales REC; ref: 18\/WA\/0158) and is sponsored by University of Bristol. It is supported by the National Institute for Health Research Clinical Research Network West of England. Results will be reported at conferences and in peer-reviewed scientific journals.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjopen-2022-065033","type":"journal-article","created":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T14:09:48Z","timestamp":1669212588000},"page":"e065033","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":5,"title":["A longitudinal observational study of home-based conversations for detecting early dementia: protocol for the CUBOId TV task"],"prefix":"10.1136","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5458-4131","authenticated-orcid":false,"given":"Daniel Paul","family":"Kumpik","sequence":"first","affiliation":[{"name":"Department of Engineering Mathematics, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raul","family":"Santos-Rodriguez","sequence":"additional","affiliation":[{"name":"Department of Engineering Mathematics, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Selwood","sequence":"additional","affiliation":[{"name":"Bristol Medical School, University of Bristol, Bristol, UK"},{"name":"Department of Population Health Sciences, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Coulthard","sequence":"additional","affiliation":[{"name":"Bristol Medical School, University of Bristol, Bristol, UK"},{"name":"Department of Translational Health Sciences, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niall","family":"Twomey","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian","family":"Craddock","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoav","family":"Ben-Shlomo","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, University of Bristol, Bristol, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2022,11,23]]},"reference":[{"key":"2025120600371545000_12.11.e065033.1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jalz.2007.04.381"},{"key":"2025120600371545000_12.11.e065033.2","doi-asserted-by":"publisher","DOI":"10.1017\/S1041610219001571"},{"key":"2025120600371545000_12.11.e065033.3","doi-asserted-by":"publisher","DOI":"10.1007\/s10339-011-0410-3"},{"key":"2025120600371545000_12.11.e065033.4","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1202753"},{"key":"2025120600371545000_12.11.e065033.5","unstructured":"Second English National Memory Clinics Audit . London: Royal College of Psychiatrists, 2015. Available: https:\/\/silo.tips\/download\/second-english-national-memory-clinics-audit-report"},{"key":"2025120600371545000_12.11.e065033.6","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2014.13806"},{"key":"2025120600371545000_12.11.e065033.7","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2796.2004.01388.x"},{"key":"2025120600371545000_12.11.e065033.8","doi-asserted-by":"publisher","DOI":"10.1212\/01.WNL.0000132523.27540.81"},{"key":"2025120600371545000_12.11.e065033.9","doi-asserted-by":"publisher","DOI":"10.1186\/S12877-016-0281-7"},{"key":"2025120600371545000_12.11.e065033.10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0116802"},{"key":"2025120600371545000_12.11.e065033.11","doi-asserted-by":"publisher","DOI":"10.3310\/hta21410"},{"key":"2025120600371545000_12.11.e065033.12","doi-asserted-by":"crossref","first-page":"1450","DOI":"10.1001\/jamainternmed.2015.2152","article-title":"Cognitive tests to detect dementia: a systematic review and meta-analysis","volume":"175","author":"Tsoi","year":"2015","journal-title":"JAMA Intern Med"},{"key":"2025120600371545000_12.11.e065033.13","doi-asserted-by":"publisher","DOI":"10.1136\/jnnp-2014-309086"},{"key":"2025120600371545000_12.11.e065033.14","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(21)00361-6"},{"key":"2025120600371545000_12.11.e065033.15","doi-asserted-by":"crossref","DOI":"10.2196\/12785","article-title":"Current state of digital biomarker technologies for real-life, home-based monitoring of cognitive function for mild cognitive impairment to mild Alzheimer disease and implications for clinical care: systematic review","volume":"21","author":"Piau","year":"2019","journal-title":"J Med Internet Res"},{"key":"2025120600371545000_12.11.e065033.16","doi-asserted-by":"crossref","DOI":"10.3390\/s21124249","article-title":"Intelligent sensing technologies for the diagnosis, monitoring and therapy of Alzheimer's disease: a systematic review","volume":"21","author":"Gillani","year":"2021","journal-title":"Sensors"},{"key":"2025120600371545000_12.11.e065033.17","doi-asserted-by":"crossref","unstructured":"Palliya Guruge C , Oviatt S , Delir Haghighi P . Advances in multimodal behavioral analytics for early dementia diagnosis: a review. Proceedings of the 2021 International Conference on Multimodal Interaction;13.doi:10.1145\/3462244.3479933","DOI":"10.1145\/3462244.3479933"},{"key":"2025120600371545000_12.11.e065033.18","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-022-11865-7","article-title":"Diagnostic accuracy of keystroke dynamics as digital biomarkers for fine motor decline in neuropsychiatric disorders: a systematic review and meta-analysis","volume":"12","author":"Alfalahi","year":"2022","journal-title":"Sci Rep"},{"key":"2025120600371545000_12.11.e065033.19","doi-asserted-by":"publisher","DOI":"10.3389\/FNAGI.2015.00096"},{"key":"2025120600371545000_12.11.e065033.20","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.1093\/brain\/awz116","article-title":"Differentiation of mild cognitive impairment using an entorhinal cortex-based test of virtual reality navigation","volume":"142","author":"Howett","year":"2019","journal-title":"Brain"},{"key":"2025120600371545000_12.11.e065033.21","doi-asserted-by":"crossref","unstructured":"Gagnon JF , Lafreni\u00e8re A , Rauchs G . Sleep in normal aging, Alzheimer\u2019s disease, and mild cognitive impairment. In: Nomikos G , Feltner D , eds. Handbook of Behavioural Neuroscience: Translational Medicine in CNS Drug Development. Elsevier, 2019: 677\u201392.","DOI":"10.1016\/B978-0-12-813743-7.00045-1"},{"key":"2025120600371545000_12.11.e065033.22","doi-asserted-by":"publisher","DOI":"10.1519\/JPT.0000000000000281"},{"key":"2025120600371545000_12.11.e065033.23","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.h369"},{"key":"2025120600371545000_12.11.e065033.24","doi-asserted-by":"publisher","DOI":"10.1016\/J.INFFUS.2021.11.006"},{"key":"2025120600371545000_12.11.e065033.25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0084-2","article-title":"Digital biomarkers for Alzheimer\u2019s disease: the mobile\/wearable devices opportunity","volume":"2","author":"Kourtis","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2025120600371545000_12.11.e065033.26","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0b013e3181b01077"},{"key":"2025120600371545000_12.11.e065033.27","doi-asserted-by":"crossref","DOI":"10.1016\/j.eclinm.2020.100583","article-title":"Linguistic markers predict onset of Alzheimer's disease","volume":"28","author":"Eyigoz","year":"2020","journal-title":"EClinicalMedicine"},{"key":"2025120600371545000_12.11.e065033.28","doi-asserted-by":"publisher","DOI":"10.1016\/J.CORTEX.2020.05.001"},{"key":"2025120600371545000_12.11.e065033.29","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2018.07.007"},{"key":"2025120600371545000_12.11.e065033.30","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2019.2955022"},{"key":"2025120600371545000_12.11.e065033.31","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-13117-7_148"},{"key":"2025120600371545000_12.11.e065033.32","doi-asserted-by":"publisher","DOI":"10.1109\/MIM.2021.9513645"},{"key":"2025120600371545000_12.11.e065033.33","doi-asserted-by":"crossref","DOI":"10.1016\/j.csl.2021.101297","article-title":"Evaluating voice-assistant commands for dementia detection","volume":"72","author":"Liang","year":"2022","journal-title":"Comput Speech Lang"},{"key":"2025120600371545000_12.11.e065033.34","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocaa174"},{"key":"2025120600371545000_12.11.e065033.35","doi-asserted-by":"crossref","DOI":"10.3389\/fpsyg.2021.620251","article-title":"Ten years of research on automatic voice and speech analysis of people weith Alzheimer\u2019s disease and mild cognitive impairment: a systematic review article","volume":"12","author":"Mart\u00ednez-Nicol\u00e1s","year":"2021","journal-title":"Front Psychol"},{"key":"2025120600371545000_12.11.e065033.36","first-page":"112","article-title":"Automatic speech analysis for the assessment of patients with predementia and Alzheimer\u2019s disease","volume":"1","author":"K\u00f6nig","year":"2015","journal-title":"Alzheimers Dement"},{"key":"2025120600371545000_12.11.e065033.37","doi-asserted-by":"publisher","DOI":"10.1080\/13803395.2018.1446513"},{"key":"2025120600371545000_12.11.e065033.38","first-page":"4","article-title":"Learning language and acoustic models for identifying Alzheimer\u2019s dementia from speech","volume":"0","author":"Shah","year":"2021","journal-title":"Front Comput Sci"},{"key":"2025120600371545000_12.11.e065033.39","doi-asserted-by":"publisher","DOI":"10.1016\/J.TRCI.2017.01.006"},{"key":"2025120600371545000_12.11.e065033.40","doi-asserted-by":"crossref","unstructured":"Nasreen S , Hough J , Purver M . Rare-class dialogue act tagging for Alzheimer\u2019s disease diagnosis. In Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2021:290-300. Available: https:\/\/aclanthology.org\/2021.sigdial-1.32","DOI":"10.18653\/v1\/2021.sigdial-1.32"},{"key":"2025120600371545000_12.11.e065033.41","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Toro PA , Bayerl SP , Arias-Vergara T . Influence of the interviewer on the automatic assessment of Alzheimer\u2019s disease in the context of the ADReSSo challenge. In Proceedings of Interspeech 2021, 2021: 3785\u20139.","DOI":"10.21437\/Interspeech.2021-1589"},{"key":"2025120600371545000_12.11.e065033.42","unstructured":"Gkoumas D , Wang B , Tsakalidis A . A longitudinal multi-modal dataset for dementia monitoring and diagnosis. arXiv 2109.01537 2021.doi:10.48550\/arXiv.2109.01537"},{"key":"2025120600371545000_12.11.e065033.43","doi-asserted-by":"publisher","DOI":"10.1515\/CLLT.2011.007"},{"key":"2025120600371545000_12.11.e065033.44","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.3233\/JAD-200888","article-title":"Artificial intelligence, speech, and language processing approaches to monitoring Alzheimer's disease: a systematic review","volume":"78","author":"de la Fuente Garcia","year":"2020","journal-title":"J Alzheimers Dis"},{"key":"2025120600371545000_12.11.e065033.45","doi-asserted-by":"crossref","unstructured":"Woznowski P , Burrows A , Diethe T . SPHERE: A Sensor Platform for Healthcare in a Residential Environment. In: Designing, Developing, and Facilitating Smart Cities. Springer International Publishing, 2017: 315\u201333.","DOI":"10.1007\/978-3-319-44924-1_14"},{"key":"2025120600371545000_12.11.e065033.46","first-page":"23","article-title":"Detecting signatures of early-stage dementia with behavioural models derived from sensor data","volume":"2820","author":"Poyiadzi","year":"2020","journal-title":"CEUR Workshop Proc"},{"key":"2025120600371545000_12.11.e065033.47","doi-asserted-by":"publisher","DOI":"10.1097\/AUD.0000000000000675"},{"key":"2025120600371545000_12.11.e065033.48","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1097\/00025572-200003000-00002","article-title":"The Glasgow hearing aid benefit profile: what it measures and how to use it","volume":"53","author":"Gatehouse","year":"2000","journal-title":"Hear J"},{"key":"2025120600371545000_12.11.e065033.49","unstructured":"Zoom Video Communications Inc . Zoom security white paper. Available: https:\/\/explore.zoom.us\/docs\/doc\/Zoom-Security-White-Paper.pdf [Accessed 28 Mar 2022]."},{"key":"2025120600371545000_12.11.e065033.50","doi-asserted-by":"publisher","DOI":"10.1121\/1.1911189"},{"key":"2025120600371545000_12.11.e065033.51","doi-asserted-by":"publisher","DOI":"10.1016\/j.jalz.2016.07.154"},{"key":"2025120600371545000_12.11.e065033.52","doi-asserted-by":"crossref","first-page":"423","DOI":"10.3233\/JAD-170991","article-title":"The Alzheimer's Disease Assessment Scale-Cognitive Subscale (ADAS-Cog): Modifications and responsiveness in pre-dementia populations. A narrative review","volume":"63","author":"Kueper","year":"2018","journal-title":"J Alzheimers Dis"},{"key":"2025120600371545000_12.11.e065033.53","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8260.1992.tb00997.x"},{"key":"2025120600371545000_12.11.e065033.54","doi-asserted-by":"publisher","DOI":"10.1300\/J018v05n01_09"},{"key":"2025120600371545000_12.11.e065033.55","doi-asserted-by":"publisher","DOI":"10.1093\/sleep\/14.6.540"},{"key":"2025120600371545000_12.11.e065033.56","doi-asserted-by":"publisher","DOI":"10.1016\/0165-1781(89)90047-4"},{"key":"2025120600371545000_12.11.e065033.57","doi-asserted-by":"crossref","DOI":"10.2196\/16142","article-title":"Evaluating the feasibility of frequent cognitive assessment using the Mezurio smartphone app: observational and interview study in adults with elevated dementia risk","volume":"8","author":"Lancaster","year":"2020","journal-title":"JMIR Mhealth Uhealth"},{"key":"2025120600371545000_12.11.e065033.58","unstructured":"Cohen J . Statistical power analysis for the behavioral sciences. 2nd ed. Routledge, 1988."},{"key":"2025120600371545000_12.11.e065033.59","doi-asserted-by":"crossref","unstructured":"Kozlowski M , Byrne D , Santos-Rodriguez R . Data fusion for robust indoor localisation in digital health. WCNCW 2018 2018 302\u20137.doi:10.1109\/WCNCW.2018.8369009","DOI":"10.1109\/WCNCW.2018.8369009"},{"key":"2025120600371545000_12.11.e065033.60","doi-asserted-by":"crossref","first-page":"1975","DOI":"10.1007\/s10462-019-09724-5","article-title":"Non-intrusive human activity recognition and abnormal behavior detection on elderly people: a review","volume":"53","author":"Lentzas","year":"2020","journal-title":"Artif Intell Rev"},{"key":"2025120600371545000_12.11.e065033.61","unstructured":"Boersma P , Weenink D . Praat: doing phonetics by computer [Computer program]. Version 6.2.10. Available: http:\/\/www.praat.org\/ [Accessed 28 Mar 2022]."},{"key":"2025120600371545000_12.11.e065033.62","unstructured":"Macwhinney B . Tools for analyzing talk Part 1: the CHAT transcription format. Carnegie, 2022. Available: https:\/\/talkbank.org\/manuals\/CHAT.pdf [Accessed 28 Mar 2022]."},{"key":"2025120600371545000_12.11.e065033.63","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2019.2952087"},{"key":"2025120600371545000_12.11.e065033.64","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12245"},{"key":"2025120600371545000_12.11.e065033.65","doi-asserted-by":"publisher","DOI":"10.1080\/17549507.2016.1221448"},{"key":"2025120600371545000_12.11.e065033.66","doi-asserted-by":"publisher","DOI":"10.3389\/fcomp.2021.640669"},{"key":"2025120600371545000_12.11.e065033.67","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-021-01394-0"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2022-065033","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T08:37:29Z","timestamp":1765010249000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2022-065033"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11]]},"references-count":67,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,11,23]]},"published-print":{"date-parts":[[2022,11]]}},"alternative-id":["10.1136\/bmjopen-2022-065033"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2022-065033","relation":{},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11]]}}}