{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T15:09:39Z","timestamp":1783436979715,"version":"3.54.6"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,3,9]],"date-time":"2021-03-09T00:00:00Z","timestamp":1615248000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,3,9]],"date-time":"2021-03-09T00:00:00Z","timestamp":1615248000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>We developed transformer-based deep learning models based on natural language processing for early risk assessment of Alzheimer\u2019s disease from the picture description test.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The lack of large datasets poses the most important limitation for using complex models that do not require feature engineering. Transformer-based pre-trained deep language models have recently made a large leap in NLP research and application. These models are pre-trained on available large datasets to understand natural language texts appropriately, and are shown to subsequently perform well on classification tasks with small training sets. The overall classification model is a simple classifier on top of the pre-trained deep language model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The models are evaluated on picture description test transcripts of the Pitt corpus, which contains data of 170 AD patients with 257 interviews and 99 healthy controls with 243 interviews. The large bidirectional encoder representations from transformers (BERT\n                      <jats:sub>Large<\/jats:sub>\n                      ) embedding with logistic regression classifier achieves classification accuracy of 88.08%, which improves the state-of-the-art by 2.48%.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Using pre-trained language models can improve AD prediction. This not only solves the problem of lack of sufficiently large datasets, but also reduces the need for expert-defined features.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-021-01456-3","type":"journal-article","created":{"date-parts":[[2021,3,9]],"date-time":"2021-03-09T04:03:37Z","timestamp":1615262617000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":113,"title":["Transformer-based deep neural network language models for Alzheimer\u2019s disease risk assessment from targeted speech"],"prefix":"10.1186","volume":"21","author":[{"given":"Alireza","family":"Roshanzamir","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hamid","family":"Aghajan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1971-6231","authenticated-orcid":false,"given":"Mahdieh","family":"Soleymani Baghshah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,9]]},"reference":[{"key":"1456_CR1","doi-asserted-by":"crossref","unstructured":"Glenner GG. Alzheimers disease Biomedical Advances in Aging. 1990;51\u201362.","DOI":"10.1007\/978-1-4613-0513-2_5"},{"key":"1456_CR2","unstructured":"International AD. World Alzheimer Report 2019: Attitudes to dementia. Alzheimer\u2019s Disease Internationals London 2019."},{"issue":"3","key":"1456_CR3","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/S0010-0277(87)80011-2","volume":"27","author":"G Blanken","year":"1987","unstructured":"Blanken G, Dittmann J, Haas J-C, Wallesch C-W. Spontaneous speech in senile dementia and aphasia: implications for a neurolinguistic model of language production. Cognition. 1987;27(3):247\u201374.","journal-title":"Cognition"},{"issue":"3","key":"1456_CR4","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1016\/j.jalz.2011.03.003","volume":"7","author":"RA Sperling","year":"2011","unstructured":"Sperling RA, Aisen PS, Beckett LA, Bennett DA, Craft S, Fagan AM, Iwatsubo T, Jack CR Jr, Kaye J, Montine TJ, et al. Toward defining the preclinical stages of Alzheimer\u2019s disease: recommendations from the national institute on aging-alzheimer\u2019s association workgroups on diagnostic guidelines for alzheimer\u2019s disease. Alzheimer\u2019s Dementia. 2011;7(3):280\u201392.","journal-title":"Alzheimer\u2019s Dementia"},{"key":"1456_CR5","first-page":"51","volume":"13","author":"B Reisberg","year":"1993","unstructured":"Reisberg B, Sclan S, Franssen E, DeLeon M, Kluger A, Torossian C, Shulman E, Steinberg G, Monteiro I, McRae T, et al. Clinical stages of normal aging and Alzheimers-disease-the GDS staging system. Neurosci Res Commun. 1993;13:51\u20134.","journal-title":"Neurosci Res Commun"},{"key":"1456_CR6","unstructured":"Mace NL, Rabins PV. The 36-hour Day: A Family Guide to Caring for People Who Have Alzheimer Disease, Related Dementias, and Memory Loss. JHU Press; 2011."},{"key":"1456_CR7","volume-title":"Getting Through: Communicating When Someone You Care for Has Alzheimer\u2019s Disease","author":"E Ostuni","year":"1986","unstructured":"Ostuni E, Santo Pietro MJC. Getting Through: Communicating When Someone You Care for Has Alzheimer\u2019s Disease. Speech Bin; 1986."},{"key":"1456_CR8","volume-title":"The assessment of aphasia and related disorders","author":"H Goodglass","year":"1983","unstructured":"Goodglass H, Kaplan E. The assessment of aphasia and related disorders, vol. 230. 2nd ed. Philadelphia: Dictionary of Biological Psychology, Lea & Febiger; 1983.","edition":"2"},{"issue":"3\u20134","key":"1456_CR9","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1080\/02687030600911419","volume":"21","author":"C Mackenzie","year":"2007","unstructured":"Mackenzie C, Brady M, Norrie J, Poedjianto N. Picture description in neurologically normal adults: concepts and topic coherence. Aphasiology. 2007;21(3\u20134):340\u201354.","journal-title":"Aphasiology"},{"issue":"6","key":"1456_CR10","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1001\/archneur.1994.00540180063015","volume":"51","author":"JT Becker","year":"1994","unstructured":"Becker JT, Boiler F, Lopez OL, Saxton J, McGonigle KL. The natural history of Alzheimer\u2019s disease: description of study cohort and accuracy of diagnosis. Arch Neurol. 1994;51(6):585\u201394.","journal-title":"Arch Neurol"},{"issue":"1","key":"1456_CR11","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1080\/026870300401603","volume":"14","author":"RS Bucks","year":"2000","unstructured":"Bucks RS, Singh S, Cuerden JM, Wilcock GK. Analysis of spontaneous, conversational speech in dementia of Alzheimer type: Evaluation of an objective technique for analysing lexical performance. Aphasiology. 2000;14(1):71\u201391.","journal-title":"Aphasiology"},{"key":"1456_CR12","unstructured":"Guinn CI, Habash A. Language analysis of speakers with dementia of the Alzheimer\u2019s type. In: 2012 AAAI Fall Symposium Series; 2012."},{"key":"1456_CR13","doi-asserted-by":"crossref","unstructured":"Orimaye SO, Wong JS-M, Golden KJ. Learning predictive linguistic features for Alzheimer\u2019s disease and related dementias using verbal utterances. In: Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality; 2014. p. 78\u201387.","DOI":"10.3115\/v1\/W14-3210"},{"key":"1456_CR14","doi-asserted-by":"crossref","unstructured":"Thomas C, Keselj V, Cercone N, Rockwood K, Asp E. Automatic detection and rating of dementia of alzheimer type through lexical analysis of spontaneous speech. In: IEEE International Conference Mechatronics and Automation, vol 3, 2005. IEEE; 2005. p. 1569\u20131574.","DOI":"10.1109\/ICMA.2005.1626789"},{"issue":"5\u20136","key":"1456_CR15","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1159\/000356726","volume":"37","author":"JJG Meil\u00e1n","year":"2014","unstructured":"Meil\u00e1n JJG, Mart\u00ednez-S\u00e1nchez F, Carro J, L\u00f3pez DE, Millian-Morell L, Arana JM. Speech in Alzheimer\u2019s disease: Can temporal and acoustic parameters discriminate dementia? Dement Geriatr Cogn Disord. 2014;37(5\u20136):327\u201334.","journal-title":"Dement Geriatr Cogn Disord"},{"issue":"1","key":"1456_CR16","first-page":"112","volume":"1","author":"A K\u00f6nig","year":"2015","unstructured":"K\u00f6nig A, Satt A, Sorin A, Hoory R, Toledo-Ronen O, Derreumaux A, Manera V, Verhey F, Aalten P, Robert PH, et al. Automatic speech analysis for the assessment of patients with predementia and Alzheimer\u2019s disease. Alzheimer\u2019s Dement Diagnosis Assess Disease Monit. 2015;1(1):112\u201324.","journal-title":"Alzheimer\u2019s Dement Diagnosis Assess Disease Monit"},{"key":"1456_CR17","doi-asserted-by":"crossref","unstructured":"Jarrold W, Peintner B, Wilkins D, Vergryi D, Richey C, Gorno-Tempini ML, Ogar J. Aided diagnosis of dementia type through computer-based analysis of spontaneous speech. In: Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality; 2014. p. 27\u201337.","DOI":"10.3115\/v1\/W14-3204"},{"issue":"s3","key":"1456_CR18","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3233\/JAD-140555","volume":"42","author":"V Rentoumi","year":"2014","unstructured":"Rentoumi V, Raoufian L, Ahmed S, de Jager CA, Garrard P. Features and machine learning classification of connected speech samples from patients with autopsy proven Alzheimer\u2019s disease with and without additional vascular pathology. J Alzheimers Dis. 2014;42(s3):3\u201317.","journal-title":"J Alzheimers Dis"},{"key":"1456_CR19","doi-asserted-by":"crossref","unstructured":"Eyigoz E, Mathur S, Santamaria M, Cecchi G, Naylor M. Linguistic markers predict onset of Alzheimer\u2019s disease. EClinicalMedicine. 2020;100583.","DOI":"10.1016\/j.eclinm.2020.100583"},{"issue":"2","key":"1456_CR20","doi-asserted-by":"publisher","first-page":"407","DOI":"10.3233\/JAD-150520","volume":"49","author":"KC Fraser","year":"2016","unstructured":"Fraser KC, Meltzer JA, Rudzicz F. Linguistic features identify Alzheimer\u2019s disease in narrative speech. J Alzheimers Dis. 2016;49(2):407\u201322.","journal-title":"J Alzheimers Dis"},{"key":"1456_CR21","doi-asserted-by":"crossref","unstructured":"Yancheva M, Rudzicz F. Vector-space topic models for detecting Alzheimer\u2019s disease. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers); 2016. p. 2337\u20132346.","DOI":"10.18653\/v1\/P16-1221"},{"key":"1456_CR22","doi-asserted-by":"crossref","unstructured":"Sirts K, Piguet O, Johnson M. Idea density for predicting Alzheimer\u2019s disease from transcribed speech. arXiv preprint arXiv:1706.04473 2017.","DOI":"10.18653\/v1\/K17-1033"},{"key":"1456_CR23","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP); 2014. p. 1532\u20131543.","DOI":"10.3115\/v1\/D14-1162"},{"key":"1456_CR24","doi-asserted-by":"crossref","unstructured":"Khodabakhsh A, Demiroglu C. Analysis of speech-based measures for detecting and monitoring Alzheimer\u2019s disease. In: Data Mining in Clinical Medicine. Springer, 2015; p. 159\u2013173","DOI":"10.1007\/978-1-4939-1985-7_11"},{"key":"1456_CR25","doi-asserted-by":"crossref","unstructured":"Weiner J, Herff C, Schultz T. Speech-based detection of Alzheimer\u2019s disease in conversational German. In: INTERSPEECH, 2016; p. 1938\u20131942.","DOI":"10.21437\/Interspeech.2016-100"},{"key":"1456_CR26","doi-asserted-by":"crossref","unstructured":"Li B, Hsu Y-T, Rudzicz F. Detecting dementia in mandarin Chinese using transfer learning from a parallel corpus. arXiv preprint arXiv:1903.00933 2019.","DOI":"10.18653\/v1\/N19-1199"},{"key":"1456_CR27","doi-asserted-by":"crossref","unstructured":"Fraser KC, Linz N, Li B, Fors KL, Rudzicz F, K\u00f6nig A, Alexandersson J, Robert P, Kokkinakis D. Multilingual prediction of Alzheimer\u2019s disease through domain adaptation and concept-based language modelling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers); 2019. p. 3659\u20133670.","DOI":"10.18653\/v1\/N19-1367"},{"key":"1456_CR28","unstructured":"Orimaye SO, Wong JS-M, Fernandez JSG. Deep-deep neural network language models for predicting mild cognitive impairment. In: BAI@ IJCAI; 2016. p. 14\u201320."},{"key":"1456_CR29","doi-asserted-by":"crossref","unstructured":"Karlekar S, Niu T, Bansal M. Detecting linguistic characteristics of Alzheimer\u2019s dementia by interpreting neural models. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol 2 (Short Papers). Association for Computational Linguistics, New Orleans, Louisiana; 2018. p. 701\u2013707","DOI":"10.18653\/v1\/N18-2110"},{"key":"1456_CR30","doi-asserted-by":"crossref","unstructured":"Fritsch J, Wankerl S, N\u00f6th E. Automatic diagnosis of Alzheimer\u2019s disease using neural network language models. In: ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE. 2019; p. 5841\u20135845","DOI":"10.1109\/ICASSP.2019.8682690"},{"key":"1456_CR31","doi-asserted-by":"publisher","first-page":"4105","DOI":"10.21437\/Interspeech.2019-1799","volume":"2019","author":"Y Pan","year":"2019","unstructured":"Pan Y, Mirheidari B, Reuber M, Venneri A, Blackburn D, Christensen H. Automatic hierarchical attention neural network for detecting ad. Proc. Interspeech. 2019;2019:4105\u20139.","journal-title":"Proc. Interspeech"},{"key":"1456_CR32","unstructured":"GLUE Benchmark. https:\/\/gluebenchmark.com\/leaderboard. Accessed 14 Mar 2020"},{"key":"1456_CR33","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I. Attention is all you need. In: Advances in Neural Information Processing Systems, 2017; p. 5998\u20136008."},{"key":"1456_CR34","first-page":"3159","volume":"33","author":"R Al-Rfou","year":"2019","unstructured":"Al-Rfou R, Choe D, Constant N, Guo M, Jones L. Character-level language modeling with deeper self-attention. Proc AAAI Conf Artif Intell. 2019;33:3159\u201366.","journal-title":"Proc AAAI Conf Artif Intell"},{"key":"1456_CR35","doi-asserted-by":"crossref","unstructured":"Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R. Transformer-xl: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860 2019.","DOI":"10.18653\/v1\/P19-1285"},{"key":"1456_CR36","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 2018."},{"key":"1456_CR37","unstructured":"Conneau A, Lample G. Cross-lingual language model pretraining. In: Advances in Neural Information Processing Systems; 2019. p. 7057\u20137067."},{"key":"1456_CR38","unstructured":"Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV. Xlnet: generalized autoregressive pretraining for language understanding. In: Advances in Neural Information Processing Systems; 2019. p. 5754\u20135764."},{"key":"1456_CR39","unstructured":"Transformers\u2014transformers 3.3.0 documentation. https:\/\/huggingface.co\/transformers\/index.html. Accessed 29 Sept 2020"},{"key":"1456_CR40","unstructured":"Zhang X, Zhao J, LeCun Y. Character-level convolutional networks for text classification. In: Advances in Neural Information Processing Systems; 2015. p. 649\u2013657."},{"issue":"11","key":"1456_CR41","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1145\/219717.219748","volume":"38","author":"GA Miller","year":"1995","unstructured":"Miller GA. Wordnet: a lexical database for English. Commun ACM. 1995;38(11):39\u201341.","journal-title":"Commun ACM"},{"key":"1456_CR42","doi-asserted-by":"crossref","unstructured":"Wang WY, Yang D. That\u2019s so annoying!!!: A lexical and frame-semantic embedding based data augmentation approach to automatic categorization of annoying behaviors using# petpeeve tweets. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing; 2015. p. 2557\u20132563.","DOI":"10.18653\/v1\/D15-1306"},{"key":"1456_CR43","doi-asserted-by":"crossref","unstructured":"Kobayashi S. Contextual augmentation: Data augmentation by words with paradigmatic relations. arXiv preprint arXiv:1805.06201 2018.","DOI":"10.18653\/v1\/N18-2072"},{"key":"1456_CR44","doi-asserted-by":"crossref","unstructured":"Wu X, Lv S, Zang L, Han J, Hu S. Conditional bert contextual augmentation. In: International Conference on Computational Science. Springer; 2019. p. 84\u201395","DOI":"10.1007\/978-3-030-22747-0_7"},{"key":"1456_CR45","unstructured":"Ma E. NLP Augmentation. https:\/\/github.com\/makcedward\/nlpaug 2019."},{"key":"1456_CR46","doi-asserted-by":"publisher","DOI":"10.4324\/9781315805672","volume-title":"The CHILDES Project: Tools for Analyzing Talk, Volume I: Transcription Format and Programs","author":"B MacWhinney","year":"2014","unstructured":"MacWhinney B. The CHILDES Project: Tools for Analyzing Talk, Volume I: Transcription Format and Programs. Psychology Press; 2014."},{"issue":"Nov","key":"1456_CR47","first-page":"2579","volume":"9","author":"LVd Maaten","year":"2008","unstructured":"Maaten LVd, Hinton G. Visualizing data using T-SNE. J Mach Learn Res. 2008;9(Nov):2579\u2013605.","journal-title":"J Mach Learn Res"},{"key":"1456_CR48","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.dadm.2018.02.004","volume":"10","author":"L Hern\u00e1ndez-Dom\u00ednguez","year":"2018","unstructured":"Hern\u00e1ndez-Dom\u00ednguez L, Ratt\u00e9 S, Sierra-Mart\u00ednez G, Roche-Bergua A. Computer-based evaluation of Alzheimer\u2019s disease and mild cognitive impairment patients during a picture description task. Alzheimer\u2019s Dement Diagnosis Assessm Disease Monit. 2018;10:260\u20138.","journal-title":"Alzheimer\u2019s Dement Diagnosis Assessm Disease Monit"},{"key":"1456_CR49","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/0022-3956(75)90026-6","volume":"12","author":"M Folstein","year":"1975","unstructured":"Folstein M, Folstein S, McHugh P. Mini-mental state: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189\u201398.","journal-title":"J Psychiatr Res"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01456-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-021-01456-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01456-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,25]],"date-time":"2024-08-25T13:49:59Z","timestamp":1724593799000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01456-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,9]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1456"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01456-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-49267\/v1","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.3.rs-49267\/v2","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.3.rs-49267\/v3","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,9]]},"assertion":[{"value":"31 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"As a data quality study based on existing and deidentified data, this work was not classified as human subjects research and did not require Institutional Review Board approval.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"92"}}