{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T00:50:38Z","timestamp":1761094238332,"version":"build-2065373602"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,10,27]]},"DOI":"10.1145\/3728424.3760767","type":"proceedings-article","created":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:17:42Z","timestamp":1761059862000},"page":"20-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Generate, Align and Predict (GAP): Detecting Neurocognitive Disorders via Cross-modal Consistency in Narratives"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2428-9702","authenticated-orcid":false,"given":"Junan","family":"Li","sequence":"first","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong SAR, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-1204-5094","authenticated-orcid":false,"given":"Jinchao","family":"Li","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong SAR, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4818-1467","authenticated-orcid":false,"given":"Ka Ho","family":"Wong","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong SAR, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9543-1572","authenticated-orcid":false,"given":"Xixin","family":"Wu","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong SAR, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4427-3532","authenticated-orcid":false,"given":"Helen","family":"Meng","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong, Hong Kong SAR, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,26]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"APA et al. 2013. Diagnostic and statistical manual of mental disorders (DSM-5\u00ae). American Psychiatric Association (APA)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Perminder S Sachdev Deborah Blacker Dan G Blazer Mary Ganguli Dilip V Jeste Jane S Paulsen and Ronald C Petersen. 2014. Classifying neurocognitive disorders: the DSM-5 approach. Nature Reviews Neurology.","DOI":"10.1038\/nrneurol.2014.181"},{"key":"e_1_3_2_1_3_1","unstructured":"Alzheimer's Disease International. 2024. World Alzheimer's Report 2024: Global changes in attitudes to dementia. Alzheimer's Disease International."},{"key":"e_1_3_2_1_4_1","volume-title":"Man Wai, and Helen Meng Mak.","author":"Wang Yuejiao","year":"2024","unstructured":"Yuejiao Wang, Xianmin Gong, Xixin Wu, Patrick Wong, Hoi-lam Helene Fung, Man Wai, and Helen Meng Mak. 2024. Naturalistic language-related moviewatching fmri task for detecting neurocognitive decline and disorder. ISCA ISCSLP."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Yuejiao Wang Xianmin Gong Lingwei Meng Xixin Wu and Helen Meng. 2024. Large language model-based fmri encoding of language functions for subjects with neurocognitive disorder. INTERSPEECH.","DOI":"10.21437\/Interspeech.2024-1616"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Yu Guo et al. 2024. Multiplex cerebrospinal fluid proteomics identifies biomarkers for diagnosis and prediction of alzheimer's disease. Nature Human Behaviour.","DOI":"10.1038\/s41562-024-01924-6"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3390\/jpm14010113"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2023.3254209"},{"key":"e_1_3_2_1_9_1","unstructured":"Aaron C Lim Lisa L Barnes Gali H Weissberger Melissa Lamar Annie L Nguyen Laura Fenton Jennifer Herrera and S Duke Han. 2023. Quantification of race\/ethnicity representation in alzheimer's disease neuroimaging research in the usa: a systematic review. Communications medicine."},{"key":"e_1_3_2_1_10_1","unstructured":"Walter Kintsch and Teun van Dijk. 1978. Cognitive psychology and discourse: recalling and summarizing stories. Current trends in text linguistics."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10936-005-6203-z"},{"key":"e_1_3_2_1_12_1","volume-title":"Oral narratives of personal experience","author":"Labov William","unstructured":"William Labov. 2010. Oral narratives of personal experience. Cambridge encyclopedia of the language sciences."},{"key":"e_1_3_2_1_13_1","volume-title":"Aline Carvalho Campanha, Paulo Henrique Ferreira Bertolucci, and Tha\u00eds Soares Cianciarullo Minett.","author":"De Lira Juliana Onofre","year":"2011","unstructured":"Juliana Onofre De Lira, Karin Zazo Ortiz, Aline Carvalho Campanha, Paulo Henrique Ferreira Bertolucci, and Tha\u00eds Soares Cianciarullo Minett. 2011. Microlinguistic aspects of the oral narrative in patients with alzheimer's disease. International Psychogeriatrics."},{"key":"e_1_3_2_1_14_1","volume-title":"Leandro Borges Dos Santos, Sonia Maria Dozzi Brucki, Eduardo Sturzeneker Tr\u00e9s, Maira Okada de Oliveira, and Let\u00edcia Lessa Mansur.","author":"Toledo C\u00edntia Matsuda","year":"2018","unstructured":"C\u00edntia Matsuda Toledo, Sandra Maria Alu\u00edsio, Leandro Borges Dos Santos, Sonia Maria Dozzi Brucki, Eduardo Sturzeneker Tr\u00e9s, Maira Okada de Oliveira, and Let\u00edcia Lessa Mansur. 2018. Analysis of macrolinguistic aspects of narratives from individuals with alzheimer's disease, mild cognitive impairment, and no cognitive impairment. Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring."},{"key":"e_1_3_2_1_15_1","unstructured":"Dingyi Yang and Qin Jin. 2024. What makes a good story and how can we measure it? a comprehensive survey of story evaluation. arXiv preprint arXiv:2408.14622."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1136\/jnnp.58.1.81"},{"key":"e_1_3_2_1_17_1","volume-title":"Matteo De Marco, and Annalena Venneri","year":"2023","unstructured":"LauraMWright, Matteo De Marco, and Annalena Venneri. 2023. Current understanding of verbal fluency in alzheimer's disease: evidence to date. Psychology Research and Behavior Management."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Morteza Rohanian Julian Hough and Matthew Purver. 2021. Alzheimer's dementia recognition using acoustic lexical disfluency and speech pause features robust to noisy inputs. arXiv:2106.15684.","DOI":"10.21437\/Interspeech.2021-1633"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Eric Williams Catherine Theys and Megan McAuliffe. 2023. Lexical-semantic properties of verbs and nouns used in conversation by people with alzheimer's disease. PLoS One.","DOI":"10.1371\/journal.pone.0288556"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Elaine Giles Karalyn Patterson and John R Hodges. 1996. Performance on the boston cookie theft picture description task in patients with early dementia of the alzheimer's type: missing information. Aphasiology.","DOI":"10.1080\/02687039608248419"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Katherine L Possin. 2010. Visual spatial cognition in neurodegenerative disease. Neurocase.","DOI":"10.1080\/13554791003730600"},{"key":"e_1_3_2_1_22_1","volume-title":"Leveraging pretrained representations with taskrelated keywords for alzheimer's disease detection","author":"Li Jinchao","unstructured":"Jinchao Li, Kaitao Song, Junan Li, Bo Zheng, Dongsheng Li, XixinWu, Xunying Liu, and Helen Meng. 2023. Leveraging pretrained representations with taskrelated keywords for alzheimer's disease detection. IEEE ICASSP."},{"key":"e_1_3_2_1_23_1","unstructured":"Jinchao Li* et al. 2025. Detecting neurocognitive disorders through analyses of topic evolution and cross-modal consistency in visual-stimulated narratives. In ArXiv. IEEE."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Jiahong Yuan Xingyu Cai Yuchen Bian Zheng Ye and Kenneth Church. 2021. Pauses for detection of alzheimer's disease. Frontiers in Computer Science.","DOI":"10.3389\/fcomp.2020.624488"},{"key":"e_1_3_2_1_25_1","volume-title":"A comparative study of acoustic and linguistic features classification for alzheimer's disease detection","author":"Li Jinchao","unstructured":"Jinchao Li, Jianwei Yu, Zi Ye, Simon Wong, Manwai Mak, Brian Mak, Xunying Liu, and Helen Meng. 2021. A comparative study of acoustic and linguistic features classification for alzheimer's disease detection. IEEE ICASSP."},{"key":"e_1_3_2_1_26_1","unstructured":"Rini Pl and Gayathri Ks. 2024. Cognitive decline assessment using semantic linguistic content and transformer deep learning architecture. International Journal of Language & Communication Disorders."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"M Zakaria Kurdi. 2024. Dementia detection with phonetic and phonological features. In FLAIRS.","DOI":"10.32473\/flairs.37.1.135379"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14283\/jpad.2024.132"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pragma.2020.04.014"},{"key":"e_1_3_2_1_30_1","volume-title":"Spoken Discourse Impairments in the Neurogenic Populations","author":"Pak-Hin Kong Anthony","unstructured":"Anthony Pak-Hin Kong. 2023. Spoken Discourse Impairments in the Neurogenic Populations. Springer."},{"key":"e_1_3_2_1_31_1","unstructured":"Junan Li Yunxiang Li Yuren Wang Xixin Wu and Helen Meng. 2024. Devising a set of compact and explainable spoken language feature for screening alzheimer's disease. ISCA ISCSLP."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2023.106364"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Jiawen Kang Junan Li Jinchao Li Xixin Wu and Helen Meng. 2024. Not all errors are equal: investigation of speech recognition errors in alzheimer's disease detection. ISCA ISCSLP.","DOI":"10.1109\/ISCSLP63861.2024.10800483"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Thomas Melistas Lefteris Kapelonis Nikos Antoniou Petros Mitseas Dimitris Sgouropoulos Theodoros Giannakopoulos Athanasios Katsamanis and Shrikanth Narayanan. 2023. Cross-lingual features for alzheimer's dementia detection from speech. In INTERSPEECH.","DOI":"10.21437\/Interspeech.2023-1934"},{"key":"e_1_3_2_1_35_1","volume-title":"Muhammad Raisul Alam, and Alex Mihailidis","author":"Mahboobeh","year":"2023","unstructured":"Mahboobeh (Mah) Parsapoor (Parsa), Muhammad Raisul Alam, and Alex Mihailidis. 2023. Performance of machine learning algorithms for dementia assessment: impacts of language tasks, recording media, and modalities. en-US. BMC Medical Informatics and Decision Making."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Ning Liu Zhenming Yuan Yan Chen Chuan Liu and Lingxing Wang. 2023. Learning implicit sentiments in alzheimer's disease recognition with contextual attention features. Frontiers in Aging Neuroscience.","DOI":"10.3389\/fnagi.2023.1122799"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Spyridoula Varlokosta Katerina Fragkopoulou Dimitra Arfani and Christina Manouilidou. 2024. Methodologies for assessing morphosyntactic ability in people with alzheimer's disease. International journal of language & communication disorders.","DOI":"10.1111\/1460-6984.12862"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Helen Meng et al. 2023. Integrated and enhanced pipeline system to support spoken language analytics for screening neurocognitive disorders. In INTERSPEECH.","DOI":"10.21437\/Interspeech.2023-2249"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Olga Ivanova Israel Mart\u00ednez-Nicol\u00e1s Elena Garc\u00eda-Pi\u00f1uela and Juan Jos\u00e9 G Meil\u00e1n. 2023. Defying syntactic preservation in alzheimer's disease: what type of impairment predicts syntactic change in dementia (if it does) and why? Frontiers in Language Sciences.","DOI":"10.3389\/flang.2023.1199107"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.3233\/ADR-230204"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Israel Mart\u00ednez-Nicol\u00e1s Thide E Llorente Francisco Mart\u00ednez-S\u00e1nchez and Juan Jos\u00e9 G Meil\u00e1n. 2021. Ten years of research on automatic voice and speech analysis of people with alzheimer's disease and mild cognitive impairment: a systematic review article. Frontiers in Psychology.","DOI":"10.3389\/fpsyg.2021.620251"},{"key":"e_1_3_2_1_42_1","volume-title":"Jian Sun, Farida Far Poor, Peter S Pressman, and Mohammad H Mahoor.","author":"Alsuhaibani Muath","year":"2024","unstructured":"Muath Alsuhaibani, Ali Pourramezan Fard, Jian Sun, Farida Far Poor, Peter S Pressman, and Mohammad H Mahoor. 2024. A review of deep learning approaches for non-invasive cognitive impairment detection. arXiv:2410.19898."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Veronika Vincze G\u00e1bor Gosztolya L\u00e1szl\u00f3 T\u00f3th Ildik\u00f3 Hoffmann and Gr\u00e9ta Szatl\u00f3czki. 2016. Detecting mild cognitive impairment by exploiting linguistic information from transcripts. In ACL.","DOI":"10.18653\/v1\/P16-2030"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2024.3420083"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Yixiao Li Xiaoyuan Yang Yuqing Luo Hadi Amirpour Hantao Liu and Wei Zhou. 2025. Unlocking implicit motion for evaluating image complexity. Displays 103131.","DOI":"10.1016\/j.displa.2025.103131"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Youxiang Zhu Nana Lin Xiaohui Liang John A Batsis Robert M Roth and Brian MacWhinney. 2023. Evaluating picture description speech for dementia detection using image-text alignment. arXiv preprint arXiv:2308.07933.","DOI":"10.1016\/j.csl.2021.101297"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Catarina Botelho John Mendon\u00e7a Anna Pompili Tanja Schultz Alberto Abad and Isabel Trancoso. 2024. Macro-descriptors for alzheimer's disease detection using large language models. In INTERSPEECH.","DOI":"10.21437\/Interspeech.2024-1255"},{"key":"e_1_3_2_1_48_1","volume-title":"BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation.","author":"Li Junnan","year":"2022","unstructured":"Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. (2022)."},{"key":"e_1_3_2_1_49_1","unstructured":"OpenAI. 2024. GPT-4 technical report. arXiv:2303.08774."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"crossref","unstructured":"Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084.","DOI":"10.18653\/v1\/D19-1410"}],"event":{"name":"MM '25:The 33rd ACM International Conference on Multimedia","location":"Dublin Ireland","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 2nd International Workshop on Multimedia Computing for Health and Medicine"],"original-title":[],"deposited":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:17:59Z","timestamp":1761059879000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728424.3760767"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,26]]},"references-count":50,"alternative-id":["10.1145\/3728424.3760767","10.1145\/3728424"],"URL":"https:\/\/doi.org\/10.1145\/3728424.3760767","relation":{},"subject":[],"published":{"date-parts":[[2025,10,26]]},"assertion":[{"value":"2025-10-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}