{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T16:11:55Z","timestamp":1783527115397,"version":"3.55.0"},"reference-count":23,"publisher":"World Scientific Pub Co Pte Ltd","issue":"08","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2026,6,30]]},"abstract":"<jats:p>The study introduces cross-modal memory-enhanced fusion (CrossMF) as a unified transformer-based model which performs emotion recognition from speech and text data. CrossMF combines dynamic attention between modalities with a memory enhancement system for effective fusion between textual and acoustic information. The training of CrossMF involves a two-step tactic where the acoustic encoder receives clean audio inputs from the Toronto emotional speech set (TESS) for optimization, yet the text encoder and fusion module acquire training from audio-text pairs from the multimodal EmotionLines (MELD) dataset. The system allows emotion predictions from three combination types, including audio-only, text-only, and audio with text inputs, due to adjustable modality access. The evaluation process takes place across the three different input scenarios to show that the system performs well with high generalization capability in both laboratory-recorded and natural conversational conditions. Fusion between multiple sources only occurs when both inputs are available so that integrity can be maintained until integration occurs. The model reaches a maximum validation accuracy of 97.68% while demonstrating sustained high-test performance, which proves its effectiveness when operated in various conditions without depending on manually created features. The architecture also supports future extensions, allowing developers to easily incorporate ablation studies and adaptive training strategies for real-world emotion-aware systems.<\/jats:p>","DOI":"10.1142\/s0218001426500072","type":"journal-article","created":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T07:22:17Z","timestamp":1770880937000},"source":"Crossref","is-referenced-by-count":2,"title":["CrossMF: A Memory-Augmented Transformer for Fast and Generalizable Emotion Recognition"],"prefix":"10.1142","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3900-1900","authenticated-orcid":false,"given":"N. S. Koti Mani","family":"Kumar Tirumanadham","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Sir C. R. Reddy College of Engineering, Eluru, Andhra Pradesh, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7458-5908","authenticated-orcid":false,"given":"S.","family":"Phani Praveen","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, PVP Siddhartha Institute of Technology, Kanuru, Vijayawada, Andhra Pradesh, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2543-342X","authenticated-orcid":false,"given":"V.","family":"Esther Jyothi","sequence":"additional","affiliation":[{"name":"Department of Computer Applications, Siddhartha Academy of Higher Education (Deemed to be University), Vijayawada, Andhra Pradesh, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0528-8459","authenticated-orcid":false,"given":"Balamuralikrishna","family":"Thati","sequence":"additional","affiliation":[{"name":"Department of IT, DVR & Dr. HS MIC College of Technology, Kanchikacherla, Andhra Pradesh, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8556-5734","authenticated-orcid":false,"given":"B. N.","family":"Swamy","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, PVP Siddhartha Institute of Technology, Kanuru, Vijayawada, Andhra Pradesh, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1488-7696","authenticated-orcid":false,"given":"Deshinta","family":"Arrora Dewi","sequence":"additional","affiliation":[{"name":"Center for Data Science and Sustainable Technologies, INTI International University, Nilai, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2026,3,28]]},"reference":[{"key":"S0218001426500072BIB001","doi-asserted-by":"publisher","DOI":"10.1109\/APSIPAASC47483.2019.9023098"},{"key":"S0218001426500072BIB002","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/2645381"},{"key":"S0218001426500072BIB003","doi-asserted-by":"crossref","unstructured":"R. Cowie\n                      et al\n                      ., Emotion recognition in human-computer interaction,\n                      IEEE Signal Process. Mag.\n                      \u00a0\n                      18\n                      (1) (2001) 32\u201380, https:\/\/doi.org\/10.1109\/79.911197.","DOI":"10.1109\/79.911197"},{"key":"S0218001426500072BIB004","doi-asserted-by":"publisher","DOI":"10.3390\/s20030592"},{"key":"S0218001426500072BIB005","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2024.106201"},{"key":"S0218001426500072BIB006","doi-asserted-by":"publisher","DOI":"10.1186\/s40359-024-01581-4"},{"key":"S0218001426500072BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3380847"},{"key":"S0218001426500072BIB008","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2024.123735"},{"key":"S0218001426500072BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP48485.2024.10446891"},{"key":"S0218001426500072BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2024.3369130"},{"key":"S0218001426500072BIB011","doi-asserted-by":"publisher","DOI":"10.3390\/app14104199"},{"key":"S0218001426500072BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2024.3445325"},{"key":"S0218001426500072BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/ICAMechS63130.2024.10818817"},{"key":"S0218001426500072BIB014","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2024.10.266"},{"issue":"8","key":"S0218001426500072BIB015","volume":"14","author":"Praveen S. P.","year":"2023","journal-title":"Int. J. Adv. Comput. Sci. Appl"},{"key":"S0218001426500072BIB016","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-25293-w"},{"key":"S0218001426500072BIB017","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph20065140"},{"issue":"8","key":"S0218001426500072BIB018","first-page":"5429","volume":"16","author":"Tirumanadham N. S. K. M. K.","year":"2024","journal-title":"Int. J. Inf. Technol."},{"key":"S0218001426500072BIB019","doi-asserted-by":"publisher","DOI":"10.48084\/etasr.6004"},{"key":"S0218001426500072BIB020","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.121692"},{"key":"S0218001426500072BIB021","doi-asserted-by":"publisher","DOI":"10.3390\/electronics13163262"},{"key":"S0218001426500072BIB022","unstructured":"https:\/\/www.kaggle.com\/datasets\/ejlok1\/toronto-emotional-speech-set-tess."},{"key":"S0218001426500072BIB023","unstructured":"https:\/\/www.kaggle.com\/datasets\/zaber666\/meld-dataset."}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001426500072","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T02:53:16Z","timestamp":1776912796000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218001426500072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,28]]},"references-count":23,"journal-issue":{"issue":"08","published-print":{"date-parts":[[2026,6,30]]}},"alternative-id":["10.1142\/S0218001426500072"],"URL":"https:\/\/doi.org\/10.1142\/s0218001426500072","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"value":"0218-0014","type":"print"},{"value":"1793-6381","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,28]]},"article-number":"2650007"}}