{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T04:26:33Z","timestamp":1787199993375,"version":"build-2736575974"},"reference-count":30,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T00:00:00Z","timestamp":1787011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011789","name":"Jilin Province Science and Technology Department","doi-asserted-by":"crossref","award":["20240401082YY"],"award-info":[{"award-number":["20240401082YY"]}],"id":[{"id":"10.13039\/501100011789","id-type":"DOI","asserted-by":"crossref"}]},{"award":["20240401082YY"],"award-info":[{"award-number":["20240401082YY"]}],"id":[{"id":"https:\/\/ror.org\/049x38272","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010211","name":"Department of Education of Jilin Province","doi-asserted-by":"crossref","award":["20240401082YY"],"award-info":[{"award-number":["20240401082YY"]}],"id":[{"id":"10.13039\/501100010211","id-type":"DOI","asserted-by":"crossref"}]},{"award":["20240401082YY"],"award-info":[{"award-number":["20240401082YY"]}],"id":[{"id":"https:\/\/ror.org\/05782e512","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In natural language understanding, intent recognition plays a central role in human\u2013computer interaction. However, in elderly-care scenarios, acoustic signals are often affected by atypical speech patterns, slower speaking rates, and environmental noise, making audio information less reliable and reducing the effectiveness of conventional text\u2013audio fusion methods. To address this problem, we propose a prompt-guided and quality-aware text\u2013audio intent recognition framework. Specifically, a \u03c72-based intent prototype soft prompt is introduced to enhance the semantic representation of text. Then, a residual-free text-guided cross-attention module is designed to refine degraded acoustic features using textual semantics as reliable guidance. In addition, a dynamic fusion gate is developed to adjust the contributions of text and audio based on modality reliability and intent-related information. Experiments on the MIntRec dataset with simulated acoustic degradation show that the proposed model achieves 60.90% accuracy, 60.80% weighted F1, and 57.90% macro-F1, outperforming several competitive baselines. These results indicate that the proposed framework can improve the robustness of intent recognition under challenging acoustic conditions in elderly-oriented interaction scenarios.<\/jats:p>","DOI":"10.3390\/s26165233","type":"journal-article","created":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T16:12:11Z","timestamp":1787069531000},"page":"5233","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Prompt-Guided and Quality-Aware Robust Text\u2013Audio Intent Recognition Framework for Elderly Care"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-6497-6662","authenticated-orcid":false,"given":"Zhimin","family":"Wei","sequence":"first","affiliation":[{"name":"College of Mechanical Engineering, Beihua University, Jilin 132021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuhao","family":"Tian","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Beihua University, Jilin 132021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanzhen","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Beihua University, Jilin 132021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7310-544X","authenticated-orcid":false,"given":"Yao","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Beihua University, Jilin 132021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0934-6046","authenticated-orcid":false,"given":"Xiaolong","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Beihua University, Jilin 132021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianyong","family":"Li","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Beihua University, Jilin 132021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MRA.2025.3543957","article-title":"Natural multimodal fusion-based human\u2013robot interaction: Application with voice and deictic posture via large language model","volume":"33","author":"Lai","year":"2025","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhou, T.H., Li, D., Jian, Z., Ding, W., and Wang, L. (2025). Home Robot Interaction Based on EEG Motor Imagery and Visual Perception Fusion. Sensors, 25.","DOI":"10.3390\/s25175568"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ran, Z., Chen, Y., Jiang, Q., and E, K. (2024, January 27\u201329). Intent Recognition in Dialogue Systems. Proceedings of the 4th Asia-Pacific Artificial Intelligence and Big Data Forum, Ganzhou, China.","DOI":"10.1145\/3718491.3718520"},{"key":"ref_4","first-page":"731","article-title":"An intent recognition pipeline for conversational AI","volume":"16","author":"Chandrakala","year":"2024","journal-title":"Int. J. Inf. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhu, Y., and Lu, H. (2025). New Method for Intent Recognition Based on Audio and Text Multimodality. Proceedings of the 2025 2nd International Conference on Intelligent Computing and Robotics (ICICR), IEEE.","DOI":"10.1109\/ICICR65456.2025.00113"},{"key":"ref_6","unstructured":"Lu, J., Batra, D., Parikh, D., and Lee, S. (2019). Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"110537","DOI":"10.1016\/j.sigpro.2026.110537","article-title":"SaliText: A Multimodal Intent Recognition Method with Saliency and Text-Guided Fusion","volume":"244","author":"Li","year":"2026","journal-title":"Signal Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1007\/s10489-025-06583-2","article-title":"Multimodal intent recognition based on text-guided cross-modal attention","volume":"55","author":"Li","year":"2025","journal-title":"Appl. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"10209","DOI":"10.1007\/s00521-019-04559-1","article-title":"Gated multimodal networks","volume":"32","author":"Arevalo","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_10","unstructured":"Hu, B., Zhang, K., Zhang, Y., and Ye, Y. (March, January 25). Adaptive multimodal fusion: Dynamic attention allocation for intent recognition. Proceedings of the AAAI Conference on Artificial Intelligence, Philadelphia, PN, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Han, W., Chen, H., and Poria, S. (2021, January 7\u201311). Improving multimodal fusion with hierarchical mutual information maximization for multimodal sentiment analysis. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.723"},{"key":"ref_12","unstructured":"Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., and Dean, J. (2017). Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lester, B., Al-Rfou, R., and Constant, N. (2021, January 7\u201311). The power of scale for parameter-efficient prompt tuning. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.243"},{"key":"ref_14","first-page":"99","article-title":"Signal quality index-based dynamic weighted fusion method for multimodal respiratory rate estimation","volume":"43","author":"Wenzhe","year":"2026","journal-title":"Chin. J. Med. Phys."},{"key":"ref_15","first-page":"18661","article-title":"Supervised contrastive learning","volume":"33","author":"Khosla","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_16","unstructured":"Tsai, Y.-H.H., Bai, S., Liang, P.P., Kolter, J.Z., Morency, L.-P., and Salakhutdinov, R. (August, January 28). Multimodal transformer for unaligned multimodal language sequences. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1016\/j.icte.2025.08.005","article-title":"Leveraging dynamic feature fusion of self & cross-attention for robust multimodal emotion recognition","volume":"12","author":"Kim","year":"2025","journal-title":"ICT Express"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Trick, S., Koert, D., Peters, J., and Rothkopf, C.A. (2019). Multimodal uncertainty reduction for intention recognition in human-robot interaction. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.","DOI":"10.1109\/IROS40897.2019.8968171"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Maharana, A., Tran, Q.H., Dernoncourt, F., Yoon, S., Bui, T., Chang, W., and Bansal, M. (2022, January 10\u201315). Multimodal intent discovery from livestream videos. Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, USA.","DOI":"10.18653\/v1\/2022.findings-naacl.36"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, H., Xu, H., Wang, X., Zhou, Q., Zhao, S., and Teng, J. (2022, January 10\u201314). Mintrec: A new dataset for multimodal intent recognition. Proceedings of the 30th ACM International Conference on Multimedia, Lisbon, Portugal.","DOI":"10.1145\/3503161.3547906"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"103881","DOI":"10.1016\/j.inffus.2025.103881","article-title":"Large multimodal model-based intent prompting learning for multimedia recommendation","volume":"127","author":"Jian","year":"2026","journal-title":"Inf. Fusion"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sun, K., Xie, Z., Ye, M., and Zhang, H. (2024, January 17\u201321). Contextual augmented global contrast for multimodal intent recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.02546"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"127631","DOI":"10.1016\/j.eswa.2025.127631","article-title":"MGC: A modal mapping coupling and gate-driven contrastive learning approach for multimodal intent recognition","volume":"281","author":"Wang","year":"2025","journal-title":"Expert Syst. Appl."},{"key":"ref_24","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv."},{"key":"ref_25","first-page":"12449","article-title":"wav2vec 2.0: A framework for self-supervised learning of speech representations","volume":"33","author":"Baevski","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ko, T., Peddinti, V., Povey, D., and Khudanpur, S. (2015, January 6\u201310). Audio augmentation for speech recognition. Proceedings of the Interspeech, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-711"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Park, D.S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E.D., and Le, Q.V. (2019). Specaugment: A simple data augmentation method for automatic speech recognition. arXiv.","DOI":"10.21437\/Interspeech.2019-2680"},{"key":"ref_28","first-page":"423","article-title":"Multimodal machine learning: A survey and taxonomy","volume":"41","author":"Ahuja","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s00530-010-0182-0","article-title":"Multimodal fusion for multimedia analysis: A survey","volume":"16","author":"Atrey","year":"2010","journal-title":"Multimed. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rahman, W., Hasan, M.K., Lee, S., Zadeh, A.B., Mao, C., Morency, L.-P., and Hoque, E. (2020, January 5\u201310). Integrating multimodal information in large pretrained transformers. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Seattle, WA, USA.","DOI":"10.18653\/v1\/2020.acl-main.214"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/16\/5233\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T04:20:08Z","timestamp":1787199608000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/16\/5233"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,18]]},"references-count":30,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["s26165233"],"URL":"https:\/\/doi.org\/10.3390\/s26165233","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,18]]}}}