{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:46:27Z","timestamp":1760132787963,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T00:00:00Z","timestamp":1697414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSFC","award":["6276085","21YCXL20","2023AH052179"],"award-info":[{"award-number":["6276085","21YCXL20","2023AH052179"]}]},{"name":"Hefei University","award":["6276085","21YCXL20","2023AH052179"],"award-info":[{"award-number":["6276085","21YCXL20","2023AH052179"]}]},{"name":"Anhui University Research Project of China","award":["6276085","21YCXL20","2023AH052179"],"award-info":[{"award-number":["6276085","21YCXL20","2023AH052179"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>As globalization accelerates, the linguistic diversity and semantic complexity of in-vehicle communication is increasing. In order to meet the needs of different language speakers, this paper proposes an interactive attention-based contrastive learning framework (IABCL) for the field of in-vehicle dialogue, aiming to effectively enhance cross-lingual natural language understanding (NLU). The proposed framework aims to address the challenges of cross-lingual interaction in in-vehicle dialogue systems and provide an effective solution. IABCL is based on a contrastive learning and attention mechanism. First, contrastive learning is applied in the encoder stage. Positive and negative samples are used to allow the model to learn different linguistic expressions of similar meanings. Its main role is to improve the cross-lingual learning ability of the model. Second, the attention mechanism is applied in the decoder stage. By articulating slots and intents with each other, it allows the model to learn the relationship between the two, thus improving the ability of natural language understanding in languages of the same language family. In addition, this paper constructed a multilingual in-vehicle dialogue (MIvD) dataset for experimental evaluation to demonstrate the effectiveness and accuracy of the IABCL framework in cross-lingual dialogue. With the framework studied in this paper, IABCL improves by 2.42% in intent, 1.43% in slot, and 2.67% in overall when compared with the latest model.<\/jats:p>","DOI":"10.3390\/s23208501","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T08:25:09Z","timestamp":1697531109000},"page":"8501","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An Interactive Framework of Cross-Lingual NLU for In-Vehicle Dialogue"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3806-3993","authenticated-orcid":false,"given":"Xinlu","family":"Li","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence and Big Data, Hefei University, Hefei 230061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liangkuan","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Big Data, Hefei University, Hefei 230061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lexuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Big Data, Hefei University, Hefei 230061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pei","family":"Cao","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Big Data, Hefei University, Hefei 230061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1109\/TSE.2011.103","article-title":"A systematic literature review on fault prediction performance in software engineering","volume":"38","author":"Hall","year":"2011","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_2","first-page":"46","article-title":"Design and analysis of dialogue based on vehicle","volume":"1","author":"Liu","year":"2023","journal-title":"Veh. Electr. Appl."},{"key":"ref_3","unstructured":"Zhang, L. (2021). Research and Application of Vehicle-Mounted Human-Computer Interface Interaction Design for Voice Interaction, Beijing University of Posts and Telecommunications. (In Chinese)."},{"key":"ref_4","unstructured":"Du, Z. (2019). Research on dialogue System of Vehicle HUD Based on Gesture Recognition, Hebei University of Science and Technology. (In Chinese)."},{"key":"ref_5","first-page":"72","article-title":"Dialogue system of vehicle touch control","volume":"2","author":"Gao","year":"2012","journal-title":"Instrum. Technol. Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Khalil, T. (2019, January 3\u20137). Cross-lingual intent classification in a low resource industrial setting. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1676"},{"key":"ref_7","unstructured":"Arora, A. (September, January 15). Cross-lingual transfer learning for intent detection of COVID-19 utterances. Proceedings of the Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020, Online."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gerz, D., Su, P.-H., Kusztos, R., Mondal, A., Lis, M., Singhal, E., Mrk\u0161i\u0107, N., Wen, T.-H., and Vuli\u0107, I. (2021, January 7\u201311). Multilingual and Cross-Lingual Intent Detection from Spoken Data. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online.","DOI":"10.18653\/v1\/2021.emnlp-main.591"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, Z., Winata, G.I., Lin, Z., Xu, P., and Fung, P. (2020, January 7\u201312). Attention-informed mixed-language training for zero-shot cross-lingual task-oriented dialogue systems. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6362"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xu, W., Haider, B., and Mansour, S. (2020). End-to-End Slot Alignment and Recognition for Cross-Lingual NLU. arXiv.","DOI":"10.18653\/v1\/2020.emnlp-main.410"},{"key":"ref_11","unstructured":"FitzGerald, J.G. (2020). STIL-Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qin, L. (2020). Cosda-ml: Multi-lingual code-switching data augmentation for zero-shot cross-lingual nlp. arXiv.","DOI":"10.24963\/ijcai.2020\/533"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Qin, L., Chen, Q., and Xie, T. (2022). GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding. arXiv.","DOI":"10.18653\/v1\/2022.acl-long.191"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yang, B. (2018). Design and Implementation of Vehicle Speech Control System Based on Oral Comprehension by Rules and Statistical Methods, Hebei University of Science and Technology. (In Chinese).","DOI":"10.1109\/CAC.2018.8623325"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rafiepour, M., and Sartakhti, J.S. (2023). CTRAN: CNN-Transformer-based Network for NLU. arXiv.","DOI":"10.1016\/j.engappai.2023.107013"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1613\/jair.1.11640","article-title":"A survey of cross-lingual word embedding models","volume":"65","author":"Ruder","year":"2019","journal-title":"J. Artif. Intell. Res."},{"key":"ref_17","first-page":"26","article-title":"Research progress of transfer learning","volume":"26","author":"Zhuang","year":"2014","journal-title":"J. Softw. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lefevre, F., Mairesse, F., and Young, S. (2010, January 26\u201330). Cross-lingual spoken language understanding from unaligned data using discriminative classification models and machine translation. Proceedings of the Eleventh Annual Conference of the International Speech Communication Association, Chiba, Japan.","DOI":"10.21437\/Interspeech.2010-38"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Adams, O. (2017, January 3\u20137). Cross-lingual word embeddings for low-resource language modeling. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, Valencia, Spain.","DOI":"10.18653\/v1\/E17-1088"},{"key":"ref_20","unstructured":"Johnson, A. (2019, January 2\u20137). Cross-lingual transfer learning for Japanese named entity recognition. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Industry Papers), Minneapolis, MN, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Y. (2018, January 2\u20136). Cross-Lingual Multi-Task Neural Architecture for Spoken Language Understanding. Proceedings of the Interspeech, Hyderabad, India.","DOI":"10.21437\/Interspeech.2018-1039"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Schuster, S., Gupta, S., Shah, R., and Lewis, M. (2019, January 2\u20137). Cross-lingual transfer learning for multilingual task-oriented dialog. Proceedings of Annual Conference of the North American Chapter of the Association for Computational Linguistics, Minneapolis, MN, USA.","DOI":"10.18653\/v1\/N19-1380"},{"key":"ref_23","unstructured":"Zhang, X., and Wang, H. (2016, January 9\u201315). A joint model of intent determination slot filling for spoken language understanding. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Shen, Y., and Jin, H. (2018). A bi-model based on semantic frame parsing model for intent detection and slot filling. arXiv.","DOI":"10.18653\/v1\/N18-2050"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, B., and Lane, I. (2016, January 8\u201312). Attention-based recurrent neural network models for joint intent detection and slot filling. Proceedings of the Interspeech, San Francisco, CA, USA.","DOI":"10.21437\/Interspeech.2016-1352"},{"key":"ref_26","unstructured":"Chen, Q., Zhuo, Z., and Wang, W. (2019). Bert for joint intent classification and slot filling. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhou, P., Huang, Z., Liu, F., and Zou, Y. (2021, January 10\u201315). PIN: A novel parallel interactive network for spoken language understanding. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9411948"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qin, L. (2021, January 6\u201311). A co-interactive transformer for joint slot filling and intent detection. Proceedings of the ICASSP 2021\u20132021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9414110"},{"key":"ref_29","first-page":"15","article-title":"Summary of deep comparative learning","volume":"49","author":"Zhang","year":"2023","journal-title":"Acta Autom. Sin."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qin, L. (2021). A survey on spoken language understanding: Recent advances and new frontiers. arXiv.","DOI":"10.24963\/ijcai.2021\/622"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Krishnan, J., Anastasopoulos, A., Purohit, H., and Rangwala, H. (2021, January 11). Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling. Proceedings of the 1st Workshop on Multilingual Representation Learning, Online.","DOI":"10.18653\/v1\/2021.mrl-1.18"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liang, S. (2022, January 7\u201311). Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.","DOI":"10.18653\/v1\/2022.emnlp-main.673"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8501\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:07:55Z","timestamp":1760130475000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8501"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,16]]},"references-count":32,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208501"],"URL":"https:\/\/doi.org\/10.3390\/s23208501","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,10,16]]}}}