{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T17:21:35Z","timestamp":1771003295607,"version":"3.50.1"},"reference-count":18,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T00:00:00Z","timestamp":1731369600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"Hangzhou Office of the Leading Group for Philosophy and Social Science Planning","award":["Z23YD011"],"award-info":[{"award-number":["Z23YD011"]}]},{"name":"Zhejiang Federation of Humanities and Social Sciences Circles","award":["2024B083"],"award-info":[{"award-number":["2024B083"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Computational Methods in Sciences and Engineering"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:p>Focused on the digital preservation and inheritance of dialects, this study illustrates the construction pathway of a digitised multimodal dialect corpus and the application of a dialect interactive learning model using the digital twin technology, taking the Hangzhou dialect as a representative. Initially, multimodal resources of the Hangzhou dialect were collected, and with the aid of digital techniques, these resources underwent annotation, segmentation, transcription, and synchronisation, culminating in the creation of the multimodal dialect corpus. Subsequently, features were extracted using Natural Language Processing (NLP) methodologies from deep learning, facilitating the construction of a Hangzhou dialect lexicon. With the annotated corpus as the foundation, combined with Feedforward Sequential Memory Networks (FSMN) and Long Short-Term Memory (LSTM) networks, acoustic and linguistic models for the Hangzhou dialect were developed, laying the groundwork for a Hangzhou dialect speech recognition system. Conclusively, by integrating digital twin technology, an autonomous dialect inheritance learning model was crafted. This model establishes a twin learning space and learning twin entity founded on auditory, visual, and tactile multimodal information. Utilising virtual reality technology, a dialect learning ecological model was designed to enhance learner agency, offering diverse learning modalities and personalised content, with the overarching goal of supporting the preservation and inheritance of dialects.<\/jats:p>","DOI":"10.1177\/14727978241299701","type":"journal-article","created":{"date-parts":[[2025,4,29]],"date-time":"2025-04-29T03:15:24Z","timestamp":1745896524000},"page":"1448-1460","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Construction of a multimodal dialect corpus based on deep learning and digital twin technology: A case study on the Hangzhou dialect"],"prefix":"10.1177","volume":"25","author":[{"given":"Yanxia","family":"Zhao","sequence":"first","affiliation":[{"name":"School of International Studies, Zhejiang Business College, Hangzhou, China"}]},{"given":"Yuhan","family":"Ding","sequence":"additional","affiliation":[{"name":"School of Humanities, Hangzhou Normal University, Hangzhou, China"}]},{"given":"Xue","family":"Min","sequence":"additional","affiliation":[{"name":"School of E-Commerce, Zhejiang Business College, Hangzhou, China"}]}],"member":"179","published-online":{"date-parts":[[2024,11,12]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1177\/00145858231190030"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.25162\/zdl-2019-0010"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3364098"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3062752"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/5365915"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1515\/EUJAL-2022-0032"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.29333\/IJI.2021.14155A"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.NEUROIMAGE.2022.119734"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/S00521-021-06754-5"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.IJHCS.2023.103136"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1187\/5\/052020"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3317236"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-022-13054-0"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","unstructured":"Oines A Weinstein E Moreno P. Hybrid LSTM-FSMN networks for acoustic modeling. In 2018 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP) Calgary AB Canada 2018 pp. 5844\u20135848. DOI: 10.1109\/ICASSP.2018.8461563.","DOI":"10.1109\/ICASSP.2018.8461563"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0218271822500948"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.ESWA.2023.121921"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2023.032290"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/9308188"}],"container-title":["Journal of Computational Methods in Sciences and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14727978241299701","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/14727978241299701","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14727978241299701","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T16:31:51Z","timestamp":1771000311000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/14727978241299701"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,12]]},"references-count":18,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10.1177\/14727978241299701"],"URL":"https:\/\/doi.org\/10.1177\/14727978241299701","relation":{},"ISSN":["1472-7978","1875-8983"],"issn-type":[{"value":"1472-7978","type":"print"},{"value":"1875-8983","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,12]]}}}