{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T07:35:52Z","timestamp":1774164952780,"version":"3.50.1"},"reference-count":39,"publisher":"Institution of Engineering and Technology (IET)","issue":"1","license":[{"start":{"date-parts":[[2024,3,2]],"date-time":"2024-03-02T00:00:00Z","timestamp":1709337600000},"content-version":"vor","delay-in-days":61,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010023","name":"Natural Science Research of Jiangsu Higher Education Institutions of China","doi-asserted-by":"publisher","award":["21KJB510022"],"award-info":[{"award-number":["21KJB510022"]}],"id":[{"id":"10.13039\/501100010023","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["ietresearch.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["IET Signal Processing"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>In the domain of lie detection, a common challenge arises from the dissimilar distributions of training and testing datasets. This causes a model mismatch, leading to a performance decline of the pretrained deep learning model. To solve this problem, we propose a lie detection technique based on a domain adversarial neural network employing a dual\u2010mode state feature. First, a deep learning neural network was used as a feature extractor to isolate speech and facial expression features exhibited by the liars. The data distributions of the source and target domain signals must be aligned. Second, a domain\u2010antagonistic transfer\u2010learning mechanism is introduced to build a neural network. The objective is to facilitate feature migration from the training to the testing domain, that is, the migration of lie\u2010related features from the source to the target domain. This method results in improved lie detection accuracy. Simulations conducted on two professional lying databases with different distributions show the superiority of the detection rate of the proposed method compared to an unimodal feature detection algorithm. The maximum improvement in detection rate was 23.3% compared to the traditional neural network\u2010based detection method. Therefore, the proposed method can learn features unrelated to domain categories, effectively mitigating the problem posed by different distributions in the training and testing of lying data.<\/jats:p>","DOI":"10.1049\/2024\/7914185","type":"journal-article","created":{"date-parts":[[2024,3,2]],"date-time":"2024-03-02T12:50:06Z","timestamp":1709383806000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Lie Detection Technology of Bimodal Feature Fusion Based on Domain Adversarial Neural Networks"],"prefix":"10.1049","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1038-7910","authenticated-orcid":false,"given":"Yan","family":"Zhou","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3761-6848","authenticated-orcid":false,"given":"Feng","family":"Bu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"265","published-online":{"date-parts":[[2024,3,2]]},"reference":[{"key":"e_1_2_9_1_2","first-page":"48","article-title":"Research and analysis of speech lie detection technology","volume":"29","author":"Zhi Y.","year":"2021","journal-title":"Guangdong Public Security Technology"},{"key":"e_1_2_9_2_2","first-page":"246","article-title":"Research status and prospects of speech lie detection technology","volume":"32","author":"Li Z.","year":"2017","journal-title":"Data Collection and Processing"},{"key":"e_1_2_9_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/mti4020025"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1587\/transfun.2020EAL2051"},{"key":"e_1_2_9_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-68133-3_10"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/08839514.2022.2034293"},{"key":"e_1_2_9_7_2","doi-asserted-by":"publisher","DOI":"10.4018\/IJITSA.316935"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-25952-7_31"},{"key":"e_1_2_9_9_2","doi-asserted-by":"publisher","DOI":"10.1037\/xap0000102"},{"key":"e_1_2_9_10_2","doi-asserted-by":"crossref","unstructured":"DaiJ. SunL. andShenX. Research on speech spoofing detection based on big data and machine learning 2021 2nd International Conference on Artificial Intelligence and Education (ICAIE) June 2021 Dali China IEEE 137\u2013140 https:\/\/doi.org\/10.1109\/ICAIE53562.2021.00036.","DOI":"10.1109\/ICAIE53562.2021.00036"},{"key":"e_1_2_9_11_2","first-page":"38","article-title":"A review of microexpression recognition research","volume":"57","author":"Ren Z.","year":"2021","journal-title":"Computer Engineering and Application"},{"key":"e_1_2_9_12_2","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2020.1836424"},{"key":"e_1_2_9_13_2","doi-asserted-by":"crossref","unstructured":"KarimiH. TangJ. andLiY. Toward end-to-end deception detection in videos 2018 IEEE International Conference on Big Data (Big Data) December 2018 Seattle WA USA IEEE 1278\u20131283 https:\/\/doi.org\/10.1109\/BigData.2018.8621909 2-s2.0-85062592263.","DOI":"10.1109\/BigData.2018.8621909"},{"key":"e_1_2_9_14_2","doi-asserted-by":"publisher","DOI":"10.1177\/0956797617705399"},{"key":"e_1_2_9_15_2","volume-title":"Affective Computing, Linlin, L., Translated by","author":"Picard R. W.","year":"2005"},{"key":"e_1_2_9_16_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v15i1.18065"},{"key":"e_1_2_9_17_2","doi-asserted-by":"crossref","unstructured":"LiX. DengC. WuQ. CuiR. TangJ. andZhangY. Research on polygraph technology based on ballistocardiogram signal 2020 IEEE 4th Information Technology Networking Electronic and Automation Control Conference (ITNEC) June 2020 Chongqing China IEEE 92\u201397 https:\/\/doi.org\/10.1109\/ITNEC48623.2020.9084887.","DOI":"10.1109\/ITNEC48623.2020.9084887"},{"key":"e_1_2_9_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-23793-5_8"},{"key":"e_1_2_9_19_2","volume-title":"Research on Lie Detection Technology Based on Speech and Radar Dual Sensors","author":"Li X.","year":"2021"},{"key":"e_1_2_9_20_2","doi-asserted-by":"crossref","unstructured":"MathurL.andMatari\u0107M. J. Affect-aware deep belief network representations for multimodal unsupervised deception detection 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021) December 2021 IEEE 1\u20138 https:\/\/doi.org\/10.1109\/FG52635.2021.9667050.","DOI":"10.1109\/FG52635.2021.9667050"},{"key":"e_1_2_9_21_2","doi-asserted-by":"publisher","DOI":"10.11772\/j.issn.1001-9081.2019071183"},{"key":"e_1_2_9_22_2","doi-asserted-by":"crossref","unstructured":"SrivastavaN.andDubeyS. Deception detection using artificial neural network and support vector machine 2018 Second International Conference on Electronics Communication and Aerospace Technology (ICECA) March 2018 Coimbatore India IEEE 1205\u20131208 https:\/\/doi.org\/10.1109\/ICECA.2018.8474706 2-s2.0-85060879266.","DOI":"10.1109\/ICECA.2018.8474706"},{"key":"e_1_2_9_23_2","first-page":"214","article-title":"Deception detection with spectral features based on deep belief network","volume":"44","author":"Xie Y.","year":"2019","journal-title":"Journal of Acoustics"},{"key":"e_1_2_9_24_2","first-page":"556","article-title":"Multi feature noncontact lie detection technology","volume":"46","author":"Jiangping W.","year":"2020","journal-title":"Jounal of East China University of Science Technology"},{"key":"e_1_2_9_25_2","first-page":"155","article-title":"Speech pressure lie detection based on speech sentiment analysis system","volume":"45","author":"Yadong C.","year":"2020","journal-title":"Criminal Technology"},{"key":"e_1_2_9_26_2","first-page":"2150","article-title":"Intelligent diagnosis method for insulation defects in small sample GIS based on domain adversarial transfer convolutional neural network","volume":"37","author":"Yanxin W.","year":"2022","journal-title":"Journal of Electrical Engineering-Elektrotechnicky Casopis"},{"key":"e_1_2_9_27_2","first-page":"32","article-title":"Modulation recognition algorithm based on multimodal domain adversarial neural networks","volume":"37","author":"Qiang X.","year":"2021","journal-title":"Aerosp Electron Countermeasures"},{"key":"e_1_2_9_28_2","first-page":"69","article-title":"Modulation classification method based on domain adaptive neural networks","volume":"21","author":"Yunhao S.","year":"2020","journal-title":"Journal of Air Force Engineering University (Natural Science Edition)"},{"key":"e_1_2_9_29_2","unstructured":"Zhihao Research on single channel speech enhancement method based on prior information at different semantic levels 2020 Harbin Institute of Technology Ph.D. Dissertation."},{"key":"e_1_2_9_30_2","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-RosasV. AbouelenienM. MihalceaR. andBurzoM. Deception detection using real-life trial data Proceedings of the 2015 ACM on International Conference on Multimodal Interaction November 2015 Association for Computing Machinery 59\u201366 https:\/\/doi.org\/10.1145\/2818346.2820758 2-s2.0-84959258855.","DOI":"10.1145\/2818346.2820758"},{"key":"e_1_2_9_31_2","volume-title":"Research on Lie Detection Based on Speech Sparse Representation","author":"Zhou Y.","year":"2017"},{"key":"e_1_2_9_32_2","first-page":"556","article-title":"Multi feature non-contact lie detection technology","volume":"46","author":"Wei J.","year":"2020","journal-title":"Journal of East China University of Science and Technology: Natural Science Edition"},{"key":"e_1_2_9_33_2","first-page":"2096","article-title":"Domain-adversarial training of neural networks","volume":"17","author":"Ganin Y.","year":"2016","journal-title":"The Journal of Machine Learning Research"},{"key":"e_1_2_9_34_2","doi-asserted-by":"crossref","unstructured":"HannunA. LeeA. XuQ. andCollobertR. Sequence-to-sequence speech recognition with time-depth separable convolutions 2019 https:\/\/doi.org\/10.48550\/arXiv.1904.02619.","DOI":"10.21437\/Interspeech.2019-2460"},{"key":"e_1_2_9_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106419"},{"key":"e_1_2_9_36_2","doi-asserted-by":"crossref","unstructured":"RubinsteinR. FaktorT. andEladM. K-SVD dictionary-learning for the analysis sparse model 2012 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP) March 2012 Kyoto Japan IEEE 5405\u20135408 https:\/\/doi.org\/10.1109\/ICASSP.2012.6289143 2-s2.0-84867617562.","DOI":"10.1109\/ICASSP.2012.6289143"},{"key":"e_1_2_9_37_2","first-page":"337","article-title":"Multimodal emotion recognition integrating speech, EEG, and facial expressions","volume":"32","author":"Fang W.","year":"2023","journal-title":"Computer System Applications"},{"key":"e_1_2_9_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04603-0"},{"key":"e_1_2_9_39_2","doi-asserted-by":"publisher","DOI":"10.3390\/app12125878"}],"container-title":["IET Signal Processing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/ietsp\/2024\/7914185.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/ietsp\/2024\/7914185.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/ietresearch.onlinelibrary.wiley.com\/doi\/pdf\/10.1049\/2024\/7914185","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T16:53:50Z","timestamp":1762361630000},"score":1,"resource":{"primary":{"URL":"https:\/\/ietresearch.onlinelibrary.wiley.com\/doi\/10.1049\/2024\/7914185"}},"subtitle":[],"editor":[{"given":"Wanli","family":"Wen","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1049\/2024\/7914185"],"URL":"https:\/\/doi.org\/10.1049\/2024\/7914185","archive":["Portico"],"relation":{},"ISSN":["1751-9675","1751-9683"],"issn-type":[{"value":"1751-9675","type":"print"},{"value":"1751-9683","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2023-08-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"7914185"}}