{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:08:49Z","timestamp":1753884529402,"version":"3.41.2"},"reference-count":20,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","funder":[{"name":"The \u201cQing Lan Project\u201d of colleges and universities in Jiangsu province"},{"name":"The Seventh Batch of Science and Technology Development Plan (Agriculture) Project of Suzhou","award":["SNG2023007"],"award-info":[{"award-number":["SNG2023007"]}]},{"name":"The Research Project on Higher Education Teaching Reform in Jiangsu Province","award":["2021JSJG176"],"award-info":[{"award-number":["2021JSJG176"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2025,1,15]]},"abstract":"<jats:p> Lying state detection is a typical psychological calculation problem with significant spatiotemporal dynamic changes. However, most existing detection methods have not fully considered the dynamic changes in psychological states, and the distribution information of time series in multimodal spaces has not effectively utilized. The current detection systems lack adaptive fusion methods for multimodal features and it is difficult to extract their spatiotemporal dependencies. Therefore, a novel speech lie detection model was proposed that combines a Convolutional Neural Network (CNN) with a Bidirectional Long Short-Term Memory (BiLSTM) neural network and multimodal feature fusion of Spatiotemporal Attention Mechanism (SAM). CNN has the ability to extract local spatial features, while BiLSTM can handle long sequences and long-term dependencies in bidirectional information flows, and the contextual information in sequences can be captured. The proposed model combined the short-term stationary characteristics in time and the diversity of semantic environments in space, and introduced SAM to fuse multimodal features of temporal and spatial dependencies as feature vectors for the detection model of lying psychological states. The simulation experiment results on the Open-source Real Life Trial lie database show that the average lie detection rate reaches 88.09%. In general, the proposed speech lie detection model has a significant detection accuracy improvement compared to the existing lie detection models. <\/jats:p>","DOI":"10.1142\/s0218126625500318","type":"journal-article","created":{"date-parts":[[2024,8,11]],"date-time":"2024-08-11T03:45:57Z","timestamp":1723347957000},"source":"Crossref","is-referenced-by-count":0,"title":["Research on CNN-BiLSTM-SAM and Multimodal Feature Fusion for Speech Lie Detection"],"prefix":"10.1142","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1038-7910","authenticated-orcid":false,"given":"Yan","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Electronics and Information Engineering, Suzhou Vocational University, Jiangsu, Suzhou 215104, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4219-4790","authenticated-orcid":false,"given":"Xinyu","family":"Pan","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Suzhou University of Science and Technology, Jiangsu, Suzhou 215009, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3761-6848","authenticated-orcid":false,"given":"Feng","family":"Bu","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Suzhou Vocational University, Jiangsu, Suzhou 215104, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2024,9,16]]},"reference":[{"key":"S0218126625500318BIB001","doi-asserted-by":"publisher","DOI":"10.1007\/BF00998267"},{"key":"S0218126625500318BIB003","doi-asserted-by":"publisher","DOI":"10.1109\/UEMCON51285.2020.9298117"},{"key":"S0218126625500318BIB005","first-page":"214","volume":"2","author":"Xie Y.","year":"2019","journal-title":"J. Acoust."},{"key":"S0218126625500318BIB006","first-page":"589","volume":"40","author":"Fu H. L.","year":"2020","journal-title":"Comput. Appl."},{"key":"S0218126625500318BIB007","first-page":"87","volume":"13396","author":"Krishnamurthy G.","year":"2023","journal-title":"Int. Conf. Comput. Linguistics Intell. Text Process."},{"key":"S0218126625500318BIB008","doi-asserted-by":"publisher","DOI":"10.3390\/mti4020025"},{"key":"S0218126625500318BIB009","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2820758"},{"key":"S0218126625500318BIB010","first-page":"556","volume":"46","author":"Wei J. P.","year":"2020","journal-title":"J. East China Univ. Sci. Technol."},{"key":"S0218126625500318BIB011","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v15i1.18065"},{"key":"S0218126625500318BIB013","first-page":"32","volume":"37","author":"Xu Q.","year":"2021","journal-title":"Aerosp. Electron Countermeasures"},{"key":"S0218126625500318BIB014","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2020.1836424"},{"key":"S0218126625500318BIB016","doi-asserted-by":"publisher","DOI":"10.3390\/app12125878"},{"key":"S0218126625500318BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106419"},{"key":"S0218126625500318BIB018","doi-asserted-by":"publisher","DOI":"10.1109\/FG52635.2021.9667050"},{"key":"S0218126625500318BIB019","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04603-0"},{"key":"S0218126625500318BIB020","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33018287"},{"key":"S0218126625500318BIB023","first-page":"589","volume":"40","author":"Fu H.","year":"2020","journal-title":"Comput. Appl."},{"key":"S0218126625500318BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8621909"},{"key":"S0218126625500318BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2023.3278668"},{"key":"S0218126625500318BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2024.3387293"}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126625500318","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,22]],"date-time":"2025-01-22T02:46:10Z","timestamp":1737513970000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218126625500318"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,16]]},"references-count":20,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2025,1,15]]}},"alternative-id":["10.1142\/S0218126625500318"],"URL":"https:\/\/doi.org\/10.1142\/s0218126625500318","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"type":"print","value":"0218-1266"},{"type":"electronic","value":"1793-6454"}],"subject":[],"published":{"date-parts":[[2024,9,16]]},"article-number":"2550031"}}