{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T07:12:28Z","timestamp":1784099548811,"version":"3.55.0"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"22","license":[{"start":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T00:00:00Z","timestamp":1694044800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T00:00:00Z","timestamp":1694044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["NRF-2017M3A9E1064781"],"award-info":[{"award-number":["NRF-2017M3A9E1064781"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["NRF-2021M3E5D2A01022397"],"award-info":[{"award-number":["NRF-2021M3E5D2A01022397"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Polygraphs are used in criminal interrogations to detect deception. However, polygraphs can be difficult to administer under circumstances that prevent the use of biosensors. To address the shortcomings of the biosensors, deception-detection technology without biosensors is needed. We propose a deception-detection method, FacialCueNet, which is a multi-modal network that utilizes both facial images and facial cues based on deep-learning technology. FacialCueNet incorporates facial cues that indicate deception, such as action-unit frequency, symmetry, gaze pattern, and micro-expressions extracted from videos. Additionally, the spatial-temporal attention module, based on convolutional neural network and convolutional long short-term memory, is applied to FacialCueNet to provide interpretable information from interrogations. Because our goal was developing an algorithm applicable to criminal interrogations, we trained and evaluated FacialCueNet using the DDCIT dataset, which was collected using a data acquisition protocol similar to those used in actual investigations. To compare deception-detection performance with state-of-the-art works, a public dataset was also used. As a result, the mean deception-detection F1 score using the DDCIT dataset was 81.22%, with an accuracy of 70.79%, recall of 0.9476, and precision of 0.7107. When evaluating against the public database, our method demonstrated an evaluation accuracy of 88.45% and achieved an AUC of 0.9541, indicating a improvement of 1.25% compared to the previous results. We also present interpretive results of deception detection by analyzing the influence of spatial and temporal factors. These results show that FacialCueNet has the potential to detect deception using only facial videos. By providing interpretation of predictions, our system could be useful tool for criminal interrogation.<\/jats:p>","DOI":"10.1007\/s10489-023-04968-9","type":"journal-article","created":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T09:02:06Z","timestamp":1694077326000},"page":"27413-27427","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["FacialCueNet: unmasking deception - an interpretable model for criminal interrogation using facial expressions"],"prefix":"10.1007","volume":"53","author":[{"given":"Borum","family":"Nam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joo Young","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beomjun","family":"Bark","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yeongmyeong","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiyoon","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soon Won","family":"So","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyung Youn","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9580-7074","authenticated-orcid":false,"given":"In Young","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,9,7]]},"reference":[{"issue":"2","key":"4968_CR1","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1177\/0261927X14528804","volume":"34","author":"KB Serota","year":"2015","unstructured":"Serota KB, Levine TR (2015) A few prolific liars: Variation in the prevalence of lying. J Lang Soc Psychol 34(2):138\u2013157","journal-title":"J Lang Soc Psychol"},{"key":"4968_CR2","doi-asserted-by":"crossref","unstructured":"Abd SH, Hashim IA, Jalal ASA (2021) Automated deception detection systems, a review. Iraqi J Sci 70\u201380","DOI":"10.24996\/ijs.2021.SI.2.8"},{"key":"4968_CR3","doi-asserted-by":"crossref","unstructured":"Speth J, Vance N, Czajka A, Bowyer KW, Wright D, Flynn P (2021) Deception detection and remote physiologicalmonitoring: A dataset and baseline experimen- tal results. In: 2021 IEEE International Joint Conference on Biometrics (IJCB). IEEE, pp 1\u20138","DOI":"10.1109\/IJCB52358.2021.9484409"},{"key":"4968_CR4","unstructured":"Matsumoto D, Hwang HS, Skinner L, Frank M (2011) Evaluating truthfulness and detecting deception. FBI L. Enforcement Bull. 80:1"},{"key":"4968_CR5","doi-asserted-by":"crossref","unstructured":"Kircher JC, Raskin DC (2019) Polygraph techniques: History, controversies, and prospects. Psychol Soc Pol 295\u2013308","DOI":"10.4324\/9781315793030-23"},{"issue":"1","key":"4968_CR6","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1177\/009318530903700107","volume":"37","author":"JA Lewis","year":"2009","unstructured":"Lewis JA, Cuppari M (2009) The polygraph: The truth lies within. The Journal of Psychiatry & Law 37(1):85\u201392","journal-title":"The Journal of Psychiatry & Law"},{"issue":"1","key":"4968_CR7","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1348\/135532509X433151","volume":"15","author":"S Porter","year":"2010","unstructured":"Porter S, Brinke L (2010) The truth about lies: What works in detecting high-stakes deception? Legal Criminol Psychol 15(1):57\u201375","journal-title":"Legal Criminol Psychol"},{"issue":"10","key":"4968_CR8","doi-asserted-by":"crossref","first-page":"120","DOI":"10.3390\/jimaging4100120","volume":"4","author":"D Borza","year":"2018","unstructured":"Borza D, Itu R, Danescu R (2018) In the eye of the deceiver: Analyzing eye movements as a cue to deception. J Imaging 4(10):120","journal-title":"J Imaging"},{"key":"4968_CR9","doi-asserted-by":"crossref","unstructured":"Karimi H, Tang J, Li Y (2018) Toward end-to-end deception detection in videos. In: 2018 IEEE International Conference on Big Data (Big Data). IEEE, pp 1278\u20131283","DOI":"10.1109\/BigData.2018.8621909"},{"issue":"3","key":"4968_CR10","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TCDS.2021.3086011","volume":"14","author":"M Karnati","year":"2021","unstructured":"Karnati M, Seal A, Yazidi A, Krejcar O (2021) Lienet: A deep convolution neural network framework for detecting deception. IEEE Trans Cogn Dev Syst 14(3):971\u2013984","journal-title":"IEEE Trans Cogn Dev Syst"},{"key":"4968_CR11","unstructured":"Ding M, Zhao A, Lu Z, Xiang T, Wen J-R Face-focused cross-stream network for deception detection in videos. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 7802\u20137811"},{"issue":"1","key":"4968_CR12","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1109\/TAFFC.2020.3015684","volume":"13","author":"MU \u015een","year":"2020","unstructured":"\u015een MU, Perez-Rosas V, Yanikoglu B, Abouelenien M, Burzo M, Mihalcea R (2020) Multimodal deception detection using real-life trial data. IEEE Trans Affect Comput 13(1):306\u2013319","journal-title":"IEEE Trans Affect Comput"},{"issue":"02","key":"4968_CR13","doi-asserted-by":"crossref","first-page":"2050068","DOI":"10.1142\/S0129065720500689","volume":"31","author":"D Avola","year":"2021","unstructured":"Avola D, Cascio M, Cinque L, Fagioli A, Foresti GL (2021) Lietome: An ensemble approach for deception detection from facial cues. Int J Neural Syst 31(02):2050068","journal-title":"Int J Neural Syst"},{"key":"4968_CR14","doi-asserted-by":"crossref","first-page":"78925","DOI":"10.1109\/ACCESS.2021.3084200","volume":"9","author":"SV Fernandes","year":"2021","unstructured":"Fernandes SV, Ullah MS (2021) Use of machine learning for deception detection from spectral and cepstral features of speech signals. IEEE Access 9:78925\u201378935","journal-title":"IEEE Access"},{"key":"4968_CR15","doi-asserted-by":"crossref","unstructured":"Sanaullah M, Gopalan K (2013) Deception detection in speech using bark band and perceptually significant energy features. In: 2013 IEEE 56th International Mid- west Symposium on Circuits and Systems (MWSCAS). IEEE, pp 1212\u20131215","DOI":"10.1109\/MWSCAS.2013.6674872"},{"issue":"2","key":"4968_CR16","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1348\/1355325041719356","volume":"9","author":"A Vrij","year":"2004","unstructured":"Vrij A (2004) Why professionals fail to catch liars and how they can improve. Legal Criminol Psychol 9(2):159\u2013181","journal-title":"Legal Criminol Psychol"},{"key":"4968_CR17","volume-title":"The Validity and Reliability of Polygraph Testing","author":"N Ansley","year":"1997","unstructured":"Ansley N (1997) The Validity and Reliability of Polygraph Testing. Forensic Research Incorporated, Maryland"},{"issue":"3","key":"4968_CR18","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/BF01044774","volume":"16","author":"CR Honts","year":"1992","unstructured":"Honts CR, Perry MV (1992) Polygraph admissibility: Changes and challenges. Law and Human Behavior 16(3):357","journal-title":"Law and Human Behavior"},{"issue":"1","key":"4968_CR19","first-page":"40","volume":"20","author":"DL Faigman","year":"2003","unstructured":"Faigman DL, Fienberg SE, Stern PC (2003) The limits of the polygraph. Issues Sci Technol 20(1):40\u201346","journal-title":"Issues Sci Technol"},{"issue":"2","key":"4968_CR20","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1037\/h0041593","volume":"58","author":"L Festinger","year":"1959","unstructured":"Festinger L, Carlsmith JM (1959) Cognitive consequences of forced compliance. J Abnorm Soc Psychol 58(2):203","journal-title":"J Abnorm Soc Psychol"},{"key":"4968_CR21","unstructured":"Cash CS (2014) Think about your heart: The effects of cognitive dissonance on cardiovascular functioning. PhD thesis, The Ohio State University"},{"key":"4968_CR22","doi-asserted-by":"crossref","unstructured":"Ngo LM, Wang W, Mandira B, Karaoglu S, Bouma H, Dibeklioglu H, Gevers T (2021) Identity unbiased deception detection by 2d-to-3d face reconstruc- tion. In: Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, pp 145\u2013154","DOI":"10.1109\/WACV48630.2021.00019"},{"key":"4968_CR23","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1609\/icwsm.v15i1.18065","volume":"15","author":"S Kumar","year":"2021","unstructured":"Kumar S, Bai C, Subrahmanian V, Leskovec J (2021) Deception detection in group video conversations using dynamic interaction networks. Proceedings of the International AAAI Conference on Web and Social Media 15:339\u2013350","journal-title":"Proceedings of the International AAAI Conference on Web and Social Media"},{"key":"4968_CR24","doi-asserted-by":"crossref","unstructured":"Yap MH, Rajoub B, Ugail H, Zwiggelaar R (2011) Visual cues of facial behaviour in deception detection. In: 2011 IEEE International Conference on Computer Applications and Industrial Electronics (ICCAIE). IEEE, pp 294\u2013299","DOI":"10.1109\/ICCAIE.2011.6162148"},{"key":"4968_CR25","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511975196","volume-title":"Memory Detection: Theory and Application of the Concealed Information Test","author":"B Verschuere","year":"2011","unstructured":"Verschuere B, Ben-Shakhar G, Meijer E (2011) Memory Detection: Theory and Application of the Concealed Information Test. Cambridge University Press, Cambridge"},{"issue":"5","key":"4968_CR26","first-page":"4237","volume":"3","author":"D Matsumoto","year":"2008","unstructured":"Matsumoto D, Ekman P (2008) Facial expression analysis. Scholarpedia 3(5):4237","journal-title":"Facial expression analysis. Scholarpedia"},{"key":"4968_CR27","doi-asserted-by":"crossref","unstructured":"Feldman RS, Jenkins L, Popoola O (1979) Detection of deception in adults and children via facial expressions. Child Dev 350\u2013355","DOI":"10.2307\/1129409"},{"issue":"1","key":"4968_CR28","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/S0005-7894(85)80057-5","volume":"16","author":"MG Dow","year":"1985","unstructured":"Dow MG (1985) Peer validation and idiographic analysis of social skill deficits. Behavior Therapy 16(1):76\u201386","journal-title":"Behavior Therapy"},{"issue":"10","key":"4968_CR29","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1016\/S0005-7967(98)00069-2","volume":"36","author":"T Fydrich","year":"1998","unstructured":"Fydrich T, Chambless DL, Perry KJ, Buergener F, Beazley MB (1998) Behav- ioral assessment of social performance: A rating system for social phobia. Behaviour Research Therapy 36(10):995\u20131010","journal-title":"Behaviour Research Therapy"},{"issue":"6","key":"4968_CR30","doi-asserted-by":"crossref","first-page":"1441","DOI":"10.1037\/0022-3514.83.6.1441","volume":"83","author":"B Egloff","year":"2002","unstructured":"Egloff B, Schmukle SC (2002) Predictive validity of an implicit association test for assessing anxiety. J Pers Soc Psychol 83(6):1441","journal-title":"J Pers Soc Psychol"},{"key":"4968_CR31","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s10919-013-0159-8","volume":"37","author":"W-J Yan","year":"2013","unstructured":"Yan W-J, Wu Q, Liang J, Chen Y-H, Fu X (2013) How fast are the leaked facial expressions: The duration of micro-expressions. J Nonverbal Behav 37:217\u2013230","journal-title":"J Nonverbal Behav"},{"issue":"2","key":"4968_CR32","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1017\/S0048577299971664","volume":"36","author":"MS Bartlett","year":"1999","unstructured":"Bartlett MS, Hager JC, Ekman P, Sejnowski TJ (1999) Measuring facial expres- sions by computer image analysis. Psychophysiol 36(2):253\u2013263","journal-title":"Psychophysiol"},{"key":"4968_CR33","volume-title":"Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage","author":"P Ekman","year":"2009","unstructured":"Ekman P (2009) Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage, revised. WW Norton & Company, New York","edition":"revised"},{"issue":"1","key":"4968_CR34","first-page":"83","volume":"7","author":"RB Graber","year":"1981","unstructured":"Graber RB (1981) Ekman: The face of man: Expressions of universal emotions in a new guinea village. Stud Vis Commun 7(1):83\u201385","journal-title":"Stud Vis Commun"},{"key":"4968_CR35","doi-asserted-by":"crossref","unstructured":"Yap MH, Ugail H, Zwiggelaar R (2013) A database for facial behavioural analysis. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG). IEEE, pp 1\u20136","DOI":"10.1109\/FG.2013.6553803"},{"issue":"1","key":"4968_CR36","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.ijpsycho.2013.03.003","volume":"88","author":"J Peth","year":"2013","unstructured":"Peth J, Kim JS, Gamer M (2013) Fixations and eye-blinks allow for detecting con- cealed crime related memories. Int J Psychophysiol 88(1):96\u2013103","journal-title":"Int J Psychophysiol"},{"key":"4968_CR37","doi-asserted-by":"crossref","unstructured":"Ekman P, Friesen WV (1978) Facial action coding system. Environmental Psychol- ogy & Nonverbal Behavior","DOI":"10.1037\/t27734-000"},{"issue":"1","key":"4968_CR38","doi-asserted-by":"crossref","first-page":"78","DOI":"10.4103\/0972-6748.196048","volume":"25","author":"A Mondal","year":"2016","unstructured":"Mondal A, Mukhopadhyay P, Basu N, Bandyopadhyay SK, Chatterjee T (2016) Quantitative analysis of euclidean distance to complement qualitative analysis of facial expression during deception. Ind Psychiatry J 25(1):78","journal-title":"Ind Psychiatry J"},{"issue":"6","key":"4968_CR39","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1111\/j.1469-8986.1972.tb00767.x","volume":"9","author":"RJ Cutrow","year":"1972","unstructured":"Cutrow RJ, Parks A, Lucas N, Thomas K (1972) The objective use of multiple physiological indices in the detection of deception. Psychophysiol 9(6):578\u2013588","journal-title":"Psychophysiol"},{"key":"4968_CR40","doi-asserted-by":"crossref","first-page":"736","DOI":"10.3389\/fpsyg.2013.00736","volume":"4","author":"FM Marchak","year":"2013","unstructured":"Marchak FM (2013) Detecting false intent using eye blink measures. Front Psychol 4:736","journal-title":"Front Psychol"},{"key":"4968_CR41","unstructured":"Rauch EH (2015) Cues to deception: eye blinking"},{"key":"4968_CR42","volume":"12","author":"X Shen","year":"2021","unstructured":"Shen X, Fan G, Niu C, Chen Z (2021) Catching a liar through facial expression of fear. Front Psychol 12:675097","journal-title":"Front Psychol"},{"issue":"2","key":"4968_CR43","first-page":"5","volume":"1","author":"P Ekman","year":"2009","unstructured":"Ekman P (2009) Lie catching and microexpressions. The Philosophy of Deception 1(2):5","journal-title":"The Philosophy of Deception"},{"issue":"3","key":"4968_CR44","doi-asserted-by":"crossref","first-page":"984","DOI":"10.1257\/aer.100.3.984","volume":"100","author":"JT-Y Wang","year":"2010","unstructured":"Wang JT-Y, Spezio M, Camerer CF (2010) Pinocchio\u2019s pupil: using eyetracking and pupil dilation to understand truth telling and deception in sender-receiver games. Am Econ Rev 100(3):984\u20131007","journal-title":"Am Econ Rev"},{"key":"4968_CR45","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Rosas V, Abouelenien M, Mihalcea R, Burzo M (2015) Deception detec- tion using real-life trial data. In: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, pp 59\u201366","DOI":"10.1145\/2818346.2820758"},{"issue":"8","key":"4968_CR46","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Computation 9(8):1735\u20131780","journal-title":"Neural Computation"},{"issue":"14","key":"4968_CR47","doi-asserted-by":"crossref","first-page":"6393","DOI":"10.3390\/app11146393","volume":"11","author":"A Gallardo-Antol\u00edn","year":"2021","unstructured":"Gallardo-Antol\u00edn A, Montero JM (2021) Detecting deception from gaze and speech using a multimodal attention lstm-based framework. Appl Sci 11(14):6393","journal-title":"Appl Sci"},{"key":"4968_CR48","doi-asserted-by":"crossref","unstructured":"Baygin M, Tuncer I, Dogan S, Barua PD, Tuncer T, Cheong KH, Acharya UR (2023) Automated facial expression recognition using exemplar hybrid deep feature generation technique. Soft Comput 1\u201317","DOI":"10.1007\/s00500-023-08230-9"},{"key":"4968_CR49","doi-asserted-by":"crossref","unstructured":"Tuncer T, Dogan S, Subasi A (2023) Automated facial expression recognition using novel textural transformation. J Ambient Intell Humaniz Comput 1\u201315","DOI":"10.1007\/s12652-023-04612-x"},{"key":"4968_CR50","doi-asserted-by":"crossref","unstructured":"Meng L, Zhao B, Chang B, Huang G, Sun W, Tung F, Sigal L (2019) Inter- pretable spatio-temporal attention for video action recognitiona. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, pp 0\u20130","DOI":"10.1109\/ICCVW.2019.00189"},{"key":"4968_CR51","unstructured":"Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-c (2015) Convolu- tional lstm network: A machine learning approach for precipitation nowcasting. Adv Neural Inf Process Syst 28"},{"key":"4968_CR52","doi-asserted-by":"crossref","unstructured":"Rudin LI, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena 60(1\u20134):259\u2013268","DOI":"10.1016\/0167-2789(92)90242-F"},{"issue":"2","key":"4968_CR53","first-page":"20","volume":"6","author":"B Amos","year":"2016","unstructured":"Amos B, Ludwiczuk B, Satyanarayanan M et al (2016) Openface: A general- purpose face recognition library with mobile applications. CMU School Comput Sci 6(2):20","journal-title":"CMU School Comput Sci"},{"key":"4968_CR54","doi-asserted-by":"crossref","unstructured":"Beh KX, Goh KM (2019) Micro-expression spotting using facial landmarks. In: 2019 IEEE 15th International Colloquium on Signal Processing & Its Applications (CSPA). IEEE, pp 192\u2013197","DOI":"10.1109\/CSPA.2019.8696059"},{"key":"4968_CR55","volume-title":"Optimum Signal Processing: an Introduction","author":"SJ Orfanidis","year":"1988","unstructured":"Orfanidis SJ (1988) Optimum Signal Processing: an Introduction. Macmillan publish- ing company, New York"},{"key":"4968_CR56","volume-title":"Correlation functions and power spectra","author":"J Larsen","year":"2009","unstructured":"Larsen J (2009) Correlation functions and power spectra. Section for Cognitive Systems, Informatics and Mathematical Modelling"},{"key":"4968_CR57","doi-asserted-by":"crossref","unstructured":"Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 31","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"4968_CR58","doi-asserted-by":"crossref","unstructured":"Cao Q, Shen L, Xie W, Parkhi OM, Zisserman A (2018) Vggface2: A dataset for recognising faces across pose and age. In: 2018 13th IEEE International Con- ference on Automatic Face & Gesture Recognition (FG 2018). IEEE, pp 67\u201374","DOI":"10.1109\/FG.2018.00020"},{"key":"4968_CR59","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.patrec.2021.03.007","volume":"146","author":"L Schoneveld","year":"2021","unstructured":"Schoneveld L, Othmani A, Abdelkawy H (2021) Leveraging recent advances in deep learning for audio-visual emotion recognition. Pattern Recognit Lett 146:1\u20137","journal-title":"Pattern Recognit Lett"},{"key":"4968_CR60","doi-asserted-by":"crossref","unstructured":"Wu Z, Singh B, Davis L, Subrahmanian V (2018) Deception detection in videos. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 32","DOI":"10.1609\/aaai.v32i1.11502"},{"issue":"3","key":"4968_CR61","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.2466\/pms.1993.76.3.1051","volume":"76","author":"M Bradley","year":"1993","unstructured":"Bradley M, Cullen M (1993) Polygraph lie detection on real events in a laboratory setting. Perceptual and Motor Skills 76(3):1051\u20131058","journal-title":"Perceptual and Motor Skills"},{"key":"4968_CR62","unstructured":"Capps MH (1991) Predictive value of the sacrifice relevant. Polygraph 20(1):1\u20136"},{"issue":"2","key":"4968_CR63","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1037\/0021-9010.67.2.131","volume":"67","author":"A Ginton","year":"1982","unstructured":"Ginton A, Daie N, Elaad E, Ben-Shakhar G (1982) A method for evaluating the use of the polygraph in a real-life situation. J Appl Psychol 67(2):131","journal-title":"J Appl Psychol"},{"issue":"2","key":"4968_CR64","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1037\/0021-9010.74.2.347","volume":"74","author":"CJ Patrick","year":"1989","unstructured":"Patrick CJ, Iacono WG (1989) Psychopathy, threat, and polygraph test accuracy. J Appl Psychol 74(2):347","journal-title":"J Appl Psychol"},{"key":"4968_CR65","unstructured":"P\u00e9rez-Campos Mayoral E, Langer AA (2019) Devil\u2019s advocate tactic to generate rapport. Polygraph 52(5)"},{"issue":"1","key":"4968_CR66","first-page":"28","volume":"44","author":"R Nelson","year":"2015","unstructured":"Nelson R (2015) Scientific basis for polygraph testing. Polygraph 44(1):28\u201361","journal-title":"Scientific basis for polygraph testing. Polygraph"},{"key":"4968_CR67","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1007\/s11031-014-9410-9","volume":"38","author":"CM Hurley","year":"2014","unstructured":"Hurley CM, Anker AE, Frank MG, Matsumoto D, Hwang HC (2014) Back- ground factors predicting accuracy and improvement in micro expression recog- nition. Motivation and Emotion 38:700\u2013714","journal-title":"Motivation and Emotion"},{"key":"4968_CR68","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/s11031-015-9528-4","volume":"40","author":"E Svetieva","year":"2016","unstructured":"Svetieva E, Frank MG (2016) Empathy, emotion dysregulation, and enhanced microexpression recognition ability. Motivation and Emotion 40:309\u2013320","journal-title":"Motivation and Emotion"},{"key":"4968_CR69","volume":"115","author":"M Khalil","year":"2022","unstructured":"Khalil M, McGough AS, Pourmirza Z, Pazhoohesh M, Walker S (2022) Machine learning, deep learning and statistical analysis for forecasting building energy con-sumption-a systematic review. Eng Appl Art Intell 115:105287","journal-title":"Eng Appl Art Intell"},{"issue":"1","key":"4968_CR70","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/97.736233","volume":"6","author":"J Sohn","year":"1999","unstructured":"Sohn J, Kim NS, Sung W (1999) A statistical model-based voice activity detection. IEEE Signal Process Lett 6(1):1\u20133","journal-title":"IEEE Signal Process Lett"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-04968-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-023-04968-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-04968-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T15:21:10Z","timestamp":1698247270000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-023-04968-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,7]]},"references-count":70,"journal-issue":{"issue":"22","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["4968"],"URL":"https:\/\/doi.org\/10.1007\/s10489-023-04968-9","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,7]]},"assertion":[{"value":"13 August 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 September 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"For the use of the Real-life Trial Dataset dataset, this study was reviewed and approved by the institutional review board of Hanyang University (HYU-2019-01-006-4), and the requirement for informed consent was waived. Also, we collected dataset according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of the Hanyang University (HYU-2019-01-006-4).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"The manuscript has not been sent to any other journal for publication.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}