{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T16:40:52Z","timestamp":1770741652721,"version":"3.49.0"},"reference-count":93,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:p>Deception detection is a relevant ability in high stakes situations such as police interrogatories or court trials, where the outcome is highly influenced by the interviewed person behavior. With the use of specific devices, e.g. polygraph or magnetic resonance, the subject is aware of being monitored and can change his behavior, thus compromising the interrogation result. For this reason, video analysis-based methods for automatic deception detection are receiving ever increasing interest. In this paper, a deception detection approach based on RGB videos, leveraging both facial features and stacked generalization ensemble, is proposed. First, a face, which is well-known to present several meaningful cues for deception detection, is identified, aligned, and masked to build video signatures. These signatures are constructed starting from five different descriptors, which allow the system to capture both static and dynamic facial characteristics. Then, video signatures are given as input to four base-level algorithms, which are subsequently fused applying the stacked generalization technique, resulting in a more robust meta-level classifier used to predict deception. By exploiting relevant cues via specific features, the proposed system achieves improved performances on a public dataset of famous court trials, with respect to other state-of-the-art methods based on facial features, highlighting the effectiveness of the proposed method.<\/jats:p>","DOI":"10.1142\/s0129065720500689","type":"journal-article","created":{"date-parts":[[2020,9,14]],"date-time":"2020-09-14T02:59:28Z","timestamp":1600052368000},"page":"2050068","source":"Crossref","is-referenced-by-count":24,"title":["LieToMe: An Ensemble Approach for Deception Detection from Facial Cues"],"prefix":"10.1142","volume":"31","author":[{"given":"Danilo","family":"Avola","sequence":"first","affiliation":[{"name":"Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marco","family":"Cascio","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luigi","family":"Cinque","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessio","family":"Fagioli","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gian Luca","family":"Foresti","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Mathematics and Physics, University of Udine, Via delle Scienze, 33100 Udine, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2020,11,16]]},"reference":[{"key":"S0129065720500689BIB001","first-page":"1","volume":"45","author":"Luo H.","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"S0129065720500689BIB002","first-page":"1","volume-title":"Proc. IEEE Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS)","author":"Avola D.","year":"2017"},{"key":"S0129065720500689BIB003","first-page":"457","volume-title":"Proc. Int. Conf. on Image Analysis and Processing (ICIAP)","author":"Avola D.","year":"2019"},{"key":"S0129065720500689BIB004","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2016.09.001","volume":"154","author":"Leo M.","year":"2017","journal-title":"Comput. Vis. Image Understand."},{"key":"S0129065720500689BIB005","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.jbi.2018.11.012","volume":"89","author":"Avola D.","year":"2019","journal-title":"J. Biomed. Inform."},{"key":"S0129065720500689BIB006","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TAFFC.2020.3003816","author":"Avola D.","year":"2020","journal-title":"IEEE Trans. Affect. Comput."},{"issue":"7","key":"S0129065720500689BIB007","doi-asserted-by":"crossref","first-page":"1813","DOI":"10.1109\/TMM.2018.2885228","volume":"21","author":"Jelodar A. B.","year":"2019","journal-title":"IEEE Trans. Multimedia"},{"key":"S0129065720500689BIB008","first-page":"10","volume":"22","author":"Avola D.","year":"2019","journal-title":"IEEE Trans. Multimedia"},{"issue":"2","key":"S0129065720500689BIB009","doi-asserted-by":"crossref","first-page":"123","DOI":"10.3233\/ICA-180588","volume":"26","author":"Sovetkin E.","year":"2019","journal-title":"Integr. Comput.-Aid. Eng."},{"issue":"6","key":"S0129065720500689BIB010","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1007\/s10979-005-7370-z","volume":"29","author":"Davis M.","year":"2006","journal-title":"Law Human Behav."},{"issue":"1","key":"S0129065720500689BIB011","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S0140525X10001354","volume":"34","author":"von Hippel W.","year":"2011","journal-title":"Behav. Brain Sci."},{"issue":"3","key":"S0129065720500689BIB012","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1207\/s15327957pspr1003_2","volume":"10","author":"Charles J.","year":"2006","journal-title":"Personal. Soc. Psychol. Rev."},{"key":"S0129065720500689BIB013","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1016\/j.neucom.2015.02.034","volume":"160","author":"Placidi G.","year":"2015","journal-title":"Neurocomputing"},{"key":"S0129065720500689BIB014","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065719500254"},{"key":"S0129065720500689BIB015","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500112"},{"issue":"07","key":"S0129065720500689BIB016","doi-asserted-by":"crossref","first-page":"1850058","DOI":"10.1142\/S0129065718500582","volume":"29","author":"Grriz J. M.","year":"2019","journal-title":"Int. J. Neural Syst."},{"key":"S0129065720500689BIB017","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065718500156"},{"key":"S0129065720500689BIB018","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065718500405"},{"issue":"6","key":"S0129065720500689BIB019","doi-asserted-by":"crossref","first-page":"2050033","DOI":"10.1142\/S0129065720500331","volume":"30","author":"Hardiansyah I.","year":"2020","journal-title":"Int. J. Neural Syst."},{"key":"S0129065720500689BIB020","doi-asserted-by":"publisher","DOI":"10.1142\/S012906571850003X"},{"key":"S0129065720500689BIB021","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065718500132"},{"key":"S0129065720500689BIB022","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065717500423"},{"key":"S0129065720500689BIB023","volume-title":"Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage","author":"Ekman P.","year":"2009"},{"issue":"5","key":"S0129065720500689BIB024","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1177\/0146167203029005010","volume":"29","author":"Newman M. L.","year":"2003","journal-title":"Personal. Soc. Psychol. Bull."},{"key":"S0129065720500689BIB026","first-page":"59","volume-title":"Proc. ACM on International Conference on Multimodal Interaction (ICMI)","author":"P\u00e9rez-Rosas V.","year":"2015"},{"key":"S0129065720500689BIB027","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.patrec.2020.04.020","volume":"135","author":"Snchez-Junquera J.","year":"2020","journal-title":"Pattern Recogn. Lett."},{"key":"S0129065720500689BIB028","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/j.patrec.2020.08.014","volume":"138","author":"Avola D.","year":"2020","journal-title":"Pattern Recogn. Lett."},{"issue":"3","key":"S0129065720500689BIB029","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1037\/h0036006","volume":"29","author":"Ekman P.","year":"1974","journal-title":"J. Personal. Soc. Psychol."},{"key":"S0129065720500689BIB030","volume-title":"What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS)","author":"Ekman P.","year":"1997"},{"issue":"1","key":"S0129065720500689BIB031","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1196\/annals.1280.010","volume":"1000","author":"Ekman P.","year":"2003","journal-title":"Ann. New York Acad. Sci."},{"key":"S0129065720500689BIB032","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0065-2601(08)60369-X","volume":"14","author":"Zuckerman M.","year":"1981","journal-title":"Adv. Exper. Soc. Psychol."},{"key":"S0129065720500689BIB033","first-page":"1","volume-title":"Proc. Int. Conf. Distributed Smart Cameras (ICDSC)","author":"Avola D.","year":"2019"},{"key":"S0129065720500689BIB034","first-page":"1","volume-title":"Proc. Int. Conf. and Workshops on Automatic Face and Gesture Recognition (FG)","author":"Baltruaitis T.","year":"2015"},{"issue":"4","key":"S0129065720500689BIB035","doi-asserted-by":"crossref","first-page":"311","DOI":"10.3233\/ICA-190723","volume":"26","author":"Yan X.","year":"2019","journal-title":"Integr. Comput.-Aid. Eng."},{"issue":"12","key":"S0129065720500689BIB036","doi-asserted-by":"crossref","first-page":"8675","DOI":"10.1007\/s00521-019-04359-7","volume":"32","author":"Alam K. M. R.","year":"2020","journal-title":"Neural Comput. Appl."},{"issue":"2","key":"S0129065720500689BIB037","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","volume":"5","author":"Wolpert D. H.","year":"1992","journal-title":"Neural Netw."},{"key":"S0129065720500689BIB038","first-page":"1","volume-title":"Proc. IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW)","author":"Gupta V.","year":"2019"},{"key":"S0129065720500689BIB039","first-page":"1","volume-title":"Proc. IEEE Int. Conf. on e-Health Networking, Applications and Services (Healthcom)","author":"Alazrai R.","year":"2018"},{"key":"S0129065720500689BIB040","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/s41066-017-0064-3","volume":"3","author":"Lai Y.","year":"2018","journal-title":"Granul. Comput."},{"issue":"4","key":"S0129065720500689BIB041","first-page":"491","volume":"36","author":"Simpson J.","year":"2008","journal-title":"J. Amer. Acad. Psychiatry Law"},{"issue":"8","key":"S0129065720500689BIB042","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.biopsych.2005.07.040","volume":"58","author":"Kozel F. A.","year":"2005","journal-title":"Biol. Psychiatry"},{"key":"S0129065720500689BIB043","doi-asserted-by":"crossref","first-page":"594","DOI":"10.3389\/fnhum.2013.00594","volume":"7","author":"Rusconi E.","year":"2013","journal-title":"Front. Human Neurosci."},{"key":"S0129065720500689BIB044","first-page":"1","volume":"12","author":"Li F.","year":"2018","journal-title":"Front. Human Neurosci."},{"key":"S0129065720500689BIB045","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2015.00709","volume":"6","author":"Bhutta M. R.","year":"2015","journal-title":"Front. Psychol."},{"key":"S0129065720500689BIB046","first-page":"1","volume-title":"Proc. Asian Control Conference (ASCC)","author":"Bhutta M. R.","year":"2015"},{"issue":"3","key":"S0129065720500689BIB047","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1016\/j.neucom.2014.04.083","volume":"151","author":"Zhou Y.","year":"2015","journal-title":"Neurocomputing"},{"key":"S0129065720500689BIB048","doi-asserted-by":"crossref","first-page":"76527","DOI":"10.1109\/ACCESS.2018.2882917","volume":"6","author":"Xie Y.","year":"2018","journal-title":"IEEE Access"},{"key":"S0129065720500689BIB049","first-page":"24","volume-title":"Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition (FG)","author":"Bhaskaran N.","year":"2011"},{"key":"S0129065720500689BIB050","first-page":"97","volume-title":"Proc. IEEE Int. Conf. on Intelligence and Security Informatics (ISI)","author":"Proudfoot J. G.","year":"2015"},{"key":"S0129065720500689BIB051","first-page":"223","volume-title":"Proc. Int. Conf. on Advances in Computing, Communications and Informatics (ICACCI)","author":"George S.","year":"2017"},{"key":"S0129065720500689BIB052","first-page":"2519","volume-title":"Proc. Int. Conf. on Pattern Recognition (ICPR)","author":"Su L.","year":"2014"},{"key":"S0129065720500689BIB053","first-page":"33","volume-title":"Proc. Int. Conf. on Advances in Computational Tools for Engineering Applications (ACTEA)","author":"Owayjan M.","year":"2012"},{"key":"S0129065720500689BIB054","first-page":"1278","volume-title":"Proc. IEEE Int. Conf. Big Data (Big Data)","author":"Karimi H.","year":"2018"},{"issue":"5","key":"S0129065720500689BIB055","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1109\/TIFS.2016.2639344","volume":"12","author":"Abouelenien M.","year":"2017","journal-title":"IEEE Trans. Inform. Forensics Secur."},{"key":"S0129065720500689BIB056","first-page":"1","volume-title":"Proc. AAAI Conf. on Artificial Intelligence (AI)","author":"Wu Z.","year":"2018"},{"key":"S0129065720500689BIB057","first-page":"1565","volume-title":"Proc. Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW)","author":"Rill-Garca R.","year":"2019"},{"key":"S0129065720500689BIB058","first-page":"1","volume-title":"Proc. Int. Conf. on Computational Linguistics and Intelligent Text Processing (CICLing)","author":"Krishnamurthy G.","year":"2018"},{"key":"S0129065720500689BIB059","first-page":"59","volume-title":"Proc. IEEE Int. Conf. on Automatic Face Gesture Recognition (FG)","author":"Baltrusaitis T.","year":"2018"},{"key":"S0129065720500689BIB060","first-page":"296","volume-title":"Proc. Int. Workshop on Automatic Face and Gesture Recognition (FGW)","author":"Freeman W. T.","year":"1995"},{"key":"S0129065720500689BIB061","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1109\/ICPR.1994.576366","volume-title":"Proc. Int. Conf. on Pattern Recognition (ICPR)","author":"Ojala T.","year":"1994"},{"key":"S0129065720500689BIB062","first-page":"3551","volume-title":"Proc. IEEE Int. Conference on Computer Vision (ICCV)","author":"Wang H.","year":"2013"},{"issue":"6","key":"S0129065720500689BIB063","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TPAMI.2007.1110","volume":"29","author":"Zhao G.","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intelli."},{"key":"S0129065720500689BIB064","first-page":"2564","volume-title":"Proc. Int. Conf. on Computer Vision (ICCV)","author":"Rublee E.","year":"2011"},{"issue":"3","key":"S0129065720500689BIB065","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1007\/s11263-013-0636-x","volume":"105","author":"S\u00e1nchez J.","year":"2013","journal-title":"Int. J. Comput. Vis."},{"issue":"3","key":"S0129065720500689BIB066","first-page":"273","volume":"20","author":"Cortes C.","year":"1995","journal-title":"Mach. Learn."},{"issue":"1","key":"S0129065720500689BIB067","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s10994-010-5221-8","volume":"85","author":"Yu H.-F.","year":"2011","journal-title":"Mach. Learn."},{"key":"S0129065720500689BIB068","first-page":"785","volume-title":"Proc. ACM Int. Conf. on Knowledge Discovery and Data Mining (SIGKDD)","author":"Chen T.","year":"2016"},{"issue":"5","key":"S0129065720500689BIB069","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/0925-2312(91)90023-5","volume":"2","author":"Murtagh F.","year":"1991","journal-title":"Neurocomputing"},{"issue":"645","key":"S0129065720500689BIB070","first-page":"1","volume":"4","author":"Carcagn\u00ec P.","year":"2015","journal-title":"SpringerPlus"},{"issue":"12","key":"S0129065720500689BIB071","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","volume":"28","author":"Ahonen T.","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intelli."},{"issue":"1","key":"S0129065720500689BIB072","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1037\/1076-8971.13.1.1","volume":"13","author":"Sporer S. L.","year":"2007","journal-title":"Psychol. Public Policy Law"},{"key":"S0129065720500689BIB073","first-page":"1517","volume-title":"Proc. IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW)","author":"Afshar S.","year":"2016"},{"key":"S0129065720500689BIB074","first-page":"3169","volume-title":"Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)","author":"Wang H.","year":"2011"},{"issue":"6","key":"S0129065720500689BIB075","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TPAMI.2007.1110","volume":"29","author":"Zhao G.","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intelli."},{"issue":"2","key":"S0129065720500689BIB076","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/TIFS.2012.2186293","volume":"7","author":"Inan T.","year":"2012","journal-title":"IEEE Trans. Inform. Forensics Secur."},{"key":"S0129065720500689BIB077","first-page":"3811","volume-title":"Proc. AAAI Conf. on Artificial Intelligence (AI)","author":"Lu C.","year":"2015"},{"key":"S0129065720500689BIB078","first-page":"755","volume-title":"Proc. Int. Conf. Intelligent System Design and Engineering Applications (ISDEA)","author":"Li H.","year":"2013"},{"key":"S0129065720500689BIB079","first-page":"2183","volume-title":"Proc. IEEE Int. Conf. Computer Vision Workshops (ICCVW)","author":"Li J.","year":"2011"},{"key":"S0129065720500689BIB080","doi-asserted-by":"crossref","first-page":"24171","DOI":"10.1109\/ACCESS.2018.2823378","volume":"6","author":"Azzopardi G.","year":"2018","journal-title":"IEEE Access"},{"key":"S0129065720500689BIB081","first-page":"430","volume-title":"Proc. European Conf. on Computer Vision (ECCV)","author":"Rosten E.","year":"2006"},{"key":"S0129065720500689BIB082","first-page":"778","volume-title":"Proc. European Conf. Computer Vision (ECCV)","author":"Calonder M.","year":"2010"},{"key":"S0129065720500689BIB083","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1016\/j.procs.2018.07.095","volume":"133","author":"A V.","year":"2018","journal-title":"Procedia Comput. Sci."},{"issue":"2","key":"S0129065720500689BIB084","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1006\/cviu.1998.0719","volume":"73","author":"Rosin P. L.","year":"1999","journal-title":"Comput. Vis. Image Understand."},{"key":"S0129065720500689BIB085","doi-asserted-by":"crossref","first-page":"23157","DOI":"10.1109\/ACCESS.2017.2749331","volume":"5","author":"Wang H.","year":"2017","journal-title":"IEEE Access"},{"key":"S0129065720500689BIB086","first-page":"1436","volume-title":"Proc. Int. Conf. on Pattern Recognition (ICPR)","author":"Martnez-Daz Y.","year":"2016"},{"issue":"4","key":"S0129065720500689BIB087","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1109\/TAFFC.2017.2667642","volume":"9","author":"Li X.","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"issue":"5","key":"S0129065720500689BIB088","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MIS.2005.85","volume":"20","author":"Meservy T. O.","year":"2005","journal-title":"IEEE Intelli. Syst."},{"key":"S0129065720500689BIB089","first-page":"3883","volume-title":"Proc. Int. Conf. on Energy, Communication, Data Analytics and Soft Computing (ICECDS)","author":"Vanlalhruaia","year":"2017"},{"key":"S0129065720500689BIB090","first-page":"1","volume-title":"Proc. Int. Green and Sustainable Computing Conf. (IGSC)","author":"Yang J.","year":"2019"},{"key":"S0129065720500689BIB091","doi-asserted-by":"crossref","first-page":"1175","DOI":"10.1016\/j.procs.2017.05.025","volume":"108","author":"Tarnowski P.","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"S0129065720500689BIB092","first-page":"51","volume-title":"Proc. Scientific Conf. of Electrical Engineering (SCEE)","author":"Thannoon H. H.","year":"2018"},{"key":"S0129065720500689BIB093","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2018.01672","volume":"9","author":"Burgoon J. K.","year":"2018","journal-title":"Front. Psychol."},{"issue":"1","key":"S0129065720500689BIB094","first-page":"1","volume":"33","author":"Rokach L.","year":"2010","journal-title":"Artifi. Intelli. Rev."}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065720500689","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T03:06:43Z","timestamp":1668740803000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0129065720500689"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,16]]},"references-count":93,"journal-issue":{"issue":"02","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["10.1142\/S0129065720500689"],"URL":"https:\/\/doi.org\/10.1142\/s0129065720500689","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,16]]}}}