{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T15:49:33Z","timestamp":1753890573148,"version":"3.41.2"},"reference-count":51,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T00:00:00Z","timestamp":1690934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>This article considers how computer vision can be enlisted for biomedical applications, specifically the measurement, data analytics and treatment of psychiatric disorders. Often, youngsters are too afraid or embarrassed to disclose their emotional and mental problems to human therapists. An AI system can be utilized not only to collect data in a non-threatening ongoing manner and record patient's temporal psychophysiological state but also to analyze and output the periodic results, it may be an efficient and effective means for therapists to plan treatments. We report on various tools for analyzing social kinesic signals for emotional and physiological states. Only one, AVATAR (and its predecessor SPECIES), both records a patient's state and also outputs an analysis that flags problem areas for therapists. In this way, automated tools can augment human observation and judgment.<\/jats:p>","DOI":"10.3389\/fcomp.2023.1168712","type":"journal-article","created":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T11:20:40Z","timestamp":1690975240000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The future of automated capture of social kinesic signals for psychiatric purposes"],"prefix":"10.3389","volume":"5","author":[{"given":"Judee K.","family":"Burgoon","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron C.","family":"Elkins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Douglas","family":"Derrick","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bradley","family":"Walls","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitris","family":"Metaxas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,8,2]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","DOI":"10.1109\/WACV.2016.7477553","article-title":"\u201cOpenface: An Opensource facial behavior analysis toolkit,\u201d","author":"Baltru\u0161aitis","year":"2016","journal-title":"2016 IEEE Winter Conference on Applications of Computer Vision (WACV)"},{"key":"B2","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1609\/icwsm.v5i1.14160","article-title":"You are known by how you vlog: personality impressions and nonverbal behavior in YouTube","volume":"5","author":"Biel","year":"2011","journal-title":"Proceedings of the International AAAI Conference on Web and Social Media."},{"key":"B3","article-title":"\u201cInteractive deception in group decision-making: New insights from communication pattern analysis,\u201d","author":"Burgoon","year":"2015","journal-title":"Discovering Hidden Temporal Patterns in Behavior and Interaction: T-Pattern Detection and Analysis with THEME."},{"journal-title":"The Psychology of trust from Relational Messages.","year":"","author":"Burgoon","key":"B4"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1017\/9781316676202","author":"Burgoon","year":"2017","journal-title":"Social Signal Processing."},{"journal-title":"Nonverbal Communication.","year":"","author":"Burgoon","key":"B6"},{"key":"B7","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s10726-012-9302-x","volume":"22","author":"Burgoon","year":"2013","journal-title":"Detecting deception in collaboration and negotiation. Group Decision and Negotiation."},{"key":"B8","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.patrec.2016.12.006","article-title":"Gaze-based biometrics: an introduction to forensic applications","volume":"113","author":"Cantoni","year":"2018","journal-title":"Pattern Recognit. Letters"},{"key":"B9","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.cortex.2021.07.005","article-title":"Neurophysiological indicators of internal attention: an fMRI\u2013eye-tracking coregistration study","volume":"143","author":"Ceh","year":"2021","journal-title":"Cortex"},{"journal-title":"Special-Purpose, Embodied Conversational Intelligence with Environmental Sensors (SPECIES) Agents: Implemented in an Automated Interviewing Kiosk","year":"2011","author":"Derrick","key":"B10"},{"key":"B11","first-page":"7802","article-title":"\u201cFace-focused cross-stream network for deception detection in videos,\u201d","author":"Ding","year":"2019","journal-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"journal-title":"New Methods to Examine Nonverbal Synchrony in dyads. Understanding Social Behavior in Dyadic and Small Group Interactions","year":"2022","author":"Dunbar","key":"B12"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fpsyg.2013.00140","article-title":"Exploring the movement dynamics of deception","volume":"4","author":"Duran","year":"2013","journal-title":"Front. Psychol."},{"key":"B14","first-page":"1","author":"Elkins","year":"2014","journal-title":"Apprising the AVATAR for Automated Border Control: Results of a European Union Field Test of AVATAR Systems for Interviewing and Passport Control [Technical]."},{"key":"B15","doi-asserted-by":"publisher","first-page":"249","DOI":"10.2753\/MIS0742-1222290409","article-title":"Are users threatened by credibility assessment systems?","volume":"29","author":"Elkins","year":"2013","journal-title":"J. Manage. Info. Syst."},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1166(199604)11:4andlt","article-title":"Neuropsychiatric applications of CANTAB","author":"Fray","year":"1996","journal-title":"Int. J. Geriatr. Psychiatr"},{"journal-title":"Frames of Mind: The Theory of Multiple Intelligences.","year":"2011","author":"Gardner","key":"B17"},{"key":"B18","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1080\/14789940412331337353","article-title":"Lie detection and the Polygraph: a historical review","volume":"16","author":"Grubin","year":"2005","journal-title":"J. Foren. Psychiatr. Psychol."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.3233\/978-1-61499-625-5-316","article-title":"The modern lie detector: AI-powered affect screening and the Employee Polygraph Protection Act (EPPA)","author":"Hinkle","year":"2020","journal-title":"Georgetown Law J."},{"key":"B20","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1109\/TAFFC.2019.2930058","article-title":"First impressions: a survey on vision-based apparent personality trait analysis","volume":"13","author":"Jacques Junior","year":"2022","journal-title":"IEEE Trans. Aff. Comput."},{"key":"B21","doi-asserted-by":"publisher","first-page":"790","DOI":"10.1109\/TMM.2010.2065218","volume":"12","author":"Jayagopi","year":"2010","journal-title":"models. IEEE Trans. Multimedia"},{"journal-title":"The Timeline Toolkit: Temporal Methods for Crime Research","year":"2020","author":"Keatley","key":"B22"},{"key":"B23","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1177\/1555343412446308","article-title":"Using eye-based psychophysiological cues to enhance screener vigilance","volume":"7","author":"Langhals","year":"2013","journal-title":"J. Cognit. Eng. Decision Making"},{"key":"B24","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1016\/j.chb.2014.04.043","article-title":"It's only a computer: virtual humans increase willingness to disclose","volume":"37","author":"Lucas","year":"2014","journal-title":"Computers in Human Behav."},{"key":"B25","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1027\/1015-5759.12.2.112","article-title":"Hidden real-time patterns in intra- and inter-individual behavior: description and detection","volume":"12","author":"Magnusson","year":"1996","journal-title":"Eur. J. Psychol. Assess."},{"key":"B26","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4939-3249-8","author":"Magnusson","year":"2016","journal-title":"Discovering Hidden Temporal Patterns in Behavior and Interaction: T-pattern Detection and Analysis With THEME"},{"key":"B27","article-title":"\u201cAutomatic extraction of deceptive behavioral cues from video,\u201d","author":"Meservy","year":"","journal-title":"Intelligence and Security Informatics: Proceedings of the Third Symposium on Intelligence and Security"},{"key":"B28","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1109\/MIS.2005.85","article-title":"Deception detection through automatic, unobtrusive analysis of nonverbal behavior","volume":"20","author":"Meservy","year":"","journal-title":"IEEE Int. Syst."},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1145\/3234507","article-title":"Wearables and social signal processing for smarter public presentations","author":"Mihoub","year":"2019","journal-title":"ACM Trans. Interact. Intell. Syst."},{"key":"B30","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1007\/s10979-005-8122-9","article-title":"Racial bias in mock juror decision-making: a meta-analytic review of defendant treatment","volume":"29","author":"Mitchell","year":"2005","journal-title":"Law Hum. Behav."},{"journal-title":"Polygraph and Lie Detection","year":"2003","key":"B31"},{"key":"B32","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1007\/s10919-022-00410-9","article-title":"Naming signatures of perceived interpersonal synchrony","volume":"46","author":"Novotny","year":"2022","journal-title":"J. Nonverb. Behav."},{"key":"B33","doi-asserted-by":"publisher","first-page":"17","DOI":"10.2753\/MIS0742-1222280102","article-title":"Embodied conversational agent-based kiosk for automated interviewing","volume":"28","author":"Nunamaker","year":"2011","journal-title":"J. Manage. Inf. Syst."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1145\/3265754","article-title":"Modeling dyadic and group impressions with intermodal and interperson features","author":"Okada","year":"2019","journal-title":"ACM Transactions on Multimedia Computing, Communications and Applications"},{"journal-title":"Decision support for rapid assessment of truth and deception using automated assessment technologies and kiosk-based embodied conversational agents","year":"2008","author":"Patton","key":"B35"},{"key":"B36","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1080\/07421222.2017.1393304","article-title":"A video-based screening system for automated risk assessment using nuanced facial features","volume":"34","author":"Pentland","year":"2017","journal-title":"J. Manage. Inf. Syst."},{"key":"B37","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1111\/j.1467-9280.2008.02116.x","article-title":"Reading between the lies: Identifying concealed and falsified emotions in universal facial expressions","volume":"19","author":"Porter","year":"2008","journal-title":"Psychol. Sci."},{"key":"B38","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10919-011-0120-7","article-title":"Secrets and lies: Involuntary leakage in deceptive facial expressions as a function of emotional intensity","volume":"36","author":"Porter","year":"2012","journal-title":"J. Nonverb. Behav."},{"key":"B39","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1080\/07421222.2016.1205929","article-title":"More than meets the eye: How oculometric behaviors evolve over the course of automated deception detection interactions","volume":"33","author":"Proudfoot","year":"2016","journal-title":"J. Manag. Inf. Syst."},{"key":"B40","doi-asserted-by":"publisher","first-page":"316","DOI":"10.3233\/978-1-61499-625-5-316","article-title":"Automatic behavior analysis during a clinical interview with a virtual human","volume":"220","author":"Rizzo","year":"2016","journal-title":"Studies Health Technol. Inf."},{"key":"B41","first-page":"380","article-title":"Recent developments in social signal processing","author":"Salah","year":"2011","journal-title":"Conference Proceedings, IEEE International Conference on Systems, Man ad Cybernetics"},{"key":"B42","doi-asserted-by":"publisher","first-page":"185","DOI":"10.2190\/DUGG-P24E-52WK-6CDG","article-title":"Emotional Intelligence","volume":"9","author":"Salovey","year":"1990","journal-title":"Imag. Cognit. Pers."},{"key":"B43","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1080\/13803395.2013.771618","article-title":"A comparison of the Cambridge Automated Neuropsychological Test Battery (CANTAB) with \u201ctraditional\u201d neuropsychological testing instruments","volume":"35","author":"Smith","year":"2013","journal-title":"J. Clin. Exp. Neuropsychol."},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63092-8_45","article-title":"\u201cDeception detection in videos using robust facial features,\u201d","author":"Stathopoulos","year":"2021","journal-title":"Proceedings of the Future Technologies Conference (FTC) 2020, Vol. 3. FTC 2020. Advances in Intelligent Systems and Computing, Vol. 1290"},{"key":"B45","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1037\/h0093929","article-title":"Cry me a river: identifying the behavioral consequences of extremely high-stakes interpersonal deception","volume":"36","author":"Ten Brinke","year":"2012","journal-title":"Law Hum. Behav."},{"key":"B46","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1007\/s10726-012-9301-y","article-title":"Negotiation outcome classification using language features","volume":"22","author":"Twitchell","year":"2013","journal-title":"Group Decision Negot."},{"key":"B47","doi-asserted-by":"publisher","first-page":"173","DOI":"10.2753\/MIS0742-1222310108","article-title":"A rigidity detection system for automated credibility assessment","volume":"31","author":"Twyman","year":"2014","journal-title":"J. Manage. Inf. Syst."},{"journal-title":"Detecting Lies and Deceit Pitfalls and Opportunities, 2e","year":"2008","author":"Vrij","key":"B48"},{"journal-title":"Using AI to Transform Behavioral Data Into Actionable Insights.","year":"2020","author":"Walls","key":"B49"},{"key":"B50","doi-asserted-by":"publisher","first-page":"e60794","DOI":"10.3791\/60794","article-title":"Implementation of a real-time psychosis risk detection and alerting system based on electronic health records using CogStack","volume":"159","author":"Wang","year":"2020","journal-title":"JoVE"},{"key":"B51","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1016\/j.inffus.2022.11.031","article-title":"Emotion fusion for mental illness detection from social media: a survey","volume":"92","author":"Zhang","year":"2023","journal-title":"Inf. Fusion"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1168712\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T11:20:52Z","timestamp":1690975252000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1168712\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,2]]},"references-count":51,"alternative-id":["10.3389\/fcomp.2023.1168712"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1168712","relation":{},"ISSN":["2624-9898"],"issn-type":[{"type":"electronic","value":"2624-9898"}],"subject":[],"published":{"date-parts":[[2023,8,2]]},"article-number":"1168712"}}