{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T15:38:06Z","timestamp":1790350686556,"version":"4.1.0"},"reference-count":47,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,2,2]],"date-time":"2022-02-02T00:00:00Z","timestamp":1643760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>Social relationships are constructed by and through the relational communication that people exchange. Relational messages are implicit nonverbal and verbal messages that signal how people regard one another and define their interpersonal relationships\u2014equal or unequal, affectionate or hostile, inclusive or exclusive, similar or dissimilar, and so forth. Such signals can be measured automatically by the latest machine learning software tools and combined into meaningful factors that represent the socioemotional expressions that constitute relational messages between people. Relational messages operate continuously on a parallel track with verbal communication, implicitly telling interactants the current state of their relationship and how to interpret the verbal messages being exchanged. We report an investigation that explored how group members signal these implicit messages through multimodal behaviors measured by sensor data and linked to the socioemotional cognitions interpreted as relational messages. By use of a modified Brunswikian lens model, we predicted perceived relational messages of dominance, affection, involvement, composure, similarity and trust from automatically measured kinesic, vocalic and linguistic indicators. The relational messages in turn predicted the veracity of group members. The Brunswikian Lens Model offers a way to connect objective behaviors exhibited by social actors to the emotions and cognitions being perceived by other interactants and linking those perceptions to social outcomes. This method can be used to ascertain what behaviors and\/or perceptions are associated with judgments of an actor\u2019s veracity. Computerized measurements of behaviors and perceptions can replace manual measurements, significantly expediting analysis and drilling down to micro-level measurement in a previously unavailable manner.<\/jats:p>","DOI":"10.3389\/fpsyg.2021.781487","type":"journal-article","created":{"date-parts":[[2022,2,2]],"date-time":"2022-02-02T04:51:31Z","timestamp":1643777491000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["How the Brunswikian Lens Model Illustrates the Relationship Between Physiological and Behavioral Signals and Psychological Emotional and Cognitive States"],"prefix":"10.3389","volume":"12","author":[{"given":"Judee K.","family":"Burgoon","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebecca Xinran","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xunyu","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tina Saiying","family":"Ge","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bradley","family":"Dorn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,2,2]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"160","DOI":"10.3389\/fnins.2018.00160","article-title":"A comparison of low-complexity real-time feature extraction for neuromorphic speech recognition.","volume":"12","author":"Acharya","year":"2018","journal-title":"Front. Neurosci."},{"key":"B2","doi-asserted-by":"publisher","first-page":"52138","DOI":"10.1109\/access.2018.2870052","article-title":"Peeking inside the black-box: a survey on explainable artificial intelligence (XAI).","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"B3","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/mc.2017.3641638","article-title":"Real-time video analytics: the killer app for edge computing.","volume":"50","author":"Ananthanarayanan","year":"2017","journal-title":"Computer"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.1037\/a0030939","article-title":"Trust, conflict, and cooperation: a meta-analysis.","volume":"139","author":"Balliet","year":"2013","journal-title":"Psychol. Bull."},{"key":"B5","first-page":"1","article-title":"Cross-dataset learning and person-specific normalisation for automatic action unit detection","author":"Baltru\u0161aitis","year":"2015","journal-title":"Proceedings of the 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)"},{"key":"B6","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/FG.2018.00019","article-title":"Openface 2.0: facial behavior analysis toolkit","author":"Baltru\u0161aitis","year":"2018","journal-title":"Proceedings of the 2018 13th IEEE International Conference on Automatic Face &amp; Gesture Recognition (FG 2018)"},{"key":"B44","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1111\/j.1467-9280.2006.01737.x","article-title":"Predictive gaze cues and personality judgments: should eye trust you?","volume":"17","author":"Bayliss","year":"2006","journal-title":"Psychol. Sci."},{"key":"B7","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1037\/0022-3514.71.1.110","article-title":"Dyad rapport and the accuracy of its judgment across situations: a lens model analysis.","volume":"71","author":"Bernieri","year":"1996","journal-title":"J. Pers. Soc. Psychol."},{"key":"B8","doi-asserted-by":"crossref","first-page":"279","DOI":"10.4135\/9781412976152.n15","article-title":"Dominance, power and influence","author":"Burgoon","year":"2006","journal-title":"The SAGE Handbook of Nonverbal Communication"},{"key":"B9","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1080\/03637758409390195","article-title":"The fundamental topoi of relational communication.","volume":"51","author":"Burgoon","year":"1984","journal-title":"Commun. Monogr."},{"key":"B45","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1080\/03637758709390214","article-title":"Validation and measurement of the fundamental themes of relational communication","volume":"54","author":"Burgoon","year":"1987","journal-title":"Commun. Monogr."},{"key":"B10","author":"Burgoon","year":"2022","journal-title":"Nonverbal Communication"},{"key":"B46","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1007\/BF01000735","article-title":"Effects of eye gaze on hiring, credibility, attraction and relational message interpretation","volume":"9","author":"Burgoon","year":"1985","journal-title":"J. Nonverbal Behav."},{"key":"B11","doi-asserted-by":"publisher","first-page":"624177","DOI":"10.3389\/fpsyg.2021.624177","article-title":"Nonverbal behaviors \u201cspeak\u201d relational messages of dominance, trust, and composure.","volume":"12","author":"Burgoon","year":"2021","journal-title":"Front. Psychol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.evolhumbehav.2014.08.001","article-title":"Honest signaling in trust interactions: smiles rated as genuine induce trust and signal higher earning opportunities.","volume":"36","author":"Centorrino","year":"2015","journal-title":"Evol. Hum. Behav."},{"key":"B13","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1162\/tacl_a_00311","article-title":"Acoustic-prosodic and lexical cues to deception and trust: deciphering how people detect lies.","volume":"8","author":"Chen","year":"2020","journal-title":"Trans. Assoc. Comput. Linguistic."},{"key":"B14","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1111\/j.1468-2958.1987.tb00115.x","article-title":"The nature of conversational involvement and nonverbal encoding patterns.","volume":"13","author":"Coker","year":"1987","journal-title":"Hum. Commun. Res."},{"key":"B15","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1080\/03637759909376462","article-title":"Structuring the concept of relational communication.","volume":"66","author":"Dillard","year":"1999","journal-title":"Commun. Monogr."},{"key":"B16","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/978-3-030-54383-9_4","article-title":"A system for multi-person, multi-modal data collection in behavioral information systems","author":"Dorn","year":"2021","journal-title":"Detecting Trust and Deception in Group Interaction"},{"key":"B17","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/978-3-030-54383-9_5","article-title":"Dominance in groups: how dyadic power theory can apply to group discussions","author":"Dunbar","year":"2021","journal-title":"Detecting Trust and Deception in Group Interaction"},{"key":"B18","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1287\/orsc.14.1.57.12806","article-title":"The role of trustworthiness in reducing transaction costs and improving performance: empirical evidence from the United States, Japan, and Korea.","volume":"14","author":"Dyer","year":"2003","journal-title":"Organ. Sci."},{"key":"B19","doi-asserted-by":"crossref","first-page":"1459","DOI":"10.1145\/1873951.1874246","article-title":"Opensmile: the Munich versatile and fast open-source audio feature extractor","author":"Eyben","year":"2010","journal-title":"Proceedings of the 18th ACM International Conference on Multimedia"},{"key":"B20","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.jfludis.2004.02.003","article-title":"The relationship between anxiety and stuttering: a multidimensional approach.","volume":"29","author":"Ezrati-Vinacour","year":"2004","journal-title":"J. Fluency Disord."},{"key":"B21","first-page":"1","article-title":"Real-time speech recognition for IoT purpose using a delta recurrent neural network accelerator","author":"Gao","year":"2019","journal-title":"Proceedings of the 2019 IEEE International Symposium on Circuits and Systems (ISCAS)"},{"key":"B22","first-page":"98","author":"Giles","year":"2021","journal-title":"Detecting Trust and Deception in Group Interaction."},{"key":"B23","first-page":"131","article-title":"The centrality of interpersonal trust in group processes","author":"Golembiewski","year":"1975","journal-title":"Theories of Group Processes"},{"key":"B24","author":"Guerrero","year":"2017","journal-title":"Close Encounters: Communication in Relationships."},{"key":"B25","doi-asserted-by":"crossref","first-page":"eaay7120","DOI":"10.1126\/scirobotics.aay7120","article-title":"XAI\u2014Explainable artificial intelligence.","volume":"4","author":"Gunning","year":"2019","journal-title":"Sci. Robot."},{"key":"B26","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1037\/a0023589","article-title":"Why do lie-catchers fail? A lens model meta-analysis of human lie judgments.","volume":"137","author":"Hartwig","year":"2011","journal-title":"Psychol. Bull."},{"key":"B27","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1080\/00335637309383149","article-title":"Elements of a model for communication processes.","volume":"59","author":"Hawes","year":"1973","journal-title":"Q. J. Speech"},{"key":"B28","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1177\/031289620202700102","article-title":"Technical language, advice understandability, and perceptions of expertise and trustworthiness: the case of the financial planner.","volume":"27","author":"Joiner","year":"2002","journal-title":"Austr. J. Manag."},{"key":"B29","doi-asserted-by":"publisher","first-page":"1912","DOI":"10.1109\/taslp.2021.3084099","article-title":"Multimodal representations for synchronized speech and real-time MRI video processing.","volume":"29","author":"Kose","year":"2021","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"B30","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1080\/1369118x.2019.1635183","article-title":"Nonverbal cues and perceptions of personality and homophily in synchronous mediated communication.","volume":"24","author":"Krishnan","year":"2021","journal-title":"Inf. Commun. Soc."},{"key":"B47","doi-asserted-by":"publisher","first-page":"730","DOI":"10.1037\/1528-3542.7.4.730","article-title":"Facial dynamics as indicators of trustworthiness and cooperative behavior","volume":"7","author":"Krumhuber","year":"2007","journal-title":"Emotion"},{"key":"B31","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1109\/TPC.2011.2172669","article-title":"Linguistic politeness in student-team emails: its impact on trust between leaders and members.","volume":"54","author":"Lam","year":"2011","journal-title":"IEEE Trans. Profess. Commun."},{"key":"B32","first-page":"55","article-title":"A technique for the measurement of attitudes.","volume":"22","author":"Likert","year":"1932","journal-title":"Arch. Psychol."},{"key":"B33","doi-asserted-by":"publisher","first-page":"e90779","DOI":"10.1371\/journal.pone.0090779","article-title":"How do you say \u2018hello\u2019? Personality impressions from brief novel voices.","volume":"9","author":"McAleer","year":"2014","journal-title":"PLoS One"},{"key":"B34","first-page":"827","article-title":"What is trust? A conceptual analysis and an interdisciplinary model","author":"McKnight","year":"2000","journal-title":"Proceedings of the AMCIS Americas Conference on Information Systems"},{"key":"B35","first-page":"103","article-title":"Structured programming for linguistic cue extraction (SPLICE)","author":"Moffitt","year":"2012","journal-title":"Proceedings of the HICSS-45 Rapid Screening Technologies, Deception Detection and Credibility Assessment Symposium"},{"key":"B36","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1089\/cyber.2012.0348","article-title":"The commitment-trust theory of relationship marketing.","volume":"58","author":"Morgan","year":"1994","journal-title":"J. Market."},{"key":"B37","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1016\/j.csl.2015.08.003","article-title":"Towards the automatic detection of involvement in conversation","author":"Oertel","year":"2011","journal-title":"Analysis of Verbal and Nonverbal Communication and Enactment. The Processing Issues"},{"key":"B38","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/978-3-030-54383-9_6","article-title":"Behavioral indicators of dominance in an adversarial group negotiation game","author":"Pentland","year":"2021","journal-title":"Detecting Trust and Deception in Group Interaction"},{"key":"B39","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1016\/s0167-6393(02)00084-5","article-title":"Vocal communication of emotion: a review of research paradigms.","volume":"40","author":"Scherer","year":"2003","journal-title":"Speech Commun."},{"key":"B40","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-54383-9","author":"Subrahmanian","year":"2021","journal-title":"Detecting Trust and Deception in Group Interaction."},{"key":"B41","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/S0147-1767(99)00023-1","article-title":"Ethnic\/cultural identity salience and conflict styles in four US ethnic groups.","volume":"24","author":"Ting-Toomey","year":"2000","journal-title":"Int. J. Int. Relat."},{"key":"B42","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0747-5632(03)00051-7","article-title":"Language dominance in interpersonal deception in computer-mediated communication.","volume":"20","author":"Zhou","year":"2004","journal-title":"Comput. Hum. Behav."},{"key":"B43","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","article-title":"A comprehensive survey on transfer learning.","volume":"109","author":"Zhuang","year":"2020","journal-title":"Proc. IEEE"}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.781487\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,2]],"date-time":"2022-02-02T04:51:55Z","timestamp":1643777515000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.781487\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,2]]},"references-count":47,"alternative-id":["10.3389\/fpsyg.2021.781487"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2021.781487","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,2]]},"article-number":"781487"}}