{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:34:14Z","timestamp":1750221254283,"version":"3.41.0"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,9,18]],"date-time":"2018-09-18T00:00:00Z","timestamp":1537228800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,9,18]]},"abstract":"<jats:p>People behave differently in different situations. With the advances in ubiquitous sensing technologies, it is now easier to capture human behavior across multiple situations automatically and unobtrusively. We investigate human behavior across two situations that are ubiquitous in hospitality (job interview and reception desk) with the objective of inferring performance on the job. Utilizing a dataset of 338 dyadic interactions, played by students from a hospitality management school, we first study the connections between automatically extracted nonverbal cues, linguistic content, and various perceived variables of soft skills and performance in these two situations. A correlation analysis reveals connection between perceived variables and nonverbal cues displayed during job interviews, and perceived performance on the job. We then propose a computational framework, with nonverbal cues and linguistic style from the two interactions as features, to infer the perceived performance and soft skills in the reception desk situation as a regression task. The best inference performance, with R2 = 0.40, is achieved using a combination of nonverbal cues extracted from the reception desk setting and the human-rated interview scores. We observe that some behavioral cues (greater speaking turn duration and head nods) are positively correlated to higher ratings for all perceived variables across both situations. The best performance using verbal content is achieved by fusion of LIWC and Doc2Vec features with R2 = 0.25 for perceived performance. Our work has implications for the creation of behavioral training systems with focus on specific behaviors for hospitality students.<\/jats:p>","DOI":"10.1145\/3264939","type":"journal-article","created":{"date-parts":[[2018,9,19]],"date-time":"2018-09-19T11:58:41Z","timestamp":1537358321000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A Tale of Two Interactions"],"prefix":"10.1145","volume":"2","author":[{"given":"Skanda","family":"Muralidhar","sequence":"first","affiliation":[{"name":"Idiap Research Institute, Martigny, Switzerland, EPFL, Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marianne Schmid","family":"Mast","sequence":"additional","affiliation":[{"name":"University of Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Gatica-Perez","sequence":"additional","affiliation":[{"name":"Idiap Research Institute, Martigny, Switzerland, EPFL, Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,9,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805843"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327663jcp1601_2"},{"key":"e_1_2_1_3_1","volume-title":"Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin 111, 2","author":"Ambady Nalini","year":"1992","unstructured":"Nalini Ambady and Robert Rosenthal . 1992. Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin 111, 2 ( 1992 ). Nalini Ambady and Robert Rosenthal. 1992. Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin 111, 2 (1992)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.64.3.431"},{"volume-title":"First impressions","author":"Ambady Nalini","key":"e_1_2_1_5_1","unstructured":"Nalini Ambady and John Joseph Skowronski . 2008. First impressions . Guilford Press . Nalini Ambady and John Joseph Skowronski. 2008. First impressions. Guilford Press."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8325.1990.tb00510.x"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070481.2070528"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0033367"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2012.2225032"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2522848.2522877"},{"volume-title":"Natural language processing with Python: analyzing text with the natural language toolkit","author":"Bird Steven","key":"e_1_2_1_11_1","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural language processing with Python: analyzing text with the natural language toolkit . O'Reilly Media, Inc. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. O'Reilly Media, Inc."},{"key":"e_1_2_1_12_1","first-page":"1044","article-title":"Nonverbal behavior and communication in the workplace: A review and an agenda for research","volume":"42","author":"Bonaccio Silvia","year":"2016","unstructured":"Silvia Bonaccio , Jane O'Reilly , Sharon L O'Sullivan , and Fran\u00e7ois Chiocchio . 2016 . Nonverbal behavior and communication in the workplace: A review and an agenda for research . J. Management 42 , 5 (2016), 1044 -- 1074 . Silvia Bonaccio, Jane O'Reilly, Sharon L O'Sullivan, and Fran\u00e7ois Chiocchio. 2016. Nonverbal behavior and communication in the workplace: A review and an agenda for research. J. Management 42, 5 (2016), 1044--1074.","journal-title":"J. Management"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.leaqua.2006.04.008"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2958.1990.tb00229.x"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993203"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2015.75"},{"key":"e_1_2_1_19_1","volume-title":"The psychological functions of function words. Social Communication","author":"Chung Cindy","year":"2007","unstructured":"Cindy Chung and James W Pennebaker . 2007. The psychological functions of function words. Social Communication ( 2007 ), 343--359. Cindy Chung and James W Pennebaker. 2007. The psychological functions of function words. Social Communication (2007), 343--359."},{"key":"e_1_2_1_20_1","unstructured":"Microsoft Cognitive Services. {n. d.}. Azure Emotion API. https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/emotion\/  Microsoft Cognitive Services. {n. d.}. Azure Emotion API. https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/emotion\/"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.92.3.802"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10869-009-9098-0"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.84.6.986"},{"key":"e_1_2_1_25_1","volume-title":"Short Communication: Powerless and Jobless? Comparing the Effects of Powerless Speech and Speech Disorders on an Applicant's Employability. Frontiers 2, 1","author":"End Christian M","year":"2013","unstructured":"Christian M End and Katherine Saunders . 2013 . Short Communication: Powerless and Jobless? Comparing the Effects of Powerless Speech and Speech Disorders on an Applicant's Employability. Frontiers 2, 1 (2013). Christian M End and Katherine Saunders. 2013. Short Communication: Powerless and Jobless? Comparing the Effects of Powerless Speech and Speech Disorders on an Applicant's Employability. Frontiers 2, 1 (2013)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8325.1980.tb00007.x"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrp.2005.08.003"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804265"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1108\/03090560010311911"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858234"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2009.01.004"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1057-7408(08)80016-2"},{"key":"e_1_2_1_33_1","volume-title":"Communication of affect between patient and physician. J. Health and Social Behavior","author":"Hall Judith A","year":"1981","unstructured":"Judith A Hall , Debra L Roter , and Cynthia S Rand . 1981. Communication of affect between patient and physician. J. Health and Social Behavior ( 1981 ), 18--30. Judith A Hall, Debra L Roter, and Cynthia S Rand. 1981. Communication of affect between patient and physician. J. Health and Social Behavior (1981), 18--30."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.1995.tb02389.x"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1978.11-259"},{"key":"e_1_2_1_36_1","article-title":"Relative contributions of verbal, articulative, and nonverbal communication to employment decisions in the job interview setting","volume":"32","author":"Hollandsworth James G","year":"1979","unstructured":"James G Hollandsworth , Richard Kazelskis , Joanne Stevens , and Mary Edith Dressel . 1979 . Relative contributions of verbal, articulative, and nonverbal communication to employment decisions in the job interview setting . J. Personnel Psychology 32 , 2 (1979). James G Hollandsworth, Richard Kazelskis, Joanne Stevens, and Mary Edith Dressel. 1979. Relative contributions of verbal, articulative, and nonverbal communication to employment decisions in the job interview setting. J. Personnel Psychology 32, 2 (1979).","journal-title":"J. Personnel Psychology"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493502"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.1996.tb01841.x"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.86.5.897"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2010.2066267"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.62.3.295"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhm.2010.09.005"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhm.2011.09.014"},{"key":"e_1_2_1_44_1","volume-title":"Profiting from controversy: Lessons from the person-situation debate. American psychologist 43, 1","author":"Kenrick Douglas T","year":"1988","unstructured":"Douglas T Kenrick and David C Funder . 1988. Profiting from controversy: Lessons from the person-situation debate. American psychologist 43, 1 ( 1988 ), 23. Douglas T Kenrick and David C Funder. 1988. Profiting from controversy: Lessons from the person-situation debate. American psychologist 43, 1 (1988), 23."},{"key":"e_1_2_1_45_1","unstructured":"Mark Knapp Judith Hall and Terrence Horgan. 2013. Nonverbal communication in human interaction. Cengage Learning.  Mark Knapp Judith Hall and Terrence Horgan. 2013. Nonverbal communication in human interaction. Cengage Learning."},{"key":"e_1_2_1_46_1","unstructured":"Max Kuhn. 2016. A Short Introduction to the caret Package. (2016).  Max Kuhn. 2016. A Short Introduction to the caret Package. (2016)."},{"key":"e_1_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Nathan R Kuncel Sarah A Hezlett and Deniz S Ones. 2004. Academic performance career potential creativity and job performance: Can one construct predict them all?  Nathan R Kuncel Sarah A Hezlett and Deniz S Ones. 2004. Academic performance career potential creativity and job performance: Can one construct predict them all?","DOI":"10.1037\/0022-3514.86.1.148"},{"key":"e_1_2_1_48_1","volume-title":"Proc. 31st ICML. 1188--1196","author":"Le Quoc","year":"2014","unstructured":"Quoc Le and Tomas Mikolov . 2014 . Distributed representations of sentences and documents . In Proc. 31st ICML. 1188--1196 . Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proc. 31st ICML. 1188--1196."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1631272.1631400"},{"key":"e_1_2_1_50_1","volume-title":"Assessing the dimensionality and structure of the consumption experience: evaluation, feeling, and satisfaction. J. Consumer research 20, 3","author":"Mano Haim","year":"1993","unstructured":"Haim Mano and Richard L Oliver . 1993. Assessing the dimensionality and structure of the consumption experience: evaluation, feeling, and satisfaction. J. Consumer research 20, 3 ( 1993 ), 451--466. Haim Mano and Richard L Oliver. 1993. Assessing the dimensionality and structure of the consumption experience: evaluation, feeling, and satisfaction. J. Consumer research 20, 3 (1993), 451--466."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/0001-8791(78)90041-6"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1097\/PSY.0b013e3182545470"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1995.1019"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152832.3152866"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993191"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3136771"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7163127"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2014.2307169"},{"key":"e_1_2_1_59_1","unstructured":"NIST NIST. 2012. Machine translation evaluation official results.  NIST NIST. 2012. Machine translation evaluation official results."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.leaqua.2014.06.002"},{"volume-title":"Artifical Intelligence for Human Computing","author":"Pantic Maja","key":"e_1_2_1_61_1","unstructured":"Maja Pantic , Alex Pentland , Anton Nijholt , and Thomas S Huang . 2007. Human computing and machine understanding of human behavior: A survey . In Artifical Intelligence for Human Computing . Springer , 47--71. Maja Pantic, Alex Pentland, Anton Nijholt, and Thomas S Huang. 2007. Human computing and machine understanding of human behavior: A survey. In Artifical Intelligence for Human Computing. Springer, 47--71."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.69.4.557"},{"key":"e_1_2_1_63_1","first-page":"559","article-title":"LIII. On lines and planes of closest fit to systems of points in space","volume":"2","author":"Pearson Karl","year":"1901","unstructured":"Karl Pearson . 1901 . LIII. On lines and planes of closest fit to systems of points in space . The London, Edinburgh, and Dublin Philosophical Magazine and J. Science 2 , 11 (1901), 559 -- 572 . Karl Pearson. 1901. LIII. On lines and planes of closest fit to systems of points in space. The London, Edinburgh, and Dublin Philosophical Magazine and J. Science 2, 11 (1901), 559--572.","journal-title":"Science"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.77.6.1296"},{"key":"e_1_2_1_65_1","volume-title":"Int. Conf. on Developmental Learning","volume":"5","author":"Pentland Alex","year":"2004","unstructured":"Alex Pentland . 2004 . Social dynamics: Signals and behavior . In Int. Conf. on Developmental Learning , Vol. 5 . Alex Pentland. 2004. Social dynamics: Signals and behavior. In Int. Conf. on Developmental Learning, Vol. 5."},{"volume-title":"Honest signals: how they shape our world","author":"Pentland Alex","key":"e_1_2_1_66_1","unstructured":"Alex Pentland and Tracy Heibeck . 2010. Honest signals: how they shape our world . MIT press . Alex Pentland and Tracy Heibeck. 2010. Honest signals: how they shape our world. MIT press."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2009.4959992"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.69.4.551"},{"volume-title":"Proc. LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA.","author":"\u0158eh\u016f\u0159ek Radim","key":"e_1_2_1_69_1","unstructured":"Radim \u0158eh\u016f\u0159ek and Petr Sojka . {n. d.}. Software Framework for Topic Modelling with Large Corpora . In Proc. LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA. Radim \u0158eh\u016f\u0159ek and Petr Sojka. {n. d.}. Software Framework for Topic Modelling with Large Corpora. In Proc. LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2011.2181941"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2406367.2406408"},{"key":"e_1_2_1_72_1","volume-title":"Methods of research on vocal communication: Paradigms and parameters. Handbook of Methods in Nonverbal Behavior Research","author":"Scherer Klaus R","year":"1982","unstructured":"Klaus R Scherer . 1982. Methods of research on vocal communication: Paradigms and parameters. Handbook of Methods in Nonverbal Behavior Research ( 1982 ), 136--198. Klaus R Scherer. 1982. Methods of research on vocal communication: Paradigms and parameters. Handbook of Methods in Nonverbal Behavior Research (1982), 136--198."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2016.11"},{"key":"e_1_2_1_74_1","volume-title":"Intraclass correlations: uses in assessing rater reliability. Psychological bulletin 86, 2","author":"Shrout Patrick E","year":"1979","unstructured":"Patrick E Shrout and Joseph L Fleiss . 1979. Intraclass correlations: uses in assessing rater reliability. Psychological bulletin 86, 2 ( 1979 ). Patrick E Shrout and Joseph L Fleiss. 1979. Intraclass correlations: uses in assessing rater reliability. Psychological bulletin 86, 2 (1979)."},{"key":"e_1_2_1_75_1","unstructured":"Aron W Siegman. 1987. The telltale voice: Nonverbal messages of verbal communication. (1987).  Aron W Siegman. 1987. The telltale voice: Nonverbal messages of verbal communication. (1987)."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053169"},{"volume-title":"Getting Started with the Computer Vision API","author":"Sole Del A","key":"e_1_2_1_77_1","unstructured":"Del A Sole . 2018. Getting Started with the Computer Vision API . Apress , Berkeley, CA . Del A Sole. 2018. Getting Started with the Computer Vision API. Apress, Berkeley, CA."},{"volume-title":"Introducing Microsoft Cognitive Services","author":"Sole Del A","key":"e_1_2_1_78_1","unstructured":"Del A Sole . 2018. Introducing Microsoft Cognitive Services . Apress , Berkeley, CA . Del A Sole. 2018. Introducing Microsoft Cognitive Services. Apress, Berkeley, CA."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.leaqua.2014.06.001"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1108\/08876040010341008"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/24634.24635"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1111\/1468-2389.00151"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2002.993141"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3264939","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3264939","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:08:00Z","timestamp":1750212480000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3264939"}},"subtitle":["Inferring Performance in Hospitality Encounters from Cross-Situation Social Sensing"],"short-title":[],"issued":{"date-parts":[[2018,9,18]]},"references-count":83,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,9,18]]}},"alternative-id":["10.1145\/3264939"],"URL":"https:\/\/doi.org\/10.1145\/3264939","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2018,9,18]]},"assertion":[{"value":"2018-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}