{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T10:26:04Z","timestamp":1760955964805,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2019,6,21]],"date-time":"2019-06-21T00:00:00Z","timestamp":1561075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Experimental economic laboratories run many studies to test theoretical predictions with actual human behaviour, including public goods games. With this experiment, participants in a group have the option to invest money in a public account or to keep it. All the invested money is multiplied and then evenly distributed. This structure incentivizes free riding, resulting in contributions to the public goods declining over time. Face-to-face Communication (FFC) diminishes free riding and thus positively affects contribution behaviour, but the question of how has remained mostly unknown. In this paper, we investigate two communication channels, aiming to explain what promotes cooperation and discourages free riding. Firstly, the facial expressions of the group in the 3-minute FFC videos are automatically analysed to predict the group behaviour towards the end of the game. The proposed automatic facial expressions analysis approach uses a new group activity descriptor and utilises random forest classification. Secondly, the contents of FFC are investigated by categorising strategy-relevant topics and using meta-data. The results show that it is possible to predict whether the group will fully contribute to the end of the games based on facial expression data from three minutes of FFC, but deeper understanding requires a larger dataset. Facial expression analysis and content analysis found that FFC and talking until the very end had a significant, positive effect on the contributions.<\/jats:p>","DOI":"10.3390\/s19122786","type":"journal-article","created":{"date-parts":[[2019,6,21]],"date-time":"2019-06-21T11:54:31Z","timestamp":1561118071000},"page":"2786","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Predicting Group Contribution Behaviour in a Public Goods Game from Face-to-Face Communication"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4738-1897","authenticated-orcid":false,"given":"Ehsan","family":"Othman","sequence":"first","affiliation":[{"name":"Neuro-Information Technology group, Institute for Information Technology and Communications, Otto-von-Guericke University Magdeburg, 39106 Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3303-3154","authenticated-orcid":false,"given":"Frerk","family":"Saxen","sequence":"additional","affiliation":[{"name":"Neuro-Information Technology group, Institute for Information Technology and Communications, Otto-von-Guericke University Magdeburg, 39106 Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9856-1548","authenticated-orcid":false,"given":"Dmitri","family":"Bershadskyy","sequence":"additional","affiliation":[{"name":"Halle Institute for Economic Research, 06108 Halle, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4762-2926","authenticated-orcid":false,"given":"Philipp","family":"Werner","sequence":"additional","affiliation":[{"name":"Neuro-Information Technology group, Institute for Information Technology and Communications, Otto-von-Guericke University Magdeburg, 39106 Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3632-2402","authenticated-orcid":false,"given":"Ayoub","family":"Al-Hamadi","sequence":"additional","affiliation":[{"name":"Neuro-Information Technology group, Institute for Information Technology and Communications, Otto-von-Guericke University Magdeburg, 39106 Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4500-8247","authenticated-orcid":false,"given":"Joachim","family":"Weimann","sequence":"additional","affiliation":[{"name":"Faculty of Economics and Management, Otto-von-Guericke University Magdeburg, 39106 Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1177\/0022002709352443","article-title":"Communication and Cooperation in Social Dilemmas: A Meta-Analytic Review","volume":"54","author":"Balliet","year":"2010","journal-title":"J. Confl. Resolut."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/s10683-010-9257-1","article-title":"Sustaining cooperation in laboratory public goods experiments: A selective survey of the literature","volume":"14","author":"Chaudhuri","year":"2011","journal-title":"Exp. Econ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/1468-0475.00080","article-title":"The effect of communication media on cooperation","volume":"4","author":"Brosig","year":"2003","journal-title":"Ger. Econ. Rev."},{"key":"ref_4","unstructured":"(2019, June 18). Public Goods Game. Available online: https:\/\/en.wikipedia.org\/w\/index.php?title=Public_goods_game&oldid=892553907."},{"key":"ref_5","unstructured":"Altemeyer-Bartscher, M., Bershadskyy, D., Schreck, P., and Timme, F. (2019, June 18). Endogenous Institution Formation in Public Good Games: The Effect of Economic Education. Available online: https:\/\/hdl.handle.net\/10419\/173200."},{"key":"ref_6","unstructured":"Mehrabian, A. (1971). Silent Messages, Wadsworth."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1037\/h0024648","article-title":"Inference of attitudes from nonverbal communication in two channels","volume":"31","author":"Mehrabian","year":"1967","journal-title":"J. Consult. Psychol."},{"key":"ref_8","unstructured":"Knapp, M.L., and Hall, J.A. (2009). Nonverbal Communication in Human Interaction, Wadsworth Publishing."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3747","DOI":"10.3390\/s120303747","article-title":"Robust Facial Expression Recognition via Compressive Sensing","volume":"12","author":"Zhang","year":"2012","journal-title":"Sensors"},{"key":"ref_10","unstructured":"Aran, O., Hung, H., and Gatica-Perez, D. (2010, January 18). A Multimodal Corpus for Studying Dominance in Small Group Conversations. Proceedings of the LREC workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, Valletta, Malta."},{"key":"ref_11","unstructured":"Horgan, T.G., Hall, J.A., and Knapp, M.L. (2014). Non-Verbal Communication in Human Interaction, Cengage Learning. [8th ed.]."},{"key":"ref_12","unstructured":"Ekman, P. (1982). Emotion in the Human Face, Cambridge University Press. [2nd ed.]."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1080\/026999399379168","article-title":"Social functions of emotions at four levels of analysis","volume":"13","author":"Keltner","year":"1999","journal-title":"Cogn. Emot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3505","DOI":"10.1098\/rstb.2009.0135","article-title":"Machine Analysis of Facial Behaviour: Naturalistic & Dynamic Behaviour 2. The Process of Automatic Facial Behaviour Analysis","volume":"364","author":"Pantic","year":"2009","journal-title":"Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1037\/0003-066X.48.4.384","article-title":"Facial expression and emotion","volume":"48","author":"Paul","year":"1993","journal-title":"Am. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Salah, A.A., and Gevers, T. (2011). Analysis of Group Conversations: Modeling Social Verticality. Computer Analysis of Human Behaviored, Springer.","DOI":"10.1007\/978-0-85729-994-9"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1037\/1528-3542.7.4.730","article-title":"Facial Dynamics as Indicators of Trustworthiness and Cooperative Behavior","volume":"7","author":"Krumhuber","year":"2007","journal-title":"Emotion"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1037\/0033-2909.111.2.256","article-title":"Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis","volume":"111","author":"Nalini","year":"1992","journal-title":"Psychol. Bull."},{"key":"ref_19","unstructured":"Forgas, J.P., and Jones, R. (1985). Interpersonal Behaviour: The Psychology of Social Interaction, Pergamon Press."},{"key":"ref_20","unstructured":"Jacques, J.C.S., G\u00fc\u00e7l\u00fct\u00fcrk, Y., Marc, P., G\u00fc\u00e7l\u00fc, U., And\u00fajar, C., Bar\u00f3, X., Escalante, H.J., Guyon, I., Gerven, M.V., and Lier, R.V. (2018). First Impressions: A Survey on Computer Vision-Based Apparent Personality Trait Analysis. arXiv."},{"key":"ref_21","first-page":"28","article-title":"The Impact of Interpersonal Communication Skills on Organizational Effectiveness and Social Self-Efficacy: A Synthesis","volume":"4","author":"Okoro","year":"2017","journal-title":"Int. J. Lang. Linguist."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.1016\/j.imavis.2009.01.004","article-title":"Automatic nonverbal analysis of social interaction in small groups: A review","volume":"27","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"George, S., and Pascal, L. (2002, January 2\u20137). An approach to automatic analysis of learners\u2019 social behavior during computer-mediated synchronous conversations. Proceedings of the International Conference on Intelligent Tutoring Systems, Biarritz, France.","DOI":"10.1007\/3-540-47987-2_64"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TASL.2008.2008238","article-title":"Modeling Dominance in Group Conversations Using Nonverbal Activity Cues","volume":"17","author":"Jayagopi","year":"2009","journal-title":"IEEE Trans. Audiospeechand Lang. Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jaques, N., McDuff, D., Kim, Y.L., and Picard, R. (2016, January 20\u201323). Understanding and predicting bonding in conversations using thin slices of facial expressions and body language. Proceedings of the International Conference on Intelligent Virtual Agents, Los Angeles, CA, USA.","DOI":"10.1007\/978-3-319-47665-0_6"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ekman, P., and Friesen, W.V. (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press.","DOI":"10.1037\/t27734-000"},{"key":"ref_27","first-page":"1","article-title":"Data mining spontaneous facial behavior with automatic expression coding","volume":"Volume 5042 LNAI","author":"Bartlett","year":"2008","journal-title":"Lecture Notes in Computer Science"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Stratou, G., Schalk JV, D., Hoegen, R., and Gratch, J. (2017, January 23\u201326). Refactoring facial expressions: An automatic analysis of natural occurring facial expressions in iterative social dilemma. Proceedings of the Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), San Antonio, TX, USA.","DOI":"10.1109\/ACII.2017.8273635"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1111\/j.1545-5300.1999.00293.x","article-title":"Predicting divorce among newlyweds from the first three minutes of a marital conflict discussion","volume":"38","author":"Carrer","year":"1999","journal-title":"Fam. Process"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1037\/0022-3514.63.2.221","article-title":"Marital processes predictive of later dissolution: Behavior, physiology, and health","volume":"63","author":"Levenson","year":"1992","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1111\/j.1741-3737.2000.00927.x","article-title":"Decade review: Observing marital interaction","volume":"62","author":"Gottman","year":"2000","journal-title":"J. Marriage Fam."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Grobova, J., Colovic, M., Marjanovic, M., Njegus, A., Demire, H., and Anbarjafari, G. (June, January 30). Automatic Hidden Sadness Detection Using Micro-Expressions. Proceedings of the 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), Washington, DC, USA.","DOI":"10.1109\/FG.2017.105"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"26391","DOI":"10.1109\/ACCESS.2018.2831927","article-title":"Dominant and Complementary Emotion Recognition from Still Images of Faces","volume":"6","author":"Guo","year":"2018","journal-title":"IEEE Access"},{"key":"ref_34","unstructured":"Kulkarni, K., Corneanu, C.A., Ofodile, I., Escalera, S., Baro, X., Hyniewska, S., Allik, J., and Anbarjafari, G. (2018). Automatic Recognition of Facial Displays of Unfelt Emotions. J. IEEE Trans. Affect. Comput."},{"key":"ref_35","first-page":"26391","article-title":"Audio-Visual Emotion Recognition in Video Clips","volume":"10","author":"Noroozi","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_36","unstructured":"Girard, J.M., Chu, W.-S., Jeni, L.A., and Cohn, J.F. (June, January 30). Sayette Group Formation Task (GFT) Spontaneous Facial Expression Database. Proceedings of the 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG), Washington, DC, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ringeval, F., Sonderegger, A., Sauer, J., and Lalanne, D. (2013, January 22\u201326). Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions. Presented at the Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops, Shanghai, China.","DOI":"10.1109\/FG.2013.6553805"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1177\/0963721417693352","article-title":"Can We Detect Cooperators by Looking at Their Face?","volume":"26","author":"Bonnefon","year":"2017","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1016\/j.tics.2016.05.012","article-title":"Can Ordinary People Detect Deception After All?","volume":"20","author":"Brinke","year":"2016","journal-title":"Trends Cogn. Sci."},{"key":"ref_40","unstructured":"Bershadskyy, D., Othman, E., and Saxen, F. (2019). Predicting Free-Riding in a Public Goods Game: Analysis of Content and Dynamic Facial Expressions in Face-to-Face Communication, Halle Institute for Economic Research (IWH). Available online: http:\/\/hdl.handle.net\/10419\/196589."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1162\/REST_a_00146","article-title":"Can Observers Predict Trustworthiness?","volume":"94","author":"Belot","year":"2012","journal-title":"Rev. Econ. Stat."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.paid.2011.09.005","article-title":"The role of Theory of Mind in assessing cooperative intentions","volume":"52","author":"Sylwester","year":"2012","journal-title":"Personal. Individ. Differ."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s11292-007-9033-1","article-title":"Fare dodging and the strong arm of the law","volume":"3","author":"Bijleveld","year":"2007","journal-title":"J. Exp. Criminol."},{"key":"ref_44","unstructured":"Kulkarni, V., Chapuis, B., Garbinato, B., and Mahalunkar, A. (2018). Addressing the Free-Rider Problem in Public Transport System. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1111\/j.1744-6570.1993.tb01571.x","article-title":"Relations Between Work Group Characteristics and Effectiveness: Implications for Designing Effective Work Groups","volume":"46","author":"Campion","year":"1993","journal-title":"Pers. Psychol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.jebo.2003.06.006","article-title":"Communication and punishment in voluntary contribution experiments","volume":"60","author":"Bochet","year":"2006","journal-title":"J. Econ. Behav. Organ."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Baltru\u0161aitis, T., Robinson, P., and Morency, L.-P. (2016, January 7\u201310). OpenFace: An open source facial behavior analysis toolkit. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477553"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/TAFFC.2016.2537327","article-title":"Traue Automatic Pain Assessment with Facial Activity Descriptors","volume":"8","author":"Werner","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Saxen, F., Werner, P., and Al-Hamadi, A. (2017, January 22\u201329). Real vs. Fake Emotion Challenge: Learning to Rank Authenticity from Facial Activity Descriptors. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.363"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s10683-006-9159-4","article-title":"Z-Tree: Zurich toolbox for ready-made economic experiments","volume":"10","author":"Fischbacher","year":"2007","journal-title":"Exp. Econ."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.euroecorev.2014.07.003","article-title":"Hroot: Hamburg registration and organization online tool Olaf","volume":"71","author":"Bock","year":"2014","journal-title":"Eur. Econ. Rev."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Werner, P., Al-Hamadi, A., Niese, R., Walter, S., Gruss, S., and Traue, H.C. (2014, January 24\u201328). Automatic pain recognition from video and biomedical signals. Presented at the 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.784"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the Mean Accuracy of Statistical Pattern Recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/12\/2786\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:00:09Z","timestamp":1760187609000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/12\/2786"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,21]]},"references-count":53,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["s19122786"],"URL":"https:\/\/doi.org\/10.3390\/s19122786","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,6,21]]}}}