{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,30]],"date-time":"2025-12-30T17:58:12Z","timestamp":1767117492864,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T00:00:00Z","timestamp":1620777600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>In the last 14 months, COVID-19 made face-to-face meetings impossible and this has led to rapid growth in videoconferencing. As highly social creatures, humans strive for direct interpersonal interaction, which means that in most of these video meetings the webcam is switched on and people are \u201clooking each other in the eyes\u201d. However, it is far from clear what the psychological consequences of this shift to virtual face-to-face communication are and if there are methods to alleviate \u201cvideoconferencing fatigue\u201d. We have studied the influence of emotions of meeting participants on the perceived outcome of video meetings. Our experimental setting consisted of 35 participants collaborating in eight teams over Zoom in a one semester course on Collaborative Innovation Networks in bi-weekly video meetings, where each team presented its progress. Emotion was tracked through Zoom face video snapshots using facial emotion recognition that recognized six emotions (happy, sad, fear, anger, neutral, and surprise). Our dependent variable was a score given after each presentation by all participants except the presenter. We found that the happier the speaker is, the happier and less neutral the audience is. More importantly, we found that the presentations that triggered wide swings in \u201cfear\u201d and \u201cjoy\u201d among the participants are correlated with a higher rating. Our findings provide valuable input for online video presenters on how to conduct better and less tiring meetings; this will lead to a decrease in \u201cvideoconferencing fatigue\u201d.<\/jats:p>","DOI":"10.3390\/fi13050126","type":"journal-article","created":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T10:59:12Z","timestamp":1620817152000},"page":"126","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Reducing Videoconferencing Fatigue through Facial Emotion Recognition"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4744-5755","authenticated-orcid":false,"given":"Jannik","family":"R\u00f6\u00dfler","sequence":"first","affiliation":[{"name":"Cologne Institute for Information Systems, University of Cologne, 50923 Cologne, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiachen","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7271-3224","authenticated-orcid":false,"given":"Peter","family":"Gloor","sequence":"additional","affiliation":[{"name":"MIT Center for Collective Intelligence, Massachusetts Institute of Technology, Cambridge, MA 02142, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"63","DOI":"10.3233\/WEB-190401","article-title":"Tracking a Leader\u2019s Humility and Its Emotions from Body, Face and Voice","volume":"17","author":"Poggi","year":"2019","journal-title":"Web Intell."},{"key":"ref_2","unstructured":"Gallo, C. (2014). Talk Like TED: The 9 Public-Speaking Secrets of the World\u2019s Top Minds, Macmillan."},{"key":"ref_3","unstructured":"Damasio, A.R. (2006). Descartes\u2019 Error: Emotion, Reason and the Human Brain, Vintage. rev. ed. with a new preface."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1454","DOI":"10.3389\/fpsyg.2017.01454","article-title":"The Influences of Emotion on Learning and Memory","volume":"8","author":"Tyng","year":"2017","journal-title":"Front. Psychol."},{"key":"ref_5","first-page":"927","article-title":"EmoCo: Visual Analysis of Emotion Coherence in Presentation Videos","volume":"26","author":"Zeng","year":"2019","journal-title":"IEEE Trans. Visual. Comput. Graph."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ko, B.C. (2018). A Brief Review of Facial Emotion Recognition Based on Visual Information. Sensors, 18.","DOI":"10.3390\/s18020401"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"121549","DOI":"10.1109\/ACCESS.2020.3006958","article-title":"Facial Micro-Expression Recognition Using Two-Dimensional Landmark Feature Maps","volume":"8","author":"Choi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"De Carolis, B., D\u2019Errico, F., Macchiarulo, N., and Palestra, G. (2019, January 14). \u201cEngaged Faces\u201d: Measuring and Monitoring Student Engagement from Face and Gaze Behavior. Proceedings of the IEEE\/WIC\/ACM International Conference on Web Intelligence-Companion Volume, New York, NY, USA.","DOI":"10.1145\/3358695.3361748"},{"key":"ref_9","unstructured":"Agrati, L.S., Burgos, D., Ducange, P., Limone, P., Perla, L., Picerno, P., Raviolo, P., and Stracke, C.M. Recognizing Cognitive Emotions in E-Learning Environment. Proceedings of the Bridges and Mediation in Higher Distance Education."},{"key":"ref_10","unstructured":"Gennari, R., Vittorini, P., De la Prieta, F., Di Mascio, T., Temperini, M., Azambuja Silveira, R., and Ovalle Carranza, D.A. Cognitive Emotions Recognition in E-Learning: Exploring the Role of Age Differences and Personality Traits. Proceedings of the Methodologies and Intelligent Systems for Technology Enhanced Learning, 9th International Conference."},{"key":"ref_11","unstructured":"Simonyan, K., and Zisserman, A. (2021, May 10). Very Deep Convolutional Networks for Large-Scale Image Recognition. Available online: https:\/\/arxiv.org\/pdf\/1409.1556.pdf."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The Extended Cohn-Kanade Dataset (CK+): A Complete Dataset for Action Unit and Emotion-Specified Expression. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_13","unstructured":"Lyons, M., Kamachi, M., and Gyoba, J. (2021, May 10). The Japanese Female Facial Expression (JAFFE) Dataset 1998; 1998. Available online: https:\/\/zenodo.org\/record\/3451524#.YJtUMqgzbIU."},{"key":"ref_14","unstructured":"Yin, L., Wei, X., Sun, Y., Wang, J., and Rosato, M.J. (2006, January 10\u201312). A 3D Facial Expression Database for Facial Behavior Research. Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR06), Southampton, UK."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.patrec.2019.01.008","article-title":"Extended Deep Neural Network for Facial Emotion Recognition","volume":"120","author":"Jain","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1146\/annurev.ps.30.020179.002523","article-title":"Facial Expressions of Emotion","volume":"30","author":"Ekman","year":"1979","journal-title":"Annu. Rev. Psychol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1080\/09658210903130764","article-title":"A Comparison of Dimensional Models of Emotion: Evidence from Emotions, Prototypical Events, Autobiographical Memories, and Words","volume":"17","author":"Rubin","year":"2009","journal-title":"Memory"},{"key":"ref_18","unstructured":"Panksepp, J. (2004). Affective Neuroscience: The Foundations of Human and Animal Emotions, Oxford University Press."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TAFFC.2017.2740923","article-title":"AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild","volume":"10","author":"Mollahosseini","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_20","unstructured":"Suk, M., and Prabhakaran, B. (2021, May 10). Real-Time Mobile Facial Expression Recognition System-A Case Study. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.1011.4398&rep=rep1&type=pdf."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"7714","DOI":"10.3390\/s130607714","article-title":"Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines","volume":"13","author":"Ghimire","year":"2013","journal-title":"Sensors"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Happy, S.L., George, A., and Routray, A. (2012, January 27\u201329). A Real Time Facial Expression Classification System Using Local Binary Patterns. Proceedings of the 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI), Kharagpur, India.","DOI":"10.1109\/IHCI.2012.6481802"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Szwoch, M., and Pieni\u0105\u017cek, P. (2015, January 25\u201327). Facial Emotion Recognition Using Depth Data. Proceedings of the 2015 8th International Conference on Human System Interaction (HSI), Warsaw, Poland.","DOI":"10.1109\/HSI.2015.7170679"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jung, H., Lee, S., Yim, J., Park, S., and Kim, J. (2021, May 10). Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition. Available online: https:\/\/www.cv-foundation.org\/openaccess\/content_iccv_2015\/papers\/Jung_Joint_Fine-Tuning_in_ICCV_2015_paper.pdf.","DOI":"10.1109\/ICCV.2015.341"},{"key":"ref_25","unstructured":"Breuer, R., and Kimmel, R. (2021, May 10). A Deep Learning Perspective on the Origin of Facial Expressions. Available online: https:\/\/arxiv.org\/pdf\/1705.01842.pdf."},{"key":"ref_26","unstructured":"Hasani, B., and Mahoor, M.H. (2021, May 10). Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks. Available online: https:\/\/arxiv.org\/pdf\/1705.07871.pdf."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1109\/TAFFC.2017.2695999","article-title":"Multi-Objective Based Spatio-Temporal Feature Representation Learning Robust to Expression Intensity Variations for Facial Expression Recognition","volume":"10","author":"Kim","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ng, H.-W., Nguyen, V.D., Vonikakis, V., and Winkler, S. (2015, January 9). Deep Learning for Emotion Recognition on Small Datasets Using Transfer Learning. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, New York, NY, USA.","DOI":"10.1145\/2818346.2830593"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"17","DOI":"10.3233\/WEB-190397","article-title":"Automating Facial Emotion Recognition","volume":"17","author":"Gervasi","year":"2019","journal-title":"Web Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chu, W.-S., De la Torre, F., and Cohn, J.F. (June, January 30). Learning Spatial and Temporal Cues for Multi-Label Facial Action Unit Detection. Proceedings of the 2017 12th IEEE International Conference on Automatic Face Gesture Recognition (FG 2017), Washington, DC, USA.","DOI":"10.1109\/FG.2017.13"},{"key":"ref_31","unstructured":"Graves, A., Mayer, C., Wimmer, M., and Radig, B. (2021, May 10). Facial Expression Recognition with Recurrent Neural Networks. Available online: https:\/\/www.cs.toronto.edu\/~graves\/cotesys_2008.pdf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.patrec.2017.06.025","article-title":"Multi Angle Optimal Pattern-Based Deep Learning for Automatic Facial Expression Recognition","volume":"139","author":"Jain","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ebrahimi Kahou, S., Michalski, V., Konda, K., Memisevic, R., and Pal, C. (2015, January 9). Recurrent Neural Networks for Emotion Recognition in Video. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, New York, NY, USA.","DOI":"10.1145\/2818346.2830596"},{"key":"ref_34","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press. Adaptive Computation and Machine Learning."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Franzoni, V., Biondi, G., Perri, D., and Gervasi, O. (2020). Enhancing Mouth-Based Emotion Recognition Using Transfer Learning. Sensors, 20.","DOI":"10.20944\/preprints202007.0379.v1"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kim, J.H., Poulose, A., and Han, D.S. (2021). The Extensive Usage of the Facial Image Threshing Machine for Facial Emotion Recognition Performance. Sensors, 21.","DOI":"10.3390\/s21062026"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kuo, C., Lai, S., and Sarkis, M. (2018, January 18\u201322). A Compact Deep Learning Model for Robust Facial Expression Recognition. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00286"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.imavis.2017.01.012","article-title":"Video-Based Emotion Recognition in the Wild Using Deep Transfer Learning and Score Fusion","volume":"65","author":"Kaya","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_39","unstructured":"Li, S., and Deng, W. (2020). Deep Facial Expression Recognition: A Survey. IEEE Trans. Affect. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhao, H., Ye, N., and Wang, R. (2018, January 3\u20135). A Survey on Automatic Emotion Recognition Using Audio Big Data and Deep Learning Architectures. Proceedings of the 2018 IEEE 4th International Conference on Big Data Security on Cloud (BigDataSecurity), Omaha, NE, USA.","DOI":"10.1109\/BDS\/HPSC\/IDS18.2018.00039"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.inffus.2020.01.011","article-title":"Emotion Recognition Using Multi-Modal Data and Machine Learning Techniques: A Tutorial and Review","volume":"59","author":"Zhang","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chen, L., Feng, G., Joe, J., Leong, C.W., Kitchen, C., and Lee, C.M. (2014, January 12). Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues. Proceedings of the Proceedings of the 16th International Conference on Multimodal Interaction, Istanbul, Turkey.","DOI":"10.1145\/2663204.2663265"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1504\/IJODE.2016.080157","article-title":"Lessons from the Collaborative Innovation Networks Seminar","volume":"4","author":"Gloor","year":"2016","journal-title":"IJODE"},{"key":"ref_44","unstructured":"Chollet, F. (2021, May 10). Xception: Deep Learning With Depthwise Separable Convolutions. Available online: https:\/\/arxiv.org\/pdf\/1610.02357.pdf."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.jretconser.2017.01.001","article-title":"Emotion and advertising effectiveness: A novel facial expression analysis approach","volume":"36","author":"Hamelin","year":"2017","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_46","unstructured":"Franzoni, V., Vallverd\u00f9, J., and Milani, A. (2021, May 10). Errors, biases and overconfidence in artificial emotional modeling. Available online: https:\/\/www.researchgate.net\/publication\/336626687_Errors_Biases_and_Overconfidence_in_Artificial_Emotional_Modeling."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/5\/126\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:59:42Z","timestamp":1760162382000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/5\/126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,12]]},"references-count":46,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["fi13050126"],"URL":"https:\/\/doi.org\/10.3390\/fi13050126","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2021,5,12]]}}}