{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,3]],"date-time":"2025-12-03T17:51:10Z","timestamp":1764784270225,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T00:00:00Z","timestamp":1565308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Speaking and presenting in public are critical skills for academic and professional development. These skills are demanded across society, and their development and evaluation are a challenge faced by higher education institutions. There are some challenges to evaluate objectively, as well as to generate valuable information to professors and appropriate feedback to students. In this paper, in order to understand and detect patterns in oral student presentations, we collected data from 222 Computer Engineering (CE) fresh students at three different times, over two different years (2017 and 2018). For each presentation, using a developed system and Microsoft Kinect, we have detected 12 features related to corporal postures and oral speaking. These features were used as input for the clustering and statistical analysis that allowed for identifying three different clusters in the presentations of both years, with stronger patterns in the presentations of the year 2017. A Wilcoxon rank-sum test allowed us to evaluate the evolution of the presentations attributes over each year and pointed out a convergence in terms of the reduction of the number of features statistically different between presentations given at the same course time. The results can further help to give students automatic feedback in terms of their postures and speech throughout the presentations and may serve as baseline information for future comparisons with presentations from students coming from different undergraduate courses.<\/jats:p>","DOI":"10.3390\/s19163493","type":"journal-article","created":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T11:11:31Z","timestamp":1565349091000},"page":"3493","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Using Depth Cameras to Detect Patterns in Oral Presentations: A Case Study Comparing Two Generations of Computer Engineering Students"],"prefix":"10.3390","volume":"19","author":[{"given":"Felipe","family":"Roque","sequence":"first","affiliation":[{"name":"Centro de Ci\u00eancias, Tecnologias e Sa\u00fade, Universidade Federal de Santa Catarina, Ararangu\u00e1 88906072, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6384-409X","authenticated-orcid":false,"given":"Cristian","family":"Cechinel","sequence":"additional","affiliation":[{"name":"Centro de Ci\u00eancias, Tecnologias e Sa\u00fade, Universidade Federal de Santa Catarina, Ararangu\u00e1 88906072, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3993-9341","authenticated-orcid":false,"given":"Tiago O.","family":"Weber","sequence":"additional","affiliation":[{"name":"Centro de Ci\u00eancias, Tecnologias e Sa\u00fade, Universidade Federal de Santa Catarina, Ararangu\u00e1 88906072, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0750-6859","authenticated-orcid":false,"given":"Robson","family":"Lemos","sequence":"additional","affiliation":[{"name":"Centro de Ci\u00eancias, Tecnologias e Sa\u00fade, Universidade Federal de Santa Catarina, Ararangu\u00e1 88906072, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rodolfo","family":"Villarroel","sequence":"additional","affiliation":[{"name":"Escuela de Ingenier\u00eda Inform\u00e1tica, Pontificia Universidad Cat\u00f3lica de Valpara\u00edso, Valpara\u00edso 2362807, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diego","family":"Miranda","sequence":"additional","affiliation":[{"name":"Escuela de Ingenier\u00eda Civil Inform\u00e1tica, Universidad de Valpara\u00edso, Valpara\u00edso 2362735, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1302-0206","authenticated-orcid":false,"given":"Roberto","family":"Munoz","sequence":"additional","affiliation":[{"name":"Escuela de Ingenier\u00eda Civil Inform\u00e1tica, Universidad de Valpara\u00edso, Valpara\u00edso 2362735, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1002\/j.2168-9830.2005.tb00828.x","article-title":"The ABET \u201cProfessional Skills\u201d\u2014Can They Be Taught? Can They Be Assessed?","volume":"94","author":"Shuman","year":"2005","journal-title":"J. Eng. Educ."},{"key":"ref_2","unstructured":"Sabin, M., Alrumaih, H., Impagliazzo, J., Lunt, B., Zhang, M., Byers, B., Newhouse, W., Paterson, B., Peltsverger, S., and Tang, C. (2017). Curriculum Guidelines for Baccalaureate Degree Programs in Information Technology, ACM. Technical Report."},{"key":"ref_3","unstructured":"Lucas, S. (2011). The Art of Public Speaking, McGraw-Hill Education. [11th ed.]."},{"key":"ref_4","unstructured":"York, D. (2013). Investigating a Relationship between Nonverbal Communication and Student Learning. [Ph.D. Thesis, Lindenwood University]."},{"key":"ref_5","first-page":"149","article-title":"Development of a Software that Supports Multimodal Learning Analytics: A Case Study on Oral Presentations","volume":"24","author":"Munoz","year":"2018","journal-title":"J. Univers. Comput. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mehrabian, A. (2017). Nonverbal Communication, Routledge.","DOI":"10.4324\/9781351308724"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"67783","DOI":"10.1109\/ACCESS.2018.2876801","article-title":"Exploring Collaborative Writing of User Stories With Multimodal Learning Analytics: A Case Study on a Software Engineering Course","volume":"6","author":"Noel","year":"2018","journal-title":"IEEE Access"},{"key":"ref_8","unstructured":"Lang, C., Siemens, G., Wise, A.F., and Ga\u0161evic, D. (2017). Multimodal Learning Analytics. The Handbook of Learning Analytics, Society for Learning Analytics Research (SoLAR). [1st ed.]."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/s11412-013-9181-4","article-title":"Real-time mutual gaze perception enhances collaborative learning and collaboration quality","volume":"8","author":"Schneider","year":"2013","journal-title":"Int. J. Comput.-Supported Collab. Learn."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ochoa, X., Dom\u00ednguez, F., Guam\u00e1n, B., Maya, R., Falcones, G., and Castells, J. (2018, January 7\u20139). The RAP System: Automatic Feedback of Oral Presentation Skills Using Multimodal Analysis and Low-cost Sensors. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, LAK \u201918, Sydney, New South Wales, Australia.","DOI":"10.1145\/3170358.3170406"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"151","DOI":"10.18608\/jla.2014.12.8","article-title":"Analyzing engineering design through the lens of computation","volume":"1","author":"Worsley","year":"2014","journal-title":"J. Learn. Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s11257-007-9037-6","article-title":"Automatic detection of learner\u2019s affect from conversational cues","volume":"18","author":"Craig","year":"2008","journal-title":"User Model. User-Adapt. Interact."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Thompson, K. (2013, January 9\u201313). Using micro-patterns of speech to predict the correctness of answers to mathematics problems: An exercise in multimodal learning analytics. Proceedings of the 15th ACM on International Conference on Multimodal Interaction, Sydney, Australia.","DOI":"10.1145\/2522848.2533792"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Oviatt, S., and Cohen, A. (2013, January 9\u201313). Written and multimodal representations as predictors of expertise and problem-solving success in mathematics. Proceedings of the 15th ACM on International Conference on Multimodal Interaction, Sydney, Australia.","DOI":"10.1145\/2522848.2533793"},{"key":"ref_15","unstructured":"Worsley, M., and Blikstein, P. (2011, January 6\u20138). What\u2019s an Expert? Using Learning Analytics to Identify Emergent Markers of Expertise through Automated Speech, Sentiment and Sketch Analysis. Proceedings of the 4th International Conference on Educational Data Mining, Eindhoven, The Netherlands."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"213","DOI":"10.18608\/jla.2016.32.10","article-title":"Augmenting Learning Analytics with Multimodal Sensory Data","volume":"3","author":"Ochoa","year":"2016","journal-title":"J. Learn. Anal."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ochoa, X., Worsley, M., Weibel, N., and Oviatt, S. (2016, January 25\u201329). Multimodal learning analytics data challenges. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge-LAK16, Edinburgh, UK.","DOI":"10.1145\/2883851.2883913"},{"key":"ref_18","unstructured":"Duda, R.O., Hart, P.E., and Stork, D.G. (1995). Pattern Classification and Scene Analysis, Wiley Interscience. [2nd ed.]."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Riquelme, F., Munoz, R., Lean, R.M., Villarroel, R., Barcelos, T.S., and de Albuquerque, V.H.C. (2019). Using multimodal learning analytics to study collaboration on discussion groups. Univers. Access Inf. Soc.","DOI":"10.1007\/s10209-019-00683-w"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Blikstein, P. (2013, January 8\u201313). Multimodal learning analytics. Proceedings of the Third International Conference on Learning Analytics and Knowledge, Leuven, Belgium.","DOI":"10.1145\/2460296.2460316"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Scherer, S., Worsley, M., and Morency, L. (2012, January 22\u201326). 1st international workshop on multimodal learning analytics. Proceedings of the ACM International Conference on Multimodal Interaction\u2014ICMI\u201912, Santa Monica, CA, USA.","DOI":"10.1145\/2388676.2388803"},{"key":"ref_22","unstructured":"Worsley, M. (2018, January 7\u20139). Multimodal Learning Analytics\u2019 Past, Present, and, Potential Futures. Proceedings of the International Conference on Learning Analytics & Knowledge, Sydney, NSW, Australia."},{"key":"ref_23","unstructured":"Bidwell, J., and Fuchs, H. (2011). Classroom Analytics: Measuring Student Engagement with Automated Gaze Tracking, Department of Computer, University of North Carolina at Chapel Hill. Technical Report."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ochoa, X., Chiluiza, K., M\u00e9ndez, G., Luzardo, G., Guam\u00e1n, B., and Castells, J. (2013, January 9\u201313). Expertise Estimation Based on Simple Multimodal Features. Proceedings of the 15th ACM on International Conference on Multimodal Interaction, ICMI \u201913, Sydney, Australia.","DOI":"10.1145\/2522848.2533789"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Raca, M., and Dillenbourg, P. (2013, January 8\u201312). System for Assessing Classroom Attention. Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK \u201913, Leuven, Belgium.","DOI":"10.1145\/2460296.2460351"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Raca, M., Tormey, R., and Dillenbourg, P. (2014, January 24\u201328). Sleepers\u2019 Lag\u2014Study on Motion and Attention. Proceedings of the Fourth International Conference on Learning Analytics In addition, Knowledge, LAK \u201914, Indianapolis, IN, USA.","DOI":"10.1145\/2567574.2567581"},{"key":"ref_27","unstructured":"Cohen, I., and Li, H. (2003, January 17). Inference of human postures by classification of 3D human body shape. Proceedings of the 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443), Nice, France."},{"key":"ref_28","unstructured":"Mo, H.C., Leou, J.J., and Lin, C.S. (2009, January 20\u201322). Human Behavior Analysis Using Multiple 2D Features and Multicategory Support Vector Machine. Proceedings of the MVA2009 IAPR Conference on Machine Vision Applications, Yokohama, Japan."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chen, R. (2011). Recognizing Human Activities Using Nonlinear SVM Decision Tree. Intelligent Computing and Information Science, Springer.","DOI":"10.1007\/978-3-642-18134-4"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chella, A., Dindo, H., and Infantino, I. (2005, January 21\u201324). A System for Simultaneous People Tracking and Posture Recognition in the context of Human-Computer Interaction. Proceedings of the EUROCON 2005\u2014The International Conference on \u201cComputer as a Tool\u201d, Belgrade, Serbia.","DOI":"10.1109\/EURCON.2005.1630114"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Moghaddam, Z., and Piccardi, M. (2010, January 29\u201329). Human Action Recognition with MPEG-7 Descriptors and Architectures. Proceedings of the First ACM International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams, ARTEMIS \u201910, Firenze, Italy.","DOI":"10.1145\/1877868.1877885"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Le, T., Nguyen, M., and Nguyen, T. (2013, January 21\u201324). Human posture recognition using human skeleton provided by Kinect. Proceedings of the 2013 International Conference on Computing, Management and Telecommunications (ComManTel), Ho Chi Minh City, Vietnam.","DOI":"10.1109\/ComManTel.2013.6482417"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Echeverr\u00eda, V., Avenda\u00f1o, A., Chiluiza, K., V\u00e1squez, A., and Ochoa, X. (2014, January 12). Presentation Skills Estimation Based on Video and Kinect Data Analysis. Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, MLA \u201914, Istanbul, Turkey.","DOI":"10.1145\/2666633.2666641"},{"key":"ref_34","unstructured":"Reilly, J., Ravenell, M., and Schneider, B. (2018, January 15\u201318). Exploring Collaboration Using Motion Sensors and Multi-Modal Learning Analytics. Proceedings of the 11th International Conference on Educational Data Mining, Buffalo, NY, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Luzardo, G., Guam\u00e1n, B., Chiluiza, K., Castells, J., and Ochoa, X. (2014, January 12). Estimation of Presentations Skills Based on Slides and Audio Features. Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, MLA \u201914, Istanbul, Turkey.","DOI":"10.1145\/2666633.2666639"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gan, T., Wong, Y., Mandal, B., Chandrasekhar, V., and Kankanhalli, M.S. (2015, January 26\u201330). Multi-sensor Self-Quantification of Presentations. Proceedings of the 23rd ACM International Conference on Multimedia, MM \u201915, Brisbane, Australia.","DOI":"10.1145\/2733373.2806252"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A Decision-Theoretic Generalization of on-Line Learning and an Application to Boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1086\/200975","article-title":"Proxemics [and Comments and Replies]","volume":"9","author":"Hall","year":"1968","journal-title":"Curr. Anthropol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chen, L., Leong, C.W., Feng, G., Lee, C.M., and Somasundaran, S. (2015, January 21\u201324). Utilizing multimodal cues to automatically evaluate public speaking performance. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi\u2019an, China.","DOI":"10.1109\/ACII.2015.7344601"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1080\/01621459.1967.10482916","article-title":"On the Kolmogorov\u2013Smirnov test for normality with mean and variance unknown","volume":"62","author":"Lilliefors","year":"1967","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gibbons, J.D., and Chakraborti, S. (2011). Nonparametric statistical inference. International Encyclopedia of Statistical Science, Springer.","DOI":"10.1201\/9781439896129"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: A graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J. Comput. Appl. Math."},{"key":"ref_45","first-page":"1","article-title":"The effect over time of a video-based reflection system on preservice teachers\u2019 oral presentations","volume":"39","author":"Cavanagh","year":"2014","journal-title":"Aust. J. Teach. Educ."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1111\/j.1749-818X.2008.00067.x","article-title":"Gesture gives a hand to language and learning: Perspectives from cognitive neuroscience, developmental psychology and education","volume":"2","author":"Kelly","year":"2008","journal-title":"Lang. Linguist. Compass"},{"key":"ref_47","first-page":"89","article-title":"Unraveling students\u2019 interaction around a tangible interface using multimodal learning analytics","volume":"7","author":"Schneider","year":"2015","journal-title":"J. Educ. Data Min."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3493\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:09:57Z","timestamp":1760188197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3493"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,9]]},"references-count":47,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19163493"],"URL":"https:\/\/doi.org\/10.3390\/s19163493","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,8,9]]}}}