{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T17:25:53Z","timestamp":1782321953935,"version":"3.54.5"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"R\u00e9gion Pays de la Loire, France","award":["Convention n\u00b02021-12881"],"award-info":[{"award-number":["Convention n\u00b02021-12881"]}]},{"DOI":"10.13039\/501100006374","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-20-CE33-0007"],"award-info":[{"award-number":["ANR-20-CE33-0007"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,2]]},"abstract":"<jats:p>In high-stakes collaborative situations, a decline in collaboration quality can lead to adverse events with significant consequences. Analyses performed by Human factor (HF) specialists, while effective in identifying and addressing collaboration issues, are case-specific and most of the time performed a posteriori. To address these limitations, our research focuses on a real-time assessment of collaboration processes using multimodal signals collected and analyzed during the activity. Existing collaboration profiles taxonomies face limitations such as a posteriori profiles detection and the absence of quantitative behavioral indicators that can be measured during the activity. Leveraging Virtual Reality (VR), we have developed a framework for evaluating collaboration in controlled setting, testing the effectiveness of a subset of multimodal signals to detect collaboration profiles. We test our approach in a study including 11 stereotyped collaborative scenarios applied to a VR puzzle-solving task. This study reveals the effectiveness of our approach in distinguishing between non-collaborative and highly collaborative profiles. However, challenges arise in discriminating between closely related collaborative profiles. This paper also proposes some guidelines on how to improve the collaboration profile detection framework and address other collaborative situations.<\/jats:p>","DOI":"10.1145\/3710996","type":"journal-article","created":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T01:35:05Z","timestamp":1746236105000},"page":"1-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["How to Categorize Collaboration during a Collaborative Puzzle-solving Task? Validation of Collaboration Profiles using Multimodal Data in Virtual Reality Context"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7264-7735","authenticated-orcid":false,"given":"Aur\u00e9lien","family":"L\u00e9chapp\u00e9","sequence":"first","affiliation":[{"name":"IMT Atlantique, LS2N, UMR CNRS 6004, Nantes, France and IMT Atlantique, Lab-STICC, UMR CNRS 6285, Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3930-9825","authenticated-orcid":false,"given":"C\u00e9dric","family":"Fleury","sequence":"additional","affiliation":[{"name":"IMT Atlantique, Lab-STICC, UMR CNRS 6285, Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9858-6844","authenticated-orcid":false,"given":"Mathieu","family":"Chollet","sequence":"additional","affiliation":[{"name":"School of Computing Science, University of Glasgow, Glasgow, United Kingdom and IMT Atlantique, LS2N, UMR CNRS 6004, Nantes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3779-0988","authenticated-orcid":false,"given":"C\u00e9dric","family":"Dumas","sequence":"additional","affiliation":[{"name":"IMT Atlantique, LS2N, UMR CNRS 6004, Nantes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"The Development of Situational-Misconceptions in Math Problem Solving. In 11th International Conference on Computer Supported Collaborative Learning, CSCL 2015","author":"Abdu Rotem","year":"2015","unstructured":"Rotem Abdu. 2015. The Development of Situational-Misconceptions in Math Problem Solving. In 11th International Conference on Computer Supported Collaborative Learning, CSCL 2015, Gothenburg, Sweden, June 7--11, 2015, Oskar Lindwall, P\u00e4ivi H\u00e4kkinen, Timothy Koschmann, Pierre Tchounikine, and Sten R. Ludvigsen (Eds.). International Society of the Learning Sciences, Gothenburg, Sweden. https:\/\/repository.isls.org\/handle\/1\/393"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.6.1.Admoni"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--98276--214"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2011.01.003"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300813"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2010.18"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.2307\/1129997"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2103.15975"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576050.3576144"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.leaqua.2022.101654"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--20798--412"},{"key":"e_1_2_1_12_1","volume-title":"Using language","author":"Clark Herbert H","unstructured":"Herbert H Clark. 1996. Using language. Cambridge university press."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/10096-006"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2017.08.007"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","unstructured":"Yong Dich Joseph Reilly and Bertrand Schneider. 2018. Using Physiological Synchrony as an Indicator of Collaboration Quality Task Performance and Learning. In Artificial Intelligence in Education (Lecture Notes in Computer Science. 98--110. https:\/\/doi.org\/10.1007\/978--3--319--93843--1_8","DOI":"10.1007\/978--3--319--93843--1_8"},{"key":"e_1_2_1_16_1","unstructured":"Pierre Dillenbourg. 1999. What do you mean by collaborative learning? Collaborative-learning: Cognitive and computational approaches. (1999) 1--19. https:\/\/hal.science\/hal-00190240\/en\/"},{"key":"e_1_2_1_17_1","first-page":"88","article-title":"The use of emotionally expressive avatars in collaborative virtual environments","volume":"88","author":"Fabri Marc","year":"2005","unstructured":"Marc Fabri and David Moore. 2005. The use of emotionally expressive avatars in collaborative virtual environments. Virtual Social Agents, Vol. 88, April (2005), 88--94.","journal-title":"Virtual Social Agents"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/app14052167"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","unstructured":"Rowanne Fleck Yvonne Rogers Nicola Yuill Paul Marshall Amanda Carr Jochen Rick and Victoria Bonnett. 2009. Actions speak loudly with words: unpacking collaboration around the table. https:\/\/doi.org\/10.1145\/1731903.1731939","DOI":"10.1145\/1731903.1731939"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.33"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2010.10.003"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1100.0547"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.287"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2388676.2388772"},{"key":"e_1_2_1_25_1","volume-title":"GroupWare: Computer Support for Business Teams","author":"Johansen Robert","unstructured":"Robert Johansen. 1988. GroupWare: Computer Support for Business Teams. The Free Press."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","unstructured":"Georgios Kahrimanis Anne Meier Irene-Angelica Chounta Eleni Voyiatzaki Hans Spada Nikol Rummel and Nikolaos Avouris. 2009. Assessing Collaboration Quality in Synchronous CSCL Problem-Solving Activities: Adaptation and Empirical Evaluation of a Rating Scheme. In Learning in the Synergy of Multiple Disciplines (Lecture Notes in Computer Science. 267--272. https:\/\/doi.org\/10.1007\/978--3--642-04636-025","DOI":"10.1007\/978--3--642-04636-025"},{"key":"e_1_2_1_27_1","unstructured":"Adam Kendom. 1976. The F-formation system: The spatial organization of social encounters. https:\/\/www.researchgate.net\/figure\/Kendons-F-formation-system_fig1261181296"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2015--380"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--95678--7_65"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666633.2666635"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/6632420"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2017.1338956"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--642--39112--511"},{"key":"e_1_2_1_34_1","unstructured":"Elizabeth McBride Jonathan Vitale Lauren Applebaum and Marcia Linn. 2017. Examining the flow of ideas during critique activities in a design project. https:\/\/repository.isls.org\/handle\/1\/296"},{"key":"e_1_2_1_35_1","volume-title":"Groups: interaction and performance","author":"McGrath Joseph Edward","unstructured":"Joseph Edward McGrath. 1984. Groups: interaction and performance. Prentice-Hall, Englewood Cliffs, N.J. OCLC: 9083474."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-006--9005-x"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/app12157499"},{"key":"e_1_2_1_38_1","unstructured":"Isabella Poggi. 2007. Mind hands face and body. A goal and belief view of multimodal communication."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--28357--512"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","unstructured":"Sambit Praharaj. 2022. Measuring the Unmeasurable? Towards Automatic Co-located Collaboration Analytics. https:\/\/doi.org\/10.13140\/RG.2.2.18216.65287","DOI":"10.13140\/RG.2.2.18216.65287"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2021.3097766"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3506860.3506922"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog000029"},{"key":"e_1_2_1_44_1","volume-title":"12th International Conference on Computer Supported Collaborative Learning, B K Smith, M Borge, E Mercier, and K Y Lim (Eds.).","volume":"1","author":"Rodr\u00edguez F J","year":"2017","unstructured":"F J Rodr\u00edguez, K M Price, and K E Boyer. 2017. Expressing and Addressing Uncertainty: A Study of Collaborative Problem-Solving Dialogues In. In Making a Difference: Prioritizing Equity and Access in CSCL, 12th International Conference on Computer Supported Collaborative Learning, B K Smith, M Borge, E Mercier, and K Y Lim (Eds.). Vol. 1. Philadelphia, PA: International Society of the Learning Sciences., Philadelphia, PA."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--1--4419--7710--617"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.3554729"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--45001--8_7"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-018--9281--2"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21248185"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979361"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2019.03.019"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476067"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124950"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2011.07.015"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.2224\/sbp.2014.42.3.465"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","unstructured":"Yiqiu Zhou and Jina Kang. 2022. Characterizing joint attention dynamics during collaborative problem-solving in an immersive astronomy simulation. https:\/\/doi.org\/10.5281\/ZENODO.6852988showDOI","DOI":"10.5281\/ZENODO.6852988showDOI"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3710996","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3710996","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T00:53:23Z","timestamp":1755737603000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3710996"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,2]]},"references-count":56,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,2]]}},"alternative-id":["10.1145\/3710996"],"URL":"https:\/\/doi.org\/10.1145\/3710996","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,2]]},"assertion":[{"value":"2025-05-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}