{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:13:31Z","timestamp":1750220011054,"version":"3.41.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"ISS","license":[{"start":{"date-parts":[[2022,11,14]],"date-time":"2022-11-14T00:00:00Z","timestamp":1668384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Austrian Science Fund FWF","award":["P 34928"],"award-info":[{"award-number":["P 34928"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,11,14]]},"abstract":"<jats:p>In recent years, research on collaborative interaction has relied on manual coding of rich audio\/video recordings. The fine-grained analysis of such material is extremely time-consuming and labor-intensive. This is not only difficult to scale, but, as a result, might also limit the quality and completeness of coding due to fatigue, inherent human biases, (accidental or intentional), and inter-rater inconsistencies. In this paper, we explore how recent advances in machine learning may reduce manual effort and loss of information while retaining the value of human intelligence in the coding process. We present ACACIA (AI Chain for Augmented Collaborative Interaction Analysis), an AI video data analysis application which combines a range of advances in machine perception of video material for the analysis of collaborative interaction. We evaluate ACACIA's abilities, show how far we can already get, and which challenges remain. Our contribution lies in establishing a combined machine and human analysis pipeline that may be generalized to different collaborative settings and guide future research.<\/jats:p>","DOI":"10.1145\/3567724","type":"journal-article","created":{"date-parts":[[2022,11,14]],"date-time":"2022-11-14T21:31:51Z","timestamp":1668461511000},"page":"354-380","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Semi-automated Analysis of Collaborative Interaction: Are We There Yet?"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3607-8873","authenticated-orcid":false,"given":"Thomas","family":"Neumayr","sequence":"first","affiliation":[{"name":"University of Applied Sciences Upper Austria, Hagenberg, Austria \/ JKU Linz, Linz, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7901-3765","authenticated-orcid":false,"given":"Mirjam","family":"Augstein","sequence":"additional","affiliation":[{"name":"University of Applied Sciences Upper Austria, Hagenberg, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1706-6319","authenticated-orcid":false,"given":"Johannes","family":"Sch\u00f6nb\u00f6ck","sequence":"additional","affiliation":[{"name":"University of Applied Sciences Upper Austria, Hagenberg, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0840-0546","authenticated-orcid":false,"given":"Sean","family":"Rintel","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8545-1924","authenticated-orcid":false,"given":"Helmut","family":"Leeb","sequence":"additional","affiliation":[{"name":"University of Applied Sciences Upper Austria, Hagenberg, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6581-9664","authenticated-orcid":false,"given":"Thomas","family":"Teichmeister","sequence":"additional","affiliation":[{"name":"University of Applied Sciences Upper Austria, Hagenberg, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,14]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"2019. act4teams\u00ae Handbuch Version 2.3. \t\t\t\t  2019. act4teams\u00ae Handbuch Version 2.3."},{"volume-title":"Interaction process analysis","author":"Bales Robert F","key":"e_1_2_2_2_1","unstructured":"Robert F Bales . 1950. Interaction process analysis ; a method for the study of small groups.. Addison-Wesley , Boston, MA, USA . Robert F Bales. 1950. Interaction process analysis; a method for the study of small groups.. Addison-Wesley, Boston, MA, USA."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38977-1_11"},{"key":"e_1_2_2_4_1","volume-title":"Anne Loomis Thompson, and Eric Horvitz","author":"Bohus Dan","year":"2021","unstructured":"Dan Bohus , Sean Andrist , Ashley Feniello , Nick Saw , Mihai Jalobeanu , Patrick Sweeney , Anne Loomis Thompson, and Eric Horvitz . 2021 . Platform for Situated Intelligence . arxiv:2103.15975. Dan Bohus, Sean Andrist, Ashley Feniello, Nick Saw, Mihai Jalobeanu, Patrick Sweeney, Anne Loomis Thompson, and Eric Horvitz. 2021. Platform for Situated Intelligence. arxiv:2103.15975."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1017\/9781316286302"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173874"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3279778.3279795"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apmr.2019.07.016"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84882-483-6_13"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-3342-9_1"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.3390\/rs12030489"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1002\/bies.201900004"},{"volume-title":"The pedagogy of a data analysis session","author":"Harris Jessica","key":"e_1_2_2_13_1","unstructured":"Jessica Harris , Maryanne Theobald , Susan Danby , Edward Reynolds , Sean Rintel , and Members of the Transcript Analysis Group (Tag). 2012. \u2018What\u2019s going on here? \u2019 The pedagogy of a data analysis session . In Reshaping Doctoral Education, Alison Lee and Susan Danby (Eds.). Routledge , London, UK . 109\u2013121. Jessica Harris, Maryanne Theobald, Susan Danby, Edward Reynolds, Sean Rintel, and Members of the Transcript Analysis Group (Tag). 2012. \u2018What\u2019s going on here?\u2019 The pedagogy of a data analysis session. In Reshaping Doctoral Education, Alison Lee and Susan Danby (Eds.). Routledge, London, UK. 109\u2013121."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature23463"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046496418802362"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.287"},{"key":"e_1_2_2_17_1","volume-title":"Glossary of transcript symbols with an introduction. Pragmatics and beyond new series, 125","author":"Jefferson Gail","year":"2004","unstructured":"Gail Jefferson . 2004. Glossary of transcript symbols with an introduction. Pragmatics and beyond new series, 125 ( 2004 ), 13\u201334. Gail Jefferson. 2004. Glossary of transcript symbols with an introduction. Pragmatics and beyond new series, 125 (2004), 13\u201334."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.4103\/aca.ACA_243_16"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1108\/13563280010377518"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1017\/9781316286302.022"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1017\/9781316286302.003"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.emj.2021.01.001"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.2307\/3105385"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.15252\/msb.20177551"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1253\/circj.CJ-19-0420"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094428117745649"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"2014. Interact 14 Benutzerhandbuch Version 14.1.4. \t\t\t\t  2014. Interact 14 Benutzerhandbuch Version 14.1.4.","DOI":"10.1167\/14.8.14"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/08351813.2018.1413878"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445290"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2015.1093421"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00345-019-03059-0"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274397"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1356"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0074524"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052600"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41433-018-0064-9"},{"volume-title":"The coding manual for qualitative researchers","author":"Salda\u00f1a Johnny","key":"e_1_2_2_37_1","unstructured":"Johnny Salda\u00f1a . 2015. The coding manual for qualitative researchers . Sage , London, UK . Johnny Salda\u00f1a. 2015. The coding manual for qualitative researchers. Sage, London, UK."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1080\/19312458.2011.651346"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-658-08493-6_18"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1167\/iovs.18-24106"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031607.1031655"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124950"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(91)90039-A"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-019-00174-2"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1080\/00220671.1934.10880446"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064720"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3567724","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3567724","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:12Z","timestamp":1750182672000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3567724"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,14]]},"references-count":46,"journal-issue":{"issue":"ISS","published-print":{"date-parts":[[2022,11,14]]}},"alternative-id":["10.1145\/3567724"],"URL":"https:\/\/doi.org\/10.1145\/3567724","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2022,11,14]]},"assertion":[{"value":"2022-11-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}