{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T02:15:03Z","timestamp":1768011303889,"version":"3.49.0"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T00:00:00Z","timestamp":1728000000000},"content-version":"vor","delay-in-days":372,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-2016908, CCF-1439957"],"award-info":[{"award-number":["IIS-2016908, CCF-1439957"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005302","name":"University of Illinois at Urbana-Champaign","doi-asserted-by":"publisher","award":["Strategic Instructional Innovations Program"],"award-info":[{"award-number":["Strategic Instructional Innovations Program"]}],"id":[{"id":"10.13039\/100005302","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Instructors using algorithmic team formation tools must decide which criteria (e.g., skills, demographics, etc.) to use to group students into teams based on their teamwork goals, and have many possible sources from which to draw these configurations (e.g., the literature, other faculty, their students, etc.). However, tools offer considerable flexibility and selecting ineffective configurations can lead to teams that do not collaborate successfully. Due to such tools' relative novelty, there is currently little knowledge of how instructors choose which of these sources to utilize, how they relate different criteria to their goals for the planned teamwork, or how they determine if their configuration or the generated teams are successful. To close this gap, we conducted a survey (N=77) and interview (N=21) study of instructors using CATME Team-Maker and other criteria-based processes to investigate instructors' goals and decisions when using team formation tools. The results showed that instructors prioritized students learning to work with diverse teammates and performed \"sanity checks\" on their formation approach's output to ensure that the generated teams would support this goal, especially focusing on criteria like gender and race. However, they sometimes struggled to relate their educational goals to specific settings in the tool. In general, they also did not solicit any input from students when configuring the tool, despite acknowledging that this information might be useful. By opening the \"black box\" of the algorithm to students, more learner-centered approaches to forming teams could therefore be a promising way to provide more support to instructors configuring algorithmic tools while at the same time supporting student agency and learning about teamwork.<\/jats:p>","DOI":"10.1145\/3610096","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T15:54:10Z","timestamp":1696434850000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Composing Team Compositions: An Examination of Instructors' Current Algorithmic Team Formation Practices"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1155-4650","authenticated-orcid":false,"given":"Emily M.","family":"Hastings","sequence":"first","affiliation":[{"name":"University of Wisconsin-Eau Claire &amp; University of Illinois at Urbana-Champaign, Eau Claire, WI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2929-9264","authenticated-orcid":false,"given":"Vidushi","family":"Ojha","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0557-6138","authenticated-orcid":false,"given":"Benedict V.","family":"Austriaco","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8788-3405","authenticated-orcid":false,"given":"Karrie","family":"Karahalios","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1859-986X","authenticated-orcid":false,"given":"Brian P.","family":"Bailey","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Team-Maker Algorithm Detail. Retrieved","year":"2019","unstructured":"2017. Team-Maker Algorithm Detail. Retrieved 4 April 2019 from https:\/\/www.catme.org\/faculty\/help#TeamMakerScoring"},{"key":"e_1_2_2_2_1","volume-title":"CATME Smarter Teamwork. Retrieved","year":"2018","unstructured":"2018. CATME Smarter Teamwork. Retrieved 31 August 2018 from http:\/\/info.catme.org\/"},{"key":"e_1_2_2_3_1","volume-title":"CATME User Institutions (Alphabetical by Country). Retrieved","year":"2020","unstructured":"2020. CATME User Institutions (Alphabetical by Country). Retrieved 19 August 2020 from https:\/\/info.catme.org\/instructor\/history-research\/our-user-base\/catme-user-institutions-alphabetical-by-country\/"},{"key":"e_1_2_2_4_1","volume-title":"Usage of CATME System. Retrieved","year":"2020","unstructured":"2020. Usage of CATME System. Retrieved 14 September 2020 from https:\/\/info.catme.org\/instructor\/history-research\/"},{"key":"e_1_2_2_5_1","unstructured":"ABET. 2019. 2020--2021 Criteria for Accrediting Computing Programs. https:\/\/www.abet.org\/wp-content\/uploads\/2019\/12\/C001--20--21-CAC-Criteria-MARK-UP-11--30--19-Updated-2.pdf."},{"key":"e_1_2_2_6_1","volume-title":"Bailey","author":"Alamri Albatool A.","year":"2018","unstructured":"Albatool A. Alamri and Brian P. Bailey. 2018. Examination of the Effectiveness of a Criteria-based Team Formation Tool. In Frontiers in Education. Ieee."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/105065198700100206"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444816676645"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/105256299902300503"},{"key":"e_1_2_2_10_1","volume-title":"The role of gender in team collaboration and performance. Interdisciplinary science reviews 36, 2","author":"Bear Julia B","year":"2011","unstructured":"Julia B Bear and Anita Williams Woolley. 2011. The role of gender in team collaboration and performance. Interdisciplinary science reviews 36, 2 (2011), 146--153."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1986.tb00215.x"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.92.3.595"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/amp0000305"},{"key":"e_1_2_2_14_1","volume-title":"et al","author":"Boud David","year":"2014","unstructured":"David Boud, Ruth Cohen, et al . 2014. Peer learning in higher education: Learning from and with each other. Routledge."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2168-9830.1994.tb01113.x"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/1053451214536039"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998250"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764213515232"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-008-9051-3"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1177\/027347538600800104"},{"key":"e_1_2_2_21_1","volume-title":"Perceived classroom control, self-regulated learning strategies, and academic achievement. Educational psychology 23, 3","author":"Eshel Yohanan","year":"2003","unstructured":"Yohanan Eshel and Revital Kohavi. 2003. Perceived classroom control, self-regulated learning strategies, and academic achievement. Educational psychology 23, 3 (2003), 249--260."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415252"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376654"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300889"},{"key":"e_1_2_2_25_1","volume-title":"Relationship between students' emotional intelligence, social bond, and interactions in online learning","author":"Han Hee Young","unstructured":"Hee Young Han. 2009. Relationship between students' emotional intelligence, social bond, and interactions in online learning. University of Illinois at Urbana-Champaign."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.3200\/JOEB.82.1.11--19"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359250"},{"key":"e_1_2_2_28_1","volume-title":"Mapping the process: An exemplar of process and challenge in grounded theory analysis. Educational researcher 34, 2","author":"Harry Beth","year":"2005","unstructured":"Beth Harry, Keith M Sturges, and Janette K Klingner. 2005. Mapping the process: An exemplar of process and challenge in grounded theory analysis. Educational researcher 34, 2 (2005), 3--13."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376797"},{"key":"e_1_2_2_30_1","volume-title":"Bailey","author":"Hastings Emily M.","year":"2018","unstructured":"Emily M. Hastings, Farnaz Jahanbakhsh, Karrie Karahalios, Darko Marinov, and Brian P. Bailey. 2018. Structure or Nurture? The Effects of Team-Building Activities and Team Composition on Team Outcomes. In Proceedings of the ACM on Human-Computer Interaction, Vol. 2. ACM."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478431.3499331"},{"key":"e_1_2_2_32_1","volume-title":"Proceeding of the 44th ACM technical symposium on Computer science education. ACM, 645--650.","author":"Henry Tyson R","unstructured":"Tyson R Henry. 2013. Creating effective student groups: an introduction to groupformation. org. In Proceeding of the 44th ACM technical symposium on Computer science education. ACM, 645--650."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1539024.1508925"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/0149206307308587"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2010.17"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socec.2019.03.005"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026011"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/105256298400900413"},{"key":"e_1_2_2_39_1","volume-title":"Transdisciplinary Engineering for Complex Socio-technical Systems--Real-life Applications: Proceedings of the 27th ISTE International Conference on Transdisciplinary Engineering, July 1--July 10","volume":"12","author":"E\u00aa J\u00e9ssica Mendes","year":"2020","unstructured":"J\u00e9ssica Mendes JORGE\u00aa, Alexandre Crepory Abbott de OLIVEIRA, and Andrea Cristina dos SANTOS. 2020. Analyzing how university is preparing engineering students for Industry 4.0. In Transdisciplinary Engineering for Complex Socio-technical Systems--Real-life Applications: Proceedings of the 27th ISTE International Conference on Transdisciplinary Engineering, July 1--July 10, 2020, Vol. 12. IOS Press, 82."},{"key":"e_1_2_2_40_1","volume-title":"Social Bonds, and School Functioning.","author":"Juvonen Janna","year":"2006","unstructured":"Janna Juvonen. 2006. Sense of Belonging, Social Bonds, and School Functioning. (2006)."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858402"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046496408328821"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134698"},{"key":"e_1_2_2_44_1","first-page":"n1","article-title":"Design and Validation of a Web-Based System for Assigning Members to Teams Using Instructor-Specified Criteria","volume":"2","author":"Layton Richard A","year":"2010","unstructured":"Richard A Layton, Misty L Loughry, Matthew W Ohland, and George D Ricco. 2010. Design and Validation of a Web-Based System for Assigning Members to Teams Using Instructor-Specified Criteria. Advances in Engineering Education 2, 1 (2010), n1.","journal-title":"Advances in Engineering Education"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702548"},{"key":"e_1_2_2_46_1","first-page":"318","article-title":"Teaching teamwork in medical education","volume":"76","author":"Lerner Susan","year":"2009","unstructured":"Susan Lerner, Diane Magrane, and Erica Friedman. 2009. Teaching teamwork in medical education. Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine: A Journal of Translational and Personalized Medicine 76, 4 (2009), 318--329.","journal-title":"Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine: A Journal of Translational and Personalized Medicine"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819979"},{"key":"e_1_2_2_48_1","doi-asserted-by":"crossref","unstructured":"Ioanna Lykourentzou Robert E Kraut and Steven P Dow. 2017. Team Dating Leads to Better Online Ad Hoc Collaborations. In CSCW. 2330--2343.","DOI":"10.1145\/2998181.2998322"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892421"},{"key":"e_1_2_2_50_1","volume-title":"The study of groups: Past, present, and future. Personality and social psychology review 4, 1","author":"McGrath Joseph E","year":"2000","unstructured":"Joseph E McGrath, Holly Arrow, and Jennifer L Berdahl. 2000. The study of groups: Past, present, and future. Personality and social psychology review 4, 1 (2000), 95--105."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/105256299301700210"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--1--4939-0378--8_10"},{"key":"e_1_2_2_53_1","volume-title":"Journal of Teaching and Learning for Graduate Employability 10, 1","author":"Oraison Humberto","year":"2019","unstructured":"Humberto Oraison, Loretta Konjarski, and Samuel Howe. 2019. Journal of Teaching and Learning for Graduate Employability 10, 1 (2019), 173--194. https:\/\/search.informit.org\/doi\/10.3316\/informit.580981748647262"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1316624.1316656"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/366413.364562"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1177\/1080569912460400"},{"key":"e_1_2_2_57_1","volume-title":"The coding manual for qualitative researchers","author":"Salda\u00f1a Johnny","unstructured":"Johnny Salda\u00f1a. 2015. The coding manual for qualitative researchers. Sage."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274420"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/13691180701858836"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1177\/1052562903252514"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047344.1047493"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10603-014-9273-1"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173590"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372782.3406277"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2006.02.008"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134744"},{"key":"e_1_2_2_67_1","unstructured":"Miaomiao Wen Keith Maki Xu Wang Steven Dow James D Herbsleb and Carolyn Penstein Ros\u00e9. 2016. Transactivity as a Predictor of Future Collaborative Knowledge Integration in Team-Based Learning in Online Courses.. In EDM. 533--538."},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1177\/027347539101300208"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1193147"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610096","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610096","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610096","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T04:20:12Z","timestamp":1755750012000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610096"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":69,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2023,9,28]]}},"alternative-id":["10.1145\/3610096"],"URL":"https:\/\/doi.org\/10.1145\/3610096","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2023-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}