{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T01:52:30Z","timestamp":1773798750771,"version":"3.50.1"},"reference-count":70,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/N509577\/1"],"award-info":[{"award-number":["EP\/N509577\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,2]]},"abstract":"<jats:p>Interactive Machine Learning (IML) enables users, including non-experts in ML, to iteratively train and improve ML models. However, limited research has been reported on how non-experts interact with these systems. Focusing on thematic analysis as a practical application, we report on a user study where 20 participants interacted with TACA, a functioning IML tool. Thematic analysis involves individual interpretation of ambiguous data, hence it is suited for and can benefit from the iterative customization of models supported by IML. Through a combination of interaction logs and semi-structured interviews, our findings revealed that, by using TACA, participants critically reflected on their analysis, gained new thematic insights, and adapted their interpretative stance. We also document misconceptions of ML concepts, positivist views, and personal blame for poor model performance. We then discuss how applications could be designed to improve the understanding of IML concepts and foster reflexive work practices.<\/jats:p>","DOI":"10.1145\/3711095","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T11:36:19Z","timestamp":1747740979000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Understanding Interaction with Machine Learning through a Thematic Analysis Coding Assistant: A User Study"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-8890-268X","authenticated-orcid":false,"given":"Federico","family":"Milana","sequence":"first","affiliation":[{"name":"University College London, London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1842-8342","authenticated-orcid":false,"given":"Enrico","family":"Costanza","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9712-4090","authenticated-orcid":false,"given":"Mirco","family":"Musolesi","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1104-0043","authenticated-orcid":false,"given":"Amid","family":"Ayobi","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2025,5,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3390\/educsci11090502"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173860"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702509"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622222"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2046396.2046416"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753336"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302280"},{"key":"e_1_2_1_9_1","volume-title":"2021 Joint ACM Conference on Intelligent User Interfaces Workshops, ACMIUI-WS 2021. CEUR Workshop Proceedings.","author":"Ayobi Amid","year":"2021","unstructured":"Amid Ayobi, Katarzyna Stawarz, Dmitri Katz, Paul Marshall, Taku Yamagata, Raul Santos-Rodr\u00edguez, Peter Flach, and Aisling Ann O'Kane. 2021. Machine Learning Explanations as Boundary Objects: How AI Researchers Explain and Non-Experts Perceive Machine Learning. In 2021 Joint ACM Conference on Intelligent User Interfaces Workshops, ACMIUI-WS 2021. CEUR Workshop Proceedings."},{"key":"e_1_2_1_10_1","volume-title":"Visualization of Confusion Matrix for Non-Expert Users (Poster). (Oct","author":"Beauxis-Aussalet Emmanuelle","year":"2014","unstructured":"Emmanuelle Beauxis-Aussalet and Lynda Hardman. 2014. Visualization of Confusion Matrix for Non-Expert Users (Poster). (Oct. 2014). https:\/\/ir.cwi.nl\/pub\/22775"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0582--9"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/2159676X.2019.1628806"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11135-021-01182-y"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.07.019"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185515"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2665--9913(20)30217--4"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467--8659.2009.01439.x"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/13645579.2011.625764"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14504701328"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020--68273-y"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185517"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13181"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207741"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/604045.604056"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357061"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1097\/00012272-200404000-00003"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581352"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/pan\/mps028"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.59"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2019.11.146"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240646"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.34293\/education.v8i4.3232"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40708-016-0042--6"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.3390\/philosophies6010022"},{"key":"e_1_2_1_36_1","first-page":"23","article-title":"Reflexivity: promoting rigour in qualitative research","volume":"23","author":"Jootun Dev","year":"2009","unstructured":"Dev Jootun, Gerry McGhee, and Glenn R. Marland. 2009. Reflexivity: promoting rigour in qualitative research. Nursing Standard, Vol. 23, 23 (Feb. 2009), 42--47.","journal-title":"Nursing Standard"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300273"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1167742"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/08838151.2012.761702"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICS51289.2020.00025"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","unstructured":"Jasy Liew Nancy McCracken Shichun Zhou and Kevin Crowston. 2014. Optimizing Features in Active Machine Learning for Complex Qualitative Content Analysis. 44--48. https:\/\/doi.org\/10.3115\/v1\/W14--2513","DOI":"10.3115\/v1\/W14--2513"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10302.001.0001"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173922"},{"key":"e_1_2_1_44_1","volume-title":"Human-like machine learning: limitations and suggestions. arXiv:1811.06052 [cs] (Nov","author":"Mastorakis Georgios","year":"2018","unstructured":"Georgios Mastorakis. 2018. Human-like machine learning: limitations and suggestions. arXiv:1811.06052 [cs] (Nov. 2018). http:\/\/arxiv.org\/abs\/1811.06052"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415186"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957276.2957280"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.3390\/app9214500"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2013.74"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124915"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2837614.2837671"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1720006"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2014.6883022"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2015.7357211"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116895"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3615335.3623062"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415224"},{"key":"e_1_2_1_58_1","volume-title":"Sternberg and Li-fang Zhang","author":"Robert","year":"2014","unstructured":"Robert J. Sternberg and Li-fang Zhang. 2014. Perspectives on Thinking, Learning, and Cognitive Styles. Routledge. Google-Books-ID: YMeQAgAAQBAJ."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346574"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1216295.1216316"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.19173\/irrodl.v13i5.1240"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745078"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2110363.2110464"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.2001.0499"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","unstructured":"Zeerak Waseem Smarika Lulz Joachim Bingel and Isabelle Augenstein. 2021. Disembodied Machine Learning: On the Illusion of Objectivity in NLP. https:\/\/doi.org\/10.48550\/arXiv.2101.11974","DOI":"10.48550\/arXiv.2101.11974"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.172"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/1943403.1943423"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196729"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2015.7347630"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41524-018-0081-z"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711095","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3711095","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:28:32Z","timestamp":1755768512000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711095"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,2]]},"references-count":70,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,2]]}},"alternative-id":["10.1145\/3711095"],"URL":"https:\/\/doi.org\/10.1145\/3711095","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,2]]},"assertion":[{"value":"2025-05-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}