{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:03:20Z","timestamp":1776114200208,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,3,18]]},"DOI":"10.1145\/3640543.3645168","type":"proceedings-article","created":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T18:23:12Z","timestamp":1712341392000},"page":"455-470","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Annota: Peer-based AI Hints Towards Learning Qualitative Coding at Scale"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9672-8669","authenticated-orcid":false,"given":"Dustin","family":"Palea","sequence":"first","affiliation":[{"name":"UC Santa Cruz, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2633-9603","authenticated-orcid":false,"given":"Giridhar","family":"Vadhul","sequence":"additional","affiliation":[{"name":"UC Santa Cruz, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1495-7052","authenticated-orcid":false,"given":"David T","family":"Lee","sequence":"additional","affiliation":[{"name":"UC Santa Cruz, United States"}]}],"member":"320","published-online":{"date-parts":[[2024,4,5]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n. d.]. ATLAS.ti | The #1 Software for Qualitative Data Analysis. https:\/\/atlasti.com"},{"key":"e_1_3_2_1_2_1","unstructured":"[n. d.]. MAXQDA | All-In-One Qualitative & Mixed Methods Data Analysis Tool. https:\/\/www.maxqda.com\/"},{"key":"e_1_3_2_1_3_1","unstructured":"[n. d.]. NVivo. https:\/\/lumivero.com\/products\/nvivo\/"},{"key":"e_1_3_2_1_4_1","unstructured":"2016. FACT SHEET: President Obama Proposes New \"First Job\" Funding to Connect Young Americans with Jobs and Skills Training to Start Their Careers. https:\/\/obamawhitehouse.archives.gov\/the-press-office\/2016\/02\/04\/fact-sheet-president-obama-proposes-new-first-job-funding-connect-young"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3102\/01623737022001041"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1513593.1513598"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479863"},{"key":"e_1_3_2_1_8_1","unstructured":"Michael Bernstein. 2023. Teaching HCI Foundations and Frontiers. https:\/\/medium.com\/@msbernst\/teaching-hci-foundations-and-frontiers-76bb22616e0d"},{"key":"e_1_3_2_1_9_1","volume-title":"Situated cognition and the culture of learning. 1989 18, 1","author":"Brown John\u00a0Seely","year":"1989","unstructured":"John\u00a0Seely Brown, Allan Collins, and Paul Duguid. 1989. Situated cognition and the culture of learning. 1989 18, 1 (1989), 32\u201342."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173868"},{"key":"e_1_3_2_1_11_1","unstructured":"Kathy Charmaz. 2014. Constructing grounded theory. sage."},{"key":"e_1_3_2_1_12_1","volume-title":"ACM SIGCHI Workshop on Human-Centered Machine Learning.","author":"Kocielnik Rafal","year":"2016","unstructured":"Nan-chen Chen, Rafal Kocielnik, Margaret Drouhard, Vanessa Pe\u00f1a-Araya, Jina Suh, Keting Cen, Xiangyi Zheng, Cecilia\u00a0R Aragon, and V Pe\u00f1a-Araya. 2016. Challenges of applying machine learning to qualitative coding. In ACM SIGCHI Workshop on Human-Centered Machine Learning."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501917"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2888574"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14504701328"},{"key":"e_1_3_2_1_16_1","volume-title":"AIAA 1st intelligent systems technical conference. 6313.","author":"Cummings Mary","unstructured":"Mary Cummings. 2004. Automation bias in intelligent time critical decision support systems. In AIAA 1st intelligent systems technical conference. 6313."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819984"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.2307\/2346806"},{"key":"e_1_3_2_1_19_1","volume-title":"The educational forum, Vol.\u00a050","author":"Dewey John","unstructured":"John Dewey. 1986. Experience and education. In The educational forum, Vol.\u00a050. Taylor & Francis, 241\u2013252."},{"key":"e_1_3_2_1_20_1","first-page":"114","article-title":"Algorithm aversion: people erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology","volume":"144","author":"Dietvorst J","year":"2015","unstructured":"Berkeley\u00a0J Dietvorst, Joseph\u00a0P Simmons, and Cade Massey. 2015. Algorithm aversion: people erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology: General 144, 1 (2015), 114.","journal-title":"General"},{"key":"e_1_3_2_1_21_1","volume-title":"Junming Cao, Roy Ka-Wei Lee, and Simon Perrault.","author":"Gao Jie","year":"2023","unstructured":"Jie Gao, Kenny Tsu\u00a0Wei Choo, Junming Cao, Roy Ka-Wei Lee, and Simon Perrault. 2023. CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysis. ACM Transactions on Computer-Human Interaction (2023)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581352"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820011"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386527.3406733"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753478"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMR.2008.4490137"},{"key":"e_1_3_2_1_27_1","volume-title":"The intentional mentor: Strategies and guidelines for the practice of mentoring.Professional psychology: Research and practice 33, 1","author":"Johnson W\u00a0Brad","year":"2002","unstructured":"W\u00a0Brad Johnson. 2002. The intentional mentor: Strategies and guidelines for the practice of mentoring.Professional psychology: Research and practice 33, 1 (2002), 88."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Andreas Kaufmann Ann Barcomb and Dirk Riehle. 2020. Supporting Interview Analysis with Autocoding.. In HICSS. 1\u201310.","DOI":"10.24251\/HICSS.2020.094"},{"key":"e_1_3_2_1_29_1","volume-title":"Learnersourcing: improving learning with collective learner activity. Ph.\u00a0D. Dissertation","author":"Juho Kim","unstructured":"Juho Kim 2015. Learnersourcing: improving learning with collective learner activity. Ph.\u00a0D. Dissertation. Massachusetts Institute of Technology."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647389"},{"key":"e_1_3_2_1_31_1","volume-title":"Experiential learning: Experience as the source of learning and development","author":"Kolb A","unstructured":"David\u00a0A Kolb. 2014. Experiential learning: Experience as the source of learning and development. FT press."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724670"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300304"},{"key":"e_1_3_2_1_34_1","volume-title":"Forum: Qualitative Sozialforschung, Vol.\u00a012","author":"Lejeune Christophe","unstructured":"Christophe Lejeune. 2011. From normal business to financial crisis... and back again. An illustration of the benefits of Cassandre for qualitative analysis. In Forum: Qualitative Sozialforschung, Vol.\u00a012. Institut fur Klinische Sychologie and Gemeindesychologie, Germany."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Yvonna\u00a0S Lincoln and Egon\u00a0G Guba. 1985. Naturalistic inquiry. sage.","DOI":"10.1016\/0147-1767(85)90062-8"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5172\/mra.455.2.1.105"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173922"},{"key":"e_1_3_2_1_38_1","volume-title":"The origins of intelligence in children. Vol.\u00a08","author":"Piaget Jean","unstructured":"Jean Piaget, Margaret Cook, 1952. The origins of intelligence in children. Vol.\u00a08. International Universities Press New York."},{"key":"e_1_3_2_1_39_1","volume-title":"Quizlet: Learning tools, flashcards, and textbook solutions. https:\/\/quizlet.com\/. Accessed: 2023-09-05.","year":"2023","unstructured":"Quizlet. 2023. Quizlet: Learning tools, flashcards, and textbook solutions. https:\/\/quizlet.com\/. Accessed: 2023-09-05."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445591"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376530"},{"key":"e_1_3_2_1_42_1","volume-title":"The coding manual for qualitative researchers. The coding manual for qualitative researchers","author":"Salda\u00f1a Johnny","year":"2021","unstructured":"Johnny Salda\u00f1a. 2021. The coding manual for qualitative researchers. The coding manual for qualitative researchers (2021), 1\u2013440."},{"key":"e_1_3_2_1_43_1","volume-title":"Qualitative and mixed methods data analysis using Dedoose: A practical approach for research across the social sciences","author":"Salmona Michelle","unstructured":"Michelle Salmona, Eli Lieber, and Dan Kaczynski. 2019. Qualitative and mixed methods data analysis using Dedoose: A practical approach for research across the social sciences. Sage Publications."},{"key":"e_1_3_2_1_44_1","unstructured":"Scratch. 2023. Scratch - Imagine Program Share. https:\/\/scratch.mit.edu\/. Accessed: 2023-08-13."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501385.3543976"},{"key":"e_1_3_2_1_46_1","volume-title":"Top Universities Join to Push Public Interest Technology. The New York Times (March","author":"Singer Natasha","year":"2019","unstructured":"Natasha Singer. 2019. Top Universities Join to Push Public Interest Technology. The New York Times (March 2019). https:\/\/www.nytimes.com\/2019\/03\/11\/technology\/universities-public-interest-technology.html"},{"key":"e_1_3_2_1_47_1","first-page":"29","article-title":"CritViz: Web-based software supporting peer critique in large creative classrooms","volume":"15","author":"Tinapple David","year":"2013","unstructured":"David Tinapple, Loren Olson, and John Sadauskas. 2013. CritViz: Web-based software supporting peer critique in large creative classrooms. Bulletin of the IEEE Technical Committee on Learning Technology 15, 1 (2013), 29.","journal-title":"Bulletin of the IEEE Technical Committee on Learning Technology"},{"key":"e_1_3_2_1_48_1","volume-title":"Mind in society: Development of higher psychological processes","author":"Vygotsky Lev\u00a0Semenovich","unstructured":"Lev\u00a0Semenovich Vygotsky and Michael Cole. 1978. Mind in society: Development of higher psychological processes. Harvard university press."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675219"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3322381"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876042"},{"key":"e_1_3_2_1_52_1","volume-title":"LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs. arXiv preprint arXiv:2307.10168","author":"Wu Tongshuang","year":"2023","unstructured":"Tongshuang Wu, Haiyi Zhu, Maya Albayrak, Alexis Axon, Amanda Bertsch, Wenxing Deng, Ziqi Ding, Bill Guo, Sireesh Gururaja, Tzu-Sheng Kuo, 2023. LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs. arXiv preprint arXiv:2307.10168 (2023)."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581754.3584136"},{"key":"e_1_3_2_1_54_1","volume-title":"IConference 2014 Proceedings","author":"Liew\u00a0Suet Yan Jasy","year":"2014","unstructured":"Jasy Liew\u00a0Suet Yan, Nancy McCracken, and Kevin Crowston. 2014. Semi-automatic content analysis of qualitative data. IConference 2014 Proceedings (2014)."}],"event":{"name":"IUI '24: 29th International Conference on Intelligent User Interfaces","location":"Greenville SC USA","acronym":"IUI '24","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 29th International Conference on Intelligent User Interfaces"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3640543.3645168","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3640543.3645168","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T00:59:13Z","timestamp":1764550753000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3640543.3645168"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,18]]},"references-count":54,"alternative-id":["10.1145\/3640543.3645168","10.1145\/3640543"],"URL":"https:\/\/doi.org\/10.1145\/3640543.3645168","relation":{},"subject":[],"published":{"date-parts":[[2024,3,18]]},"assertion":[{"value":"2024-04-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}