{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:25:53Z","timestamp":1776108353427,"version":"3.50.1"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T00:00:00Z","timestamp":1634083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100016296","name":"Israel National Cyber Directorate","doi-asserted-by":"publisher","award":["0612018391"],"award-info":[{"award-number":["0612018391"]}],"id":[{"id":"10.13039\/501100016296","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"<jats:p>The need for advanced automation and artificial intelligence (AI) in various fields, including text classification, has dramatically increased in the last decade, leaving us critically dependent on their performance and reliability. Yet, as we increasingly rely more on AI applications, their algorithms are becoming more nuanced, more complex, and less understandable precisely at a time we need to understand them better and trust them to perform as expected. Text classification in the medical and cybersecurity domains is a good example of a task where we may wish to keep the human in the loop. Human experts lack the capacity to deal with the high volume and velocity of data that needs to be classified, and ML techniques are often unexplainable and lack the ability to capture the required context needed to make the right decision and take action. We propose a new abstract configuration of Human-Machine Learning (HML) that focuses on reciprocal learning, where the human and the AI are collaborating partners. We employ design-science research (DSR) to learn and design an application of the HML configuration, which incorporates software to support combining human and artificial intelligences. We define the HML configuration by its conceptual components and their function. We then describe the development of a system called Fusion that supports human-machine reciprocal learning. Using two case studies of text classification from the cyber domain, we evaluate Fusion and the proposed HML approach, demonstrating benefits and challenges. Our results show a clear ability of domain experts to improve the ML classification performance over time, while both human and machine, collaboratively, develop their conceptualization, i.e., their knowledge of classification. We generalize our insights from the DSR process as actionable principles for researchers and designers of 'human in the learning loop' systems. We conclude the paper by discussing HML configurations and the challenge of capturing and representing knowledge gained jointly by human and machine, an area we feel has great potential.<\/jats:p>","DOI":"10.1145\/3479587","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T02:30:11Z","timestamp":1634610611000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["The Design of Reciprocal Learning Between Human and Artificial Intelligence"],"prefix":"10.1145","volume":"5","author":[{"given":"Alexey","family":"Zagalsky","sequence":"first","affiliation":[{"name":"Tel Aviv University, Tel Aviv, Israel"}]},{"given":"Dov","family":"Te'eni","sequence":"additional","affiliation":[{"name":"Tel Aviv University, Tel Aviv, Israel"}]},{"given":"Inbal","family":"Yahav","sequence":"additional","affiliation":[{"name":"Tel Aviv University, Tel Aviv, Israel"}]},{"given":"David G.","family":"Schwartz","sequence":"additional","affiliation":[{"name":"Bar-Ilan University, Ramat Gan, Israel"}]},{"given":"Gahl","family":"Silverman","sequence":"additional","affiliation":[{"name":"Tel Aviv University, Tel Aviv, Israel"}]},{"given":"Daniel","family":"Cohen","sequence":"additional","affiliation":[{"name":"Bar-Ilan University, Ramat Gan, Israel"}]},{"given":"Yossi","family":"Mann","sequence":"additional","affiliation":[{"name":"Bar-Ilan University, Ramat Gan, Israel"}]},{"given":"Dafna","family":"Lewinsky","sequence":"additional","affiliation":[{"name":"Bar-Ilan University, Ramat Gan, Israel"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2005.81"},{"key":"e_1_2_1_2_1","volume-title":"CyberGate: a design framework and system for text analysis of computer-mediated communication. MIS Quarterly","author":"Abbasi Ahmed","year":"2008","unstructured":"Ahmed Abbasi and Hsinchun Chen. 2008. CyberGate: a design framework and system for text analysis of computer-mediated communication. MIS Quarterly (2008), 811--837."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/isj.12116"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-019-09418-w"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpe.2017.05.016"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/0170840614556918"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-2073"},{"key":"e_1_2_1_8_1","volume-title":"Explanatory Model Analysis","author":"Biecek Przemyslaw","unstructured":"Przemyslaw Biecek and Tomasz Burzykowski. 2021. Explanatory Model Analysis. Chapman and Hall\/CRC, New York. https:\/\/pbiecek.github.io\/ema\/"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.5.3.456"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.1991.175794"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics8080832"},{"key":"e_1_2_1_12_1","unstructured":"Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis. sage."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/1388299.1388313"},{"key":"e_1_2_1_15_1","first-page":"1","article-title":"The scored society: Due process for automated predictions","volume":"89","author":"Citron Danielle Keats","year":"2014","unstructured":"Danielle Keats Citron and Frank Pasquale. 2014. The scored society: Due process for automated predictions. Wash. L. Rev. 89 (2014), 1.","journal-title":"Wash. L. Rev."},{"key":"e_1_2_1_16_1","volume-title":"Research design: Qualitative, quantitative, and mixed methods approaches","author":"Creswell John W","unstructured":"John W Creswell and J David Creswell. 2017. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications."},{"key":"e_1_2_1_17_1","volume-title":"Qualitative inquiry and research design: Choosing among five approaches","author":"Creswell John W","unstructured":"John W Creswell and Cheryl N Poth. 2016. Qualitative inquiry and research design: Choosing among five approaches. Sage publications."},{"key":"e_1_2_1_18_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 [cs.CL]","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 [cs.CL]"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/14759551.2011.590305"},{"key":"e_1_2_1_20_1","unstructured":"Jonathan Dinu Jeffrey Bigham and J. Zico Kolter. 2020. Challenging common interpretability assumptions in feature attribution explanations. arXiv:2012.02748 [cs.LG]"},{"key":"e_1_2_1_21_1","unstructured":"Natasha Duarte Emma Llanso and Anna C Loup. 2018. Mixed Messages? The Limits of Automated Social Media Content Analysis.. In FAT. 106."},{"key":"e_1_2_1_22_1","unstructured":"Paul M Fitts. 1951. Human engineering for an effective air-navigation and traffic-control system. (1951)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v033.i01"},{"key":"e_1_2_1_24_1","volume-title":"Pradeep Dasigi","author":"Gardner Matt","year":"2018","unstructured":"Matt Gardner, Joel Grus, Mark Neumann, Oyvind Taf jord, Pradeep Dasigi, Nelson Liu, Matthew Peters, Michael Schmitz, and Luke Zettlemoyer. 2018. AllenNLP: A Deep Semantic Natural Language Processing Platform. arXiv:1803.07640 [cs.CL]"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2856492"},{"key":"e_1_2_1_26_1","volume-title":"Cognitive psychology: Connecting mind, research and everyday experience","author":"Goldstein E Bruce","unstructured":"E Bruce Goldstein. 2014. Cognitive psychology: Connecting mind, research and everyday experience. Nelson Education."},{"key":"e_1_2_1_27_1","volume-title":"Practices of color classification. Mind, culture, and activity 7, 1--2","author":"Goodwin Charles","year":"2000","unstructured":"Charles Goodwin. 2000. Practices of color classification. Mind, culture, and activity 7, 1--2 (2000), 19--36."},{"key":"e_1_2_1_28_1","volume-title":"Qualitative data analysis: An introduction","author":"Grbich Carol","unstructured":"Carol Grbich. 2012. Qualitative data analysis: An introduction. Sage."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00649"},{"key":"e_1_2_1_30_1","volume-title":"Positioning and presenting design science research for maximum impact. MIS quarterly","author":"Gregor Shirley","year":"2013","unstructured":"Shirley Gregor and Alan R Hevner. 2013. Positioning and presenting design science research for maximum impact. MIS quarterly (2013), 337--355."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsis.2020.101614"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_48"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/647402.725294"},{"key":"e_1_2_1_34_1","volume-title":"A theory of reciprocal learning in dyads. Cognitive systems 6, 2","author":"J\u00f6rg Ton","year":"2004","unstructured":"Ton J\u00f6rg. 2004. A theory of reciprocal learning in dyads. Cognitive systems 6, 2 (2004), 3."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1060.0237"},{"key":"e_1_2_1_36_1","volume-title":"Tushar Khot, Ashish Sabharwal, and Dan Roth.","author":"Khashabi Daniel","year":"2020","unstructured":"Daniel Khashabi, Erfan Sadeqi Azer, Tushar Khot, Ashish Sabharwal, and Dan Roth. 2020. On the Possibilities and Limitations of Multi-hop Reasoning Under Linguistic Imperfections. arXiv:1901.02522 [cs.CL]"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/info10040150"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/3019323"},{"key":"e_1_2_1_39_1","unstructured":"William Marcellino Christian Johnson Marek N Posard and Todd C Helmus. 2020. Foreign Interference in the 2020 Election. (2020)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Scott Mayer McKinney Marcin Sieniek Varun Godbole Jonathan Godwin Natasha Antropova Hutan Ashrafian Trevor Back Mary Chesus Greg S Corrado Ara Darzi et al. 2020. International evaluation of an AI system for breast cancer screening. Nature 577 7788 (2020) 89--94.","DOI":"10.1038\/s41586-019-1799-6"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-1006"},{"key":"e_1_2_1_42_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_2_1_44_1","volume-title":"Decreasing cognitive load for novice students: Effects of explanatory versus corrective feedback in discovery-based multimedia. Instructional science 32, 1","author":"Moreno Roxana","year":"2004","unstructured":"Roxana Moreno. 2004. Decreasing cognitive load for novice students: Effects of explanatory versus corrective feedback in discovery-based multimedia. Instructional science 32, 1 (2004), 99--113."},{"key":"e_1_2_1_45_1","volume-title":"The knowledge-creating company: How Japanese companies create the dynamics of innovation","author":"Nonaka Ikujiro","unstructured":"Ikujiro Nonaka and Hirotaka Takeuchi. 1995. The knowledge-creating company: How Japanese companies create the dynamics of innovation. Oxford university press."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.3115\/1218955.1218990"},{"key":"e_1_2_1_47_1","first-page":"521","article-title":"Formal concept analysis in information science","volume":"40","author":"Priss Uta","year":"2006","unstructured":"Uta Priss. 2006. Formal concept analysis in information science. Arist 40, 1 (2006), 521--543.","journal-title":"Arist"},{"key":"e_1_2_1_48_1","volume-title":"Artificial Intelligence and Management: The Automation-Augmentation Paradox","author":"Raisch Sebastian","year":"2020","unstructured":"Sebastian Raisch and Sebastian Krakowski. 2020. Artificial Intelligence and Management: The Automation-Augmentation Paradox. Academy of Management Review ja (2020)."},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Marco Tulio Ribeiro Sameer Singh and Carlos Guestrin. 2016. \"Why Should I Trust You?\": Explaining the Predictions of Any Classifier. arXiv:1602.04938 [cs.LG]","DOI":"10.18653\/v1\/N16-3020"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312705052102"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0048-x"},{"key":"e_1_2_1_52_1","volume-title":"Qualitative content analysis in practice","author":"Schreier Margrit","unstructured":"Margrit Schreier. 2012. Qualitative content analysis in practice. Sage publications."},{"key":"e_1_2_1_53_1","doi-asserted-by":"crossref","unstructured":"David G Schwartz. 1995. Cooperating Heterogeneous Systems.","DOI":"10.1007\/978-1-4615-2211-9"},{"key":"e_1_2_1_54_1","volume-title":"Action design research. MIS quarterly","author":"Sein Maung K","year":"2011","unstructured":"Maung K Sein, Ola Henfridsson, Sandeep Purao, Matti Rossi, and Rikard Lindgren. 2011. Action design research. MIS quarterly (2011), 37--56."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.1995.537867"},{"key":"e_1_2_1_56_1","first-page":"57","article-title":"Analyzing behavioral big data: methodological, practical, ethical, and moral issues","volume":"29","author":"Shmueli Galit","year":"2017","unstructured":"Galit Shmueli. 2017. Analyzing behavioral big data: methodological, practical, ethical, and moral issues. Quality Engineering 29, 1 (2017), 57--74.","journal-title":"Quality Engineering"},{"key":"e_1_2_1_57_1","volume-title":"Research dilemmas with behavioral big data. Big data 5, 2","author":"Shmueli Galit","year":"2017","unstructured":"Galit Shmueli. 2017. Research dilemmas with behavioral big data. Big data 5, 2 (2017), 98--119."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/0008125619862257"},{"key":"e_1_2_1_59_1","volume-title":"1st International Conference on Artificial Intelligence in HCI, AI-HCI, Held as Part of HCI International 2020","author":"So Chaehan","year":"2020","unstructured":"Chaehan So. 2020. Human-in-the-Loop Design Cycles--A Process Framework that Integrates Design Sprints, Agile Processes, and Machine Learning with Humans. Lecture Notes in Artificial Intelligence, 1st International Conference on Artificial Intelligence in HCI, AI-HCI, Held as Part of HCI International 2020, Kopenhagen, Denmark (19--24 July 2020)."},{"key":"e_1_2_1_60_1","volume-title":"Understanding the Prediction Mechanism of Sentiments by XAI Visualization. arXiv preprint arXiv:2003.01425","author":"Chaehan So.","year":"2020","unstructured":"Chaehan So. 2020. Understanding the Prediction Mechanism of Sentiments by XAI Visualization. arXiv preprint arXiv:2003.01425 (2020)."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370000802584539"},{"key":"e_1_2_1_62_1","volume-title":"Plans and situated actions: The problem of human-machine communication","author":"Suchman Lucy A","unstructured":"Lucy A Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press."},{"key":"e_1_2_1_63_1","volume-title":"Human-machine reconfigurations: Plans and situated actions","author":"Suchman Lucy A","unstructured":"Lucy A Suchman. 2007. Human-machine reconfigurations: Plans and situated actions. Cambridge university press."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_2_1_65_1","volume-title":"A cognitive-affective model of organizational communication for designing IT. MIS quarterly 25, 2","author":"Te'eni Dov","year":"2001","unstructured":"Dov Te'eni. 2001. A cognitive-affective model of organizational communication for designing IT. MIS quarterly 25, 2 (2001), 251--312."},{"key":"e_1_2_1_66_1","unstructured":"Lev S Vygotsky. 1978. Mind in society: The development of higher mental processes (E. Rice Ed. & Trans.)."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017208"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/0169-2070(95)00644-3"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1050.0133"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1080\/1057610X.2015.1119546"},{"key":"e_1_2_1_71_1","volume-title":"Joint cognitive systems: Patterns in cognitive systems engineering","author":"Woods David D","unstructured":"David D Woods and Erik Hollnagel. 2006. Joint cognitive systems: Patterns in cognitive systems engineering. CRC Press."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209889.3209897"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2840127"},{"key":"e_1_2_1_74_1","volume-title":"Making sense of business analytics in project selection and prioritisation: insights from the start-up trenches. Information Technology & People","author":"Zamani Efpraxia D","year":"2021","unstructured":"Efpraxia D Zamani, Anastasia Griva, Konstantina Spanaki, Paidi O'Raghallaigh, and David Sammon. 2021. Making sense of business analytics in project selection and prioritisation: insights from the start-up trenches. Information Technology & People (2021)."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479587","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3479587","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:55:31Z","timestamp":1752468931000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":74,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.1145\/3479587"],"URL":"https:\/\/doi.org\/10.1145\/3479587","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"assertion":[{"value":"2021-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}