{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T02:53:20Z","timestamp":1764557600146,"version":"3.41.0"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"3-4","license":[{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"crossref","award":["KE 740\/17-2"],"award-info":[{"award-number":["KE 740\/17-2"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>\n            Linguistic insight in the form of high-level relationships and rules in text builds the basis of our understanding of language. However, the data-driven generation of such structures often lacks labeled resources that can be used as training data for supervised machine learning. The creation of such ground-truth data is a time-consuming process that often requires domain expertise to resolve text ambiguities and characterize linguistic phenomena. Furthermore, the creation and refinement of machine learning models is often challenging for linguists as the models are often complex, in-transparent, and difficult to understand. To tackle these challenges, we present a visual analytics technique for interactive data labeling that applies concepts from gamification and explainable Artificial Intelligence (XAI) to support complex classification tasks. The visual-interactive labeling interface promotes the creation of effective training data. Visual explanations of learned rules unveil the decisions of the machine learning model and support iterative and interactive optimization. The gamification-inspired design guides the user through the labeling process and provides feedback on the model performance. As an instance of the proposed technique, we present\n            <jats:italic>QuestionComb<\/jats:italic>\n            , a workspace tailored to the task of question classification (i.e., in\n            <jats:italic>information-seeking<\/jats:italic>\n            vs.\n            <jats:italic>non-information-seeking<\/jats:italic>\n            questions). Our evaluation studies confirm that gamification concepts are beneficial to engage users through continuous feedback, offering an effective visual analytics technique when combined with active learning and XAI.\n          <\/jats:p>","DOI":"10.1145\/3429448","type":"journal-article","created":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T19:30:07Z","timestamp":1630697407000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["QuestionComb: A Gamification Approach for the Visual Explanation of Linguistic Phenomena through Interactive Labeling"],"prefix":"10.1145","volume":"11","author":[{"given":"Rita","family":"Sevastjanova","sequence":"first","affiliation":[{"name":"University of Konstanz, Konstanz, Germany"}]},{"given":"Wolfgang","family":"Jentner","sequence":"additional","affiliation":[{"name":"University of Konstanz, Konstanz, Germany"}]},{"given":"Fabian","family":"Sperrle","sequence":"additional","affiliation":[{"name":"University of Konstanz, Konstanz, Germany"}]},{"given":"Rebecca","family":"Kehlbeck","sequence":"additional","affiliation":[{"name":"University of Konstanz, Konstanz, Germany"}]},{"given":"J\u00fcrgen","family":"Bernard","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, Canada"}]},{"given":"Mennatallah","family":"El-assady","sequence":"additional","affiliation":[{"name":"University of Konstanz, Konstanz, Germany"}]}],"member":"320","published-online":{"date-parts":[[2021,9,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"volume-title":"Proceedings of the ACM SIGMOD Conference on Management of Data. ACM, 207\u2013216","author":"Agrawal Rakesh","key":"e_1_2_1_2_1","unstructured":"Rakesh Agrawal , Tomasz Imielinski , and Arun N. Swami . 1993. Mining association rules between sets of items in large databases . In Proceedings of the ACM SIGMOD Conference on Management of Data. ACM, 207\u2013216 . https:\/\/doi.org\/10.1145\/170035.170072 10.1145\/170035.170072 Rakesh Agrawal, Tomasz Imielinski, and Arun N. Swami. 1993. Mining association rules between sets of items in large databases. In Proceedings of the ACM SIGMOD Conference on Management of Data. ACM, 207\u2013216. https:\/\/doi.org\/10.1145\/170035.170072"},{"key":"e_1_2_1_3_1","first-page":"487","article-title":"Fast algorithms for mining association rules","volume":"1215","author":"Agrawal Rakesh","year":"1994","unstructured":"Rakesh Agrawal and Ramakrishnan Srikant . 1994 . Fast algorithms for mining association rules . In Very Large Data Bases , Vol. 1215. 487 \u2013 499 . Rakesh Agrawal and Ramakrishnan Srikant. 1994. Fast algorithms for mining association rules. In Very Large Data Bases, Vol. 1215. 487\u2013499.","journal-title":"Very Large Data Bases"},{"key":"e_1_2_1_4_1","volume-title":"Data Engineering","author":"Agrawal Rakesh","year":"1995","unstructured":"Rakesh Agrawal and Ramakrishnan Srikant . 1995. Mining sequential patterns . In Data Engineering . IEEE Computer Society , 3\u201314. https:\/\/doi.org\/10.1109\/ICDE. 1995 .380415 10.1109\/ICDE.1995.380415 Rakesh Agrawal and Ramakrishnan Srikant. 1995. Mining sequential patterns. In Data Engineering. IEEE Computer Society, 3\u201314. https:\/\/doi.org\/10.1109\/ICDE.1995.380415"},{"key":"e_1_2_1_5_1","first-page":"301","article-title":"Identification, description and interpretation of English rhetorical questions in political speeches","volume":"1","author":"Al-Jumaily Abdullatif A.","year":"2009","unstructured":"Abdullatif A. Al-Jumaily and Jassim N. Al-Azzawi . 2009 . Identification, description and interpretation of English rhetorical questions in political speeches . Ahl Al-Bait. 1 (2009), 301 \u2013 314 . Abdullatif A. Al-Jumaily and Jassim N. Al-Azzawi. 2009. Identification, description and interpretation of English rhetorical questions in political speeches. Ahl Al-Bait. 1 (2009), 301\u2013314.","journal-title":"Ahl Al-Bait."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the International Conference on Systems Science (HICSS\u201911)","author":"Arias-Hern\u00e1ndez Richard","year":"2011","unstructured":"Richard Arias-Hern\u00e1ndez , Linda T. Kaastra , Tera Marie Green , and Brian D. Fisher . 2011. Pair analytics: Capturing reasoning processes in collaborative visual analytics . In Proceedings of the International Conference on Systems Science (HICSS\u201911) . IEEE Computer Society, 1\u201310. https:\/\/doi.org\/10.1109\/HICSS. 2011 .339 10.1109\/HICSS.2011.339 Richard Arias-Hern\u00e1ndez, Linda T. Kaastra, Tera Marie Green, and Brian D. Fisher. 2011. Pair analytics: Capturing reasoning processes in collaborative visual analytics. In Proceedings of the International Conference on Systems Science (HICSS\u201911). IEEE Computer Society, 1\u201310. https:\/\/doi.org\/10.1109\/HICSS.2011.339"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964897.1964906"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13446"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI16234_05"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the Conference on Visualization (EuroVis\u201918)","author":"Bernard J\u00fcrgen","year":"2018","unstructured":"J\u00fcrgen Bernard , Marco Hutter , Markus Lehmann , Martin M\u00fcller , Matthias Zeppelzauer , and Michael Sedlmair . 2018 . Learning from the best\u2014Visual analysis of a quasi-optimal data labeling strategy . In Proceedings of the Conference on Visualization (EuroVis\u201918) . Eurographics. J\u00fcrgen Bernard, Marco Hutter, Markus Lehmann, Martin M\u00fcller, Matthias Zeppelzauer, and Michael Sedlmair. 2018. Learning from the best\u2014Visual analysis of a quasi-optimal data labeling strategy. In Proceedings of the Conference on Visualization (EuroVis\u201918). Eurographics."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744818"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2836034.2836035"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13406"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-018-1500-3"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-013-0273-5"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the CEUR Workshop Proceedings","volume":"1311","author":"Brath Richard","year":"2014","unstructured":"Richard Brath and Ebad Banissi . 2014 . Using font attributes in knowledge maps and information retrieval . In Proceedings of the CEUR Workshop Proceedings , Vol. 1311 . London South Bank University, 23\u201330. Richard Brath and Ebad Banissi. 2014. Using font attributes in knowledge maps and information retrieval. In Proceedings of the CEUR Workshop Proceedings, Vol. 1311. London South Bank University, 23\u201330."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2012.6400486"},{"key":"#cr-split#-e_1_2_1_19_1.1","doi-asserted-by":"crossref","unstructured":"Mohammad Chegini J\u00fcrgen Bernard Philip Berger Alexei Sourin Keith Andrews and Tobias Schreck. 2019. Interactive labelling of a multivariate dataset for supervised machine learning using linked visualisations clustering and active learning. Vis. Inf. (2019). https:\/\/doi.org\/10.1016\/j.visinf.2019.03.002 10.1016\/j.visinf.2019.03.002","DOI":"10.1016\/j.visinf.2019.03.002"},{"key":"#cr-split#-e_1_2_1_19_1.2","doi-asserted-by":"crossref","unstructured":"Mohammad Chegini J\u00fcrgen Bernard Philip Berger Alexei Sourin Keith Andrews and Tobias Schreck. 2019. Interactive labelling of a multivariate dataset for supervised machine learning using linked visualisations clustering and active learning. Vis. Inf. (2019). https:\/\/doi.org\/10.1016\/j.visinf.2019.03.002","DOI":"10.1016\/j.visinf.2019.03.002"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745083"},{"volume-title":"Actionable Gamification: Beyond Points, Badges, and Leaderboards. Leanpub.","year":"2015","key":"e_1_2_1_21_1","unstructured":"Yu-kai Chou. 2015 . Actionable Gamification: Beyond Points, Badges, and Leaderboards. Leanpub. Yu-kai Chou. 2015. Actionable Gamification: Beyond Points, Badges, and Leaderboards. Leanpub."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207738"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the Anais Estendidos do XXIII Simp\u00f3sio Brasileiro de Sistemas Multim\u00eddia e Web. SBC, 209\u2013213","author":"Cirqueira Douglas","year":"2017","unstructured":"Douglas Cirqueira , Lucas Vin\u00edcius , M\u00e1rcia Pinheiro , Ant\u00f4nio Jacob Junior , F\u00e1bio Lobato , and \u00c1damo Santana . 2017 . Opinion label: A gamified crowdsourcing system for sentiment analysis annotation . In Proceedings of the Anais Estendidos do XXIII Simp\u00f3sio Brasileiro de Sistemas Multim\u00eddia e Web. SBC, 209\u2013213 . https:\/\/sol.sbc.org.br\/index.php\/webmedia_estendido\/article\/view\/4865. Douglas Cirqueira, Lucas Vin\u00edcius, M\u00e1rcia Pinheiro, Ant\u00f4nio Jacob Junior, F\u00e1bio Lobato, and \u00c1damo Santana. 2017. Opinion label: A gamified crowdsourcing system for sentiment analysis annotation. In Proceedings of the Anais Estendidos do XXIII Simp\u00f3sio Brasileiro de Sistemas Multim\u00eddia e Web. SBC, 209\u2013213. https:\/\/sol.sbc.org.br\/index.php\/webmedia_estendido\/article\/view\/4865."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA459166"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the ACM CHI Workshop: Human\u2013Centered Machine Learning Perspectives.","author":"El-Assady Mennatallah","year":"2019","unstructured":"Mennatallah El-Assady , Wolfgang Jentner , Rebecca Kehlbeck , Udo Schlegel , Rita Sevastjanova , Fabian Sperrle , Thilo Spinner , and Daniel Keim . 2019 . Towards explainable artificial intelligence: Structuring the processes of explanations . In Proceedings of the ACM CHI Workshop: Human\u2013Centered Machine Learning Perspectives. Mennatallah El-Assady, Wolfgang Jentner, Rebecca Kehlbeck, Udo Schlegel, Rita Sevastjanova, Fabian Sperrle, Thilo Spinner, and Daniel Keim. 2019. Towards explainable artificial intelligence: Structuring the processes of explanations. In Proceedings of the ACM CHI Workshop: Human\u2013Centered Machine Learning Perspectives."},{"key":"e_1_2_1_26_1","volume-title":"lingvis.io\u2014A linguistic visual analytics framework","author":"El-Assady Mennatallah","year":"1865","unstructured":"Mennatallah El-Assady , Wolfgang Jentner , Fabian Sperrle , Rita Sevastjanova , Annette Hautli-Janisz , Miriam Butt , and Daniel Keim . 2019. lingvis.io\u2014A linguistic visual analytics framework . In Association for Computational Linguistics: System Demonstrations . Association for Computational Linguistics , 13\u201318. https:\/\/doi.org\/10. 1865 3\/v1\/P19-3003 10.18653\/v1 Mennatallah El-Assady, Wolfgang Jentner, Fabian Sperrle, Rita Sevastjanova, Annette Hautli-Janisz, Miriam Butt, and Daniel Keim. 2019. lingvis.io\u2014A linguistic visual analytics framework. In Association for Computational Linguistics: System Demonstrations. Association for Computational Linguistics, 13\u201318. https:\/\/doi.org\/10.18653\/v1\/P19-3003"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.260"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13092"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the SIGKDD Conference on Knowledge Discovery and Data Mining","volume":"96","author":"Ester Martin","year":"1996","unstructured":"Martin Ester , Hans-Peter Kriegel , J\u00f6rg Sander , and Xiaowei Xu . 1996 . A density-based algorithm for discovering clusters in large spatial databases with noise . In Proceedings of the SIGKDD Conference on Knowledge Discovery and Data Mining , Vol. 96 . 226\u2013231. Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the SIGKDD Conference on Knowledge Discovery and Data Mining, Vol. 96. 226\u2013231."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06608-0_4"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382831"},{"key":"e_1_2_1_32_1","volume-title":"Groenen and Ingwer Borg","author":"Patrick J.","year":"2014","unstructured":"Patrick J. F. Groenen and Ingwer Borg . 2014 . Past, Present , and Future of Multidimensional Scaling. CRC Press . 95\u2013117 pages. Patrick J. F. Groenen and Ingwer Borg. 2014. Past, Present, and Future of Multidimensional Scaling. CRC Press. 95\u2013117 pages."},{"volume-title":"Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI\u201909)","author":"Harper F. Maxwell","key":"e_1_2_1_33_1","unstructured":"F. Maxwell Harper , Daniel Moy , and Joseph A. Konstan . 2009. Facts or friends? Distinguishing informational and conversational questions in social q&a sites . In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI\u201909) . 759\u2013768. F. Maxwell Harper, Daniel Moy, and Joseph A. Konstan. 2009. Facts or friends? Distinguishing informational and conversational questions in social q&a sites. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI\u201909). 759\u2013768."},{"key":"e_1_2_1_34_1","first-page":"100","article-title":"Algorithm\u00a0AS 136: A k-means clustering algorithm","volume":"28","author":"Hartigan John A.","year":"1979","unstructured":"John A. Hartigan and Manchek A. Wong . 1979 . Algorithm\u00a0AS 136: A k-means clustering algorithm . J. Roy. Stat. Soc. Ser. C 28 , 1 (1979), 100 \u2013 108 . John A. Hartigan and Manchek A. Wong. 1979. Algorithm\u00a0AS 136: A k-means clustering algorithm. J. Roy. Stat. Soc. Ser. C 28, 1 (1979), 100\u2013108.","journal-title":"J. Roy. Stat. Soc. Ser. C"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2133416.2146416"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.277"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2012.6400492"},{"key":"e_1_2_1_38_1","first-page":"303","article-title":"Visualization and Visual Analytic Techniques for Patterns. Springer International Publishing","volume":"12","author":"Jentner Wolfgang","year":"2019","unstructured":"Wolfgang Jentner and Daniel A. Keim . 2019 . Visualization and Visual Analytic Techniques for Patterns. Springer International Publishing , Chapter 12 , 303 \u2013 337 . https:\/\/doi.org\/10.1007\/978-3-030-04921-8 10.1007\/978-3-030-04921-8 Wolfgang Jentner and Daniel A. Keim. 2019. Visualization and Visual Analytic Techniques for Patterns. Springer International Publishing, Chapter 12, 303\u2013337. https:\/\/doi.org\/10.1007\/978-3-030-04921-8","journal-title":"Chapter"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Workshop on Visualization for AI Explainability.","author":"Jentner Wolfgang","year":"2018","unstructured":"Wolfgang Jentner , Rita Sevastjanova , Florian Stoffel , Daniel A. Keim , J\u00fcrgen Bernard , and Mennatallah El-Assady . 2018 . Minions, sheep, and fruits: Metaphorical narratives to explain artificial intelligence and build trust . In Proceedings of the Workshop on Visualization for AI Explainability. Wolfgang Jentner, Rita Sevastjanova, Florian Stoffel, Daniel A. Keim, J\u00fcrgen Bernard, and Mennatallah El-Assady. 2018. Minions, sheep, and fruits: Metaphorical narratives to explain artificial intelligence and build trust. In Proceedings of the Workshop on Visualization for AI Explainability."},{"volume-title":"Proceedings of the Conference on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV\u201914)","author":"Linda","key":"e_1_2_1_40_1","unstructured":"Linda T. Kaastra and Brian D. Fisher. 2014. Field experiment methodology for pair analytics . In Proceedings of the Conference on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV\u201914) . ACM, 152\u2013159. https:\/\/doi.org\/10.1145\/2669557.2669572 10.1145\/2669557.2669572 Linda T. Kaastra and Brian D. Fisher. 2014. Field experiment methodology for pair analytics. In Proceedings of the Conference on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV\u201914). ACM, 152\u2013159. https:\/\/doi.org\/10.1145\/2669557.2669572"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02291817"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the Computing Natural Language Inference Workshop.","author":"Kalouli Aikaterini-Lida","year":"2017","unstructured":"Aikaterini-Lida Kalouli , Valeria de Paiva , and Livy Real . 2017 . Correcting contradictions . In Proceedings of the Computing Natural Language Inference Workshop. Aikaterini-Lida Kalouli, Valeria de Paiva, and Livy Real. 2017. Correcting contradictions. In Proceedings of the Computing Natural Language Inference Workshop."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201918)","author":"Kalouli Aikaterini-Lida","year":"2018","unstructured":"Aikaterini-Lida Kalouli , Katharina Kaiser , Annette Hautli-Janisz , Georg A. Kaiser , and Miriam Butt . 2018 . A multilingual approach to question classification . In Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201918) . European Language Resources Association (ELRA). Aikaterini-Lida Kalouli, Katharina Kaiser, Annette Hautli-Janisz, Georg A. Kaiser, and Miriam Butt. 2018. A multilingual approach to question classification. In Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201918). European Language Resources Association (ELRA)."},{"key":"e_1_2_1_44_1","volume-title":"The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education","author":"Kapp Karl M.","unstructured":"Karl M. Kapp . 2012. The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education ( 1 st ed.). Pfeiffer & Company . Karl M. Kapp. 2012. The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education (1st ed.). Pfeiffer & Company.","edition":"1"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the Workshop and Tutorial on Interactive Adaptive Learning (IAL\u201917)","author":"Kottke Daniel","year":"2017","unstructured":"Daniel Kottke , Adrian Calma , Denis Huseljic , Georg Krempl , and Bernhard Sick . 2017 . Challenges of reliable, realistic and comparable active learning evaluation . In Proceedings of the Workshop and Tutorial on Interactive Adaptive Learning (IAL\u201917) , co-located with ECML PKDD. 2\u201314. Daniel Kottke, Adrian Calma, Denis Huseljic, Georg Krempl, and Bernhard Sick. 2017. Challenges of reliable, realistic and comparable active learning evaluation. In Proceedings of the Workshop and Tutorial on Interactive Adaptive Learning (IAL\u201917), co-located with ECML PKDD. 2\u201314."},{"key":"e_1_2_1_46_1","volume-title":"Parallel syntactic annotation in CReST. Ling. Issues Lang. Technol. 7, 4","author":"K\u00fcbler Sandra","year":"2012","unstructured":"Sandra K\u00fcbler , Eric Baucom , and Matthias Scheutz . 2012. Parallel syntactic annotation in CReST. Ling. Issues Lang. Technol. 7, 4 ( 2012 ). Sandra K\u00fcbler, Eric Baucom, and Matthias Scheutz. 2012. Parallel syntactic annotation in CReST. Ling. Issues Lang. Technol. 7, 4 (2012)."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50.30392"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the Workshop on Visualization for AI Explainability.","author":"Li Mingwei","year":"2018","unstructured":"Mingwei Li , Zhenge Zhao , and Carlos Scheidegger . 2018 . Visualizing neuron activations of neural networks with the grand tour . In Proceedings of the Workshop on Visualization for AI Explainability. Mingwei Li, Zhenge Zhao, and Carlos Scheidegger. 2018. Visualizing neuron activations of neural networks with the grand tour. In Proceedings of the Workshop on Visualization for AI Explainability."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236386.3241340"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visinf.2017.01.006"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2009.01.002"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972757.37"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services (CENTRIC\u201913)","author":"Marache-Francisco Cathie","year":"2013","unstructured":"Cathie Marache-Francisco and Eric Brangier . 2013 . Process of gamification . In Proceedings of the International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services (CENTRIC\u201913) , 126\u2013131. Cathie Marache-Francisco and Eric Brangier. 2013. Process of gamification. In Proceedings of the International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services (CENTRIC\u201913), 126\u2013131."},{"key":"e_1_2_1_54_1","unstructured":"David C. McClelland. 1987. Human Motivation. Cambridge University Press.  David C. McClelland. 1987. Human Motivation. Cambridge University Press."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dsp.2017.10.011"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(87)80013-5"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the International Conference on Web and Social Media (ICWSM\u201916)","volume":"10","author":"Ranganath Suhas","year":"2016","unstructured":"Suhas Ranganath , Xia Hu , Jiliang Tang , Suhang Wang , and Huan Liu . 2016 . Identifying rhetorical questions in social media . In Proceedings of the International Conference on Web and Social Media (ICWSM\u201916) , Vol. 10 . AAAI Press. https:\/\/ojs.aaai.org\/index.php\/ICWSM\/article\/view\/14771. Suhas Ranganath, Xia Hu, Jiliang Tang, Suhang Wang, and Huan Liu. 2016. Identifying rhetorical questions in social media. In Proceedings of the International Conference on Web and Social Media (ICWSM\u201916), Vol. 10. AAAI Press. https:\/\/ojs.aaai.org\/index.php\/ICWSM\/article\/view\/14771."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/3290753.3290761"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346481"},{"key":"e_1_2_1_60_1","first-page":"39","article-title":"Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. ITU Journal: ICT Discoveries","volume":"1","author":"Samek Wojciech","year":"2018","unstructured":"Wojciech Samek , Thomas Wiegand , and Klaus-Robert M\u00fcller . 2018 . Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. ITU Journal: ICT Discoveries , Special Issue 1: The impact of Artificial Intelligence on Communication Networks and Services 1 (2018), 39 \u2013 48 . Wojciech Samek, Thomas Wiegand, and Klaus-Robert M\u00fcller. 2018. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. ITU Journal: ICT Discoveries, Special Issue 1: The impact of Artificial Intelligence on Communication Networks and Services 1 (2018), 39\u201348.","journal-title":"Special Issue 1: The impact of Artificial Intelligence on Communication Networks and Services"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2010.181"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.5555\/3019233"},{"key":"e_1_2_1_63_1","unstructured":"Burr Settles Mark Craven and Soumya Ray. 2008. Multiple-instance active learning. In Advances in Neural Information Processing Systems. 1289\u20131296.   Burr Settles Mark Craven and Soumya Ray. 2008. Multiple-instance active learning. In Advances in Neural Information Processing Systems. 1289\u20131296."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130417"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the Workshop on Visualization for AI Explainability.","author":"Sevastjanova Rita","year":"2018","unstructured":"Rita Sevastjanova , Fabian Beck , Basil Ell , Cagatay Turkay , Rafael Henkin , Miriam Butt , Daniel A. Keim , and Mennatallah El-Assady . 2018 . Going beyond visualization: Verbalization as complementary medium to explain machine learning models . In Proceedings of the Workshop on Visualization for AI Explainability. Rita Sevastjanova, Fabian Beck, Basil Ell, Cagatay Turkay, Rafael Henkin, Miriam Butt, Daniel A. Keim, and Mennatallah El-Assady. 2018. Going beyond visualization: Verbalization as complementary medium to explain machine learning models. In Proceedings of the Workshop on Visualization for AI Explainability."},{"key":"e_1_2_1_66_1","unstructured":"Rita Sevastjanova Mennatallah El-Assady Annette Hautli Aikaterini-Lida Kalouli Rebecca Kehlbeck Oliver Deussen Daniel A. Keim and Miriam Butt. 2018. Mixed-initiative active learning for generating linguistic insights in question classification. In DSIA: Data Systems for Interactive Analysis.  Rita Sevastjanova Mennatallah El-Assady Annette Hautli Aikaterini-Lida Kalouli Rebecca Kehlbeck Oliver Deussen Daniel A. Keim and Miriam Butt. 2018. Mixed-initiative active learning for generating linguistic insights in question classification. In DSIA: Data Systems for Interactive Analysis."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the Workshop for Machine Learning from User Interaction for Visualization and Analytics at IEEE VIS.","author":"Sevastjanova Rita","year":"2019","unstructured":"Rita Sevastjanova , Hanna Sch\u00e4fer , J\u00fcrgen Bernard , Daniel A. Keim , and Mennatallah El-Assady . 2019 . Shall we play? Extending the visual analytics design space through gameful design concepts . In Proceedings of the Workshop for Machine Learning from User Interaction for Visualization and Analytics at IEEE VIS. Rita Sevastjanova, Hanna Sch\u00e4fer, J\u00fcrgen Bernard, Daniel A. Keim, and Mennatallah El-Assady. 2019. Shall we play? Extending the visual analytics design space through gameful design concepts. In Proceedings of the Workshop for Machine Learning from User Interaction for Visualization and Analytics at IEEE VIS."},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the EuroVis Workshop on Visual Analytics (EuroVA\u201920)","author":"Sperrle Fabian","year":"2020","unstructured":"Fabian Sperrle , Astrik Jeitler , J\u00fcrgen Bernard , Daniel A. Keim , and Mennatallah El-Assady . 2020 . Learning and teaching in co-adaptive guidance for mixed-initiative visual analytics . In Proceedings of the EuroVis Workshop on Visual Analytics (EuroVA\u201920) . Eurographics. Fabian Sperrle, Astrik Jeitler, J\u00fcrgen Bernard, Daniel A. Keim, and Mennatallah El-Assady. 2020. Learning and teaching in co-adaptive guidance for mixed-initiative visual analytics. In Proceedings of the EuroVis Workshop on Visual Analytics (EuroVA\u201920). Eurographics."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3012430.3012604"},{"key":"e_1_2_1_70_1","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton . 2008 . Visualizing data using t-SNE . J. Mach. Learn. Res. 9 (2008), 2579 \u2013 2605 . Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. J. Mach. Learn. Res. 9 (2008), 2579\u20132605.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.108"},{"volume-title":"Proceedings of the Text Retrieval Conference (TREC\u201902)","author":"Vendrig Jeroen","key":"e_1_2_1_72_1","unstructured":"Jeroen Vendrig , Ioannis Patras , Cees Snoek , Marcel Worring , Jurgen den Hartog , Stephan Raaijmakers , Jeroen van Rest , and David A . van Leeuwen. 2002. TREC feature extraction by active learning . In Proceedings of the Text Retrieval Conference (TREC\u201902) . Jeroen Vendrig, Ioannis Patras, Cees Snoek, Marcel Worring, Jurgen den Hartog, Stephan Raaijmakers, Jeroen van Rest, and David A. van Leeuwen. 2002. TREC feature extraction by active learning. In Proceedings of the Text Retrieval Conference (TREC\u201902)."},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the 10th International Conference on Computational Semantics (IWCS\u201913)","author":"Venhuizen Noortje","year":"2013","unstructured":"Noortje Venhuizen , Kilian Evang , Valerio Basile , and Johan Bos . 2013 . Gamification for word sense labeling . In Proceedings of the 10th International Conference on Computational Semantics (IWCS\u201913) . https:\/\/hal.inria.fr\/hal-01342431. Noortje Venhuizen, Kilian Evang, Valerio Basile, and Johan Bos. 2013. Gamification for word sense labeling. In Proceedings of the 10th International Conference on Computational Semantics (IWCS\u201913). https:\/\/hal.inria.fr\/hal-01342431."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2012.6248050"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the Annual Conference on Computational Linguistics (COLING\u201910)","author":"Wang Kai","year":"2010","unstructured":"Kai Wang and Tat-Seng Chua . 2010 . Exploiting salient patterns for question detection and question retrieval in community-based question answering . In Proceedings of the Annual Conference on Computational Linguistics (COLING\u201910) . Tsinghua University Press, 1155\u20131163. Kai Wang and Tat-Seng Chua. 2010. Exploiting salient patterns for question detection and question retrieval in community-based question answering. In Proceedings of the Annual Conference on Computational Linguistics (COLING\u201910). Tsinghua University Press, 1155\u20131163."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899412.1899414"},{"volume-title":"For the Win: How Game Thinking Can Revolutionize Your Business","author":"Werbach Kevin","key":"e_1_2_1_77_1","unstructured":"Kevin Werbach and Dan Hunter . 2012. For the Win: How Game Thinking Can Revolutionize Your Business . Wharton Digital Press . Kevin Werbach and Dan Hunter. 2012. For the Win: How Game Thinking Can Revolutionize Your Business. Wharton Digital Press."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2006.262442"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972733.15"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488523"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3429448","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3429448","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:03Z","timestamp":1750193283000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3429448"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,3]]},"references-count":81,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3429448"],"URL":"https:\/\/doi.org\/10.1145\/3429448","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2021,9,3]]},"assertion":[{"value":"2019-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}