{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T22:50:10Z","timestamp":1777503010136,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,29]]},"DOI":"10.1145\/3491102.3501823","type":"proceedings-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T17:08:31Z","timestamp":1651165711000},"page":"1-13","source":"Crossref","is-referenced-by-count":43,"title":["Neo: Generalizing Confusion Matrix Visualization to Hierarchical and Multi-Output Labels"],"prefix":"10.1145","author":[{"given":"Jochen","family":"G\u00f6rtler","sequence":"first","affiliation":[{"name":"University of Konstanz, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fred","family":"Hohman","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dominik","family":"Moritz","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kanit","family":"Wongsuphasawat","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donghao","family":"Ren","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rahul","family":"Nair","sequence":"additional","affiliation":[{"name":"Apple, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Kirchner","sequence":"additional","affiliation":[{"name":"Apple, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kayur","family":"Patel","sequence":"additional","affiliation":[{"name":"Apple, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346660"},{"key":"e_1_3_2_2_2_1","volume-title":"Do convolutional neural networks learn class hierarchy?IEEE Transactions on Visualization and Computer Graphics","author":"Alsallakh Bilal","year":"2017","unstructured":"Bilal Alsallakh , Amin Jourabloo , Mao Ye , Xiaoming Liu , and Liu Ren . 2017. Do convolutional neural networks learn class hierarchy?IEEE Transactions on Visualization and Computer Graphics ( 2017 ). https:\/\/doi.org\/10.1109\/tvcg.2017.2744683 Bilal Alsallakh, Amin Jourabloo, Mao Ye, Xiaoming Liu, and Liu Ren. 2017. Do convolutional neural networks learn class hierarchy?IEEE Transactions on Visualization and Computer Graphics (2017). https:\/\/doi.org\/10.1109\/tvcg.2017.2744683"},{"key":"e_1_3_2_2_3_1","volume-title":"ICML Workshop on Human Interpretability in Machine Learning.","author":"Alsallakh Bilal","year":"2020","unstructured":"Bilal Alsallakh , Zhixin Yan , Shabnam Ghaffarzadegan , Zeng Dai , and Liu Ren . 2020 . Visualizing classification structure of large-scale classifiers . In ICML Workshop on Human Interpretability in Machine Learning. Bilal Alsallakh, Zhixin Yan, Shabnam Ghaffarzadegan, Zeng Dai, and Liu Ren. 2020. Visualizing classification structure of large-scale classifiers. In ICML Workshop on Human Interpretability in Machine Learning."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702509"},{"key":"e_1_3_2_2_6_1","volume-title":"Semiology of graphics","author":"Bertin Jacques","unstructured":"Jacques Bertin . 1983. Semiology of graphics . University of Wisconsin Press. Jacques Bertin. 1983. Semiology of graphics. University of Wisconsin Press."},{"key":"e_1_3_2_2_8_1","volume-title":"A Bayesian interpretation of the confusion matrix. Annals of Mathematics and Artificial Intelligence","author":"Caelen Olivier","year":"2017","unstructured":"Olivier Caelen . 2017. A Bayesian interpretation of the confusion matrix. Annals of Mathematics and Artificial Intelligence ( 2017 ). https:\/\/doi.org\/10.1007\/s10472-017-9564-8 Olivier Caelen. 2017. A Bayesian interpretation of the confusion matrix. Annals of Mathematics and Artificial Intelligence (2017). https:\/\/doi.org\/10.1007\/s10472-017-9564-8"},{"key":"e_1_3_2_2_9_1","volume-title":"Readings in information visualization: Using vision to think","author":"Card K","unstructured":"Stuart\u00a0 K Card , Jock\u00a0 D Mackinlay , and Ben Shneiderman . 1999. Readings in information visualization: Using vision to think . Morgan Kaufmann Publishers Inc . Stuart\u00a0K Card, Jock\u00a0D Mackinlay, and Ben Shneiderman. 1999. Readings in information visualization: Using vision to think. Morgan Kaufmann Publishers Inc."},{"key":"e_1_3_2_2_10_1","volume-title":"A relational model of data for large shared data banks. Commun. ACM","author":"Codd Edgar\u00a0Frank","year":"1970","unstructured":"Edgar\u00a0Frank Codd . 1970. A relational model of data for large shared data banks. Commun. ACM ( 1970 ). Edgar\u00a0Frank Codd. 1970. A relational model of data for large shared data banks. Commun. ACM (1970)."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Graham\u00a0R Gibbs. 2007. Thematic coding and categorizing. Analyzing Qualitative Data(2007). https:\/\/doi.org\/10.4135\/9781849208574.n4  Graham\u00a0R Gibbs. 2007. Thematic coding and categorizing. Analyzing Qualitative Data(2007). https:\/\/doi.org\/10.4135\/9781849208574.n4","DOI":"10.4135\/9781849208574"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"crossref","unstructured":"A. Hinterreiter P. Ruch H. Stitz M. Ennemoser J. Bernard H. Strobelt and M. Streit. 2020. ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion. IEEE Transactions on Visualization and Computer Graphics (2020). https:\/\/doi.org\/10.1109\/tvcg.2020.3012063  A. Hinterreiter P. Ruch H. Stitz M. Ennemoser J. Bernard H. Strobelt and M. Streit. 2020. ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion. IEEE Transactions on Visualization and Computer Graphics (2020). https:\/\/doi.org\/10.1109\/tvcg.2020.3012063","DOI":"10.1109\/TVCG.2020.3012063"},{"key":"e_1_3_2_2_14_1","unstructured":"Robert Hogg and Elliot Tanis. 2020. Probability and statistical inference. Pearson.  Robert Hogg and Elliot Tanis. 2020. Probability and statistical inference. Pearson."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376177"},{"key":"e_1_3_2_2_16_1","volume-title":"International Journal of Data Mining & Knowledge Management Process","author":"Hossin Mohammad","year":"2015","unstructured":"Mohammad Hossin and M.\u00a0 N. Sulaiman . 2015. A review on evaluation metrics for data classification evaluations . International Journal of Data Mining & Knowledge Management Process ( 2015 ). https:\/\/doi.org\/10.5121\/ijdkp.2015.5201 Mohammad Hossin and M.\u00a0N. Sulaiman. 2015. A review on evaluation metrics for data classification evaluations. International Journal of Data Mining & Knowledge Management Process (2015). https:\/\/doi.org\/10.5121\/ijdkp.2015.5201"},{"key":"e_1_3_2_2_17_1","volume-title":"Toxic comment classification challenge. Kaggle","year":"2017","unstructured":"Jigsaw. 2017. Toxic comment classification challenge. Kaggle ( 2017 ). Jigsaw. 2017. Toxic comment classification challenge. Kaggle (2017)."},{"key":"e_1_3_2_2_18_1","volume-title":"ActiVis: Visual exploration of industry-scale deep neural network models","author":"Kahng Minsuk","year":"2017","unstructured":"Minsuk Kahng , Pierre\u00a0 Y Andrews , Aditya Kalro , and Duen\u00a0Horng Chau . 2017. ActiVis: Visual exploration of industry-scale deep neural network models . IEEE Transactions on Visualization and Computer Graphics ( 2017 ). https:\/\/doi.org\/10.1109\/tvcg.2017.2744718 Minsuk Kahng, Pierre\u00a0Y Andrews, Aditya Kalro, and Duen\u00a0Horng Chau. 2017. ActiVis: Visual exploration of industry-scale deep neural network models. IEEE Transactions on Visualization and Computer Graphics (2017). https:\/\/doi.org\/10.1109\/tvcg.2017.2744718"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2254556.2254659"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753529"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415842"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.5121\/csit.2020.100801"},{"key":"e_1_3_2_2_23_1","volume-title":"WordNet: a lexical database for English. Commun. ACM","author":"Miller A","year":"1995","unstructured":"George\u00a0 A Miller . 1995. WordNet: a lexical database for English. Commun. ACM ( 1995 ). https:\/\/doi.org\/10.1145\/219717.219748 George\u00a0A Miller. 1995. WordNet: a lexical database for English. Commun. ACM (1995). https:\/\/doi.org\/10.1145\/219717.219748"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866038"},{"key":"e_1_3_2_2_25_1","volume-title":"Squares: Supporting interactive performance analysis for multiclass classifiers","author":"Ren Donghao","year":"2016","unstructured":"Donghao Ren , Saleema Amershi , Bongshin Lee , Jina Suh , and Jason\u00a0 D Williams . 2016 . Squares: Supporting interactive performance analysis for multiclass classifiers . IEEE Transactions on Visualization and Computer Graphics ( 2016). https:\/\/doi.org\/10.1109\/tvcg.2016.2598828 Donghao Ren, Saleema Amershi, Bongshin Lee, Jina Suh, and Jason\u00a0D Williams. 2016. Squares: Supporting interactive performance analysis for multiclass classifiers. IEEE Transactions on Visualization and Computer Graphics (2016). https:\/\/doi.org\/10.1109\/tvcg.2016.2598828"},{"key":"e_1_3_2_2_26_1","volume-title":"Vega-lite: A grammar of interactive graphics","author":"Satyanarayan Arvind","year":"2016","unstructured":"Arvind Satyanarayan , Dominik Moritz , Kanit Wongsuphasawat , and Jeffrey Heer . 2016 . Vega-lite: A grammar of interactive graphics . IEEE Transactions on Visualization and Computer Graphics ( 2016). https:\/\/doi.org\/10.31219\/osf.io\/mqzyx Arvind Satyanarayan, Dominik Moritz, Kanit Wongsuphasawat, and Jeffrey Heer. 2016. Vega-lite: A grammar of interactive graphics. IEEE Transactions on Visualization and Computer Graphics (2016). https:\/\/doi.org\/10.31219\/osf.io\/mqzyx"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/IV.2009.45"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415224"},{"key":"e_1_3_2_2_29_1","volume-title":"Polaris: A system for query, analysis, and visualization of multidimensional relational databases","author":"Stolte Chris","year":"2002","unstructured":"Chris Stolte , Diane Tang , and Pat Hanrahan . 2002 . Polaris: A system for query, analysis, and visualization of multidimensional relational databases . IEEE Transactions on Visualization and Computer Graphics ( 2002). https:\/\/doi.org\/10.1109\/2945.981851 Chris Stolte, Diane Tang, and Pat Hanrahan. 2002. Polaris: A system for query, analysis, and visualization of multidimensional relational databases. IEEE Transactions on Visualization and Computer Graphics (2002). https:\/\/doi.org\/10.1109\/2945.981851"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775064"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/645496.657884"},{"key":"e_1_3_2_2_32_1","volume-title":"Intelligent Information Processing and Web Mining","author":"Susmaga Robert","unstructured":"Robert Susmaga . 2004. Confusion matrix visualization . In Intelligent Information Processing and Web Mining . Springer . https:\/\/doi.org\/10.1007\/978-3-540-39985-8_12 Robert Susmaga. 2004. Confusion matrix visualization. In Intelligent Information Processing and Web Mining. Springer. https:\/\/doi.org\/10.1007\/978-3-540-39985-8_12"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518895"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"crossref","unstructured":"Niklas T\u00f6tsch and Daniel Hoffmann. 2021. Classifier uncertainty: Evidence potential impact and probabilistic treatment. PeerJ Computer Science(2021). https:\/\/doi.org\/10.7717\/peerj-cs.398  Niklas T\u00f6tsch and Daniel Hoffmann. 2021. Classifier uncertainty: Evidence potential impact and probabilistic treatment. PeerJ Computer Science(2021). https:\/\/doi.org\/10.7717\/peerj-cs.398","DOI":"10.7717\/peerj-cs.398"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2011.6102453"},{"key":"e_1_3_2_2_36_1","volume-title":"Facets: An open source visualization tool for machine learning training data","author":"Wexler James","year":"2017","unstructured":"James Wexler . 2017 . Facets: An open source visualization tool for machine learning training data . http:\/\/ai.googleblog.com\/2017\/07\/facets-open-source-visualization-tool.html. James Wexler. 2017. Facets: An open source visualization tool for machine learning training data. http:\/\/ai.googleblog.com\/2017\/07\/facets-open-source-visualization-tool.html."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Leland Wilkinson and Michael Friendly. 2009. The history of the cluster heat map. The American Statistician(2009). https:\/\/doi.org\/10.1198\/tas.2009.0033  Leland Wilkinson and Michael Friendly. 2009. The history of the cluster heat map. The American Statistician(2009). https:\/\/doi.org\/10.1198\/tas.2009.0033","DOI":"10.1198\/tas.2009.0033"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025768"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196729"},{"key":"e_1_3_2_2_40_1","volume-title":"Manifold: A model-agnostic framework for interpretation and diagnosis of machine learning models","author":"Zhang J.","year":"2019","unstructured":"J. Zhang , Y. Wang , P. Molino , L. Li , and D.\u00a0 S. Ebert . 2019 . Manifold: A model-agnostic framework for interpretation and diagnosis of machine learning models . IEEE Transactions on Visualization and Computer Graphics ( 2019). https:\/\/doi.org\/10.1109\/tvcg.2018.2864499 J. Zhang, Y. Wang, P. Molino, L. Li, and D.\u00a0S. Ebert. 2019. Manifold: A model-agnostic framework for interpretation and diagnosis of machine learning models. IEEE Transactions on Visualization and Computer Graphics (2019). https:\/\/doi.org\/10.1109\/tvcg.2018.2864499"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445186"}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","location":"New Orleans LA USA","acronym":"CHI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3501823","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491102.3501823","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:51Z","timestamp":1750188651000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3501823"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":40,"alternative-id":["10.1145\/3491102.3501823","10.1145\/3491102"],"URL":"https:\/\/doi.org\/10.1145\/3491102.3501823","relation":{},"subject":[],"published":{"date-parts":[[2022,4,29]]}}}