{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T11:58:16Z","timestamp":1753358296862,"version":"3.41.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T00:00:00Z","timestamp":1736467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"\n Building higher-quality image classification models requires better performance analysis (PA) to help understand their behaviors. We propose ConfusionLens, a dynamic and interactive visualization interface that augments a conventional confusion matrix with focus+context visualization. This interface allows users to seamlessly switch table layouts among three views (overall view, class-level view, and between-class view) while observing all of the instance images in a single screen. We designed and implemented a ConfusionLens prototype that supports hundreds of instances, and then conducted a user study (N\n \n \\(=\\)<\/jats:tex-math>\n <\/jats:inline-formula>\n 14) to evaluate it compared to the conventional confusion matrix with a split view of instances. Results show that ConfusionLens achieved faster task-completion time in observing instance-level performance and higher accuracy in observing between-class confusion. Moreover, we conducted an expert interview (N\n \n \\(=\\)<\/jats:tex-math>\n <\/jats:inline-formula>\n 6) to investigate the applicability of our interface to practical PA tasks, and then implemented several extensions of ConfusionLens based on the feedback. Feedback on these extensions from users experienced in image classification (N\n \n \\(=\\)<\/jats:tex-math>\n <\/jats:inline-formula>\n 5) demonstrated their general usefulness and highlighted their beneficial use in PA tasks.\n <\/jats:p>","DOI":"10.1145\/3700139","type":"journal-article","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T14:05:04Z","timestamp":1729173904000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["ConfusionLens: Focus+Context Visualization Interface for Performance Analysis of Multiclass Image Classifiers"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1039-0167","authenticated-orcid":false,"given":"Kazuyuki","family":"Fujita","sequence":"first","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9382-7741","authenticated-orcid":false,"given":"Keito","family":"Uwaseki","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-7908-2080","authenticated-orcid":false,"given":"Hongyu","family":"Bu","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1020-5750","authenticated-orcid":false,"given":"Kazuki","family":"Takashima","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7047-627X","authenticated-orcid":false,"given":"Yoshifumi","family":"Kitamura","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,1,10]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Tensorflow.. Tensorboard. Retrieved from https:\/\/www.tensorflow.org\/tensorboard"},{"issue":"12","key":"e_1_3_2_3_2","doi-asserted-by":"crossref","first-page":"1703","DOI":"10.1109\/TVCG.2014.2346660","article-title":"Visual methods for analyzing probabilistic classification data","volume":"20","author":"Alsallakh Bilal","year":"2014","unstructured":"Bilal Alsallakh, Allan Hanbury, Helwig Hauser, Silvia Miksch, and Andreas Rauber. 2014. Visual methods for analyzing probabilistic classification data. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 1703\u20131712.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1145\/2702123.2702509","volume-title":"Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems","author":"Amershi Saleema","year":"2015","unstructured":"Saleema Amershi, Max Chickering, Steven M. Drucker, Bongshin Lee, Patrice Simard, and Jina Suh. 2015. Modeltracker: Redesigning performance analysis tools for machine learning. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 337\u2013346."},{"issue":"3","key":"e_1_3_2_5_2","first-page":"114","article-title":"Determining what individual SUS scores mean: Adding an adjective rating scale","volume":"4","author":"Bangor Aaron","year":"2009","unstructured":"Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies 4, 3 (2009), 114\u2013123.","journal-title":"Journal of Usability Studies"},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1145\/503376.503423","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Baudisch Patrick","year":"2002","unstructured":"Patrick Baudisch, Nathaniel Good, Victoria Bellotti, and Pamela Schraedley. 2002. Keeping things in context: A comparative evaluation of focus plus context screens, overviews, and zooming. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 259\u2013266."},{"key":"e_1_3_2_7_2","volume-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI \u201922)","author":"B\u00e4uerle Alex","year":"2022","unstructured":"Alex B\u00e4uerle, \u00c1ngel Alexander Cabrera, Fred Hohman, Megan Maher, David Koski, Xavier Suau, Titus Barik, and Dominik Moritz. 2022. Symphony: Composing interactive interfaces for machine learning. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI \u201922). ACM, New York, NY, Article 210, 14 pages. DOI: 10.1145\/3491102.3502102"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3209425"},{"key":"e_1_3_2_9_2","first-page":"67","volume-title":"Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG \u201918)","author":"Cao Qiong","year":"2018","unstructured":"Qiong Cao, Li Shen, Weidi Xie, Omkar M Parkhi, and Andrew Zisserman. 2018. VGGFace2: A dataset for recognising faces across pose and age. In Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG \u201918), 67\u201374."},{"issue":"1","key":"e_1_3_2_10_2","first-page":"172","article-title":"OpenPose: Realtime multi-person 2D pose estimation using Part Affinity Fields","volume":"43","author":"Cao Zhe","year":"2019","unstructured":"Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2019. OpenPose: Realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence 43, 1 (2019), 172\u2013186.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2023.3326588"},{"key":"e_1_3_2_12_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/VAST.2010.5652443","volume-title":"Proceedings of the IEEE Symposium on Visual Analytics Science and Technology","author":"Choo Jaegul","year":"2010","unstructured":"Jaegul Choo, Hanseung Lee, Jaeyeon Kihm, and Haesun Park. 2010. iVisClassifier: An interactive visual analytics system for classification based on supervised dimension reduction. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology. IEEE, 27\u201334."},{"key":"e_1_3_2_13_2","first-page":"3642","volume-title":"Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition","author":"Ciregan Dan","year":"2012","unstructured":"Dan Ciregan, Ueli Meier, and J\u00fcrgen Schmidhuber. 2012. Multi-column deep neural networks for image classification. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, 3642\u20133649."},{"issue":"1","key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1456650.1456652","article-title":"A review of overview+detail, zooming, and focus+context interfaces","volume":"41","author":"Cockburn Andy","year":"2009","unstructured":"Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2009. A review of overview+detail, zooming, and focus+context interfaces. ACM Computing Surveys 41, 1 (2009), 1\u201331.","journal-title":"ACM Computing Surveys"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/978-1-4471-3754-2_6","volume-title":"Proceedings of the People and Computers XVII\u2014Designing for Society","author":"Cockburn Andy","year":"2004","unstructured":"Andy Cockburn and Joshua Savage. 2004. Comparing speed-dependent automatic zooming with traditional scroll, pan and zoom methods. In Proceedings of the People and Computers XVII\u2014Designing for Society, 87\u2013102."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/1473871619878085"},{"issue":"5439","key":"e_1_3_2_17_2","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1126\/science.286.5439.531","article-title":"Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring","volume":"286","author":"Golub Todd R.","year":"1999","unstructured":"Todd R. Golub, Donna K. Slonim, Pablo Tamayo, Christine Huard, Michelle Gaasenbeek, Jill P. Mesirov, Hilary Coller, Mignon L. Loh, James R. Downing, Mark A. Caligiuri, et al. 1999. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 286, 5439 (1999), 531\u2013537.","journal-title":"Science"},{"key":"e_1_3_2_18_2","volume-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI \u201922)","author":"G\u00f6rtler Jochen","year":"2022","unstructured":"Jochen G\u00f6rtler, Fred Hohman, Dominik Moritz, Kanit Wongsuphasawat, Donghao Ren, Rahul Nair, Marc Kirchner, and Kayur Patel. 2022. Neo: Generalizing confusion matrix visualization to hierarchical and multi-output labels. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI \u201922). ACM, New York, NY, Article 408, 13 pages. DOI: 10.1145\/3491102.3501823"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114855"},{"issue":"2","key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1109\/TVCG.2020.3012063","article-title":"ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion","volume":"28","author":"Hinterreiter Andreas","year":"2020","unstructured":"Andreas Hinterreiter, Peter Ruch, Holger Stitz, Martin Ennemoser, Jurgen Bernard, Hendrik Strobelt, and Marc Streit. 2020. ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion. IEEE Transactions on Visualization and Computer Graphics 28, 2 (2022), 1222\u20131236.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"issue":"4","key":"e_1_3_2_21_2","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1145\/586081.586086","article-title":"Navigation patterns and usability of zoomable user interfaces with and without an overview","volume":"9","author":"Hornb\u00e6k Kasper","year":"2002","unstructured":"Kasper Hornb\u00e6k, Benjamin B. Bederson, and Catherine Plaisant. 2002. Navigation patterns and usability of zoomable user interfaces with and without an overview. ACM Transactions on Computer-Human Interaction 9, 4 (2002), 362\u2013389.","journal-title":"ACM Transactions on Computer-Human Interaction"},{"key":"e_1_3_2_22_2","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1145\/3279778.3279923","volume-title":"Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces","author":"Huang Xin","year":"2018","unstructured":"Xin Huang, Kazuki Takashima, Kazuyuki Fujita, and Yoshifumi Kitamura. 2018. Dynamic, flexible and multi-dimensional visualization of digital photos and their metadata. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces, 405\u2013408."},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"1343","DOI":"10.1145\/1753326.1753529","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Kapoor Ashish","year":"2010","unstructured":"Ashish Kapoor, Bongshin Lee, Desney Tan, and Eric Horvitz. 2010. Interactive optimization for steering machine classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1343\u20131352."},{"key":"e_1_3_2_24_2","doi-asserted-by":"crossref","first-page":"6:1","DOI":"10.1145\/2542284","volume-title":"Proceedings of the SIGGRAPH Asia 2013 Emerging Technologies","author":"Kitamura Yoshifumi","year":"2013","unstructured":"Yoshifumi Kitamura, Chi Thanh Vi, Gengdai Liu, Kazuki Takashima, Yuichi Itoh, and Sriram Subramanian. 2013. D-FLIP: Dynamic & flexible interactive photoshow. In Proceedings of the SIGGRAPH Asia 2013 Emerging Technologies, 6:1\u20136:3."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3209354"},{"key":"e_1_3_2_26_2","first-page":"5177","volume-title":"Proceedings of the IEEE International Conference on Image Processing (ICIP \u201914)","author":"Maeda T.","year":"2014","unstructured":"T. Maeda, T. Yamasaki, and K. Aizawa. 2014. Multi-stage object classification featuring confidence analysis of classifier and inclined local Naive Bayes nearest neighbor. In Proceedings of the IEEE International Conference on Image Processing (ICIP \u201914), 5177\u20135181. DOI: 10.1109\/ICIP.2014.7026048"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.2312\/evs.20211047"},{"key":"e_1_3_2_28_2","volume-title":"Proceedings of the IEEE Visualization Conference (VIS \u201920)","author":"P\u00fchringer Michael","year":"2020","unstructured":"Michael P\u00fchringer, Andreas Hinterreiter, and Marc Streit. 2020. InstanceFlow: Visualizing the evolution of classifier confusion at the instance level. In Proceedings of the IEEE Visualization Conference (VIS \u201920). IEEE."},{"key":"e_1_3_2_29_2","first-page":"318","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Rao Ramana","year":"1994","unstructured":"Ramana Rao and Stuart K. Card. 1994. The table lens: Merging graphical and symbolic representations in an interactive focus+context visualization for tabular information. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 318\u2013322."},{"key":"e_1_3_2_30_2","first-page":"779","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Redmon Joseph","year":"2016","unstructured":"Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 779\u2013788."},{"issue":"1","key":"e_1_3_2_31_2","first-page":"61","article-title":"Squares: Supporting interactive performance analysis for multiclass classifiers","volume":"23","author":"Ren Donghao","year":"2016","unstructured":"Donghao Ren, Saleema Amershi, Bongshin Lee, Jina Suh, and Jason D. Williams. 2016. Squares: Supporting interactive performance analysis for multiclass classifiers. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2016), 61\u201370.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_2_32_2","first-page":"91","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Proceedings of the Advances in Neural Information Processing Systems, 91\u201399."},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1145\/2939672.2939778","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Ribeiro Marco Tulio","year":"2016","unstructured":"Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. \u201cWhy should I trust you?\u201d: Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1135\u20131144."},{"key":"e_1_3_2_34_2","first-page":"233","volume-title":"Proceedings of the IEEE Symposium on Information Visualization, (INFOVIS \u201905)","author":"Riehmann Patrick","year":"2005","unstructured":"Patrick Riehmann, Manfred Hanfler, and Bernd Froehlich. 2005. Interactive sankey diagrams. In Proceedings of the IEEE Symposium on Information Visualization, (INFOVIS \u201905). IEEE, 233\u2013240."},{"key":"e_1_3_2_35_2","first-page":"815","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Schroff Florian","year":"2015","unstructured":"Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. FaceNet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 815\u2013823."},{"key":"e_1_3_2_36_2","first-page":"618","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Selvaraju Ramprasaath R.","year":"2017","unstructured":"Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2017. Grad-CAM: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE International Conference on Computer Vision, 618\u2013626."},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1145\/1518701.1518895","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Talbot Justin","year":"2009","unstructured":"Justin Talbot, Bongshin Lee, Ashish Kapoor, and Desney S. Tan. 2009. EnsembleMatrix: Interactive visualization to support machine learning with multiple classifiers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1283\u20131292."},{"issue":"1","key":"e_1_3_2_38_2","doi-asserted-by":"crossref","first-page":"40","DOI":"10.3758\/BF03213026","article-title":"Theoretical analysis of an alphabetic confusion matrix","volume":"9","author":"Townsend James T.","year":"1971","unstructured":"James T. Townsend. 1971. Theoretical analysis of an alphabetic confusion matrix. Perception & Psychophysics 9, 1 (1971), 40\u201350.","journal-title":"Perception & Psychophysics"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0734-189X(85)80004-9"},{"issue":"4","key":"e_1_3_2_40_2","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.entcom.2014.08.005","article-title":"A dynamic flexible and interactive display method of digital photographs","volume":"5","author":"Vi Chi Thanh","year":"2014","unstructured":"Chi Thanh Vi, Kazuki Takashima, Hitomi Yokoyama, Gengdai Liu, Yuichi Itoh, Sriram Subramanian, and Yoshifumi Kitamura. 2014. A dynamic flexible and interactive display method of digital photographs. Entertainment Computing 5, 4 (2014), 451\u2013462.","journal-title":"Entertainment Computing"},{"issue":"1","key":"e_1_3_2_41_2","first-page":"56","article-title":"The what-if tool: Interactive probing of machine learning models","volume":"26","author":"Wexler James","year":"2019","unstructured":"James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2019), 56\u201365.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3182488"},{"key":"e_1_3_2_43_2","volume-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI \u201922)","author":"Yang Yalong","year":"2022","unstructured":"Yalong Yang, Wenyu Xia, Fritz Lekschas, Carolina Nobre, Robert Kr\u00fcger, and Hanspeter Pfister. 2022. The pattern is in the details: An evaluation of interaction techniques for locating, searching, and contextualizing details in multivariate matrix visualizations. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI \u201922). ACM, New York, NY, Article 84, 15 pages. DOI: 10.1145\/3491102.3517673"},{"issue":"1","key":"e_1_3_2_44_2","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/TVCG.2018.2864499","article-title":"Manifold: A model-agnostic framework for interpretation and diagnosis of machine learning models","volume":"25","author":"Zhang Jiawei","year":"2018","unstructured":"Jiawei Zhang, Yang Wang, Piero Molino, Lezhi Li, and David S. Ebert. 2018. Manifold: A model-agnostic framework for interpretation and diagnosis of machine learning models. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2018), 364\u2013373.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3700139","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3700139","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:09:49Z","timestamp":1750295389000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3700139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,10]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3,31]]}},"alternative-id":["10.1145\/3700139"],"URL":"https:\/\/doi.org\/10.1145\/3700139","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2025,1,10]]},"assertion":[{"value":"2023-11-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-15","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}