{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T05:37:55Z","timestamp":1751607475599,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":64,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445425","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T02:33:36Z","timestamp":1620441216000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["User Ex Machina : Simulation as a Design Probe in Human-in-the-Loop Text Analytics"],"prefix":"10.1145","author":[{"given":"Anamaria","family":"Crisan","sequence":"first","affiliation":[{"name":"Tableau Research, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Correll","sequence":"additional","affiliation":[{"name":"Tableau Research Tableau Software, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467618"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2014.7042493"},{"key":"e_1_3_2_1_3_1","volume-title":"Natural Language Processing with Python","author":"Bird Steven","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural Language Processing with Python ( 1 st ed.). O\u2019Reilly Media, Inc. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python(1st ed.). O\u2019Reilly Media, Inc.","edition":"1"},{"key":"e_1_3_2_1_4_1","first-page":"993","article-title":"Latent Dirichlet Allocation","author":"Blei M","year":"2003","unstructured":"David\u00a0 M Blei , Andrew\u00a0 Y Ng , and Michael\u00a0 I Jordan . 2003 . Latent Dirichlet Allocation . Journal of Machine Learning Research 3 , Jan (2003), 993 \u2013 1022 . David\u00a0M Blei, Andrew\u00a0Y Ng, and Michael\u00a0I Jordan. 2003. Latent Dirichlet Allocation. Journal of Machine Learning Research 3, Jan (2003), 993\u20131022.","journal-title":"Journal of Machine Learning Research 3"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2012.6400486"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.154"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-57207-4_25"},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the 22nd International Conference on Neural Information Processing Systems(NIPS\u201909)","author":"Chang Jonathan","year":"2009","unstructured":"Jonathan Chang , Jordan Boyd-Graber , Sean Gerrish , Chong Wang , and David\u00a0 M. Blei . 2009 . Reading tea leaves: how humans interpret topic models . In Proceedings of the 22nd International Conference on Neural Information Processing Systems(NIPS\u201909) . Curran Associates Inc., Vancouver, British Columbia, Canada, 288\u2013296. https:\/\/www.aclweb.org\/anthology\/N15-1018.pdf Jonathan Chang, Jordan Boyd-Graber, Sean Gerrish, Chong Wang, and David\u00a0M. Blei. 2009. Reading tea leaves: how humans interpret topic models. In Proceedings of the 22nd International Conference on Neural Information Processing Systems(NIPS\u201909). Curran Associates Inc., Vancouver, British Columbia, Canada, 288\u2013296. https:\/\/www.aclweb.org\/anthology\/N15-1018.pdf"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2010.5652443"},{"key":"e_1_3_2_1_10_1","volume-title":"International Conference on Machine Learning. 612\u2013620","author":"Chuang Jason","year":"2013","unstructured":"Jason Chuang , Sonal Gupta , Christopher Manning , and Jeffrey Heer . 2013 . Topic Model Diagnostics: Assessing Domain Relevance via Topical Alignment . In International Conference on Machine Learning. 612\u2013620 . http:\/\/proceedings.mlr.press\/v28\/chuang13.html ISSN: 1938-7228 Section : Machine Learning. Jason Chuang, Sonal Gupta, Christopher Manning, and Jeffrey Heer. 2013. Topic Model Diagnostics: Assessing Domain Relevance via Topical Alignment. In International Conference on Machine Learning. 612\u2013620. http:\/\/proceedings.mlr.press\/v28\/chuang13.html ISSN: 1938-7228 Section: Machine Learning."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2254556.2254572"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2362364.2362367"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207738"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01439.x"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2009.5333443"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073001.1073010"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300418"},{"key":"e_1_3_2_1_19_1","volume-title":"IEEE Visualization Workshop Proceedings: The 2nd Workshop on Interactive Visual Text Analytics: Task-Driven Analysis of Social Media Content.","author":"Correll Michael","year":"2012","unstructured":"Michael Correll and Michael Gleicher . 2012 . What shakespeare taught us about text visualization . In IEEE Visualization Workshop Proceedings: The 2nd Workshop on Interactive Visual Text Analytics: Task-Driven Analysis of Social Media Content. Michael Correll and Michael Gleicher. 2012. What shakespeare taught us about text visualization. In IEEE Visualization Workshop Proceedings: The 2nd Workshop on Interactive Visual Text Analytics: Task-Driven Analysis of Social Media Content."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864907"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics"},{"key":"e_1_3_2_1_22_1","volume-title":"The computational case against computational literary studies. Critical inquiry 45, 3","author":"Z Da.","year":"2019","unstructured":"Nan\u00a0 Z Da. 2019. The computational case against computational literary studies. Critical inquiry 45, 3 ( 2019 ), 601\u2013639. Nan\u00a0Z Da. 2019. The computational case against computational literary studies. Critical inquiry 45, 3 (2019), 601\u2013639."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188404"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300295"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745080"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864769"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2914729"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Fothergill Richard","year":"2016","unstructured":"Richard Fothergill , Paul Cook , and Timothy Baldwin . 2016 . Evaluating a topic modelling approach to measuring corpus similarity . In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916) . 273\u2013279. Richard Fothergill, Paul Cook, and Timothy Baldwin. 2016. Evaluating a topic modelling approach to measuring corpus similarity. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916). 273\u2013279."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.76"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745118"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1807184115"},{"key":"e_1_3_2_1_32_1","volume-title":"Fifteenth National Conference on Artificial Intelligence (AAAI-98)","author":"Hirschberg J","year":"1998","unstructured":"J Hirschberg . 1998 . Every time I fire a linguist, my performance goes up, and other myths of the statistical natural language processing revolution. Invited talk . In Fifteenth National Conference on Artificial Intelligence (AAAI-98) . J Hirschberg. 1998. Every time I fire a linguist, my performance goes up, and other myths of the statistical natural language processing revolution. Invited talk. In Fifteenth National Conference on Artificial Intelligence (AAAI-98)."},{"key":"e_1_3_2_1_33_1","volume-title":"Green Sleeves\u201d: Digital Approaches to Shakespeare\u2019s Language of Genre. Shakespeare Quarterly 61, 3","author":"Hope Jonathan","year":"2010","unstructured":"Jonathan Hope and Michael Witmore . 2010. The Hundredth Psalm to the Tune of \u201d Green Sleeves\u201d: Digital Approaches to Shakespeare\u2019s Language of Genre. Shakespeare Quarterly 61, 3 ( 2010 ), 357\u2013390. Jonathan Hope and Michael Witmore. 2010. The Hundredth Psalm to the Tune of\u201d Green Sleeves\u201d: Digital Approaches to Shakespeare\u2019s Language of Genre. Shakespeare Quarterly 61, 3 (2010), 357\u2013390."},{"key":"e_1_3_2_1_34_1","volume-title":"Proceedings of the Sixth New Zealand Computer Science Research Student Conference (NZCSRSC2008)","author":"Huang Anna","year":"2008","unstructured":"Anna Huang . 2008 . Similarity measures for text document clustering . In Proceedings of the Sixth New Zealand Computer Science Research Student Conference (NZCSRSC2008) , Christchurch, New Zealand, Vol.\u00a04. 9\u201356. Anna Huang. 2008. Similarity measures for text document clustering. In Proceedings of the Sixth New Zealand Computer Science Research Student Conference (NZCSRSC2008), Christchurch, New Zealand, Vol.\u00a04. 9\u201356."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2015.1093271"},{"key":"e_1_3_2_1_36_1","volume-title":"Data clustering: a review. ACM computing surveys (CSUR) 31, 3","author":"Jain K","year":"1999","unstructured":"Anil\u00a0 K Jain , M\u00a0Narasimha Murty , and Patrick\u00a0 J Flynn . 1999. Data clustering: a review. ACM computing surveys (CSUR) 31, 3 ( 1999 ), 264\u2013323. Anil\u00a0K Jain, M\u00a0Narasimha Murty, and Patrick\u00a0J Flynn. 1999. Data clustering: a review. ACM computing surveys (CSUR) 31, 3 (1999), 264\u2013323."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300432"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346325"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2015.7156366"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1637"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/E14-1056"},{"key":"e_1_3_2_1_42_1","first-page":"59","article-title":"A Human-in-the-loop Perspective on AutoML: Milestones and the Road Ahead.","volume":"42","author":"Jung\u00a0Lin Lee Doris","year":"2019","unstructured":"Doris Jung\u00a0Lin Lee , Stephen Macke , Doris Xin , Angela Lee , Silu Huang , and Aditya\u00a0 G Parameswaran . 2019 . A Human-in-the-loop Perspective on AutoML: Milestones and the Road Ahead. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 42 , 2 (2019), 59 \u2013 70 . Doris Jung\u00a0Lin Lee, Stephen Macke, Doris Xin, Angela Lee, Silu Huang, and Aditya\u00a0G Parameswaran. 2019. A Human-in-the-loop Perspective on AutoML: Milestones and the Road Ahead.Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 42, 2 (2019), 59\u201370.","journal-title":"Bulletin of the IEEE Computer Society Technical Committee on Data Engineering"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2017.03.007"},{"key":"e_1_3_2_1_44_1","unstructured":"David Lewis. 1997. Reuters-21578 Text Categorization Test Collection Distribution 1.0. http:\/\/www.daviddlewis.com\/resources\/testcollections\/reuters21578\/  David Lewis. 1997. Reuters-21578 Text Categorization Test Collection Distribution 1.0. http:\/\/www.daviddlewis.com\/resources\/testcollections\/reuters21578\/"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3317287.3328534"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13672"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3028985"},{"key":"e_1_3_2_1_48_1","volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning(EMNLP-CoNLL \u201912)","author":"Mao Xian-Ling","year":"2012","unstructured":"Xian-Ling Mao , Zhao-Yan Ming , Tat-Seng Chua , Si Li , Hongfei Yan , and Xiaoming Li . 2012 . SSHLDA: a semi-supervised hierarchical topic model . In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning(EMNLP-CoNLL \u201912) . Association for Computational Linguistics, Jeju Island, Korea, 800\u2013809. Xian-Ling Mao, Zhao-Yan Ming, Tat-Seng Chua, Si Li, Hongfei Yan, and Xiaoming Li. 2012. SSHLDA: a semi-supervised hierarchical topic model. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning(EMNLP-CoNLL \u201912). Association for Computational Linguistics, Jeju Island, Korea, 800\u2013809."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376420"},{"volume-title":"maps, trees: abstract models for a literary history","author":"Moretti Franco","key":"e_1_3_2_1_50_1","unstructured":"Franco Moretti . 2005. Graphs , maps, trees: abstract models for a literary history . Verso . Franco Moretti. 2005. Graphs, maps, trees: abstract models for a literary history. Verso."},{"volume-title":"Weapons of math destruction: How big data increases inequality and threatens democracy","author":"O\u2019Neil Cathy","key":"e_1_3_2_1_51_1","unstructured":"Cathy O\u2019Neil . 2016. Weapons of math destruction: How big data increases inequality and threatens democracy . Broadway Books . Cathy O\u2019Neil. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/1473871618785390"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_1_54_1","unstructured":"Xiaoying Pu and Matthew Kay. 2018. The Garden of Forking Paths in Visualization: A Design Space for Reliable Exploratory Visual Analytics: Position Paper. In 2018 IEEE Evaluation and Beyond-Methodological Approaches for Visualization (BELIV). IEEE 37\u201345.  Xiaoying Pu and Matthew Kay. 2018. The Garden of Forking Paths in Visualization: A Design Space for Reliable Exploratory Visual Analytics: Position Paper. In 2018 IEEE Evaluation and Beyond-Methodological Approaches for Visualization (BELIV). IEEE 37\u201345."},{"volume-title":"Handbook of Human Centric Visualization","author":"Rensink A","key":"e_1_3_2_1_55_1","unstructured":"Ronald\u00a0 A Rensink . 2014. On the prospects for a science of visualization . In Handbook of Human Centric Visualization . Springer , 147\u2013175. Ronald\u00a0A Rensink. 2014. On the prospects for a science of visualization. In Handbook of Human Centric Visualization. Springer, 147\u2013175."},{"key":"e_1_3_2_1_56_1","volume-title":"Navigating the local modes of big data. Computational Social Science 51","author":"Roberts E","year":"2016","unstructured":"Margaret\u00a0 E Roberts , Brandon\u00a0 M Stewart , and Dustin Tingley . 2016. Navigating the local modes of big data. Computational Social Science 51 ( 2016 ). Margaret\u00a0E Roberts, Brandon\u00a0M Stewart, and Dustin Tingley. 2016. Navigating the local modes of big data. Computational Social Science 51 (2016)."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172965"},{"key":"e_1_3_2_1_58_1","volume-title":"Probabilistic topic models. Handbook of latent semantic analysis 427, 7","author":"Steyvers Mark","year":"2007","unstructured":"Mark Steyvers and Tom Griffiths . 2007. Probabilistic topic models. Handbook of latent semantic analysis 427, 7 ( 2007 ), 424\u2013440. Mark Steyvers and Tom Griffiths. 2007. Probabilistic topic models. Handbook of latent semantic analysis 427, 7 (2007), 424\u2013440."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70596"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67256-4_30"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFVIS.1995.528686"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigMM.2016.25"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visinf.2017.01.005"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:MACH.0000027785.44527.d6"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Yokohama Japan","acronym":"CHI '21"},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445425","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445425","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:35Z","timestamp":1750195715000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":64,"alternative-id":["10.1145\/3411764.3445425","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445425","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}