{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:13:41Z","timestamp":1776111221423,"version":"3.50.1"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,6,17]],"date-time":"2019-06-17T00:00:00Z","timestamp":1560729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007297","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-18-1-2193"],"award-info":[{"award-number":["N00014-18-1-2193"]}],"id":[{"id":"10.13039\/100007297","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100001906","name":"Washington Research Foundation","doi-asserted-by":"publisher","award":["Cable Professorship"],"award-info":[{"award-number":["Cable Professorship"]}],"id":[{"id":"10.13039\/100001906","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Moore Foundation","doi-asserted-by":"crossref","award":["Data-Driven Discovery Investigator program"],"award-info":[{"award-number":["Data-Driven Discovery Investigator program"]}],"id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2019,8,31]]},"abstract":"<jats:p>Tools for Interactive Machine Learning (IML) enable end users to update models in a \u201crapid, focused, and incremental\u201d\u2014yet local\u2014manner. In this work, we study the question of local decision making in an IML context around feature selection for a sentiment classification task. Specifically, we characterize the utility of interactive feature selection through a combination of human-subjects experiments and computational simulations. We find that, in expectation, interactive modification fails to improve model performance and may hamper generalization due to overfitting. We examine how these trends are affected by the dataset, learning algorithm, and the training set size. Across these factors we observe consistent generalization issues. Our results suggest that rapid iterations with IML systems can be dangerous if they encourage local actions divorced from global context, degrading overall model performance. We conclude by discussing the implications of our feature selection results to the broader area of IML systems and research.<\/jats:p>","DOI":"10.1145\/3319616","type":"journal-article","created":{"date-parts":[[2019,6,18]],"date-time":"2019-06-18T12:14:26Z","timestamp":1560860066000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":33,"title":["Local Decision Pitfalls in Interactive Machine Learning"],"prefix":"10.1145","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1630-0588","authenticated-orcid":false,"given":"Tongshuang","family":"Wu","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel S.","family":"Weld","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey","family":"Heer","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,6,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346660"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702509"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622222"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753531"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207680"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201910)","volume":"10","author":"Baccianella Stefano","year":"2010","unstructured":"Stefano Baccianella , Andrea Esuli , and Fabrizio Sebastiani . 2010 . SentiWordNet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining . In Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201910) , Vol. 10 . 2200--2204. Stefano Baccianella, Andrea Esuli, and Fabrizio Sebastiani. 2010. SentiWordNet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. In Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201910), Vol. 10. 2200--2204."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jml.2012.11.001"},{"key":"e_1_2_1_9_1","volume-title":"Kalai","author":"Bolukbasi Tolga","year":"2016","unstructured":"Tolga Bolukbasi , Kai-Wei Chang , James Y. Zou , Venkatesh Saligrama , and Adam T . Kalai . 2016 . Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Advances in Neural Information Processing Systems . 4349--4357. Tolga Bolukbasi, Kai-Wei Chang, James Y. Zou, Venkatesh Saligrama, and Adam T. Kalai. 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Advances in Neural Information Processing Systems. 4349--4357."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2015.7347637"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2012.6400486"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143865"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026044"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 600--611","author":"Cheng Justin","unstructured":"Justin Cheng and Michael S. Bernstein . 2015. Flock: Hybrid crowd-machine learning classifiers . In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 600--611 . Justin Cheng and Michael S. Bernstein. 2015. Flock: Hybrid crowd-machine learning classifiers. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 600--611."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.212"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2013.08.003"},{"key":"e_1_2_1_17_1","volume-title":"The reusable holdout: Preserving validity in adaptive data analysis. Science 349, 6248","author":"Dwork Cynthia","year":"2015","unstructured":"Cynthia Dwork , Vitaly Feldman , Moritz Hardt , Toniann Pitassi , Omer Reingold , and Aaron Roth . 2015. The reusable holdout: Preserving validity in adaptive data analysis. Science 349, 6248 ( 2015 ), 636--638. Cynthia Dwork, Vitaly Feldman, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Aaron Roth. 2015. The reusable holdout: Preserving validity in adaptive data analysis. Science 349, 6248 (2015), 636--638."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 8th International Conference on Intelligent User Interfaces. ACM, 39--45","author":"Fails Jerry Alan","unstructured":"Jerry Alan Fails and Dan R . Olsen Jr. 2003. Interactive machine learning . In Proceedings of the 8th International Conference on Intelligent User Interfaces. ACM, 39--45 . Jerry Alan Fails and Dan R. Olsen Jr. 2003. Interactive machine learning. In Proceedings of the 8th International Conference on Intelligent User Interfaces. ACM, 39--45."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978965"},{"key":"e_1_2_1_20_1","volume-title":"A synopsis of linguistic theory","author":"Firth John R.","year":"1930","unstructured":"John R. Firth . 1957. A synopsis of linguistic theory , 1930 --1955. In Studies in Linguistic Analysis. Blackwell , Oxford. John R. Firth. 1957. A synopsis of linguistic theory, 1930--1955. In Studies in Linguistic Analysis. Blackwell, Oxford."},{"key":"e_1_2_1_21_1","unstructured":"Alec Go Richa Bhayani and Lei Huang. 2009. Twitter Sentiment Classification Using Distant Supervision. CS224N Project Report. Stanford.  Alec Go Richa Bhayani and Lei Huang. 2009. Twitter Sentiment Classification Using Distant Supervision. CS224N Project Report. Stanford."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the ROCLING 2011 Poster Papers. Association for Computational Linguistics, 252--264","author":"Gong Shu-Ping","year":"2011","unstructured":"Shu-Ping Gong and Kathleen Ahrens . 2011 . The prior knowledge effect on the processing of vague discourse in Mandarin Chinese . In Proceedings of the ROCLING 2011 Poster Papers. Association for Computational Linguistics, 252--264 . Shu-Ping Gong and Kathleen Ahrens. 2011. The prior knowledge effect on the processing of vague discourse in Mandarin Chinese. In Proceedings of the ROCLING 2011 Poster Papers. Association for Computational Linguistics, 252--264."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00163"},{"key":"e_1_2_1_24_1","unstructured":"Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems. 3315--3323.   Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems. 3315--3323."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.277"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the ACM CHI 2013, Many People Many Eyes Workshop.","author":"Hullman Jessica","year":"2013","unstructured":"Jessica Hullman . 2013 . How prior knowledge affects the processing of visualized data . In Proceedings of the ACM CHI 2013, Many People Many Eyes Workshop. Jessica Hullman. 2013. How prior knowledge affects the processing of visualized data. In Proceedings of the ACM CHI 2013, Many People Many Eyes Workshop."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01475.x"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/70.1.163"},{"key":"e_1_2_1_29_1","volume-title":"Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies.","author":"Kotsiantis Sotiris B.","year":"2007","unstructured":"Sotiris B. Kotsiantis , I. Zaharakis , and P. Pintelas . 2007 . Supervised machine learning: A review of classification techniques. In Proceedings of the 2007 Conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies. Sotiris B. Kotsiantis, I. Zaharakis, and P. Pintelas. 2007. Supervised machine learning: A review of classification techniques. In Proceedings of the 2007 Conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346482"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858529"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557238"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030365.2030367"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 31st AAAI Conference on Artificial Intelligence","volume":"1","author":"Lakkaraju Himabindu","year":"2017","unstructured":"Himabindu Lakkaraju , Ece Kamar , Rich Caruana , and Eric Horvitz . 2017 . Identifying unknown unknowns in the open world: Representations and policies for guided exploration . In Proceedings of the 31st AAAI Conference on Artificial Intelligence , Vol. 1 . 2124--2132. Himabindu Lakkaraju, Ece Kamar, Rich Caruana, and Eric Horvitz. 2017. Identifying unknown unknowns in the open world: Representations and policies for guided exploration. In Proceedings of the 31st AAAI Conference on Artificial Intelligence, Vol. 1. 2124--2132."},{"key":"e_1_2_1_36_1","volume-title":"Archives of Psychology","author":"Likert Rensis","unstructured":"Rensis Likert . 1932. A technique for the measurement of attitudes . In Archives of Psychology . The Science Press , New York . Rensis Likert. 1932. A technique for the measurement of attitudes. In Archives of Psychology. The Science Press, New York."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visinf.2017.01.006"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002472.2002491"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1951.10500769"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2011.6102448"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 3rd Conference on Email and Anti-Spam (CEAS\u201906)","volume":"17","author":"Metsis Vangelis","year":"2006","unstructured":"Vangelis Metsis , Ion Androutsopoulos , and Georgios Paliouras . 2006 . Spam filtering with naive Bayes\u2014which naive Bayes? In Proceedings of the 3rd Conference on Email and Anti-Spam (CEAS\u201906) , Vol. 17 . 28--69. Vangelis Metsis, Ion Androutsopoulos, and Georgios Paliouras. 2006. Spam filtering with naive Bayes\u2014which naive Bayes? In Proceedings of the 3rd Conference on Email and Anti-Spam (CEAS\u201906), Vol. 17. 28--69."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.24297\/ijct.v2i3c.2717"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.89.1.103"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357160"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the National Conference on Artificial Intelligence","volume":"21","author":"Poulin Brett","year":"2006","unstructured":"Brett Poulin , Roman Eisner , Duane Szafron , Paul Lu , Russell Greiner , David S. Wishart , Alona Fyshe , Brandon Pearcy , Cam MacDonell , and John Anvik . 2006 . Visual explanation of evidence with additive classifiers . In Proceedings of the National Conference on Artificial Intelligence , Vol. 21 . Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press. Brett Poulin, Roman Eisner, Duane Szafron, Paul Lu, Russell Greiner, David S. Wishart, Alona Fyshe, Brandon Pearcy, Cam MacDonell, and John Anvik. 2006. Visual explanation of evidence with additive classifiers. In Proceedings of the National Conference on Artificial Intelligence, Vol. 21. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277758"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 19th international joint conference on Artificial intelligence (IJCAI\u201905)","volume":"5","author":"Raghavan Hema","year":"2005","unstructured":"Hema Raghavan , Omid Madani , and Rosie Jones . 2005 . InterActive feature selection . In Proceedings of the 19th international joint conference on Artificial intelligence (IJCAI\u201905) , Vol. 5 . 841--846. Hema Raghavan, Omid Madani, and Rosie Jones. 2005. InterActive feature selection. In Proceedings of the 19th international joint conference on Artificial intelligence (IJCAI\u201905), Vol. 5. 841--846."},{"key":"e_1_2_1_50_1","first-page":"1655","article-title":"Active learning with feedback on features and instances","author":"Raghavan Hema","year":"2006","unstructured":"Hema Raghavan , Omid Madani , and Rosie Jones . 2006 . Active learning with feedback on features and instances . Journal of Machine Learning Research 7 , Aug. (2006), 1655 -- 1686 . Hema Raghavan, Omid Madani, and Rosie Jones. 2006. Active learning with feedback on features and instances. Journal of Machine Learning Research 7, Aug. (2006), 1655--1686.","journal-title":"Journal of Machine Learning Research 7"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/3157794.3157797"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598828"},{"key":"e_1_2_1_53_1","volume-title":"Mar.","author":"Reunanen Juha","year":"2003","unstructured":"Juha Reunanen . 2003. Overfitting in making comparisons between variable selection methods. Journal of Machine Learning Research 3 , Mar. ( 2003 ), 1371--1382. Juha Reunanen. 2003. Overfitting in making comparisons between variable selection methods. Journal of Machine Learning Research 3, Mar. (2003), 1371--1382."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of ICML Workshop on Visualization for Deep Learning.","author":"Rong Xin","year":"2016","unstructured":"Xin Rong and Eytan Adar . 2016 . Visual tools for debugging neural language models . In Proceedings of ICML Workshop on Visualization for Deep Learning. Xin Rong and Eytan Adar. 2016. Visual tools for debugging neural language models. In Proceedings of ICML Workshop on Visualization for Deep Learning."},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1467--1478","author":"Settles Burr","year":"2011","unstructured":"Burr Settles . 2011 . Closing the loop: Fast, interactive semi-supervised annotation with queries on features and instances . In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1467--1478 . Burr Settles. 2011. Closing the loop: Fast, interactive semi-supervised annotation with queries on features and instances. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1467--1478."},{"key":"e_1_2_1_56_1","volume-title":"Social Psychology: Handbook of Basic Principles","author":"Shafir Eldar","unstructured":"Eldar Shafir . 2007. Decisions constructed locally: Some fundamental principles of the psychology of decision making . In Social Psychology: Handbook of Basic Principles . Arie W. Kruglanski and E. Tory Higgins (Eds.), Guilford Publications , Chapter 14, 334--352. Eldar Shafir. 2007. Decisions constructed locally: Some fundamental principles of the psychology of decision making. In Social Psychology: Handbook of Basic Principles. Arie W. Kruglanski and E. Tory Higgins (Eds.), Guilford Publications, Chapter 14, 334--352."},{"key":"e_1_2_1_57_1","volume-title":"Aparna Lakshmiratan, Denis Xavier Charles, L\u00e9on Bottou, Carlos Garcia Jurado Suarez, David Grangier, Saleema Amershi, Johan Verwey, and Jina Suh.","author":"Simard Patrice Y.","year":"2014","unstructured":"Patrice Y. Simard , David Maxwell Chickering , Aparna Lakshmiratan, Denis Xavier Charles, L\u00e9on Bottou, Carlos Garcia Jurado Suarez, David Grangier, Saleema Amershi, Johan Verwey, and Jina Suh. 2014 . ICE : Enabling non-experts to build models interactively for large-scale lopsided problems. CoRR abs\/1409.4814. Patrice Y. Simard, David Maxwell Chickering, Aparna Lakshmiratan, Denis Xavier Charles, L\u00e9on Bottou, Carlos Garcia Jurado Suarez, David Grangier, Saleema Amershi, Johan Verwey, and Jina Suh. 2014. ICE: Enabling non-experts to build models interactively for large-scale lopsided problems. CoRR abs\/1409.4814."},{"key":"e_1_2_1_58_1","volume-title":"Models of Man","author":"Simon Herbert A.","unstructured":"Herbert A. Simon . 1957. Models of Man ; Social and Rational. Wiley , Oxford. Herbert A. Simon. 1957. Models of Man; Social and Rational. Wiley, Oxford."},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI\u201916)","author":"Stumpf Simone","year":"2016","unstructured":"Simone Stumpf , Adrian Bussone , and Dympna O \u2019sullivan . 2016 . Explanations considered harmful? User interactions with machine learning systems . In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI\u201916) . Simone Stumpf, Adrian Bussone, and Dympna O \u2019sullivan. 2016. Explanations considered harmful? User interactions with machine learning systems. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI\u201916)."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.03.004"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1378773.1378781"},{"key":"e_1_2_1_62_1","volume-title":"Retrieved","author":"Picture Team Google Big","year":"2017","unstructured":"Google Big Picture Team . 2017 . Facets: Visualization for ML datasets . Retrieved February 11, 2018 from https:\/\/pair-code.github.io\/facets\/. Google Big Picture Team. 2017. Facets: Visualization for ML datasets. Retrieved February 11, 2018 from https:\/\/pair-code.github.io\/facets\/."},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 4th Workshop on Visual Text Analytics (IUI TextVis\u201915)","author":"Trivedi Gaurav","year":"2015","unstructured":"Gaurav Trivedi , Phuong Pham , Wendy Chapman , Rebecca Hwa , Janyce Wiebe , and Harry Hochheiser . 2015 . An interactive tool for natural language processing on clinical text . In Proceedings of the 4th Workshop on Visual Text Analytics (IUI TextVis\u201915) . Retrieved from http:\/\/vialab.science.uoit.ca\/textvis 2015\/{PDF}. Gaurav Trivedi, Phuong Pham, Wendy Chapman, Rebecca Hwa, Janyce Wiebe, and Harry Hochheiser. 2015. An interactive tool for natural language processing on clinical text. In Proceedings of the 4th Workshop on Visual Text Analytics (IUI TextVis\u201915). Retrieved from http:\/\/vialab.science.uoit.ca\/textvis2015\/{PDF}."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240630"},{"key":"e_1_2_1_65_1","volume-title":"Judgment under uncertainty: Heuristics and biases. Science 185, 4157","author":"Tversky Amos","year":"1974","unstructured":"Amos Tversky and Daniel Kahneman . 1974. Judgment under uncertainty: Heuristics and biases. Science 185, 4157 ( 1974 ), 1124--1131. Amos Tversky and Daniel Kahneman. 1974. Judgment under uncertainty: Heuristics and biases. Science 185, 4157 (1974), 1124--1131."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077257.3077263"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3319616","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3319616","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3319616","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:34Z","timestamp":1750204474000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3319616"}},"subtitle":["An Investigation into Feature Selection in Sentiment Analysis"],"short-title":[],"issued":{"date-parts":[[2019,6,17]]},"references-count":67,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,8,31]]}},"alternative-id":["10.1145\/3319616"],"URL":"https:\/\/doi.org\/10.1145\/3319616","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,17]]},"assertion":[{"value":"2018-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}