{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:16:42Z","timestamp":1777778202105,"version":"3.51.4"},"reference-count":45,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2018,2,23]],"date-time":"2018-02-23T00:00:00Z","timestamp":1519344000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2019,7]]},"abstract":"<jats:p>In the last decade, there has been an exponential growth of asynchronous online conversations (e.g. blogs), thanks to the rise of social media. Analyzing and gaining insights from such discussions can be quite challenging for a user, especially when the user deals with hundreds of comments that are scattered around multiple different conversations. A promising solution to this problem is to automatically mine the major topics from conversations and organize them into a hierarchical structure. However, the resultant topic hierarchy can be noisy and\/or it may not match the user\u2019s current information needs. To address this problem, we introduce a novel human-in-the-loop approach that allows the user to revise the topic hierarchy based on her feedback. We incorporate this approach within a visual text analytics system that helps users in analyzing and getting insights from conversations by exploring and revising the topic hierarchy. We evaluated the resulting system with real users in a lab-based study. The results from the user study, when compared to its counterpart that does not support interactive revisions of a hierarchical topic model, provide empirical evidence of the potential utility of our system in terms of both performance and subjective measures. Finally, we summarize generalizable lessons for introducing human-in-the-loop computation within a visual text analytics system.<\/jats:p>","DOI":"10.1177\/1473871618757228","type":"journal-article","created":{"date-parts":[[2018,2,24]],"date-time":"2018-02-24T00:30:32Z","timestamp":1519432232000},"page":"318-338","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":11,"title":["Interactive topic hierarchy revision for exploring a collection of online conversations"],"prefix":"10.1177","volume":"18","author":[{"given":"Enamul","family":"Hoque","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Giuseppe","family":"Carenini","sequence":"additional","affiliation":[{"name":"The University of British Columbia, Vancouver, BC, Canada"}]}],"member":"179","published-online":{"date-parts":[[2018,2,23]]},"reference":[{"key":"bibr1-1473871618757228","doi-asserted-by":"publisher","DOI":"10.2200\/S00363ED1V01Y201105DTM017"},{"key":"bibr2-1473871618757228","first-page":"39","volume-title":"Proceedings of the working conference on advanced visual interfaces (AVI)","author":"Indratmo Vassileva J"},{"key":"bibr3-1473871618757228","first-page":"153","volume-title":"Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining","author":"Wei F"},{"key":"bibr4-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.212"},{"key":"bibr5-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5413-0"},{"key":"bibr6-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12378"},{"key":"bibr7-1473871618757228","first-page":"96","volume-title":"Proceedings of the 21st international conference on intelligent user interfaces (IUI)","author":"Hoque E"},{"key":"bibr8-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.162"},{"key":"bibr9-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346433"},{"key":"bibr10-1473871618757228","first-page":"183","volume-title":"Proceedings of the IEEE conference on visual analytics science and technology (VAST)","author":"Liu S"},{"key":"bibr11-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2017.03.007"},{"key":"bibr12-1473871618757228","first-page":"169","volume-title":"Proceedings of the 20th international conference on intelligent user interfaces (IUI)","author":"Hoque E"},{"key":"bibr13-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.111"},{"key":"bibr14-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.213"},{"key":"bibr15-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.175"},{"key":"bibr16-1473871618757228","first-page":"979","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI)","author":"Vi\u00e9gas FB"},{"key":"bibr17-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.129"},{"key":"bibr18-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/2945.981848"},{"key":"bibr19-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2373384"},{"key":"bibr20-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2509990"},{"key":"bibr21-1473871618757228","first-page":"25","volume-title":"Proceedings of the 26th annual international conference on machine learning","author":"Andrzejewski D"},{"key":"bibr22-1473871618757228","first-page":"248","volume-title":"Proceedings of the 2009 conference on empirical methods on natural language processing (EMNLP)","author":"Ramage D"},{"key":"bibr23-1473871618757228","first-page":"158","volume-title":"Proceedings of the 20th international conference on intelligent user interfaces (IUI)","author":"Yang Y"},{"key":"bibr24-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1613\/jair.3940"},{"key":"bibr25-1473871618757228","first-page":"1","volume-title":"Proceedings of the NIPS workshop on topic models: computation, application and evaluation","author":"Chuang J"},{"key":"bibr26-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03108.x"},{"key":"bibr27-1473871618757228","first-page":"213","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI)","author":"Pirolli P"},{"key":"bibr28-1473871618757228","first-page":"74","volume-title":"Proceedings of the international working conference on advanced visual interfaces (AVI)","author":"Chuang J"},{"key":"bibr29-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1002\/env.3170050203"},{"key":"bibr30-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(97)00010-6"},{"key":"bibr31-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2011.12.002"},{"key":"bibr32-1473871618757228","first-page":"2081","volume-title":"Proceedings of the 33rd international conference on machine learning","author":"Vikram S"},{"key":"bibr33-1473871618757228","first-page":"562","volume-title":"Proceedings of the 41st annual meeting on association for computational linguistics (ACL)","author":"Galley M"},{"key":"bibr34-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/34.868688"},{"key":"bibr35-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.026113"},{"key":"bibr36-1473871618757228","first-page":"739","volume-title":"Proceedings of the 7th IEEE international conference on data mining","author":"Zhou D"},{"key":"bibr37-1473871618757228","first-page":"3294","volume-title":"Proceedings of the advances in neural information processing systems","author":"Kiros R"},{"key":"bibr38-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346435"},{"key":"bibr39-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70589"},{"key":"bibr40-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.183"},{"key":"bibr41-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70539"},{"key":"bibr42-1473871618757228","volume-title":"Statistical methods for rates and proportions","author":"Fleiss JL","year":"2013"},{"key":"bibr43-1473871618757228","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346331"},{"key":"bibr44-1473871618757228","first-page":"1262","volume-title":"Proceedings of the 52nd annual meeting of the association for computational linguistics (ACL)","author":"Hasan KS"},{"key":"bibr45-1473871618757228","first-page":"443","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems (CHI)","author":"Chuang J"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871618757228","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1473871618757228","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871618757228","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:18:56Z","timestamp":1777490336000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1473871618757228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,23]]},"references-count":45,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,7]]}},"alternative-id":["10.1177\/1473871618757228"],"URL":"https:\/\/doi.org\/10.1177\/1473871618757228","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,2,23]]}}}