{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T20:30:02Z","timestamp":1792787402687,"version":"4.5.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"GROUP","license":[{"start":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T00:00:00Z","timestamp":1642118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSERC Discovery Grant","award":["2015-06585"],"award-info":[{"award-number":["2015-06585"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,1,14]]},"abstract":"<jats:p>As online communities have grown, Computational Social Science has rapidly developed new techniques to study them. However, these techniques require researchers to become experts in a wide variety of tools in addition to qualitative and computational research methods. Studying online communities also requires researchers to constantly navigate highly contextual ethical and transparency considerations when engaging with data, such as respecting their members' privacy when discussing sensitive or stigmatized topics. To overcome these challenges, we developed the Computational Thematic Analysis Toolkit, a modular software package that supports analysis of online communities by combining aspects of reflexive thematic analysis with computational techniques. Our toolkit demonstrates how common analysis tasks like data collection, cleaning and filtering, modelling and sampling, and coding can be implemented within a single visual interface, and how that interface can encourage researchers to manage ethical and transparency considerations throughout their research process.<\/jats:p>","DOI":"10.1145\/3492844","type":"journal-article","created":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T16:26:16Z","timestamp":1642177576000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["The Computational Thematic Analysis Toolkit"],"prefix":"10.1145","volume":"6","author":[{"given":"Robert P.","family":"Gauthier","sequence":"first","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James R.","family":"Wallace","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,1,14]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin and etal 2016. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. http:\/\/arxiv.org\/abs\/1603.04467 arXiv: 1603.04467.  Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin and et al. 2016. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. http:\/\/arxiv.org\/abs\/1603.04467 arXiv: 1603.04467."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/nep.12780"},{"key":"e_1_2_1_3_1","first-page":"1","article-title":"Pseudonymous Parents: Comparing Parenting Roles and Identities on the Mommit and Daddit Subreddits. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York","volume":"489","author":"Ammari Tawfiq","year":"2018","unstructured":"Tawfiq Ammari , Sarita Schoenebeck , and Daniel M. Romero . 2018 . Pseudonymous Parents: Comparing Parenting Roles and Identities on the Mommit and Daddit Subreddits. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York , NY, USA , 489 : 1 -- 489 :13. https:\/\/doi.org\/10.1145\/3173574.3174063 10.1145\/3173574.3174063 Tawfiq Ammari, Sarita Schoenebeck, and Daniel M. Romero. 2018. Pseudonymous Parents: Comparing Parenting Roles and Identities on the Mommit and Daddit Subreddits. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 489:1--489:13. https:\/\/doi.org\/10.1145\/3173574.3174063","journal-title":"NY, USA"},{"key":"e_1_2_1_4_1","volume-title":"Advances in Knowledge Discovery and Data Mining (Lecture Notes in Computer Science), Mohammed J. Zaki, Jeffrey Xu Yu","author":"Arun R.","unstructured":"R. Arun , V. Suresh , C. E. Veni Madhavan , and M. N. Narasimha Murthy . 2010. On Finding the Natural Number of Topics with Latent Dirichlet Allocation: Some Observations . In Advances in Knowledge Discovery and Data Mining (Lecture Notes in Computer Science), Mohammed J. Zaki, Jeffrey Xu Yu , B. Ravindran, and Vikram Pudi (Eds.). Springer , USA , 391--402. https:\/\/doi.org\/10.1007\/978--3--642--13657--3_43 10.1007\/978--3--642--13657--3_43 R. Arun, V. Suresh, C. E. Veni Madhavan, and M. N. Narasimha Murthy. 2010. On Finding the Natural Number of Topics with Latent Dirichlet Allocation: Some Observations. In Advances in Knowledge Discovery and Data Mining (Lecture Notes in Computer Science), Mohammed J. Zaki, Jeffrey Xu Yu, B. Ravindran, and Vikram Pudi (Eds.). Springer, USA, 391--402. https:\/\/doi.org\/10.1007\/978--3--642--13657--3_43"},{"key":"e_1_2_1_5_1","first-page":"2","article-title":"A thematic analysis of patient communication in Parkinson's disease online support group discussion forums","volume":"28","author":"Attar Angelica","year":"2012","unstructured":"Angelica Attar and Neil S. Coulson . 2012 . A thematic analysis of patient communication in Parkinson's disease online support group discussion forums . Computers in Human Behavior 28 , 2 (Mar 2012), 500--506. https:\/\/doi.org\/10.1016\/j. chb.2011.10.022 10.1016\/j Angelica Attar and Neil S. Coulson. 2012. A thematic analysis of patient communication in Parkinson's disease online support group discussion forums. Computers in Human Behavior 28, 2 (Mar 2012), 500--506. https:\/\/doi.org\/10.1016\/j. chb.2011.10.022","journal-title":"Computers in Human Behavior"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23786"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7347"},{"key":"e_1_2_1_8_1","volume-title":"Natural language processing with Python: analyzing text with the natural language toolkit","author":"Bird Steven","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural language processing with Python: analyzing text with the natural language toolkit . O'Reilly Media, Inc. , Sebastopol, CA . Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. O'Reilly Media, Inc., Sebastopol, CA."},{"key":"e_1_2_1_9_1","volume-title":"Proc. ACM Hum.-Comput. Interact.","volume":"6","author":"Blei David M.","year":"2022","unstructured":"David M. Blei , Andrew Y. Ng , and Michael I. Jordan . 2003. Latent dirichlet allocation. Journal of machine Learning research 3, Jan (2003), 993--1022 . Proc. ACM Hum.-Comput. Interact. , Vol. 6 , No. GROUP, Article 25. Publication date : January 2022 . The Computational Thematic Analysis Toolkit 25:13 David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. Journal of machine Learning research 3, Jan (2003), 993--1022. Proc. ACM Hum.-Comput. Interact., Vol. 6, No. GROUP, Article 25. Publication date: January 2022. The Computational Thematic Analysis Toolkit 25:13"},{"key":"e_1_2_1_10_1","volume-title":"Transforming qualitative information: Thematic analysis and code development","author":"Boyatzis Richard E.","unstructured":"Richard E. Boyatzis . 1998. Transforming qualitative information: Thematic analysis and code development . Sage Publications, Inc, Thousand Oaks, CA , US. Richard E. Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development. Sage Publications, Inc, Thousand Oaks, CA, US."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021316409277"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185515"},{"key":"e_1_2_1_14_1","unstructured":"Microsoft Corporation. 2021. Microsoft Excel. https:\/\/office.microsoft.com\/excel  Microsoft Corporation. 2021. Microsoft Excel. https:\/\/office.microsoft.com\/excel"},{"key":"e_1_2_1_15_1","volume-title":"Research Ethics Roundtable. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing (CSCW '20 Companion). Association for Computing Machinery","author":"Densmore Melissa","year":"2020","unstructured":"Melissa Densmore , Casey Fiesler , Cosmin Munteanu , Michael Muller , Janet C. Read , Katie Shilton , and \u00d6zge Suba??. 2020 . Research Ethics Roundtable. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing (CSCW '20 Companion). Association for Computing Machinery , New York, New York, USA, 195--198. https:\/\/doi.org\/10.1145\/3406865.34 19015 10.1145\/3406865.3419015 Melissa Densmore, Casey Fiesler, Cosmin Munteanu, Michael Muller, Janet C. Read, Katie Shilton, and \u00d6zge Suba??. 2020. Research Ethics Roundtable. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing (CSCW '20 Companion). Association for Computing Machinery, New York, New York, USA, 195--198. https:\/\/doi.org\/10.1145\/3406865.3419015"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.poetic.2013.08.004"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media (ICWSM","author":"Dinakar Karthik","year":"2012","unstructured":"Karthik Dinakar , Birago Jones , Henry Lieberman , Rosalind Picard , Carolyn Rose , Matthew Thoman , and Roi Reichart . 2012 . You too?! mixed-initiative lda story matching to help teens in distress . In Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media (ICWSM 2012). Association for the Advancement of Artificial Intelligence, Palo Alto, California, 74--81. Karthik Dinakar, Birago Jones, Henry Lieberman, Rosalind Picard, Carolyn Rose, Matthew Thoman, and Roi Reichart. 2012. You too?! mixed-initiative lda story matching to help teens in distress. In Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media (ICWSM 2012). Association for the Advancement of Artificial Intelligence, Palo Alto, California, 74--81."},{"key":"e_1_2_1_18_1","unstructured":"Robin Dunn. 2021. wxPython: Cross platform GUI toolkit for Python \"Phoenix\" version. http:\/\/wxPython.org\/  Robin Dunn. 2021. wxPython: Cross platform GUI toolkit for Python \"Phoenix\" version. http:\/\/wxPython.org\/"},{"key":"e_1_2_1_19_1","volume-title":"Kiriam Escobar Lee, and Patricia A. Cavazos-Rehg","author":"D'Agostino Alexandra R.","year":"2017","unstructured":"Alexandra R. D'Agostino , Allison R. Optican , Shaina J. Sowles , Melissa J. Krauss , Kiriam Escobar Lee, and Patricia A. Cavazos-Rehg . 2017 . Social networking online to recover from opioid use disorder: A study of community interactions. Drug and Alcohol Dependence 181 (Dec. 2017), 5--10. https:\/\/doi.org\/10.1016\/j.drugalcdep.2017.09.010 10.1016\/j.drugalcdep.2017.09.010 Alexandra R. D'Agostino, Allison R. Optican, Shaina J. Sowles, Melissa J. Krauss, Kiriam Escobar Lee, and Patricia A. Cavazos-Rehg. 2017. Social networking online to recover from opioid use disorder: A study of community interactions. Drug and Alcohol Dependence 181 (Dec. 2017), 5--10. https:\/\/doi.org\/10.1016\/j.drugalcdep.2017.09.010"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2018.113"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745080"},{"key":"e_1_2_1_22_1","first-page":"13","article-title":"Visual Analytics for Topic Model Optimization based on User-Steerable Speculative Execution","volume":"25","author":"El-Assady Mennatallah","year":"2018","unstructured":"Mennatallah El-Assady , Fabian Sperrle , Oliver Deussen , Daniel Keim , and Christopher Collins . 2018 . Visual Analytics for Topic Model Optimization based on User-Steerable Speculative Execution . IEEE Transactions on Visualization and Computer Graphics 25 , 1 (2018), 13 . vialab.science.uoit.ca\/wp-content\/papercite-data\/pdf\/ela2018b2.pdf Mennatallah El-Assady, Fabian Sperrle, Oliver Deussen, Daniel Keim, and Christopher Collins. 2018. Visual Analytics for Topic Model Optimization based on User-Steerable Speculative Execution. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2018), 13. vialab.science.uoit.ca\/wp-content\/papercite-data\/pdf\/ela2018b2.pdf","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-soc-081715-074206"},{"key":"e_1_2_1_25_1","volume-title":"Francisco J. Mart\u00ednez-Murcia, and Feng Wang.","author":"Fardet Tanguy","year":"2021","unstructured":"Tanguy Fardet , cy1110 , Francisco J. Mart\u00ednez-Murcia, and Feng Wang. 2021 . mpl-chord-diagram: Python module to plot chord diagrams with matplotlib. https:\/\/codeberg.org\/tfardet\/mpl_chord_diagram Tanguy Fardet, cy1110, Francisco J. Mart\u00ednez-Murcia, and Feng Wang. 2021. mpl-chord-diagram: Python module to plot chord diagrams with matplotlib. https:\/\/codeberg.org\/tfardet\/mpl_chord_diagram"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media 14 (May","author":"Fiesler Casey","year":"2020","unstructured":"Casey Fiesler , Nathan Beard , and Brian C. Keegan . 2020. No Robots, Spiders, or Scrapers: Legal and Ethical Regulation of Data Collection Methods in Social Media Terms of Service . Proceedings of the International AAAI Conference on Web and Social Media 14 (May 2020 ), 187--196. Casey Fiesler, Nathan Beard, and Brian C. Keegan. 2020. No Robots, Spiders, or Scrapers: Legal and Ethical Regulation of Data Collection Methods in Social Media Terms of Service. Proceedings of the International AAAI Conference on Web and Social Media 14 (May 2020), 187--196."},{"key":"e_1_2_1_27_1","unstructured":"Scientific Software Development GmbH. 2021. ATLAS.ti: The Qualitative Data Analysis & Research Software. https: \/\/atlasti.com\/  Scientific Software Development GmbH. 2021. ATLAS.ti: The Qualitative Data Analysis & Research Software. https: \/\/atlasti.com\/"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/1359105307071744"},{"key":"e_1_2_1_29_1","volume-title":"SCST@ CHIIR","author":"Hoeber Orland","unstructured":"Orland Hoeber , Larena Hoeber , Ryan Snelgrove , and Laura Wood . 2017. Interactively Producing Purposive Samples for Qualitative Research using Exploratory Search .. In SCST@ CHIIR . Association for Computing Machinery , Oslo, Norway , 18--20. Orland Hoeber, Larena Hoeber, Ryan Snelgrove, and Laura Wood. 2017. Interactively Producing Purposive Samples for Qualitative Research using Exploratory Search.. In SCST@ CHIIR. Association for Computing Machinery, Oslo, Norway, 18--20."},{"key":"e_1_2_1_30_1","volume-title":"Sofie Van Landeghem, and Adriane Boyd","author":"Honnibal Matthew","year":"2020","unstructured":"Matthew Honnibal , Ines Montani , Sofie Van Landeghem, and Adriane Boyd . 2020 . spaCy: Industrial-strength Natural Language Processing in Python . https:\/\/doi.org\/10.5281\/zenodo.1212303 10.5281\/zenodo.1212303 Matthew Honnibal, Ines Montani, Sofie Van Landeghem, and Adriane Boyd. 2020. spaCy: Industrial-strength Natural Language Processing in Python. https:\/\/doi.org\/10.5281\/zenodo.1212303"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.55"},{"key":"e_1_2_1_32_1","volume-title":"Supporting Serendipity: Opportunities and Challenges for Human-AI Collaboration in Qualitative Analysis. Proceedings of the ACM on Human-Computer Proc. ACM Hum.-Comput. Interact.","volume":"6","author":"Jiang Jialun Aaron","year":"2022","unstructured":"Jialun Aaron Jiang , Kandrea Wade , Casey Fiesler , and Jed R. Brubaker . 2021 . Supporting Serendipity: Opportunities and Challenges for Human-AI Collaboration in Qualitative Analysis. Proceedings of the ACM on Human-Computer Proc. ACM Hum.-Comput. Interact. , Vol. 6 , No. GROUP, Article 25. Publication date : January 2022 . 25:14 Robert P. Gauthier & James R. Wallace Interaction 5, CSCW1 (Apr 2021), 1--23. https:\/\/doi.org\/10.1145\/3449168 arXiv: 2102.03702. 10.1145\/3449168 Jialun Aaron Jiang, Kandrea Wade, Casey Fiesler, and Jed R. Brubaker. 2021. Supporting Serendipity: Opportunities and Challenges for Human-AI Collaboration in Qualitative Analysis. Proceedings of the ACM on Human-Computer Proc. ACM Hum.-Comput. Interact., Vol. 6, No. GROUP, Article 25. Publication date: January 2022. 25:14 Robert P. Gauthier & James R. Wallace Interaction 5, CSCW1 (Apr 2021), 1--23. https:\/\/doi.org\/10.1145\/3449168 arXiv: 2102.03702."},{"key":"e_1_2_1_33_1","unstructured":"Google LLC. 2021. Google Docs. https:\/\/docs.google.com\/  Google LLC. 2021. Google Docs. https:\/\/docs.google.com\/"},{"key":"e_1_2_1_34_1","unstructured":"QSR International Pty Ltd. 2021. NVivo qualitative data analysis software. https:\/\/www.qsrinternational.com\/nvivoqualitative-data-analysis-software\/home  QSR International Pty Ltd. 2021. NVivo qualitative data analysis software. https:\/\/www.qsrinternational.com\/nvivoqualitative-data-analysis-software\/home"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/19312458.2018.1430754"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2011.641993"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/13.6.522"},{"key":"e_1_2_1_38_1","volume-title":"Mallet: A machine learning for language toolkit","author":"McCallum Andrew Kachites","year":"2002","unstructured":"Andrew Kachites McCallum . 2002 . Mallet: A machine learning for language toolkit . http:\/\/mallet.cs.umass.edu Andrew Kachites McCallum. 2002. Mallet: A machine learning for language toolkit. http:\/\/mallet.cs.umass.edu"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdigh.2017.00021"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2145432.2145462"},{"key":"e_1_2_1_41_1","unstructured":"Andreas Mueller. 2021. wordcloud: A little word cloud generator. https:\/\/github.com\/amueller\/word_cloud  Andreas Mueller. 2021. wordcloud: A little word cloud generator. https:\/\/github.com\/amueller\/word_cloud"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 19th International Conference on Supporting Group Work (GROUP '16)","author":"Muller Michael","unstructured":"Michael Muller , Shion Guha , Eric P.S. Baumer , David Mimno , and N. Sadat Shami . 2016. Machine Learning and Grounded Theory Method: Convergence, Divergence, and Combination . In Proceedings of the 19th International Conference on Supporting Group Work (GROUP '16) . ACM, New York, NY, USA, 3--8. https:\/\/doi.org\/10.1145\/2957276.2957280 10.1145\/2957276.2957280 Michael Muller, Shion Guha, Eric P.S. Baumer, David Mimno, and N. Sadat Shami. 2016. Machine Learning and Grounded Theory Method: Convergence, Divergence, and Combination. In Proceedings of the 19th International Conference on Supporting Group Work (GROUP '16). ACM, New York, NY, USA, 3--8. https:\/\/doi.org\/10.1145\/2957276.2957280"},{"key":"e_1_2_1_43_1","volume-title":"SIGCHI Research Ethics Town Hall. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). Association for Computing Machinery","author":"Munteanu Cosmin","year":"2019","unstructured":"Cosmin Munteanu , Amy Bruckman , Michael Muller , Christopher Frauenberger , Casey Fiesler , Robert E. Kraut , Katie Shilton , and Jenny Waycott . 2019 . SIGCHI Research Ethics Town Hall. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). Association for Computing Machinery , New York, New York, USA, 1--6. https:\/\/doi.org\/10.1145\/3290607.3311742 10.1145\/3290607.3311742 Cosmin Munteanu, Amy Bruckman, Michael Muller, Christopher Frauenberger, Casey Fiesler, Robert E. Kraut, Katie Shilton, and Jenny Waycott. 2019. SIGCHI Research Ethics Town Hall. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). Association for Computing Machinery, New York, New York, USA, 1--6. https:\/\/doi.org\/10.1145\/3290607.3311742"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124117729703"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318034"},{"key":"e_1_2_1_46_1","volume-title":"Automatic Evaluation of Topic Coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT '10)","author":"Newman David","year":"2010","unstructured":"David Newman , Jey Han Lau , Karl Grieser , and Timothy Baldwin . 2010 . Automatic Evaluation of Topic Coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT '10) . Association for Computational Linguistics, USA, 100--108. http:\/\/dl.acm.org\/ citation.cfm?id= 1857999.1858011 event-place: Los Angeles, California. David Newman, Jey Han Lau, Karl Grieser, and Timothy Baldwin. 2010. Automatic Evaluation of Topic Coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT '10). Association for Computational Linguistics, USA, 100--108. http:\/\/dl.acm.org\/ citation.cfm?id=1857999.1858011 event-place: Los Angeles, California."},{"key":"#cr-split#-e_1_2_1_47_1.1","unstructured":"The pandas development team. 2020. pandas-dev\/pandas: Pandas. https:\/\/doi.org\/10.5281\/zenodo.3509134 10.5281\/zenodo.3509134"},{"key":"#cr-split#-e_1_2_1_47_1.2","unstructured":"The pandas development team. 2020. pandas-dev\/pandas: Pandas. https:\/\/doi.org\/10.5281\/zenodo.3509134"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1110"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/0001839219887663"},{"key":"e_1_2_1_50_1","volume-title":"Python Machine Learning","author":"Raschka Sebastian","unstructured":"Sebastian Raschka . 2015. Python Machine Learning . Packt Publishing Ltd, USA. Google-Books-ID : GOVOCwAAQBAJ. Sebastian Raschka. 2015. Python Machine Learning. Packt Publishing Ltd, USA. Google-Books-ID: GOVOCwAAQBAJ."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50","author":"Rehurek Radim","year":"2010","unstructured":"Radim Rehurek and Petr Sojka . 2010 . Software Framework for Topic Modelling with Large Corpora . In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50 . Radim Rehurek and Petr Sojka. 2010. Software Framework for Topic Modelling with Large Corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks. ELRA, Valletta, Malta, 45--50."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2005.tb00268.x"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2684822.2685324"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3110"},{"key":"e_1_2_1_55_1","unstructured":"VERBI Software. 2021. MAXQDA. https:\/\/www.maxqda.com\/qualitative-analysis-software  VERBI Software. 2021. MAXQDA. https:\/\/www.maxqda.com\/qualitative-analysis-software"},{"key":"e_1_2_1_56_1","volume-title":"CA. Proc. ACM Hum.-Comput. Interact.","volume":"6","author":"Strauss Anselm","year":"1997","unstructured":"Anselm Strauss and Juliet M Corbin . 1997 . Grounded theory in practice. Sage, Thousand Oaks , CA. Proc. ACM Hum.-Comput. Interact. , Vol. 6 , No. GROUP, Article 25. Publication date : January 2022. The Computational Thematic Analysis Toolkit 25:15 Anselm Strauss and Juliet M Corbin. 1997. Grounded theory in practice. Sage, Thousand Oaks, CA. Proc. ACM Hum.-Comput. Interact., Vol. 6, No. GROUP, Article 25. Publication date: January 2022. The Computational Thematic Analysis Toolkit 25:15"},{"key":"e_1_2_1_57_1","volume-title":"Wilson","author":"Sukumar Poorna Talkad","year":"2020","unstructured":"Poorna Talkad Sukumar , Ignacio Avellino , Christian Remy , Michael A. DeVito , Tawanna R. Dillahunt , Joanna McGrenere , and Max L . Wilson . 2020 . Transparency in Qualitative Research : Increasing Fairness in the CHI Review Process. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery , New York, NY, USA, 1--6. https:\/\/doi.org\/10.1145\/3334480.3381066 10.1145\/3334480.3381066 Poorna Talkad Sukumar, Ignacio Avellino, Christian Remy, Michael A. DeVito, Tawanna R. Dillahunt, Joanna McGrenere, and Max L. Wilson. 2020. Transparency in Qualitative Research: Increasing Fairness in the CHI Review Process. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--6. https:\/\/doi.org\/10.1145\/3334480.3381066"},{"key":"e_1_2_1_58_1","volume-title":"Wilson","author":"Sukumar Poorna Talkad","year":"2020","unstructured":"Poorna Talkad Sukumar , Ignacio Avellino , Christian Remy , Michael A. DeVito , Tawanna R. Dillahunt , Joanna McGrenere , and Max L . Wilson . 2020 . Transparency in Qualitative Research : Increasing Fairness in the CHI Review Process. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery , New York, NY, USA, 1--6. https:\/\/doi.org\/10.1145\/3334480.3381066 10.1145\/3334480.3381066 Poorna Talkad Sukumar, Ignacio Avellino, Christian Remy, Michael A. DeVito, Tawanna R. Dillahunt, Joanna McGrenere, and Max L. Wilson. 2020. Transparency in Qualitative Research: Increasing Fairness in the CHI Review Process. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--6. https:\/\/doi.org\/10.1145\/3334480.3381066"},{"key":"e_1_2_1_59_1","unstructured":"Markus Tretzmuller. 2021. biterm: Biterm Topic Model. https:\/\/github.com\/markoarnauto\/biterm  Markus Tretzmuller. 2021. biterm: Biterm Topic Model. https:\/\/github.com\/markoarnauto\/biterm"},{"key":"e_1_2_1_60_1","doi-asserted-by":"crossref","unstructured":"Rivka Tuval-Mashiach. 20161027. Raising the curtain: The importance of transparency in qualitative research. Qualitative Psychology 4 2 (20161027) 126. https:\/\/doi.org\/10.1037\/qup0000062    10.1037\/qup0000062\nRivka Tuval-Mashiach. 20161027. Raising the curtain: The importance of transparency in qualitative research. Qualitative Psychology 4 2 (20161027) 126. https:\/\/doi.org\/10.1037\/qup0000062","DOI":"10.1037\/qup0000062"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the Annual Symposium on Computer-Human Interaction in Play","author":"Vornhagen Jan B.","unstructured":"Jan B. Vornhagen , April Tyack , and Elisa D. Mekler . 2020. Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency . In Proceedings of the Annual Symposium on Computer-Human Interaction in Play ( Virtual Event, Canada) (CHI PLAY '20). Association for Computing Machinery, New York, NY, USA, 4--18. https:\/\/doi.org\/10.1145\/3410404.3414229 10.1145\/3410404.3414229 Jan B. Vornhagen, April Tyack, and Elisa D. Mekler. 2020. Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Canada) (CHI PLAY '20). Association for Computing Machinery, New York, NY, USA, 4--18. https:\/\/doi.org\/10.1145\/3410404.3414229"},{"key":"e_1_2_1_62_1","volume-title":"Transparency of CHI Research Artifacts: Results of a Self-Reported Survey","author":"Wacharamanotham Chat","unstructured":"Chat Wacharamanotham , Lukas Eisenring , Steve Haroz , and Florian Echtler . 2020. Transparency of CHI Research Artifacts: Results of a Self-Reported Survey . Association for Computing Machinery , New York, NY, USA , 1--14. https: \/\/doi.org\/10.1145\/3313831.3376448 10.1145\/3313831.3376448 Chat Wacharamanotham, Lukas Eisenring, Steve Haroz, and Florian Echtler. 2020. Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. Association for Computing Machinery, New York, NY, USA, 1--14. https: \/\/doi.org\/10.1145\/3313831.3376448"},{"key":"e_1_2_1_63_1","doi-asserted-by":"crossref","unstructured":"Malcolm Williams. 2003. Making Sense of  Malcolm Williams. 2003. Making Sense of","DOI":"10.1046\/j.1468-3156.2003.00214.x"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3492844","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3492844","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:48:27Z","timestamp":1750178907000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3492844"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,14]]},"references-count":63,"journal-issue":{"issue":"GROUP","published-print":{"date-parts":[[2022,1,14]]}},"alternative-id":["10.1145\/3492844"],"URL":"https:\/\/doi.org\/10.1145\/3492844","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,14]]},"assertion":[{"value":"2022-01-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}