{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T19:32:55Z","timestamp":1780687975931,"version":"3.54.1"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"2-3","license":[{"start":{"date-parts":[[2019,3,18]],"date-time":"2019-03-18T00:00:00Z","timestamp":1552867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2019,9,30]]},"abstract":"<jats:p>Given the increasing popularity of customer service dialogue on Twitter, analysis of conversation data is essential to understanding trends in customer and agent behavior for the purpose of automating customer service interactions. In this work, we develop a novel taxonomy of fine-grained \u201cdialogue acts\u201d frequently observed in customer service, showcasing acts that are more suited to the domain than the more generic existing taxonomies. Using a sequential SVM-HMM model, we model conversation flow, predicting the dialogue act of a given turn in real time, and showcase this using our \u201cPredDial\u201d portal. We characterize differences between customer and agent behavior in Twitter customer service conversations and investigate the effect of testing our system on different customer service industries. Finally, we use a data-driven approach to predict important conversation outcomes: customer satisfaction, customer frustration, and overall problem resolution. We show that the type and location of certain dialogue acts in a conversation have a significant effect on the probability of desirable and undesirable outcomes and present actionable rules based on our findings. We explore the correlations between different dialogue acts and the outcome of the conversations in detail using an actionable-rule discovery task by leveraging a state-of-the-art sequential rule mining algorithm while modeling a set of conversations as a set of sequences. The patterns and rules we derive can be used as guidelines for outcome-driven automated customer service platforms.<\/jats:p>","DOI":"10.1145\/3213014","type":"journal-article","created":{"date-parts":[[2019,3,19]],"date-time":"2019-03-19T12:11:29Z","timestamp":1552997489000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Modeling and Computational Characterization of Twitter Customer Service Conversations"],"prefix":"10.1145","volume":"9","author":[{"given":"Shereen","family":"Oraby","sequence":"first","affiliation":[{"name":"University of California, Santa Cruz, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mansurul","family":"Bhuiyan","sequence":"additional","affiliation":[{"name":"IBM Research, Almaden, San Jose, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pritam","family":"Gundecha","sequence":"additional","affiliation":[{"name":"IBM Research, Almaden, San Jose, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jalal","family":"Mahmud","sequence":"additional","affiliation":[{"name":"IBM Research, Almaden, San Jose, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rama","family":"Akkiraju","sequence":"additional","affiliation":[{"name":"IBM Research, Almaden, San Jose, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,3,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/359784.359822"},{"key":"e_1_2_1_2_1","volume-title":"International Conference on Machine Learning (ICML\u201903)","author":"Altun Yasemin","year":"2003","unstructured":"Yasemin Altun , Ioannis Tsochantaridis , and Thomas Hofmann . 2003 . Hidden Markov support vector machines . In International Conference on Machine Learning (ICML\u201903) . Yasemin Altun, Ioannis Tsochantaridis, and Thomas Hofmann. 2003. Hidden Markov support vector machines. In International Conference on Machine Learning (ICML\u201903)."},{"key":"e_1_2_1_3_1","volume-title":"Austin","author":"John","year":"1962","unstructured":"John L. Austin . 1962 . How to Do Things with Words. Harvard University Press , Cambridge, MA. John L. Austin. 1962. How to Do Things with Words. Harvard University Press, Cambridge, MA."},{"key":"e_1_2_1_4_1","unstructured":"Steven Bird Ewan Klein and Edward Loper. 2009. Natural Language Processing with Python. O\u2019Reilly Media.   Steven Bird Ewan Klein and Edward Loper. 2009. Natural Language Processing with Python. O\u2019Reilly Media."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201910)","author":"Boyer Kristy Elizabeth","unstructured":"Kristy Elizabeth Boyer , Eun Young Ha , Robert Phillips , Michael D. Wallis , Mladen A. Vouk , and James C. Lester . 2010. Dialogue act modeling in a complex task-oriented domain . In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201910) . Association for Computational Linguistics, 297--305. Kristy Elizabeth Boyer, Eun Young Ha, Robert Phillips, Michael D. Wallis, Mladen A. Vouk, and James C. Lester. 2010. Dialogue act modeling in a complex task-oriented domain. In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201910). Association for Computational Linguistics, 297--305."},{"key":"e_1_2_1_6_1","volume-title":"7th Conference on International Language Resources and Evaluation (LREC\u201910)","author":"Bunt Harry","year":"2010","unstructured":"Harry Bunt , Jan Alexandersson , Jean Carletta , Jae-Woong Choe , Alex Chengyu Fang , Koiti Hasida , Kiyong Lee , Volha Petukhova , Andrei Popescu-Belis , Laurent Romary , Claudia Soria , and David Traum . 2010 . Towards an ISO standard for dialogue act annotation . In 7th Conference on International Language Resources and Evaluation (LREC\u201910) , 2548--2555. Harry Bunt, Jan Alexandersson, Jean Carletta, Jae-Woong Choe, Alex Chengyu Fang, Koiti Hasida, Kiyong Lee, Volha Petukhova, Andrei Popescu-Belis, Laurent Romary, Claudia Soria, and David Traum. 2010. Towards an ISO standard for dialogue act annotation. In 7th Conference on International Language Resources and Evaluation (LREC\u201910), 2548--2555."},{"key":"e_1_2_1_7_1","volume-title":"AAAI Fall Symposium on Communicative Action in Humans and Machines","volume":"56","author":"Mark","unstructured":"Mark G. Core and James Allen. 1997. Coding dialogs with the DAMSL annotation scheme . In AAAI Fall Symposium on Communicative Action in Humans and Machines , Vol. 56 . Mark G. Core and James Allen. 1997. Coding dialogs with the DAMSL annotation scheme. In AAAI Fall Symposium on Communicative Action in Humans and Machines, Vol. 56."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06608-0_4"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the SIGDIAL 2013 Conference. Association for Computational Linguistics, 214--222","author":"Gasic Milica","year":"2013","unstructured":"Milica Gasic , Catherine Breslin , Matthew Henderson , Dongho Kim , Martin Szummer , Blaise Thomson , Pirros Tsiakoulis , and Steve Young . 2013 . POMDP-based dialogue manager adaptation to extended domains . In Proceedings of the SIGDIAL 2013 Conference. Association for Computational Linguistics, 214--222 . Milica Gasic, Catherine Breslin, Matthew Henderson, Dongho Kim, Martin Szummer, Blaise Thomson, Pirros Tsiakoulis, and Steve Young. 2013. POMDP-based dialogue manager adaptation to extended domains. In Proceedings of the SIGDIAL 2013 Conference. Association for Computational Linguistics, 214--222."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2930238.2930285"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3609"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2009.89"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1628960.1628976"},{"key":"e_1_2_1_16_1","volume-title":"Australasian Language Technology Workshop. 159--160","author":"Ivanovic Edward","year":"2006","unstructured":"Edward Ivanovic . 2006 . Using dialogue acts to suggest responses in support services via instant messaging . Australasian Language Technology Workshop. 159--160 . Edward Ivanovic. 2006. Using dialogue acts to suggest responses in support services via instant messaging. Australasian Language Technology Workshop. 159--160."},{"key":"e_1_2_1_17_1","unstructured":"Edward Ivanovic. 2008. Automatic instant messaging dialogue using statistical models and dialogue acts. Master\u2019s Research Thesis.  Edward Ivanovic. 2008. Automatic instant messaging dialogue using statistical models and dialogue acts. Master\u2019s Research Thesis."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5108-8"},{"key":"e_1_2_1_19_1","volume-title":"Joty and Enamul Hoque","author":"Shafiq","year":"2016","unstructured":"Shafiq R. Joty and Enamul Hoque . 2016 . Speech act modeling of written asynchronous conversations with task-specific embeddings and conditional structured models. In Association for Computer Linguistics (ACL '16). 1746--1756. Shafiq R. Joty and Enamul Hoque. 2016. Speech act modeling of written asynchronous conversations with task-specific embeddings and conditional structured models. In Association for Computer Linguistics (ACL'16). 1746--1756."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1870658.1870742"},{"key":"e_1_2_1_22_1","volume-title":"26th Pacific Asia Conference on Language, Information and Computation, 463--472","author":"Kim Su Nam","year":"2012","unstructured":"Su Nam Kim , Lawrence Cavedon , and Timothy Baldwin . 2012 . Classifying dialogue acts in multi-party live chats . In 26th Pacific Asia Conference on Language, Information and Computation, 463--472 . Su Nam Kim, Lawrence Cavedon, and Timothy Baldwin. 2012. Classifying dialogue acts in multi-party live chats. In 26th Pacific Asia Conference on Language, Information and Computation, 463--472."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 26th International Conference on Computational Linguistics (COLING'10)","author":"Kl\u00fcwer Tina","year":"2010","unstructured":"Tina Kl\u00fcwer , Hans Uszkoreit , and Feiyu Xu . 2010 . Using syntactic and semantic based relations for dialogue act recognition . In Proceedings of the 26th International Conference on Computational Linguistics (COLING'10) , 570--578. Tina Kl\u00fcwer, Hans Uszkoreit, and Feiyu Xu. 2010. Using syntactic and semantic based relations for dialogue act recognition. In Proceedings of the 26th International Conference on Computational Linguistics (COLING'10), 570--578."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 18th International Conference on Machine Learning (ICML\u201901)","author":"Lafferty John D.","unstructured":"John D. Lafferty , Andrew McCallum , and Fernando C. N. Pereira . 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data . In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901) . Morgan Kaufmann Publishers, San Francisco, CA, 282--289. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901). Morgan Kaufmann Publishers, San Francisco, CA, 282--289."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3632"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text (CAAGET\u201910)","author":"Saif","unstructured":"Saif M. Mohammad and Peter D. Turney. 2010. Emotions evoked by common words and phrases: Using Mechanical Turk to create an emotion lexicon . In Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text (CAAGET\u201910) . Association for Computational Linguistics, 26--34. Saif M. Mohammad and Peter D. Turney. 2010. Emotions evoked by common words and phrases: Using Mechanical Turk to create an emotion lexicon. In Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text (CAAGET\u201910). Association for Computational Linguistics, 26--34."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/NEBC.1991.154675"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025191"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_31_1","volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"Puterman Martin L.","unstructured":"Martin L. Puterman . 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming . John Wiley 8 Sons, Inc., New York. Martin L. Puterman. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley 8 Sons, Inc., New York."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/1857999.1858019"},{"key":"e_1_2_1_33_1","unstructured":"Harvey Sacks. 1992. In Harvey Sacks: Lectures on Conversation Gail Jefferson (Ed.). Blackwell Publishing.  Harvey Sacks. 1992. In Harvey Sacks: Lectures on Conversation Gail Jefferson (Ed.). Blackwell Publishing."},{"key":"e_1_2_1_35_1","volume-title":"Language Mind and Knowledge","author":"Searle John R.","unstructured":"John R. Searle . 1975. A taxonomy of illocutionary acts . In Language Mind and Knowledge , Vol. 7 . University of Minnesota Press , 344--369. John R. Searle. 1975. A taxonomy of illocutionary acts. In Language Mind and Knowledge, Vol. 7. University of Minnesota Press, 344--369."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120100561737"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856818"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/SLT.2006.326825"},{"key":"e_1_2_1_39_1","volume-title":"International Association for the Advancement of Artificial Intelligence Conference (AAAI) on Web and Social Media (ICWSM'16)","author":"Vosoughi Soroush","year":"2013","unstructured":"Soroush Vosoughi and Deb Roy . 2013 . A semi-automatic method for efficient detection of stories on social media . International Association for the Advancement of Artificial Intelligence Conference (AAAI) on Web and Social Media (ICWSM'16) . 707--710. Soroush Vosoughi and Deb Roy. 2013. A semi-automatic method for efficient detection of stories on social media. International Association for the Advancement of Artificial Intelligence Conference (AAAI) on Web and Social Media (ICWSM'16). 707--710."},{"key":"e_1_2_1_40_1","volume-title":"International Association for the Advancement of Artificial Intelligence Conference (AAAI) on Web and Social Media (ICWSM'16)","author":"Vosoughi Soroush","year":"2016","unstructured":"Soroush Vosoughi and Deb Roy . 2016 . Tweet acts: A speech act classifier for twitter . International Association for the Advancement of Artificial Intelligence Conference (AAAI) on Web and Social Media (ICWSM'16) . 711--714. Soroush Vosoughi and Deb Roy. 2016. Tweet acts: A speech act classifier for twitter. International Association for the Advancement of Artificial Intelligence Conference (AAAI) on Web and Social Media (ICWSM'16). 711--714."},{"key":"e_1_2_1_41_1","volume-title":"Zaki and Wagner Meira Jr","author":"Mohammed","year":"2014","unstructured":"Mohammed J. Zaki and Wagner Meira Jr . 2014 . Data Mining and Analysis: Fundamental Concepts and Algorithms. Cambridge University Press , New York. Mohammed J. Zaki and Wagner Meira Jr. 2014. Data Mining and Analysis: Fundamental Concepts and Algorithms. Cambridge University Press, New York."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4614"},{"key":"e_1_2_1_43_1","volume-title":"What are Tweeters doing: Recognizing speech acts in Twitter. Analyzing Microtext WS-11-05","author":"Zhang Renxian","year":"2011","unstructured":"Renxian Zhang , Dehong Gao , and Wenjie Li. 2011. What are Tweeters doing: Recognizing speech acts in Twitter. Analyzing Microtext WS-11-05 ( 2011 ), 86--91. Renxian Zhang, Dehong Gao, and Wenjie Li. 2011. What are Tweeters doing: Recognizing speech acts in Twitter. Analyzing Microtext WS-11-05 (2011), 86--91."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3213014","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3213014","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:08:11Z","timestamp":1750212491000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3213014"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,18]]},"references-count":41,"journal-issue":{"issue":"2-3","published-print":{"date-parts":[[2019,9,30]]}},"alternative-id":["10.1145\/3213014"],"URL":"https:\/\/doi.org\/10.1145\/3213014","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,18]]},"assertion":[{"value":"2017-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}