{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:29:18Z","timestamp":1750307358934,"version":"3.41.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2011,5,1]],"date-time":"2011-05-01T00:00:00Z","timestamp":1304208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000138","name":"U.S. Department of Education","doi-asserted-by":"publisher","award":["R305A080628"],"award-info":[{"award-number":["R305A080628"]}],"id":[{"id":"10.13039\/100000138","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Speech Lang. Process."],"published-print":{"date-parts":[[2011,5]]},"abstract":"<jats:p>The richness of multimodal dialogue makes the space of possible features required to describe it very large relative to the amount of training data. However, conventional classifier learners require large amounts of data to avoid overfitting, or do not generalize well to unseen examples. To learn dialogue classifiers using a rich feature set and fewer data points than features, we apply a recent technique, \u2113<jats:sub>1<\/jats:sub>-regularized logistic regression. We demonstrate this approach empirically on real data from Project LISTEN's Reading Tutor, which displays a story on a computer screen and listens to a child read aloud. We train a classifier to predict task completion (i.e., whether the student will finish reading the story) with 71% accuracy on a balanced, unseen test set. To characterize differences in the behavior of children when they choose the story they read, we likewise train and test a classifier that with 73.6% accuracy infers who chose the story based on the ensuing dialogue. Both classifiers significantly outperform baselines and reveal relevant features of the dialogue.<\/jats:p>","DOI":"10.1145\/1966407.1966413","type":"journal-article","created":{"date-parts":[[2011,6,6]],"date-time":"2011-06-06T11:51:38Z","timestamp":1307361098000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Classifying dialogue in high-dimensional space"],"prefix":"10.1145","volume":"7","author":[{"given":"Jos\u00e9 P.","family":"Gonz\u00e1lez-Brenes","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA"}]},{"given":"Jack","family":"Mostow","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA"}]}],"member":"320","published-online":{"date-parts":[[2011,6,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Ai H. Tetreault J. R. and Litman D. J. 2007. Comparing user simulation models for dialog strategy learning. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics. (Companion Volume Short Papers) Association for Computational Linguistics. 1--4. Ai H. Tetreault J. R. and Litman D. J. 2007. Comparing user simulation models for dialog strategy learning. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics. (Companion Volume Short Papers) Association for Computational Linguistics. 1--4.","DOI":"10.3115\/1614108.1614109"},{"volume-title":"Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer, 645--646","author":"Aist G.","key":"e_1_2_1_2_1","unstructured":"Aist , G. and Mostow , J . 2000. Improving story choice in a reading tutor that listens . In Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer, 645--646 . Aist, G. and Mostow, J. 2000. Improving story choice in a reading tutor that listens. In Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer, 645--646."},{"key":"e_1_2_1_3_1","unstructured":"Aist G. and Mostow J. 2007. Balancing learner and tutor control by taking turns: Faster and better mixed-initiative task choice in a reading tutor that listens. In The Path of Speech Technologies in Computer Assisted Language Learning: From Research toward Practice M. Holland V. Holland and F. Fisher Eds. Routledge New York 220--240. Aist G. and Mostow J. 2007. Balancing learner and tutor control by taking turns: Faster and better mixed-initiative task choice in a reading tutor that listens. In The Path of Speech Technologies in Computer Assisted Language Learning: From Research toward Practice M. Holland V. Holland and F. Fisher Eds. Routledge New York 220--240."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3975(97)00115-1"},{"volume-title":"Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer, 584--593","author":"Beck J.","key":"e_1_2_1_5_1","unstructured":"Beck , J. and Woolf , B. P . 2000. High-level student modeling with machine learning . In Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer, 584--593 . Beck, J. and Woolf, B. P. 2000. High-level student modeling with machine learning. In Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer, 584--593."},{"volume-title":"Does learner control affect learning&quest","author":"Beck J. E.","key":"e_1_2_1_6_1","unstructured":"Beck , J. E. 2007. Does learner control affect learning&quest ; In Proceedings of the Conference on Artificial Intelligence in Education : Building Technology Rich Learning Contexts That Work. IOS Press , 135--142. Beck, J. E. 2007. Does learner control affect learning&quest; In Proceedings of the Conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work. IOS Press, 135--142."},{"volume-title":"Proceedings of the 17th National Conference on Artificial Intelligence. 552--557","author":"Beck J. E.","key":"e_1_2_1_7_1","unstructured":"Beck , J. E. , Woolf , B. P. , and Beal , C. R . 2000. Advisor: A machine learning architecture for intelligent tutor construction . In Proceedings of the 17th National Conference on Artificial Intelligence. 552--557 . Beck, J. E., Woolf, B. P., and Beal, C. R. 2000. Advisor: A machine learning architecture for intelligent tutor construction. In Proceedings of the 17th National Conference on Artificial Intelligence. 552--557."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/234285.234289"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13388-6_10"},{"volume-title":"Proceedings of the NAACL 5th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, 66--73","author":"Boyer K. E.","key":"e_1_2_1_10_1","unstructured":"Boyer , K. E. , Phillips , R. , Ha , E. Y. , Wallis , M. D. , Vouk , M. A. , and Lester , J. C . 2010b. Leveraging hidden dialogue state to select tutorial moves . In Proceedings of the NAACL 5th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, 66--73 . Boyer, K. E., Phillips, R., Ha, E. Y., Wallis, M. D., Vouk, M. A., and Lester, J. C. 2010b. Leveraging hidden dialogue state to select tutorial moves. In Proceedings of the NAACL 5th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, 66--73."},{"volume-title":"Proceedings of the 1st International Conference on Educational Data Mining. 30--36","author":"Chi M.","key":"e_1_2_1_11_1","unstructured":"Chi , M. , Jordan , P. , VanLehn , K. , and Hall , M . 2008. Reinforcement learning-based feature selection for developing pedagogically effective tutorial dialogue tactics . In Proceedings of the 1st International Conference on Educational Data Mining. 30--36 . Chi, M., Jordan, P., VanLehn, K., and Hall, M. 2008. Reinforcement learning-based feature selection for developing pedagogically effective tutorial dialogue tactics. In Proceedings of the 1st International Conference on Educational Data Mining. 30--36."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13388-6_27"},{"volume-title":"Proceedings of the 17th Annual Conference on Computational Learning Theory. Springer, 472--486","author":"Dudik M.","key":"e_1_2_1_13_1","unstructured":"Dudik , M. , Phillips , S. J. , and Schapire , R. E . 2004. Performance guarantees for regularized maximum entropy density estimation . In Proceedings of the 17th Annual Conference on Computational Learning Theory. Springer, 472--486 . Dudik, M., Phillips, S. J., and Schapire, R. E. 2004. Performance guarantees for regularized maximum entropy density estimation. In Proceedings of the 17th Annual Conference on Computational Learning Theory. Springer, 472--486."},{"volume-title":"Proceedings of the International Workshop on Spoken Dialogue Systems. Springer.","author":"Gonz\u00e1lez-Brenes J. P.","key":"e_1_2_1_14_1","unstructured":"Gonz\u00e1lez-Brenes , J. P. , Black , A. W. , and Eskenazi , M . 2009. Describing spoken dialogue systems differences . In Proceedings of the International Workshop on Spoken Dialogue Systems. Springer. Gonz\u00e1lez-Brenes, J. P., Black, A. W., and Eskenazi, M. 2009. Describing spoken dialogue systems differences. In Proceedings of the International Workshop on Spoken Dialogue Systems. Springer."},{"key":"e_1_2_1_15_1","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon I.","year":"2003","unstructured":"Guyon , I. and Elisseeff , A. 2003 . An introduction to variable and feature selection . J. Mach. Learn. Resea. 3 , 1157 -- 1182 . Guyon, I. and Elisseeff, A. 2003. An introduction to variable and feature selection. J. Mach. Learn. Resea. 3, 1157--1182.","journal-title":"J. Mach. Learn. Resea."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2006.32.2.263"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073147"},{"key":"e_1_2_1_18_1","unstructured":"Hastie T. Tibshirani R. and Friedman J. 2003. The Elements of Statistical Learning: Data Mining Inference and Prediction 2nd Ed. Springer New York. Hastie T. Tibshirani R. and Friedman J. 2003. The Elements of Statistical Learning: Data Mining Inference and Prediction 2nd Ed. Springer New York."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2008.07-028-R2-05-82"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1006\/csla.1993.1007"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-005-0768-5"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Lee S.-I. Ganapathi V. and Koller D. 2007. Efficient structure learning of markov networks using l1-regularization. In Advances in Neural Information Processing Systems 19 B. Sch\u00f6lkopf J. Platt and T. Hoffman Eds. MIT Press Cambridge MA 817--824. Lee S.-I. Ganapathi V. and Koller D. 2007. Efficient structure learning of markov networks using l 1 -regularization. In Advances in Neural Information Processing Systems 19 B. Sch\u00f6lkopf J. Platt and T. Hoffman Eds. MIT Press Cambridge MA 817--824.","DOI":"10.7551\/mitpress\/7503.003.0107"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2008.03.001"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2005.11.003"},{"key":"e_1_2_1_25_1","unstructured":"Mostow J. and Aist G. 2001. Evaluating tutors that listen: an overview of project LISTEN. In Smart Machines in Education K. Forbus and P. Feltovich Eds. MIT Press Cambridge MA 169--234. Mostow J. and Aist G. 2001. Evaluating tutors that listen: an overview of project LISTEN. In Smart Machines in Education K. Forbus and P. Feltovich Eds. MIT Press Cambridge MA 169--234."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.2190\/06AX-QW99-EQ5G-RDCF"},{"volume-title":"Proceedings of the 14th International Conference on Artificial Intelligence in Education (AIED'09)","author":"Mostow J.","key":"e_1_2_1_27_1","unstructured":"Mostow , J. and Duong , M . 2009. Automated Assessment of Oral Reading Prosody . In Proceedings of the 14th International Conference on Artificial Intelligence in Education (AIED'09) . IOS Press, 189--196. Mostow, J. and Duong, M. 2009. Automated Assessment of Oral Reading Prosody. In Proceedings of the 14th International Conference on Artificial Intelligence in Education (AIED'09). IOS Press, 189--196."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015435"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the Workshop on Machine Learning for Information Filtering (IJCAI99)","author":"Nigam K.","year":"1999","unstructured":"Nigam , K. , Lafferty , J. , and McCallum , A. 1999 . Using maximum entropy for text classification . In Proceedings of the Workshop on Machine Learning for Information Filtering (IJCAI99) . T. Dean Ed., Morgan Kaufmann, 61--67. Nigam, K., Lafferty, J., and McCallum, A. 1999. Using maximum entropy for text classification. In Proceedings of the Workshop on Machine Learning for Information Filtering (IJCAI99). T. Dean Ed., Morgan Kaufmann, 61--67."},{"volume-title":"Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Okanohara D.","key":"e_1_2_1_30_1","unstructured":"Okanohara , D. and Tsujii , J . 2009. Learning combination features with l1 regularization . In Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics , Companion Volume: Short Papers. Association for Computational Linguistics, 97--100. Okanohara, D. and Tsujii, J. 2009. Learning combination features with l1 regularization. In Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers. Association for Computational Linguistics, 97--100."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2007.00607.x"},{"volume-title":"Proceedings of the 2006 Workshop on Spoken Language Technology Workshop. IEEE, 190--193","author":"Rieser V.","key":"e_1_2_1_32_1","unstructured":"Rieser , V. and Lemon , O . 2006. Using logistic regression to initialise reinforcement-learning-based dialogue systems . In Proceedings of the 2006 Workshop on Spoken Language Technology Workshop. IEEE, 190--193 . Rieser, V. and Lemon, O. 2006. Using logistic regression to initialise reinforcement-learning-based dialogue systems. In Proceedings of the 2006 Workshop on Spoken Language Technology Workshop. IEEE, 190--193."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324909005099"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.880083"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1--8.","author":"Schmidt M.","key":"e_1_2_1_35_1","unstructured":"Schmidt , M. , Murphy , K. , Fung , G. , and Rosales , R . 2008. Structure learning in random fields for heart motion abnormality detection . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1--8. Schmidt, M., Murphy, K., Fung, G., and Rosales, R. 2008. Structure learning in random fields for heart motion abnormality detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1--8."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg308"},{"key":"e_1_2_1_37_1","unstructured":"Singh S. P. Kearns M. J. Litman D. J. and Walker M. A. 1999. Reinforcement learning for spoken dialogue systems. In Advances in Neural Information Processing Systems. Vol. 12. MIT Press Cambridge MA 956--962. Singh S. P. Kearns M. J. Litman D. J. and Walker M. A. 1999. Reinforcement learning for spoken dialogue systems. In Advances in Neural Information Processing Systems. Vol. 12. MIT Press Cambridge MA 956--962."},{"volume-title":"Proceedings of the 7th International Conference on Text, Speech and Dialogue. Springer, 629--636","author":"Steidl S.","key":"e_1_2_1_38_1","unstructured":"Steidl , S. , Hacker , C. , Ruff , C. , Batliner , A. , N\u00f6th , E. , and Haas , J . 2004. Looking at the last two turns, id say this dialogue is doomed--measuring dialogue success . In Proceedings of the 7th International Conference on Text, Speech and Dialogue. Springer, 629--636 . Steidl, S., Hacker, C., Ruff, C., Batliner, A., N\u00f6th, E., and Haas, J. 2004. Looking at the last two turns, id say this dialogue is doomed--measuring dialogue success. In Proceedings of the 7th International Conference on Text, Speech and Dialogue. Springer, 629--636."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2009.2030111"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324900002503"},{"key":"e_1_2_1_42_1","unstructured":"Walker M. Langkilde I. Wright J. Gorin A. and Litman D. 2000. Learning to predict problematic situations in a spoken dialogue system: experiments with how may i help you&quest; In Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference. Morgan Kaufmann Publishers Inc. San Francisco CA 210--217. Walker M. Langkilde I. Wright J. Gorin A. and Litman D. 2000. Learning to predict problematic situations in a spoken dialogue system: experiments with how may i help you&quest; In Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference. Morgan Kaufmann Publishers Inc. San Francisco CA 210--217."},{"volume-title":"Proceedings of the Eighteenth International Conference on Machine Learning (ICML'01)","author":"Xing E. P.","key":"e_1_2_1_43_1","unstructured":"Xing , E. P. , Jordan , M. I. , and Karp , R. M . 2001. Feature selection for high-dimensional genomic microarray data . In Proceedings of the Eighteenth International Conference on Machine Learning (ICML'01) . Morgan Kaufmann Publishers Inc., San Francisco, CA, 601--608. Xing, E. P., Jordan, M. I., and Karp, R. M. 2001. Feature selection for high-dimensional genomic microarray data. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML'01). Morgan Kaufmann Publishers Inc., San Francisco, CA, 601--608."},{"volume-title":"Proceedings of the 14th International Conference on Machine Learning (ICML'97)","author":"Yang Y.","key":"e_1_2_1_44_1","unstructured":"Yang , Y. and Pedersen , J. O . 1997. A comparative study on feature selection in text categorization . In Proceedings of the 14th International Conference on Machine Learning (ICML'97) . Morgan Kaufmann Publishers Inc., San Francisco, CA, 412--420. Yang, Y. and Pedersen, J. O. 1997. A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning (ICML'97). Morgan Kaufmann Publishers Inc., San Francisco, CA, 412--420."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00532.x"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1214\/07-AOS520"}],"container-title":["ACM Transactions on Speech and Language Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1966407.1966413","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1966407.1966413","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:22:26Z","timestamp":1750245746000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1966407.1966413"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,5]]},"references-count":46,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,5]]}},"alternative-id":["10.1145\/1966407.1966413"],"URL":"https:\/\/doi.org\/10.1145\/1966407.1966413","relation":{},"ISSN":["1550-4875","1550-4883"],"issn-type":[{"type":"print","value":"1550-4875"},{"type":"electronic","value":"1550-4883"}],"subject":[],"published":{"date-parts":[[2011,5]]},"assertion":[{"value":"2010-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-06-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}