{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T05:50:44Z","timestamp":1773381044767,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,3,23]],"date-time":"2020-03-23T00:00:00Z","timestamp":1584921600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,3,23]]},"DOI":"10.1145\/3375462.3375490","type":"proceedings-article","created":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T17:48:06Z","timestamp":1584121686000},"page":"490-495","source":"Crossref","is-referenced-by-count":2,"title":["Detecting learning in noisy data"],"prefix":"10.1145","author":[{"given":"Beata Beigman","family":"Klebanov","sequence":"first","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anastassia","family":"Loukina","sequence":"additional","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Lockwood","sequence":"additional","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Van Rynald T.","family":"Liceralde","sequence":"additional","affiliation":[{"name":"University of North Carolina and Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Sabatini","sequence":"additional","affiliation":[{"name":"University of Memphis"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nitin","family":"Madnani","sequence":"additional","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Binod","family":"Gyawali","sequence":"additional","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zuowei","family":"Wang","sequence":"additional","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jennifer","family":"Lentini","sequence":"additional","affiliation":[{"name":"Educational Testing Service"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,3,23]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Brent Townshend, and Masanori Suzuki.","author":"Balogh Jennifer","year":"2012","unstructured":"Jennifer Balogh , Jared Bernstein , Jian Cheng , Alistair Van Moere , Brent Townshend, and Masanori Suzuki. 2012 . Validation of Automated Scoring of Oral Reading. <u>Educational and Psychological Measurement <\/u> 72, 3 (2012), 435--452. Jennifer Balogh, Jared Bernstein, Jian Cheng, Alistair Van Moere, Brent Townshend, and Masanori Suzuki. 2012. Validation of Automated Scoring of Oral Reading. <u>Educational and Psychological Measurement<\/u> 72, 3 (2012), 435--452."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"D. Bates M. M\u00e4chler B. Bolker and S. Walker. 2015. Fitting Linear Mixed-Effects Models Using lme4. <u>Journal of Statistical Software<\/u> 67 1 (2015) 1--48.  D. Bates M. M\u00e4chler B. Bolker and S. Walker. 2015. Fitting Linear Mixed-Effects Models Using lme4. <u>Journal of Statistical Software<\/u> 67 1 (2015) 1--48.","DOI":"10.18637\/jss.v067.i01"},{"key":"e_1_3_2_1_3_1","volume-title":"Would you? Could you? On a tablet? Analytics of Children's eBook Reading. In <u>Proceedings of the 9th International Conference on Learning Analytics & Knowledge.<\/u&gt","author":"Klebanov Beata Beigman","unstructured":"Beata Beigman Klebanov , Anastassia Loukina , Nitin Madnani , John Sabatini , and Jennifer Lentini . 2019. Would you? Could you? On a tablet? Analytics of Children's eBook Reading. In <u>Proceedings of the 9th International Conference on Learning Analytics & Knowledge.<\/u&gt ; ACM , Tempe, AZ, USA , 106--110. Beata Beigman Klebanov, Anastassia Loukina, Nitin Madnani, John Sabatini, and Jennifer Lentini. 2019. Would you? Could you? On a tablet? Analytics of Children's eBook Reading. In <u>Proceedings of the 9th International Conference on Learning Analytics & Knowledge.<\/u> ACM, Tempe, AZ, USA, 106--110."},{"key":"e_1_3_2_1_4_1","volume-title":"Charlotte, NC: Information Age Publisher.","author":"Bernstein J.","year":"2018","unstructured":"J. Bernstein , J. Cheng , J. Balog , and R. Downey . 2018 . Artificial intelligence for scoring oral reading fluency. In <u>Applications of artificial intelligence to assessment<\/u>, H. Jiao and R. Lissitz (Eds .). Charlotte, NC: Information Age Publisher. J. Bernstein, J.Cheng, J. Balog, and R. Downey. 2018. Artificial intelligence for scoring oral reading fluency. In <u>Applications of artificial intelligence to assessment<\/u>, H. Jiao and R. Lissitz (Eds.). Charlotte, NC: Information Age Publisher."},{"key":"e_1_3_2_1_5_1","volume-title":"Audio Quality Issue for Automatic Speech Assessment. In <u>Proceedings of SLaTE Workshop.<\/u&gt","author":"Chen Lei","unstructured":"Lei Chen . 2009. Audio Quality Issue for Automatic Speech Assessment. In <u>Proceedings of SLaTE Workshop.<\/u&gt ; Wroxall , UK , 97--100. Lei Chen. 2009. Audio Quality Issue for Automatic Speech Assessment. In <u>Proceedings of SLaTE Workshop.<\/u> Wroxall, UK, 97--100."},{"key":"e_1_3_2_1_6_1","volume-title":"Eugene, OR: Institute for the Development of Educational Achievement.","author":"Good R.H.","year":"2002","unstructured":"R.H. Good , R.A. Kaminski , and S. Dill . 2002 . DIBELS oral reading fluency and retell fluency. In <u>Dynamic indicators of basic early literacy skills ( 6 th ed.)<\/u>, R.H. Good and R.A. Kaminski (Eds .). Eugene, OR: Institute for the Development of Educational Achievement. R.H. Good, R.A. Kaminski, and S. Dill. 2002. DIBELS oral reading fluency and retell fluency. In <u>Dynamic indicators of basic early literacy skills (6th ed.)<\/u>, R.H. Good and R.A. Kaminski (Eds.). Eugene, OR: Institute for the Development of Educational Achievement.","edition":"6"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"J. Hasbrouck and G. Tindal. 2006. Oral Reading Fluency Norms: A Valuable Assessment Tool for Reading Teachers. <u>The Reading Teacher<\/u> 59 (2006) 636--644.  J. Hasbrouck and G. Tindal. 2006. Oral Reading Fluency Norms: A Valuable Assessment Tool for Reading Teachers. <u>The Reading Teacher<\/u> 59 (2006) 636--644.","DOI":"10.1598\/RT.59.7.3"},{"key":"e_1_3_2_1_8_1","volume-title":"Behavioral Research and Teaching","author":"Hasbrouck Jan","unstructured":"Jan Hasbrouck and Gerald Tindal . 2017. <u> An update to compiled ORF norms.<\/u> Technical Report . Behavioral Research and Teaching , University of Oregon. Jan Hasbrouck and Gerald Tindal. 2017. <u>An update to compiled ORF norms.<\/u> Technical Report. Behavioral Research and Teaching, University of Oregon."},{"key":"e_1_3_2_1_9_1","volume-title":"Communication and prosody: Functional aspects of prosody. <u>Speech Communication<\/u&gt","author":"Hirschberg Julia","year":"2002","unstructured":"Julia Hirschberg . 2002. Communication and prosody: Functional aspects of prosody. <u>Speech Communication<\/u&gt ; 36, 1-2 ( 2002 ), 31--43. Julia Hirschberg. 2002. Communication and prosody: Functional aspects of prosody. <u>Speech Communication<\/u> 36, 1-2 (2002), 31--43."},{"key":"e_1_3_2_1_10_1","volume-title":"Kame'enui","author":"Roland H.","year":"2001","unstructured":"Roland H. Good III, Deborah C. Simmons , and Edward J . Kame'enui . 2001 . The Importance and Decision-Making Utility of a Continuum of Fluency-Based Indicators of Foundational Reading Skills for Third-Grade High-Stakes Outcomes. <u>Scientific Studies of Reading <\/u> 5, 3 (2001), 257--288. Roland H. Good III, Deborah C. Simmons, and Edward J. Kame'enui. 2001. The Importance and Decision-Making Utility of a Continuum of Fluency-Based Indicators of Foundational Reading Skills for Third-Grade High-Stakes Outcomes. <u>Scientific Studies of Reading<\/u> 5, 3 (2001), 257--288."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v082.i13"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"A. Loukina B. Beigman Klebanov P. Lange B. Gyawali and Y. Qian. 2017. Developing speech processing technologies for shared book reading with a computer. In <u>6th International Workshop on Child Computer Interaction.<\/u> 46--51.  A. Loukina B. Beigman Klebanov P. Lange B. Gyawali and Y. Qian. 2017. Developing speech processing technologies for shared book reading with a computer. In <u>6th International Workshop on Child Computer Interaction.<\/u> 46--51.","DOI":"10.21437\/WOCCI.2017-8"},{"key":"e_1_3_2_1_13_1","volume":"201","author":"Loukina A.","unstructured":"A. Loukina , B. Beigman Klebanov , P. Lange , Y. Qian , B. Gyawali , N. Madnani , A. Misra , K. Zechner , Z. Wang , and J. Sabatini. 201 9. Automated Estimation of Oral Reading Fluency During Summer Camp e-Book Reading with MyTurn-ToRead. In <u>Proceedings of the Annual Conference of the International Speech Communication Association.<\/u> Gratz, Austria, 21--25. A. Loukina, B. Beigman Klebanov, P. Lange, Y. Qian, B. Gyawali, N. Madnani, A. Misra, K. Zechner, Z. Wang, and J. Sabatini. 2019. Automated Estimation of Oral Reading Fluency During Summer Camp e-Book Reading with MyTurn-ToRead. In <u>Proceedings of the Annual Conference of the International Speech Communication Association.<\/u> Gratz, Austria, 21--25.","journal-title":"J. Sabatini."},{"key":"e_1_3_2_1_14_1","volume-title":"Towards Understanding Text Factors in Oral Reading. In <u>Proceedings of Annual 2018 Conference of the North American","author":"Loukina A.","unstructured":"A. Loukina , V. Liceralde , and B. Beigman Klebanov . 2018. Towards Understanding Text Factors in Oral Reading. In <u>Proceedings of Annual 2018 Conference of the North American Chapter of the Association for Computational Linguistics.<\/u> New Orleans , Louisiana , 2143--2154. A. Loukina, V. Liceralde, and B. Beigman Klebanov. 2018. Towards Understanding Text Factors in Oral Reading. In <u>Proceedings of Annual 2018 Conference of the North American Chapter of the Association for Computational Linguistics.<\/u> New Orleans, Louisiana, 2143--2154."},{"key":"e_1_3_2_1_15_1","volume-title":"Performance improvement of automatic pronunciation assessment in a noisy classroom. In <u>Proceedings of 2012 IEEE Workshop on Spoken Language Technology (SLT).<\/u&gt","author":"Luan Yi","unstructured":"Yi Luan , Masayuki Suzuki , Yutaka Yamauchi , Nobuaki Minematsu , Shuhei Kato , and Keikichi Hirose . 2012. Performance improvement of automatic pronunciation assessment in a noisy classroom. In <u>Proceedings of 2012 IEEE Workshop on Spoken Language Technology (SLT).<\/u&gt ; Miami , FL , 428--431. Yi Luan, Masayuki Suzuki, Yutaka Yamauchi, Nobuaki Minematsu, Shuhei Kato, and Keikichi Hirose. 2012. Performance improvement of automatic pronunciation assessment in a noisy classroom. In <u>Proceedings of 2012 IEEE Workshop on Spoken Language Technology (SLT).<\/u> Miami, FL, 428--431."},{"key":"e_1_3_2_1_16_1","volume-title":"Anastassia Loukina, Binod Gyawali, Patrick Lange, John Sabatini, and Michael Flor.","author":"Madnani Nitin","year":"2019","unstructured":"Nitin Madnani , Beata Beigman Klebanov , Anastassia Loukina, Binod Gyawali, Patrick Lange, John Sabatini, and Michael Flor. 2019 . My Turn To Read: An Interleaved E-book Reading Tool for Developing and Struggling Readers. In <u>Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics : System Demonstrations.<\/u> Florence, Italy, 141--146. Nitin Madnani, Beata Beigman Klebanov, Anastassia Loukina, Binod Gyawali, Patrick Lange, John Sabatini, and Michael Flor. 2019. My Turn To Read: An Interleaved E-book Reading Tool for Developing and Struggling Readers. In <u>Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations.<\/u> Florence, Italy, 141--146."},{"key":"e_1_3_2_1_17_1","volume-title":"Why and how our automated reading tutor listens. In <u>Proceedings of the International Symposium on Automatic Detection of Errors in Pronunciation Training.<\/u&gt","author":"Mostow Jack","unstructured":"Jack Mostow . 2012. Why and how our automated reading tutor listens. In <u>Proceedings of the International Symposium on Automatic Detection of Errors in Pronunciation Training.<\/u&gt ; Stockholm , Sweden , 43--52. Jack Mostow. 2012. Why and how our automated reading tutor listens. In <u>Proceedings of the International Symposium on Automatic Detection of Errors in Pronunciation Training.<\/u> Stockholm, Sweden, 43--52."},{"key":"e_1_3_2_1_18_1","volume-title":"Online Readability and Text Complexity Analysis with TextEvaluator. In <u>Proceedings of the 2015 Conference of the North American","author":"Napolitano Diane","unstructured":"Diane Napolitano , Kathleen Sheehan , and Robert Mundkowsky . 2015. Online Readability and Text Complexity Analysis with TextEvaluator. In <u>Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations.<\/u> Denver , Colorado , 96--100. Diane Napolitano, Kathleen Sheehan, and Robert Mundkowsky. 2015. Online Readability and Text Complexity Analysis with TextEvaluator. In <u>Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations.<\/u> Denver, Colorado, 96--100."},{"key":"e_1_3_2_1_19_1","volume-title":"Within-year oral reading fluency with CBM: a comparison of models. <u>Reading and Writing<\/u&gt","author":"Nese Joseph F. T.","year":"2012","unstructured":"Joseph F. T. Nese , Gina Biancarosa , Daniel Anderson , Cheng-Fei Lai , Julie Alonzo , and Gerald Tindal . 2012. Within-year oral reading fluency with CBM: a comparison of models. <u>Reading and Writing<\/u&gt ; 25, 4 ( 2012 ), 887--915. Joseph F. T. Nese, Gina Biancarosa, Daniel Anderson, Cheng-Fei Lai, Julie Alonzo, and Gerald Tindal. 2012. Within-year oral reading fluency with CBM: a comparison of models. <u>Reading and Writing<\/u> 25, 4 (2012), 887--915."},{"key":"e_1_3_2_1_20_1","unstructured":"Eunice Kennedy Shriver National Institute of Child Health and DHH Human Development NIH. 2000. Report of the National Reading Panel: Teaching Children to Read: Reports of the Subgroups (00-4754). https:\/\/www.nichd.nih.gov\/sites\/default\/files\/publications\/pubs\/nrp\/Documents\/report.pdf  Eunice Kennedy Shriver National Institute of Child Health and DHH Human Development NIH. 2000. Report of the National Reading Panel: Teaching Children to Read: Reports of the Subgroups (00-4754). https:\/\/www.nichd.nih.gov\/sites\/default\/files\/publications\/pubs\/nrp\/Documents\/report.pdf"},{"key":"e_1_3_2_1_21_1","unstructured":"University of Oregon. 2019. 8th Edition of Dynamic Indicators of Basic Early Literacy Skills (DIBELS): Administration and Scoring Guide. https:\/\/dibels.uoregon.edu\/docs\/materials\/d8\/dibels_8_admin_and_scoring_guide_07_2019.pdf  University of Oregon. 2019. 8th Edition of Dynamic Indicators of Basic Early Literacy Skills (DIBELS): Administration and Scoring Guide. https:\/\/dibels.uoregon.edu\/docs\/materials\/d8\/dibels_8_admin_and_scoring_guide_07_2019.pdf"},{"key":"e_1_3_2_1_22_1","volume-title":"Benchmark Assessments Offer Regular Checkups on Student Achievement. <u>Education Week<\/u&gt","author":"Olsen Lynn","year":"2005","unstructured":"Lynn Olsen . 2005. Benchmark Assessments Offer Regular Checkups on Student Achievement. <u>Education Week<\/u&gt ; 25, 13 ( 2005 ), 13--14. Lynn Olsen. 2005. Benchmark Assessments Offer Regular Checkups on Student Achievement. <u>Education Week<\/u> 25, 13 (2005), 13--14."},{"key":"e_1_3_2_1_23_1","volume-title":"Moving Toward a Comprehensive Assessment System: A Framework for Considering Interim Assessments. <u>Educational Measurement: Issues and Practice<\/u&gt","author":"Perie Marianne","year":"2009","unstructured":"Marianne Perie , Scott Marion , and Brian Gong . 2009. Moving Toward a Comprehensive Assessment System: A Framework for Considering Interim Assessments. <u>Educational Measurement: Issues and Practice<\/u&gt ; 28, 3 ( 2009 ), 5--13. Marianne Perie, Scott Marion, and Brian Gong. 2009. Moving Toward a Comprehensive Assessment System: A Framework for Considering Interim Assessments. <u>Educational Measurement: Issues and Practice<\/u> 28, 3 (2009), 5--13."},{"key":"e_1_3_2_1_24_1","volume-title":"An investigation of the reliability and standard error of measurement of words read correctly per minute using curriculum-based measurement. <u>Journal of Psychoeducational Assessment<\/u&gt","author":"Poncy Brian","year":"2005","unstructured":"Brian Poncy , Christopher Skinner , and Philip Axtell . 2005. An investigation of the reliability and standard error of measurement of words read correctly per minute using curriculum-based measurement. <u>Journal of Psychoeducational Assessment<\/u&gt ; 23, 4 ( 2005 ), 326--338. Brian Poncy, Christopher Skinner, and Philip Axtell. 2005. An investigation of the reliability and standard error of measurement of words read correctly per minute using curriculum-based measurement. <u>Journal of Psychoeducational Assessment<\/u> 23, 4 (2005), 326--338."},{"key":"e_1_3_2_1_25_1","volume-title":"A Language and Environment for Statistical Computing.<\/u&gt","author":"Team R Core","unstructured":"R Core Team . 2019. <u>R : A Language and Environment for Statistical Computing.<\/u&gt ; R Foundation for Statistical Computing . https:\/\/www.R-project.org\/ R Core Team. 2019. <u>R: A Language and Environment for Statistical Computing.<\/u> R Foundation for Statistical Computing. https:\/\/www.R-project.org\/"},{"key":"e_1_3_2_1_26_1","volume-title":"Applications and Data Analysis Methods<\/u&gt","author":"Raudenbush Stephen","unstructured":"Stephen Raudenbush and Anthony Bryk . 2002. <u> Hierarchical Linear Models : Applications and Data Analysis Methods<\/u&gt ; ( second ed.). Sage, Newbury Park , CA. Stephen Raudenbush and Anthony Bryk. 2002. <u>Hierarchical Linear Models: Applications and Data Analysis Methods<\/u> (second ed.). Sage, Newbury Park, CA."},{"key":"e_1_3_2_1_27_1","volume-title":"Sage","author":"Snijders Tom","unstructured":"Tom Snijders and Roel Bosker . 2012. <u> Multilevel Analysis <\/u> (2 ed.). Sage , London . Tom Snijders and Roel Bosker. 2012. <u>Multilevel Analysis<\/u> (2 ed.). Sage, London."},{"key":"e_1_3_2_1_28_1","volume-title":"Renata Ticha, and Christine A. Espin.","author":"Wayman Miya Miura","year":"2007","unstructured":"Miya Miura Wayman , Teri Wallace , Hilda Ives Wiley , Renata Ticha, and Christine A. Espin. 2007 . Literature synthesis on curriculum-based measurement in reading. <u>Journal of Special Education <\/u> 41, 2 (2007), 85--120. Miya Miura Wayman, Teri Wallace, Hilda Ives Wiley, Renata Ticha, and Christine A. Espin. 2007. Literature synthesis on curriculum-based measurement in reading. <u>Journal of Special Education<\/u> 41, 2 (2007), 85--120."},{"key":"e_1_3_2_1_29_1","volume-title":"Communicative function and prosodic form in speech timing. <u>Speech Communication<\/u&gt","author":"White Laurence","year":"2014","unstructured":"Laurence White . 2014. Communicative function and prosodic form in speech timing. <u>Speech Communication<\/u&gt ; 63-64 ( 2014 ), 38--54. Laurence White. 2014. Communicative function and prosodic form in speech timing. <u>Speech Communication<\/u> 63-64 (2014), 38--54."}],"event":{"name":"LAK '20: 10th International Conference on Learning Analytics and Knowledge","location":"Frankfurt Germany","acronym":"LAK '20"},"container-title":["Proceedings of the Tenth International Conference on Learning Analytics & Knowledge"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375462.3375490","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375462.3375490","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:30Z","timestamp":1750203870000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375462.3375490"}},"subtitle":["the case of oral reading fluency"],"short-title":[],"issued":{"date-parts":[[2020,3,23]]},"references-count":29,"alternative-id":["10.1145\/3375462.3375490","10.1145\/3375462"],"URL":"https:\/\/doi.org\/10.1145\/3375462.3375490","relation":{},"subject":[],"published":{"date-parts":[[2020,3,23]]}}}