{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:08:55Z","timestamp":1750306135825,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,7,9]],"date-time":"2017-07-09T00:00:00Z","timestamp":1499558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,7,9]]},"DOI":"10.1145\/3099023.3099042","type":"proceedings-article","created":{"date-parts":[[2017,7,10]],"date-time":"2017-07-10T12:17:13Z","timestamp":1499689033000},"page":"197-201","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Measuring Predictive Performance of User Models"],"prefix":"10.1145","author":[{"given":"Radek","family":"Pel\u00e1nek","sequence":"first","affiliation":[{"name":"Masaryk University, Brno, Czech Rep"}]}],"member":"320","published-online":{"date-parts":[[2017,7,9]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Ryan Baker. 2013. A'\/AUC Code. http:\/\/www.columbia.edu\/~rsb216\/edmtools.html. (2013).  Ryan Baker. 2013. A'\/AUC Code. http:\/\/www.columbia.edu\/~rsb216\/edmtools.html. (2013)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69132-7_44"},{"key":"e_1_3_2_1_3_1","unstructured":"Joseph Beck. 2007. Difficulties in inferring student knowledge from observations (and why you should care) Proc. of Educational Data Mining. 21--30.  Joseph Beck. 2007. Difficulties in inferring student knowledge from observations (and why you should care) Proc. of Educational Data Mining. 21--30."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73078-1_17"},{"key":"e_1_3_2_1_5_1","unstructured":"Joseph E Beck and Xiaolu Xiong 2013. Limits to accuracy: How well can we do at student modeling Educational Data Mining. 4--11.  Joseph E Beck and Xiaolu Xiong 2013. Limits to accuracy: How well can we do at student modeling Educational Data Mining. 4--11."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Glenn W Brier. 1950. Verification of forecasts expressed in terms of probability. Monthly weather review Vol. 78 1 (1950) 1--3.  Glenn W Brier. 1950. Verification of forecasts expressed in terms of probability. Monthly weather review Vol. 78 1 (1950) 1--3.","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2"},{"key":"e_1_3_2_1_8_1","unstructured":"Tom Fawcett. 2004. ROC graphs: Notes and practical considerations for researchers. Machine learning Vol. 31 1 (2004) 1--38.  Tom Fawcett. 2004. ROC graphs: Notes and practical considerations for researchers. Machine learning Vol. 31 1 (2004) 1--38."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.10.010"},{"volume-title":"Proc. of Graphics Interface","year":"2005","author":"Fogarty James","key":"e_1_3_2_1_10_1"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214506000001437"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13388-6_8"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.3233\/JAI-2011-016"},{"volume-title":"Proc. of Educational Data Mining. 84--91","year":"2014","author":"Gonz\u00e1lez-Brenes JP","key":"e_1_3_2_1_14_1"},{"key":"e_1_3_2_1_15_1","unstructured":"Jos\u00e9 P Gonz\u00e1lez-Brenes. 2015. Modeling Skill Acquisition Over Time with Sequence and Topic Modeling. AISTATS.  Jos\u00e9 P Gonz\u00e1lez-Brenes. 2015. Modeling Skill Acquisition Over Time with Sequence and Topic Modeling. AISTATS."},{"key":"e_1_3_2_1_16_1","unstructured":"Jos\u00e9 P Gonz\u00e1lez-Brenes and Yun Huang 2015. Your model is predictive - but is it useful? theoretical and empirical considerations of a new paradigm for adaptive tutoring evaluation Proc. of Educational Data Mining.  Jos\u00e9 P Gonz\u00e1lez-Brenes and Yun Huang 2015. Your model is predictive - but is it useful? theoretical and empirical considerations of a new paradigm for adaptive tutoring evaluation Proc. of Educational Data Mining."},{"volume-title":"Proc. of Educational Data Mining. 236--240","year":"2013","author":"Gonz\u00e1lez-Brenes Jos\u00e9 P","key":"e_1_3_2_1_17_1"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1256\/qj.06.25"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5119-5"},{"volume-title":"Beyond Knowledge Tracing: Modeling Skill Topologies with Bayesian Networks Proc. of Intelligent Tutoring Systems. 188--198","year":"2014","author":"K\u00e4ser T.","key":"e_1_3_2_1_20_1"},{"key":"e_1_3_2_1_21_1","unstructured":"Tanja K\u00e4ser Kenneth R Koedinger and Markus Gross. 2014. Different parameters - same prediction: An analysis of learning curves Proc. of Educational Data Mining. 52--59.  Tanja K\u00e4ser Kenneth R Koedinger and Markus Gross. 2014. Different parameters - same prediction: An analysis of learning curves Proc. of Educational Data Mining. 52--59."},{"volume-title":"Proc. of Educational Data Mining.","year":"2016","author":"Khajah Mohammad","key":"e_1_3_2_1_22_1"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Jorge M Lobo Alberto Jim\u00e9nez-Valverde and Raimundo Real. 2008. AUC: a misleading measure of the performance of predictive distribution models. Global ecology and Biogeography Vol. 17 2 (2008) 145--151.  Jorge M Lobo Alberto Jim\u00e9nez-Valverde and Raimundo Real. 2008. AUC: a misleading measure of the performance of predictive distribution models. Global ecology and Biogeography Vol. 17 2 (2008) 145--151.","DOI":"10.1111\/j.1466-8238.2007.00358.x"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1175\/825.1"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2"},{"key":"e_1_3_2_1_26_1","unstructured":"Juraj Nivznan Radek Pel\u00e1nek and Jivr\u00ed vRih\u00e1k. 2015. Student Models for Prior Knowledge Estimation. In Educational Data Mining.  Juraj Nivznan Radek Pel\u00e1nek and Jivr\u00ed vRih\u00e1k. 2015. Student Models for Prior Knowledge Estimation. In Educational Data Mining."},{"key":"e_1_3_2_1_27_1","unstructured":"J. Papouvsek R. Pel\u00e1nek and V. Stanislav. 2014. Adaptive Practice of Facts in Domains with Varied Prior Knowledge Educational Data Mining. 6--13.  J. Papouvsek R. Pel\u00e1nek and V. Stanislav. 2014. Adaptive Practice of Facts in Domains with Varied Prior Knowledge Educational Data Mining. 6--13."},{"key":"e_1_3_2_1_28_1","unstructured":"Zachary A Pardos Yoav Bergner Daniel T Seaton and David E Pritchard 2013. Adapting Bayesian Knowledge Tracing to a Massive Open Online Course in edX Proc. of Educational Data Mining. 137--144.  Zachary A Pardos Yoav Bergner Daniel T Seaton and David E Pritchard 2013. Adapting Bayesian Knowledge Tracing to a Massive Open Online Course in edX Proc. of Educational Data Mining. 137--144."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207243.2207249"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Zachary A Pardos and Neil T Heffernan 2011. KT-IDEM: Introducing item difficulty to the knowledge tracing model. User Modeling Adaption and Personalization (2011) 243--254.   Zachary A Pardos and Neil T Heffernan 2011. KT-IDEM: Introducing item difficulty to the knowledge tracing model. User Modeling Adaption and Personalization (2011) 243--254.","DOI":"10.1007\/978-3-642-22362-4_21"},{"key":"e_1_3_2_1_31_1","volume-title":"Towards Moment of Learning Accuracy. In AIED 2013 Workshops Proceedings","volume":"4","author":"Pardos Zachary A","year":"2013"},{"key":"e_1_3_2_1_32_1","article-title":"Metrics for Evaluation of Student Models","volume":"7","author":"Pel\u00e1nek Radek","year":"2015","journal-title":"Journal of Educational Data Mining"},{"key":"e_1_3_2_1_33_1","unstructured":"Chris Piech Jonathan Bassen Jonathan Huang Surya Ganguli Mehran Sahami Leonidas J Guibas and Jascha Sohl-Dickstein 2015. Deep Knowledge Tracing. In Advances in Neural Information Processing Systems. 505--513.   Chris Piech Jonathan Bassen Jonathan Huang Surya Ganguli Mehran Sahami Leonidas J Guibas and Jascha Sohl-Dickstein 2015. Deep Knowledge Tracing. In Advances in Neural Information Processing Systems. 505--513."},{"volume-title":"Proc. of Educational Data Mining. 185--192","year":"2013","author":"Pedro Michael Sao","key":"e_1_3_2_1_34_1"},{"key":"e_1_3_2_1_35_1","unstructured":"Zoltan Toth Olivier Talagrand Guillem Candille and Yuejian Zhu 2003. Forecast Verification: A Practitioner's Guide in Atmospheric Science. Wiley Chapter Probability and ensemble forecasts 137--163.  Zoltan Toth Olivier Talagrand Guillem Candille and Yuejian Zhu 2003. Forecast Verification: A Practitioner's Guide in Atmospheric Science. Wiley Chapter Probability and ensemble forecasts 137--163."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Yutao Wang and Joseph Beck 2013. Class vs. Student in a Bayesian Network Student Model Artificial Intelligence in Education. Springer 151--160.  Yutao Wang and Joseph Beck 2013. Class vs. Student in a Bayesian Network Student Model Artificial Intelligence in Education. Springer 151--160.","DOI":"10.1007\/978-3-642-39112-5_16"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Yutao Wang and Neil Heffernan 2013. Extending knowledge tracing to allow partial credit: using continuous versus binary nodes Artificial Intelligence in Education. Springer 181--188.  Yutao Wang and Neil Heffernan 2013. Extending knowledge tracing to allow partial credit: using continuous versus binary nodes Artificial Intelligence in Education. Springer 181--188.","DOI":"10.1007\/978-3-642-39112-5_19"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Michael V Yudelson Kenneth R Koedinger and Geoffrey J Gordon 2013. Individualized Bayesian Knowledge Tracing Models. Artificial Intelligence in Education. Springer 171--180.  Michael V Yudelson Kenneth R Koedinger and Geoffrey J Gordon 2013. Individualized Bayesian Knowledge Tracing Models. Artificial Intelligence in Education. Springer 171--180.","DOI":"10.1007\/978-3-642-39112-5_18"}],"event":{"name":"UMAP '17: 25th Conference on User Modeling, Adaptation and Personalization","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Bratislava Slovakia","acronym":"UMAP '17"},"container-title":["Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3099023.3099042","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3099023.3099042","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:37:16Z","timestamp":1750217836000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3099023.3099042"}},"subtitle":["The Details Matter"],"short-title":[],"issued":{"date-parts":[[2017,7,9]]},"references-count":37,"alternative-id":["10.1145\/3099023.3099042","10.1145\/3099023"],"URL":"https:\/\/doi.org\/10.1145\/3099023.3099042","relation":{},"subject":[],"published":{"date-parts":[[2017,7,9]]},"assertion":[{"value":"2017-07-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}