{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T18:51:45Z","timestamp":1776883905637,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,21]]},"DOI":"10.1145\/3583780.3615455","type":"proceedings-article","created":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T07:45:42Z","timestamp":1697874342000},"page":"4674-4680","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Addressing Selection Bias in Computerized Adaptive Testing: A User-Wise Aggregate Influence Function Approach"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1764-3128","authenticated-orcid":false,"given":"Soonwoo","family":"Kwon","sequence":"first","affiliation":[{"name":"Riiid AI Research, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4585-3587","authenticated-orcid":false,"given":"Sojung","family":"Kim","sequence":"additional","affiliation":[{"name":"Riiid AI Research, Seoul, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2082-9091","authenticated-orcid":false,"given":"Seunghyun","family":"Lee","sequence":"additional","affiliation":[{"name":"Riiid AI Research, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9106-2922","authenticated-orcid":false,"given":"Jin-Young","family":"Kim","sequence":"additional","affiliation":[{"name":"Riiid AI Research, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6535-1943","authenticated-orcid":false,"given":"Suyeong","family":"An","sequence":"additional","affiliation":[{"name":"Riiid AI Research, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2369-6335","authenticated-orcid":false,"given":"Kyuseok","family":"Kim","sequence":"additional","affiliation":[{"name":"Riiid AI Research, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,21]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Quality Meets Diversity: A Model-Agnostic Framework for Computerized Adaptive Testing. In 2020 IEEE International Conference on Data Mining (ICDM). IEEE Computer Society","author":"Bi H.","unstructured":"H. Bi , H. Ma , Z. Huang , Y. Yin , Q. Liu , E. Chen , Y. Su , and S. Wang . 2020 . Quality Meets Diversity: A Model-Agnostic Framework for Computerized Adaptive Testing. In 2020 IEEE International Conference on Data Mining (ICDM). IEEE Computer Society , Los Alamitos, CA, USA, 42--51. H. Bi, H. Ma, Z. Huang, Y. Yin, Q. Liu, E. Chen, Y. Su, and S. Wang. 2020. Quality Meets Diversity: A Model-Agnostic Framework for Computerized Adaptive Testing. In 2020 IEEE International Conference on Data Mining (ICDM). IEEE Computer Society, Los Alamitos, CA, USA, 42--51."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662169602000303"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3564284"},{"key":"e_1_3_2_1_4_1","volume-title":"Development of Adaptive Formative Assessment System Using Computerized Adaptive Testing and Dynamic Bayesian Networks. Applied Sciences 10, 22","author":"Choi Younyoung","year":"2020","unstructured":"Younyoung Choi and Cayce McClenen . 2020. Development of Adaptive Formative Assessment System Using Computerized Adaptive Testing and Dynamic Bayesian Networks. Applied Sciences 10, 22 ( 2020 ). Younyoung Choi and Cayce McClenen. 2020. Development of Adaptive Formative Assessment System Using Computerized Adaptive Testing and Dynamic Bayesian Networks. Applied Sciences 10, 22 (2020)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/332"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1974.10482962"},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning (ICML'17)","author":"Koh Pang Wei","year":"2017","unstructured":"Pang Wei Koh and Percy Liang . 2017 . Understanding Black-Box Predictions via Influence Functions . In Proceedings of the 34th International Conference on Machine Learning (ICML'17) . Article 70 , 1885--1894 pages. Pang Wei Koh and Percy Liang. 2017. Understanding Black-Box Predictions via Influence Functions. In Proceedings of the 34th International Conference on Machine Learning (ICML'17). Article 70, 1885--1894 pages."},{"key":"e_1_3_2_1_8_1","volume-title":"Garnett (Eds.)","volume":"32","author":"Koh Pang Wei W","year":"2019","unstructured":"Pang Wei W Koh , Kai-Siang Ang , Hubert Teo , and Percy S Liang . 2019 . On the Accuracy of Influence Functions for Measuring Group Effects. In Advances in Neural Information Processing Systems, H.Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R . Garnett (Eds.) , Vol. 32 . Curran Associates, Inc. Pang Wei W Koh, Kai-Siang Ang, Hubert Teo, and Percy S Liang. 2019. On the Accuracy of Influence Functions for Measuring Group Effects. In Advances in Neural Information Processing Systems, H.Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc."},{"key":"e_1_3_2_1_9_1","unstructured":"Wim J. Linden and Gees A.W. Glas (Eds.). 2000. Computerized Adaptive Testing: Theory and Practice. Springer Dordrecht.  Wim J. Linden and Gees A.W. Glas (Eds.). 2000. Computerized Adaptive Testing: Theory and Practice. Springer Dordrecht."},{"key":"e_1_3_2_1_10_1","volume-title":"Applications of Item Response Theory To Practical Testing Problems (1st. ed.)","author":"Lord F.M.","unstructured":"F.M. Lord . 1980. Applications of Item Response Theory To Practical Testing Problems (1st. ed.) . Routledge . F.M. Lord. 1980. Applications of Item Response Theory To Practical Testing Problems (1st. ed.). Routledge."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380255"},{"key":"e_1_3_2_1_12_1","volume-title":"Handbook of item response theory modeling","author":"Reise Steven P","unstructured":"Steven P Reise and Dennis A Revicki . 2014. Handbook of item response theory modeling . Taylor & Francis New York . Steven P Reise and Dennis A Revicki. 2014. Handbook of item response theory modeling. Taylor & Francis New York."},{"key":"e_1_3_2_1_13_1","volume-title":"Machine Learning-- Driven Language Assessment. Transactions of the Association for Computational Linguistics 8 (04","author":"Settles Burr","year":"2020","unstructured":"Burr Settles , Geoffrey T. LaFlair , and Masato Hagiwara . 2020. Machine Learning-- Driven Language Assessment. Transactions of the Association for Computational Linguistics 8 (04 2020 ), 247--263. Burr Settles, Geoffrey T. LaFlair, and Masato Hagiwara. 2020. Machine Learning-- Driven Language Assessment. Transactions of the Association for Computational Linguistics 8 (04 2020), 247--263."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of The 25th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research","volume":"17","author":"Silva Andrew","year":"2022","unstructured":"Andrew Silva , Rohit Chopra , and Matthew Gombolay . 2022 . Cross-Loss Influence Functions to Explain Deep Network Representations . In Proceedings of The 25th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research , Vol. 151), Gustau Camps-Valls, Francisco J. R. Ruiz, and Isabel Valera (Eds.). PMLR, 1-- 17 . Andrew Silva, Rohit Chopra, and Matthew Gombolay. 2022. Cross-Loss Influence Functions to Explain Deep Network Representations. In Proceedings of The 25th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research, Vol. 151), Gustau Camps-Valls, Francisco J. R. Ruiz, and Isabel Valera (Eds.). PMLR, 1--17."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-011-9215-7"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-010-9186-0"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441799"},{"key":"e_1_3_2_1_18_1","volume-title":"Richard E Turner, Richard G Baraniuk, Craig Barton, Simon Peyton Jones, et al.","author":"Lamb Angus","year":"2020","unstructured":"ZichaoWang, Angus Lamb , Evgeny Saveliev , Pashmina Cameron , Yordan Zaykov , Jos\u00e9 Miguel Hern\u00e1ndez-Lobato , Richard E Turner, Richard G Baraniuk, Craig Barton, Simon Peyton Jones, et al. 2020 . Instructions and guide for diagnostic questions: The neurips 2020 education challenge. arXiv preprint arXiv:2007.12061 (2020). ZichaoWang, Angus Lamb, Evgeny Saveliev, Pashmina Cameron, Yordan Zaykov, Jos\u00e9 Miguel Hern\u00e1ndez-Lobato, Richard E Turner, Richard G Baraniuk, Craig Barton, Simon Peyton Jones, et al. 2020. Instructions and guide for diagnostic questions: The neurips 2020 education challenge. arXiv preprint arXiv:2007.12061 (2020)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662168200600408"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1984.tb01040.x"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2022.100104"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146621612455687"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401321"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531928"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i4.20399"}],"event":{"name":"CIKM '23: The 32nd ACM International Conference on Information and Knowledge Management","location":"Birmingham United Kingdom","acronym":"CIKM '23","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 32nd ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615455","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3583780.3615455","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:54Z","timestamp":1750178214000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615455"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,21]]},"references-count":25,"alternative-id":["10.1145\/3583780.3615455","10.1145\/3583780"],"URL":"https:\/\/doi.org\/10.1145\/3583780.3615455","relation":{},"subject":[],"published":{"date-parts":[[2023,10,21]]},"assertion":[{"value":"2023-10-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}