{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T04:23:44Z","timestamp":1772598224966,"version":"3.50.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,5,19]],"date-time":"2020-05-19T00:00:00Z","timestamp":1589846400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,19]],"date-time":"2020-05-19T00:00:00Z","timestamp":1589846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Braz Comput Soc"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Computerized adaptive testing (CAT) based on item response theory allows more accurate assessments with fewer questions than the classic paper and pencil (P&amp;P) test. Nonetheless, the CAT construction involves some key questions that, when done properly, can further improve the accuracy and efficiency in estimating the examinees\u2019 abilities. One of the main questions is in regard to choosing the item selection rule (ISR). The classic CAT makes exclusive use of one ISR. However, these rules have differences depending on the examinees\u2019 ability level and on the CAT stage. Thus, the objective of this work is to reduce the dichotomous test size which is inserted in a classic CAT with no significant loss of accuracy in the estimation of the examinee\u2019s ability level. For this purpose, we analyze the ISR performance and then build a personalized item selection process in CAT considering the use of more than one rule. The case study in <jats:italic>Mathematics and its Technologies<\/jats:italic> test of the ENEM 2012 shows that the Kullback-Leibler information with a posterior distribution (<jats:italic>KLP<\/jats:italic>) has better performance in the examinees\u2019 ability estimation when compared with Fisher information (<jats:italic>F<\/jats:italic>), Kullback-Leibler information (<jats:italic>KL<\/jats:italic>), maximum likelihood weighted information (<jats:italic>MLWI<\/jats:italic>), and maximum posterior weighted information (<jats:italic>MPWI<\/jats:italic>) rules. Previous results in the literature show that CAT using <jats:italic>KLP<\/jats:italic> was able to reduce this test size by 46.6<jats:italic>%<\/jats:italic> from the full size of 45 items with no significant loss of accuracy in estimating the examinees\u2019 ability level. In this work, we observe that the <jats:italic>F<\/jats:italic> and the <jats:italic>MLWI<\/jats:italic> rules performed better on early CAT stages to estimate examinees\u2019 proficiency level with extreme negative and positive values, respectively. With this information, we were able to reduce the same test by 53.3<jats:italic>%<\/jats:italic> using the personalized item selection process, called ALICAT, which includes the best rules working together.<\/jats:p>","DOI":"10.1186\/s13173-020-00098-z","type":"journal-article","created":{"date-parts":[[2020,5,19]],"date-time":"2020-05-19T12:03:47Z","timestamp":1589889827000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["ALICAT: a customized approach to item selection process in computerized adaptive testing"],"prefix":"10.1186","volume":"26","author":[{"given":"Victor M.","family":"G. Jatob\u00e1","sequence":"first","affiliation":[]},{"given":"Jorge S.","family":"Farias","sequence":"additional","affiliation":[]},{"given":"Valdinei","family":"Freire","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8530-5545","authenticated-orcid":false,"given":"Andr\u00e9 S.","family":"Ruela","sequence":"additional","affiliation":[]},{"given":"Karina V.","family":"Delgado","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,5,19]]},"reference":[{"key":"98_CR1","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1007\/978-3-540-30139-4_2","volume-title":"International Conference on Intelligent Tutoring Systems","author":"E Guzm\u00e1n","year":"2004","unstructured":"Guzm\u00e1n E, Conejo R (2004) A model for student knowledge diagnosis through adaptive testing In: International Conference on Intelligent Tutoring Systems, 12\u201321.. Springer, Berlin."},{"issue":"1","key":"98_CR2","first-page":"55","volume":"4","author":"E Kovatcheva","year":"2009","unstructured":"Kovatcheva E, Nikolov R (2009) An adaptive feedback approach for e-learning systems. IEEE Technol Eng Educ(ITEE) 4(1):55\u201357.","journal-title":"IEEE Technol Eng Educ(ITEE)"},{"issue":"3","key":"98_CR3","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1016\/j.compedu.2010.04.015","volume":"55","author":"J L\u00f3pez-Cuadrado","year":"2010","unstructured":"L\u00f3pez-Cuadrado J, P\u00e9rez TA, Vadillo J. \u00c1., Guti\u00e9rrez J (2010) Calibration of an item bank for the assessment of Basque language knowledge. Comput Educ 55(3):1044\u20131055.","journal-title":"Comput Educ"},{"key":"98_CR4","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-3-642-14657-2_4","volume-title":"Hybrid learning","author":"K Wong","year":"2010","unstructured":"Wong K, Leung K, Kwan R, Tsang P (2010) E-learning: developing a simple web-based intelligent tutoring system using cognitive diagnostic assessment and adaptive testing technology. In: Tsang P, Cheung SKS, Lee VSK, Huang R (eds)Hybrid learning, 23\u201334.. Springer, Berlin, Heidelberg."},{"key":"98_CR5","unstructured":"de Andrade DF, Tavares HR, da Cunha Valle R (2000) Teoria da resposta ao item: conceitos e aplica\u00e7\u00f5es. ABE - Associa\u00e7\u00e3o Brasileira de Estat\u00edstica, S\u00e3o Paulo."},{"key":"98_CR6","unstructured":"Instituto Nacional de Educa\u00e7\u00e3o e Pesquisas Educacionais An\u00edsio Teixeira Entenda sua nota no ENEM (2013). http:\/\/download.inep.gov.br\/educacao_basica\/enem\/guia_participante\/2013\/guia_do_participante_notas.pdf. Accessed: 29 Mar 2017."},{"issue":"3","key":"98_CR7","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.compedu.2004.01.006","volume":"44","author":"C-M Chen","year":"2005","unstructured":"Chen C-M, Lee H-M, Chen Y-H (2005) Personalized e-learning system using item response theory. Comput Educ 44(3):237\u2013255.","journal-title":"Comput Educ"},{"issue":"4","key":"98_CR8","doi-asserted-by":"crossref","first-page":"439","DOI":"10.3102\/10769986029004439","volume":"29","author":"DO Segall","year":"2004","unstructured":"Segall DO (2004) A sharing item response theory model for computerized adaptive testing. J Educ Behav Stat 29(4):439\u2013460.","journal-title":"J Educ Behav Stat"},{"key":"98_CR9","doi-asserted-by":"crossref","DOI":"10.4324\/9781410605931","volume-title":"Computerized adaptive testing","author":"H Wainer","year":"2000","unstructured":"Wainer H (2000) Computerized adaptive testing. Routledge, New York, NY."},{"key":"98_CR10","unstructured":"Bernes-Lee T (2006) Linked data - design issues. http:\/\/www.w3.org\/DesignIssues\/LinkedData.html. Accessed 4 Dec 2018."},{"issue":"2","key":"98_CR11","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1111\/j.1745-3984.2004.tb01112.x","volume":"41","author":"S-Y Chen","year":"2004","unstructured":"Chen S-Y, Ankenman RD (2004) Effects of practical constraints on item selection rules at the early stages of computerized adaptive testing. J Educ Meas 41(2):149\u2013174.","journal-title":"J Educ Meas"},{"issue":"3","key":"98_CR12","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1177\/01466210022031705","volume":"24","author":"S-Y Chen","year":"2000","unstructured":"Chen S-Y, Ankenmann RD, Chang H-H (2000) A comparison of item selection rules at the early stages of computerized adaptive testing. Appl Psychol Meas 24(3):241\u2013255.","journal-title":"Appl Psychol Meas"},{"issue":"2","key":"98_CR13","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1348\/000711007X230937","volume":"61","author":"JR Barrada","year":"2008","unstructured":"Barrada JR, Olea J, Ponsoda V, Abad FJ (2008) Incorporating randomness in the Fisher information for improving item-exposure control in cats. Br J Math Stat Psychol 61(2):493\u2013513.","journal-title":"Br J Math Stat Psychol"},{"issue":"3","key":"98_CR14","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1111\/j.1745-3984.2011.00145.x","volume":"48","author":"C Wang","year":"2011","unstructured":"Wang C, Chang H-H, Huebner A (2011) Restrictive stochastic item selection methods in cognitive diagnostic computerized adaptive testing. J Educ Meas 48(3):255\u2013273.","journal-title":"J Educ Meas"},{"key":"98_CR15","volume-title":"Tests adaptativos informatizados Editora UNED AULA","author":"J Olea Diaz","year":"2013","unstructured":"Olea Diaz J, Ponsoda V (2013) Tests adaptativos informatizados Editora UNED AULA. ABIERTA, Spain."},{"issue":"12","key":"98_CR16","doi-asserted-by":"crossref","first-page":"3890","DOI":"10.1109\/TLA.2015.7404924","volume":"13","author":"D Spenassato","year":"2015","unstructured":"Spenassato D, Bornia AC, Tezza R (2015) Computerized adaptive testing: a review of research and technical characteristics. IEEE Lat Am Trans 13(12):3890\u20133898.","journal-title":"IEEE Lat Am Trans"},{"issue":"1","key":"98_CR17","first-page":"1","volume":"16","author":"NA Thompson","year":"2011","unstructured":"Thompson NA, Weiss DJ (2011) A framework for the development of computerized adaptive tests. Pract Assess Res Eval 16(1):1\u20139.","journal-title":"Pract Assess Res Eval"},{"issue":"4","key":"98_CR18","first-page":"80","volume":"10","author":"M Al-A\u2019Ali","year":"2007","unstructured":"Al-A\u2019Ali M (2007) Implementation of an improved adaptive testing theory. Educ Technol Soc 10(4):80\u201394.","journal-title":"Educ Technol Soc"},{"key":"98_CR19","first-page":"237","volume-title":"New horizons in testing: latent trait test theory and computerized adaptive testing","author":"MD Reckase","year":"1983","unstructured":"Reckase MD, Weiss D (1983) A procedure for decision making using tailored testing In: New horizons in testing: latent trait test theory and computerized adaptive testing, 237\u2013255.. Academic Press, San Diego."},{"key":"98_CR20","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1007\/3-540-61327-7_156","volume-title":"International conference on intelligent tutoring systems","author":"JA Collins","year":"1996","unstructured":"Collins JA, Greer JE, Huang SX (1996) Adaptive assessment using granularity hierarchies and Bayesian nets In: International conference on intelligent tutoring systems, 569\u2013577.. Springer, Berlin."},{"key":"98_CR21","unstructured":"Rudner LM (2002) An examination of decision-theory adaptive testing procedures In: Annual Meeting of the American Educational Research Association, 1\u201314, New Orleans."},{"key":"98_CR22","unstructured":"Hambleton RK, Swaminathan H, Rogers HJ (1991) Fundamentals of item response theory. Sage, Newbury Park, California."},{"key":"98_CR23","unstructured":"Galvao AF, Neto RF, Borges CCH (2013) Um modelo inteligente para sele\u00e7\u00e3o de itens em testes adaptativos computadorizados. Master\u2019s thesis. Universidade Federal de Juiz de Fora (UFJF), Brazil."},{"issue":"5","key":"98_CR24","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1177\/00131640021970862","volume":"60","author":"T Eggen","year":"2000","unstructured":"Eggen T, Straetmans G (2000) Computerized adaptive testing for classifying examinees into three categories. Educ Psychol Meas 60(5):713\u2013734.","journal-title":"Educ Psychol Meas"},{"issue":"4","key":"98_CR25","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1177\/014662102237796","volume":"26","author":"P Van Rijn","year":"2002","unstructured":"Van Rijn P, Eggen T, Hemker B, Sanders P (2002) Evaluation of selection procedures for computerized adaptive testing with polytomous items. Appl Psychol Meas 26(4):393\u2013411.","journal-title":"Appl Psychol Meas"},{"key":"98_CR26","unstructured":"Butterfield MS (2016) Comparing item selection methods in computerized adaptive testing using the rating scale model. PhD thesis."},{"key":"98_CR27","volume-title":"Applications of item response theory to practical testing problems","author":"FM Lord","year":"1980","unstructured":"Lord FM (1980) Applications of item response theory to practical testing problems. Routledge, New York, NY."},{"issue":"3","key":"98_CR28","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1177\/014662169602000303","volume":"20","author":"H-H Chang","year":"1996","unstructured":"Chang H-H, Ying Z (1996) A global information approach to computerized adaptive testing. Appl Psychol Meas 20(3):213\u2013229.","journal-title":"Appl Psychol Meas"},{"key":"98_CR29","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-0-387-85461-8_1","volume-title":"Elements of adaptive testing","author":"WJV der Linden","year":"2009","unstructured":"der Linden WJV, Pashley PJ (2009) Item selection and ability estimation in adaptive testing In: Elements of adaptive testing, 3\u201330.. Springer, New York, NY."},{"issue":"2","key":"98_CR30","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/BF02294775","volume":"63","author":"WJ van der Linden","year":"1998","unstructured":"van der Linden WJ (1998) Bayesian item selection criteria for adaptive testing. Psychometrika 63(2):201\u2013216.","journal-title":"Psychometrika"},{"issue":"2","key":"98_CR31","doi-asserted-by":"crossref","first-page":"203","DOI":"10.3102\/10769986022002203","volume":"22","author":"WJ Veerkamp","year":"1997","unstructured":"Veerkamp WJ, Berger MP (1997) Some new item selection criteria for adaptive testing. J Educ Behav Stat 22(2):203\u2013226.","journal-title":"J Educ Behav Stat"},{"issue":"4","key":"98_CR32","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1177\/014662168200600405","volume":"6","author":"RD Bock","year":"1982","unstructured":"Bock RD, Mislevy RJ (1982) Adaptive EAP estimation of ability in a microcomputer environment. Appl Psychol Meas 6(4):431\u2013444. https:\/\/doi.org\/10.1177\/014662168200600405.","journal-title":"Appl Psychol Meas"},{"issue":"87","key":"98_CR33","first-page":"389","volume":"23","author":"JP Gon\u00e7alves","year":"2015","unstructured":"Gon\u00e7alves JP, Alu\u00edsio SM (2015) Teste adaptativo computadorizado multidimensional com prop\u00f3sitos educacionais: Princ\u00edpios e m\u00e9todos. Rev Ensaio: Avalia\u00e7\u00e3o e Pol\u00edticas P\u00fablicas em Educa\u00e7\u00e3o 23(87):389\u2013414.","journal-title":"Rev Ensaio: Avalia\u00e7\u00e3o e Pol\u00edticas P\u00fablicas em Educa\u00e7\u00e3o"},{"key":"98_CR34","unstructured":"Costa CES (2015) An\u00e1lise da dimensionalidade e modelagem multidimensional pela tri no enem (1998-2008). PhD thesis, Universidade Federal de Santa Catarina."},{"key":"98_CR35","first-page":"67","volume":"33","author":"GG Andrade","year":"2012","unstructured":"Andrade GG (2012) A metodologia do enem: uma reflex\u00e3o. S\u00e9rie-Estudos-Peri\u00f3dico do Programa de P\u00f3s-Gradua\u00e7\u00e3o em Educa\u00e7\u00e3o da UCDB 33:67\u201376.","journal-title":"S\u00e9rie-Estudos-Peri\u00f3dico do Programa de P\u00f3s-Gradua\u00e7\u00e3o em Educa\u00e7\u00e3o da UCDB"},{"key":"98_CR36","unstructured":"(2016) Instituto Nacional de Estudos e Pesquisas Educacionais An\u00edsio Teixeira: Microdados do ENEM. Bras\u00edlia: Inep, 2016. http:\/\/portal.inep.gov.br\/basica-levantamentos-acessar. Accessed: 29 Mar 2017."},{"issue":"2","key":"98_CR37","first-page":"1","volume":"24","author":"D Spenassato","year":"2016","unstructured":"Spenassato D, Trierweiller AC, de Andrade DF, Bornia AC (2016) Testes adaptativos computadorizados aplicados em avalia\u00e7\u00f5es educacionais. Rev Bras de Informatica na Educa\u00e7\u00e3o 24(2):1\u201312.","journal-title":"Rev Bras de Informatica na Educa\u00e7\u00e3o"},{"key":"98_CR38","unstructured":"Hanson BA (2002) IRT command language. http:\/\/www.openirt.com\/b-a-h\/software\/irt\/icl\/. Accessed 4 Dec 2018."},{"issue":"8","key":"98_CR39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v048.i08","volume":"48","author":"D Magis","year":"2012","unstructured":"Magis D, Ra\u00eeche G, et al (2012) Random generation of response patterns under computerized adaptive testing with the R package catR. J Stat Softw 48(8):1\u201331.","journal-title":"J Stat Softw"},{"key":"98_CR40","doi-asserted-by":"crossref","unstructured":"Jatob\u00e1 V, Delgado KV, Farias J, Freire V (2018) Compara\u00e7\u00e3o de regras de sele\u00e7\u00e3o de itens em testes adaptativos computadorizados: um estudo de caso no enem In: Proceedings of the Brazilian Symposium on Computers in Education, 1453\u20131462, Fortaleza.","DOI":"10.5753\/cbie.sbie.2018.1453"}],"container-title":["Journal of the Brazilian Computer Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13173-020-00098-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13173-020-00098-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13173-020-00098-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,13]],"date-time":"2024-08-13T10:46:09Z","timestamp":1723545969000},"score":1,"resource":{"primary":{"URL":"https:\/\/journal-bcs.springeropen.com\/articles\/10.1186\/s13173-020-00098-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,19]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["98"],"URL":"https:\/\/doi.org\/10.1186\/s13173-020-00098-z","relation":{},"ISSN":["0104-6500","1678-4804"],"issn-type":[{"value":"0104-6500","type":"print"},{"value":"1678-4804","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,19]]},"assertion":[{"value":"4 January 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 May 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"4"}}