{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T23:32:22Z","timestamp":1770593542684,"version":"3.49.0"},"reference-count":35,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2017,3,29]],"date-time":"2017-03-29T00:00:00Z","timestamp":1490745600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2017,3,29]]},"abstract":"<jats:p>Computer-based testing systems take advantage of the interaction between computers and individuals to sequentially customize the presented test items to the test-taker\u2019s ability estimate. Administering such sequential adaptive tests has many benefits including personalized tests, accurate measurement, item security, and substantial cost reduction. However, the design of such intelligent tests is a complex process and it is important to explore the impact of various parameters and options on the performance before switching from traditional tests in a particular environment. Although Monte Carlo simulation is a typical tool for achieving this purpose, it depends on generating pseudo-random samples, which may fail to effectively represent the environment under study and thus incorrect inferences can be drawn. This paper presents a comprehensive case study to evaluate and compare the performance of a number of sequential adaptive testing procedures but using post-hoc simulation, where items of a real conventional test are re-administered adaptively. The comparisons are based on the number of administered items, standard error of measurement, item exposure rates, and correlation between adaptive and non-adaptive estimates. It is found that the results varies based on the settings. However, Bayesian estimation with adaptive item selection can lead to greater savings in terms of the number of test items without jeopardizing the estimated ability. It also has the lowest average exposure rate for each item.<\/jats:p>","DOI":"10.3233\/jifs-169241","type":"journal-article","created":{"date-parts":[[2017,3,31]],"date-time":"2017-03-31T18:22:19Z","timestamp":1490984539000},"page":"2977-2986","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of sequential adaptive testing with real-data simulation: A case study"],"prefix":"10.1177","volume":"32","author":[{"given":"El-Sayed M.","family":"El-Alfy","sequence":"first","affiliation":[{"name":"Department of Information and Computer Science, College of Computer Sciences and Engineering, King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia"}]}],"member":"179","published-online":{"date-parts":[[2017,3,29]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14363-2"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1201\/b17279"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1155\/2012\/527351"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISISE.2010.100"},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","unstructured":"van der LindenW.J. and GlasC.A.W. Computerized adaptive testing: Theory and practice Kluwer Academic Publishers 2000.","DOI":"10.1007\/0-306-47531-6"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.2458\/jmm.v2i1.12351"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-014-9401-5"},{"issue":"8","key":"e_1_3_2_9_2","first-page":"1","article-title":"A review of item exposure control strategies for computerized adaptive testing developed from 1983 to 2005","volume":"5","author":"Georgiadou E.","year":"2007","unstructured":"GeorgiadouE., TriantafillouE. and EconomidesA., A review of item exposure control strategies for computerized adaptive testing developed from 1983 to 2005, Journal of Technology, Learning, and Assessment5(8) (2007), 1\u201339.","journal-title":"Journal of Technology, Learning, and Assessment"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781482276725"},{"key":"e_1_3_2_11_2","article-title":"Optimizing item exposure control algorithms for polytomous computerized adaptive tests with restricted item banks","author":"Chajewski M.","year":"2009","unstructured":"ChajewskiM. and LewisC., Optimizing item exposure control algorithms for polytomous computerized adaptive tests with restricted item banks. In Proceedings of GMAC Conference on Computerized Adaptive Testing, 2009.","journal-title":"Proceedings of GMAC Conference on Computerized Adaptive Testing"},{"key":"e_1_3_2_12_2","article-title":"Adaptive item calibration: A process for estimating item parameters within a computerized adaptive test","author":"Kingsbury G.G.","year":"2009","unstructured":"KingsburyG.G., Adaptive item calibration: A process for estimating item parameters within a computerized adaptive test. In Proceedings of GMAC Conference on Computerized Adaptive Testing, 2009.","journal-title":"Proceedings of GMAC Conference on Computerized Adaptive Testing"},{"issue":"5","key":"e_1_3_2_13_2","first-page":"1","article-title":"Computerized adaptive testing: A comparison of three content balancing methods","volume":"2","author":"Leung C.-K.","year":"2003","unstructured":"LeungC.-K., ChangH.-H. and HauK.-T., Computerized adaptive testing: A comparison of three content balancing methods, Journal of Technology, Learning and Assessment2(5) (2003), 1\u201316.","journal-title":"Journal of Technology, Learning and Assessment"},{"issue":"3","key":"e_1_3_2_14_2","first-page":"333","article-title":"Building adaptive tests using Bayesian networks","volume":"40","author":"Vomlel J.","year":"2004","unstructured":"VomlelJ., Building adaptive tests using Bayesian networks, Kybernetika40(3) (2004), 333\u2013348.","journal-title":"Kybernetika"},{"issue":"1","key":"e_1_3_2_15_2","first-page":"1","article-title":"An automatic online calibration design in adaptive testing","volume":"11","author":"Makransky G.","year":"2014","unstructured":"MakranskyG. and GlasC.A.W., An automatic online calibration design in adaptive testing, Journal of Applied Testing Technology11(1) (2014), 1\u201320.","journal-title":"Journal of Applied Testing Technology"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195377033.001.0001"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1177\/014662169401800203"},{"key":"e_1_3_2_18_2","unstructured":"Hae-OkK. Monte carlo simulation comparison of two-stage testing and computerized adaptive testing. PhD thesis The University of Nebraska - Lincoln 1993."},{"issue":"2","key":"e_1_3_2_19_2","first-page":"313","article-title":"Comparison of methods for controlling maximum exposure rates in computerized adaptive testing","volume":"21","author":"Barrada J.R.","year":"2009","unstructured":"BarradaJ.R., AbadF.J. and VeldkampB., Comparison of methods for controlling maximum exposure rates in computerized adaptive testing, Psicothema21(2) (2009), 313\u2013320.","journal-title":"Psicothema"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1177\/0013164498058004002"},{"key":"e_1_3_2_21_2","article-title":"Comparison of adaptive bayesian estimation and weighted bayesian estimation in multidimensional computerized adaptive testing","author":"Chen P.H.","year":"2009","unstructured":"ChenP.H., Comparison of adaptive bayesian estimation and weighted bayesian estimation in multidimensional computerized adaptive testing. In Proceedings of GMAC Conference on Computerized Adaptive Testing, 2009.","journal-title":"Proceedings of GMAC Conference on Computerized Adaptive Testing"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1177\/014662169602000201"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1177\/0013164497057002006"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1994.tb00446.x"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1177\/0013164402238082"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1177\/0013164407301544"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1177\/0146621604270412"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2004.11.002"},{"key":"e_1_3_2_29_2","article-title":"Kullback-Leibler information in multidimensional adaptive testing: Theory and application","author":"Wang C.","year":"2009","unstructured":"WangC. and ChangH., Kullback-Leibler information in multidimensional adaptive testing: Theory and application. In Proceedings of GMAC Conference on Computerized Adaptive Testing, 2009.","journal-title":"Proceedings of GMAC Conference on Computerized Adaptive Testing"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-61327-7_128"},{"key":"e_1_3_2_31_2","volume-title":"The basics of item response theory","author":"Baker F.B.","year":"2001","unstructured":"BakerF.B., The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation, 2 edition, 2001.","edition":"2"},{"key":"e_1_3_2_32_2","volume-title":"Fundamentals of Item Response Theory","author":"Hambleton R.K.","year":"1991","unstructured":"HambletonR.K., Fundamentals of Item Response Theory. Sage Publications, Inc, 1991."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2691-6"},{"key":"e_1_3_2_34_2","volume-title":"Applications of Item Response Theory To Practical Testing Problems","author":"Lord F.M.","year":"1980","unstructured":"LordF.M., Applications of Item Response Theory To Practical Testing Problems, Lawrence Associates, 1980."},{"key":"e_1_3_2_35_2","volume-title":"Manual for CATSim: Comprehensive Simulation of Computerized Adaptive Testing","author":"Guyer R.","year":"2010","unstructured":"GuyerR. and WeissD.J., Manual for CATSim: Comprehensive Simulation of Computerized Adaptive Testing. St. Paul MN: Assessment Systems Corporation, 2010."},{"key":"e_1_3_2_36_2","unstructured":"RudnerL.M. PARAM-3PL calibration software for the 3 parameter logistic IRT model 2005. http:\/\/edres.org\/irt\/param"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169241","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-169241","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169241","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T02:21:44Z","timestamp":1770517304000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-169241"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,29]]},"references-count":35,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,3,29]]}},"alternative-id":["10.3233\/JIFS-169241"],"URL":"https:\/\/doi.org\/10.3233\/jifs-169241","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,3,29]]}}}