02155nas a2200145 4500008004100000245005100041210005100092260005500143520166100198653002301859653002001882100001901902700001301921856007501934 2017 eng d00aItem Parameter Drifting and Online Calibration0 aItem Parameter Drifting and Online Calibration aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Item calibration is a part of the most important topics in item response theory (IRT). Since many largescale testing programs have switched from paper and pencil (P&P) testing mode to computerized adaptive testing (CAT) mode, developing methods for efficiently calibrating new items have become vital. Among many proposed item calibration processes in CAT, online calibration is the most cost-effective. This presentation introduces an online (re)calibration design to detect item parameter drift for computerized adaptive testing (CAT) in both unidimensional and multidimensional environments. Specifically, for online calibration optimal design in unidimensional computerized adaptive testing model, a two-stage design is proposed by implementing a proportional density index algorithm. For a multidimensional computerized adaptive testing model, a four-quadrant online calibration pretest item selection design with proportional density index algorithm is proposed. Comparisons were made between different online calibration item selection strategies. Results showed that under unidimensional computerized adaptive testing, the proposed modified two-stage item selection criterion with the proportional density algorithm outperformed the other existing methods in terms of item parameter calibration and item parameter drift detection, and under multidimensional computerized adaptive testing, the online (re)calibration technique with the proposed four-quadrant item selection design with proportional density index outperformed other methods.

Session Video

10aonline calibration10aParameter Drift1 aChang, Hua-Hua1 aGuo, Rui uhttp://mail.iacat.org/item-parameter-drifting-and-online-calibration-0