00617nas a2200121 4500008004100000245012600041210006900167260009700236100001100333700001700344700001400361856012000375 2009 eng d00aAn evaluation of a new procedure for computing information functions for Bayesian scores from computerized adaptive tests0 aevaluation of a new procedure for computing information function aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aIto, K1 aPommerich, M1 aSegall, D uhttp://mail.iacat.org/content/evaluation-new-procedure-computing-information-functions-bayesian-scores-computerized02157nas a2200133 4500008004100000245012000041210006900161300000900230490000600239520162500245653001701870100001701887856011901904 2007 eng d00aThe effect of using item parameters calibrated from paper administrations in computer adaptive test administrations0 aeffect of using item parameters calibrated from paper administra a1-290 v53 aComputer administered tests are becoming increasingly prevalent as computer technology becomes more readily available on a large scale. For testing programs that utilize both computer and paper administrations, mode effects are problematic in that they can result in examinee scores that are artificially inflated or deflated. As such, researchers have engaged in extensive studies of whether scores differ across paper and computer presentations of the same tests. The research generally seems to indicate that the more complicated it is to present or take a test on computer, the greater the possibility of mode effects. In a computer adaptive test, mode effects may be a particular concern if items are calibrated using item responses obtained from one administration mode (i.e., paper), and those parameters are then used operationally in a different administration mode (i.e., computer). This paper studies the suitability of using parameters calibrated from a paper administration for item selection and scoring in a computer adaptive administration, for two tests with lengthy passages that required navigation in the computer administration. The results showed that the use of paper calibrated parameters versus computer calibrated parameters in computer adaptive administrations had small to moderate effects on the reliability of examinee scores, at fairly short test lengths. This effect was generally diminished for longer test lengths. However, the results suggest that in some cases, some loss in reliability might be inevitable if paper-calibrated parameters are used in computer adaptive administrations.10aMode effects1 aPommerich, M uhttp://mail.iacat.org/content/effect-using-item-parameters-calibrated-paper-administrations-computer-adaptive-test02154nas a2200109 4500008003900000245012000039210006900159490000600228520167200234100001701906856012101923 2007 d00aThe Effect of Using Item Parameters Calibrated from Paper Administrations in Computer Adaptive Test Administrations0 aEffect of Using Item Parameters Calibrated from Paper Administra0 v53 a

Computer administered tests are becoming increasingly prevalent as computer technology becomes more readily available on a large scale. For testing programs that utilize both computer and paper administrations, mode effects are problematic in that they can
result in examinee scores that are artificially inflated or deflated. As such, researchers have engaged in extensive studies of whether scores differ across paper and computer presentations of the same tests. The research generally seems to indicate that the more
complicated it is to present or take a test on computer, the greater the possibility of mode effects. In a computer adaptive test, mode effects may be a particular concern if items are calibrated using item responses obtained from one administration mode (i.e., paper), and those parameters are then used operationally in a different administration mode (i.e., computer). This paper studies the suitability of using parameters calibrated from a paper administration for item selection and scoring in a computer adaptive administration, for two tests with lengthy passages that required navigation in the computer administration. The results showed that the use of paper calibrated parameters versus computer calibrated parameters in computer adaptive administrations had small to
moderate effects on the reliability of examinee scores, at fairly short test lengths. This effect was generally diminished for longer test lengths. However, the results suggest that in some cases, some loss in reliability might be inevitable if paper-calibrated parameters
are used in computer adaptive administrations. 

1 aPommerich, M uhttp://mail.iacat.org/content/effect-using-item-parameters-calibrated-paper-administrations-computer-adaptive-test-000479nas a2200109 4500008004100000245009900041210006900140260001500209100001400224700001700238856011400255 2001 eng d00aAn examination of item review on a CAT using the specific information item selection algorithm0 aexamination of item review on a CAT using the specific informati aSeattle WA1 aBowles, R1 aPommerich, M uhttp://mail.iacat.org/content/examination-item-review-cat-using-specific-information-item-selection-algorithm00481nas a2200109 4500008004100000245009900041210006900140260001500209100001400224700001700238856011600255 2001 eng d00aAn examination of item review on a CAT using the specific information item selection algorithm0 aexamination of item review on a CAT using the specific informati aSeattle WA1 aBowles, R1 aPommerich, M uhttp://mail.iacat.org/content/examination-item-review-cat-using-specific-information-item-selection-algorithm-0