01395nas a2200181 4500008004500000022001400045245008700059210006900146490000700215520080200222653003401024653002501058653001901083653001901102653001601121100002101137856005501158 2024 Engldsh  a2165-659200aThe Influence of Computerized Adaptive Testing on Psychometric Theory and Practice0 aInfluence of Computerized Adaptive Testing on Psychometric Theor0 v113 a

The major premise of this article is that part of the stimulus for the evolution of psychometric theory since the 1950s was the introduction of the concept of computerized adaptive testing (CAT) or its earlier non-CAT variations. The conceptual underpinnings of CAT that had the most influence on psychometric theory was the shift of emphasis from the test (or test score) as the focus of analysis to the test item (or item score). The change in focus allowed a change in the way that test results are conceived of as measurements. It also resolved the conflict among a number of ideas that were present in the early work on psychometric theory. Some of the conflicting ideas are summarized below to show how work on the development of CAT resolved some of those conflicts.

 

10acomputerized adaptive testing10aItem Response Theory10aparadigm shift10ascaling theory10atest design1 aReckase, Mark, D uhttps://jcatpub.net/index.php/jcat/issue/view/34/901730nas a2200133 4500008003900000245008300039210006900122300001200191490000700203520130000210100001201510700002101522856005301543 2014 d00aItem Pool Design for an Operational Variable-Length Computerized Adaptive Test0 aItem Pool Design for an Operational VariableLength Computerized  a473-4940 v743 a

For computerized adaptive tests (CATs) to work well, they must have an item pool with sufficient numbers of good quality items. Many researchers have pointed out that, in developing item pools for CATs, not only is the item pool size important but also the distribution of item parameters and practical considerations such as content distribution and item exposure issues. Yet, there is little research on how to design item pools to have those desirable features. The research reported in this article provided step-by-step hands-on guidance on the item pool design process by applying the bin-and-union method to design item pools for a large-scale licensure CAT employing complex adaptive testing algorithm with variable test length, a decision based on stopping rule, content balancing, and exposure control. The design process involved extensive simulations to identify several alternative item pool designs and evaluate their performance against a series of criteria. The design output included the desired item pool size and item parameter distribution. The results indicate that the mechanism used to identify the desirable item pool features functions well and that two recommended item pool designs would support satisfactory performance of the operational testing program.

1 aHe, Wei1 aReckase, Mark, D uhttp://epm.sagepub.com/content/74/3/473.abstract00460nas a2200121 4500008003900000245009100039210007600130300001200206490000600218100002800224700002100252856006500273 2007 d00aA “Rearrangement Procedure” For Scoring Adaptive Tests with Review Options0 a“Rearrangement Procedure†For Scoring Adaptive Tests with Rev a387-4070 v71 aPapanastasiou, Elena, C1 aReckase, Mark, D uhttp://www.tandfonline.com/doi/abs/10.1080/15305050701632262