01538nas a2200169 4500008004200000245012100042210006900163520094900232100001801181700001701199700002501216700001801241700002201259700002201281700002001303856004501323 In Press d 00aDevelopment of a Computerized Adaptive Test for Anxiety Based on the Dutch–Flemish Version of the PROMIS Item Bank0 aDevelopment of a Computerized Adaptive Test for Anxiety Based on3 aWe used the Dutch–Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample (N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch–Flemish version of the PROMIS Anxiety item bank.1 aFlens, Gerard1 aSmits, Niels1 aTerwee, Caroline, B.1 aDekker, Joost1 aHuijbrechts, Irma1 aSpinhoven, Philip1 ade Beurs, Edwin uhttps://doi.org/10.1177/107319111774674201609nas a2200205 4500008004500000022001400045245005000059210004900109300001000158490000600168520099300174653003501167653003401202653002301236653001901259653002701278100002301305700001501328856006001343 2019 Engldsh  a2165-659200aTime-Efficient Adaptive Measurement of Change0 aTimeEfficient Adaptive Measurement of Change a15-340 v73 a

The adaptive measurement of change (AMC) refers to the use of computerized adaptive testing (CAT) at multiple occasions to efficiently assess a respondent’s improvement, decline, or sameness from occasion to occasion. Whereas previous AMC research focused on administering the most informative item to a respondent at each stage of testing, the current research proposes the use of Fisher information per time unit as an item selection procedure for AMC. The latter procedure incorporates not only the amount of information provided by a given item but also the expected amount of time required to complete it. In a simulation study, the use of Fisher information per time unit item selection resulted in a lower false positive rate in the majority of conditions studied, and a higher true positive rate in all conditions studied, compared to item selection via Fisher information without accounting for the expected time taken. Future directions of research are suggested.

10aadaptive measurement of change10acomputerized adaptive testing10aFisher information10aitem selection10aresponse-time modeling1 aFinkelman, Matthew1 aWang, Chun uhttp://iacat.org/jcat/index.php/jcat/article/view/73/3500515nas a2200133 4500008003900000245012900039210006900168300000900237490000600246100001800252700002700270700002400297856006000321 2018 d00aFactors Affecting the Classification Accuracy and Average Length of a Variable-Length Cognitive Diagnostic Computerized Test0 aFactors Affecting the Classification Accuracy and Average Length a1-140 v61 aHuebner, Alan1 aFinkelman, Matthew, D.1 aWeissman, Alexander uhttp://iacat.org/jcat/index.php/jcat/article/view/55/3000444nas a2200145 4500008004500000245005100045210005100096260001200147300001000159490000600169100002200175700001800197700002300215856006000238 2018 Engldsh 00aImplementing Three CATs Within Eighteen Months0 aImplementing Three CATs Within Eighteen Months c09/2018 a38-550 v61 aSpoden, Christian1 aFrey, Andreas1 aBernhardt, Raphael uhttp://iacat.org/jcat/index.php/jcat/article/view/70/3301532nas a2200169 4500008003900000245007100039210006900110300001200179490000700191520103000198100001601228700001801244700001801262700001801280700001901298856004501317 2018 d00aLatent Class Analysis of Recurrent Events in Problem-Solving Items0 aLatent Class Analysis of Recurrent Events in ProblemSolving Item a478-4980 v423 aComputer-based assessment of complex problem-solving abilities is becoming more and more popular. In such an assessment, the entire problem-solving process of an examinee is recorded, providing detailed information about the individual, such as behavioral patterns, speed, and learning trajectory. The problem-solving processes are recorded in a computer log file which is a time-stamped documentation of events related to task completion. As opposed to cross-sectional response data from traditional tests, process data in log files are massive and irregularly structured, calling for effective exploratory data analysis methods. Motivated by a specific complex problem-solving item “Climate Control” in the 2012 Programme for International Student Assessment, the authors propose a latent class analysis approach to analyzing the events occurred in the problem-solving processes. The exploratory latent class analysis yields meaningful latent classes. Simulation studies are conducted to evaluate the proposed approach.1 aXu, Haochen1 aFang, Guanhua1 aChen, Yunxiao1 aLiu, Jingchen1 aYing, Zhiliang uhttps://doi.org/10.1177/014662161774832505519nas a2200193 4500008004100000245009000041210006900131260005500200520480200255653002305057653001905080653002105099653002605120100002205146700002005168700001605188700001905204856010205223 2017 eng d00aAdaptive Item and Feedback Selection in Personalized Learning with a Network Approach0 aAdaptive Item and Feedback Selection in Personalized Learning wi aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Personalized learning is a term used to describe educational systems that adapt student-specific curriculum sequencing, pacing, and presentation based on their unique backgrounds, knowledge, preferences, interests, and learning goals. (Chen, 2008; Netcoh, 2016). The technological approach to personalized learning provides data-driven models to incorporate these adaptations automatically. Examples of applications include online learning systems, educational games, and revision-aid systems. In this study we introduce Bayesian networks as a methodology to implement an adaptive framework within a personalized learning environment. Existing ideas from Computerized Adaptive Testing (CAT) with Item Response Theory (IRT), where choices about content provision are based on maximizing information, are related to the goals of personalized learning environments. Personalized learning entails other goals besides efficient ability estimation by maximizing information, such as an adaptive configuration of preferences and feedback to the student. These considerations will be discussed and their application in networks will be illustrated.

Adaptivity in Personalized Learning.In standard CAT’s there is a focus on selecting items that provide maximum information about the ability of an individual at a certain point in time (Van der Linden & Glas, 2000). When learning is the main goal of testing, alternative adaptive item selection methods were explored by Eggen (2012). The adaptive choices made in personalized learning applications require additional adaptivity with respect to the following aspects; the moment of feedback, the kind of feedback, and the possibility for students to actively influence the learning process.

Bayesian Networks and Personalized Learning.Personalized learning aims at constructing a framework to incorporate all the aspects mentioned above. Therefore, the goal of this framework is not only to focus on retrieving ability estimates by choosing items on maximum information, but also to construct a framework that allows for these other factors to play a role. Plajner and Vomlel (2016) have already applied Bayesian Networks to adaptive testing, selecting items with help of entropy reduction. Almond et al. (2015) provide a reference work on Bayesian Networks in Educational Assessment. Both acknowledge the potential of the method in terms of features such as modularity options to build finer-grained models. IRT does not allow to model sub-skills very easily and to gather information on fine-grained level, due to its dependency on the assumption of generally one underlying trait. The local independence assumption in IRT implies being interested in mainly the student’s overall ability on the subject of interest. When the goal is to improve student’s learning, we are not just interested in efficiently coming to their test score on a global subject. One wants a model that is able to map educational problems and talents in detail over the whole educational program, while allowing for dependency between items. The moment in time can influence topics to be better mastered than others, and this is exactly what we can to get out of a model. The possibility to model flexible structures, estimate abilities on a very detailed level for sub-skills and to easily incorporate other variables such as feedback in Bayesian Networks makes it a very promising method for making adaptive choices in personalized learning. It is shown in this research how item and feedback selection can be performed with help of the promising Bayesian Networks. A student involvement possibility is also introduced and evaluated.

References

Almond, R. G., Mislevy, R. J., Steinberg, L. S., Yan, D., & Williamson, D. M. (2015). Bayesian Networks in Educational Assessment. Test. New York: Springer Science+Business Media. http://doi.org/10.1007/978-0-387-98138-3

Eggen, T.J.H.M. (2012) Computerized Adaptive Testing Item Selection in Computerized Adaptive Learning Systems. In: Eggen. TJHM & Veldkamp, BP.. (Eds). Psychometrics in Practice at RCEC. Enschede: RCEC

Netcoh, S. (2016, March). “What Do You Mean by ‘Personalized Learning?’. Croscutting Conversations in Education – Research, Reflections & Practice. Blogpost.

Plajner, M., & Vomlel, J. (2016). Student Skill Models in Adaptive Testing. In Proceedings of the Eighth International Conference on Probabilistic Graphical Models (pp. 403-414).

Van der Linden, W. J., & Glas, C. A. (2000). Computerized adaptive testing: Theory and practice. Dordrecht: Kluwer Academic Publishers.

Session Video

10afeedback selection10aitem selection10anetwork approach10apersonalized learning1 avan Buuren, Nikky1 aStraat, Hendrik1 aEggen, Theo1 aFox, Jean-Paul uhttp://mail.iacat.org/adaptive-item-and-feedback-selection-personalized-learning-network-approach02166nas a2200157 4500008003900000245007600039210006900115300001200184490000700196520167900203100002001882700001801902700001801920700002501938856004501963 2017 d00aIs a Computerized Adaptive Test More Motivating Than a Fixed-Item Test?0 aComputerized Adaptive Test More Motivating Than a FixedItem Test a495-5110 v413 aComputer adaptive tests provide important measurement advantages over traditional fixed-item tests, but research on the psychological reactions of test takers to adaptive tests is lacking. In particular, it has been suggested that test-taker engagement, and possibly test performance as a consequence, could benefit from the control that adaptive tests have on the number of test items examinees answer correctly. However, previous research on this issue found little support for this possibility. This study expands on previous research by examining this issue in the context of a mathematical ability assessment and by considering the possible effect of immediate feedback of response correctness on test engagement, test anxiety, time on task, and test performance. Middle school students completed a mathematics assessment under one of three test type conditions (fixed, adaptive, or easier adaptive) and either with or without immediate feedback about the correctness of responses. Results showed little evidence for test type effects. The easier adaptive test resulted in higher engagement and lower anxiety than either the adaptive or fixed-item tests; however, no significant differences in performance were found across test types, although performance was significantly higher across all test types when students received immediate feedback. In addition, these effects were not related to ability level, as measured by the state assessment achievement levels. The possibility that test experiences in adaptive tests may not in practice be significantly different than in fixed-item tests is raised and discussed to explain the results of this and previous studies.1 aLing, Guangming1 aAttali, Yigal1 aFinn, Bridgid1 aStone, Elizabeth, A. uhttps://doi.org/10.1177/014662161770755601568nas a2200181 4500008003900000245011800039210006900157300001100226490000700237520097700244100001801221700001701239700002501256700001801281700002201299700002001321856004501341 2017 d00aDevelopment of a Computer Adaptive Test for Depression Based on the Dutch-Flemish Version of the PROMIS Item Bank0 aDevelopment of a Computer Adaptive Test for Depression Based on  a79-1050 v403 aWe developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample (N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.1 aFlens, Gerard1 aSmits, Niels1 aTerwee, Caroline, B.1 aDekker, Joost1 aHuijbrechts, Irma1 ade Beurs, Edwin uhttps://doi.org/10.1177/016327871668416801710nas a2200133 4500008003900000245008100039210006900120300001200189490000700201520128300208100002001491700001801511856004701529 2017 d00aHeuristic Constraint Management Methods in Multidimensional Adaptive Testing0 aHeuristic Constraint Management Methods in Multidimensional Adap a241-2620 v773 aAlthough multidimensional adaptive testing (MAT) has been proven to be highly advantageous with regard to measurement efficiency when several highly correlated dimensions are measured, there are few operational assessments that use MAT. This may be due to issues of constraint management, which is more complex in MAT than it is in unidimensional adaptive testing. Very few studies have examined the performance of existing constraint management methods (CMMs) in MAT. The present article focuses on the effectiveness of two promising heuristic CMMs in MAT for varying levels of imposed constraints and for various correlations between the measured dimensions. Through a simulation study, the multidimensional maximum priority index (MMPI) and multidimensional weighted penalty model (MWPM), as an extension of the weighted penalty model, are examined with regard to measurement precision and constraint violations. The results show that both CMMs are capable of addressing complex constraints in MAT. However, measurement precision losses were found to differ between the MMPI and MWPM. While the MMPI appears to be more suitable for use in assessment situations involving few to a moderate number of constraints, the MWPM should be used when numerous constraints are involved.1 aBorn, Sebastian1 aFrey, Andreas uhttp://dx.doi.org/10.1177/001316441664374401269nas a2200301 4500008003900000022001400039245021000053210006900263260000800332300001600340490000700356520033300363100001600696700001300712700001400725700001900739700001600758700001500774700001500789700001500804700002000819700001400839700001400853700001800867700001200885700002400897856004600921 2017 d a1573-264900aThe validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the Kids-CAT study0 avalidation of a computeradaptive test CAT for assessing healthre cMay a1105–11170 v263 aRecently, we developed a computer-adaptive test (CAT) for assessing health-related quality of life (HRQoL) in children and adolescents: the Kids-CAT. It measures five generic HRQoL dimensions. The aims of this article were (1) to present the study design and (2) to investigate its psychometric properties in a clinical setting.1 aBarthel, D.1 aOtto, C.1 aNolte, S.1 aMeyrose, A.-K.1 aFischer, F.1 aDevine, J.1 aWalter, O.1 aMierke, A.1 aFischer, K., I.1 aThyen, U.1 aKlein, M.1 aAnkermann, T.1 aRose, M1 aRavens-Sieberer, U. uhttps://doi.org/10.1007/s11136-016-1437-901809nas a2200133 4500008003900000245010300039210006900142300001200211490000700223520134300230100002201573700002701595856005301622 2016 d00aOn Computing the Key Probability in the Stochastically Curtailed Sequential Probability Ratio Test0 aComputing the Key Probability in the Stochastically Curtailed Se a142-1560 v403 aThe Stochastically Curtailed Sequential Probability Ratio Test (SCSPRT) is a termination criterion for computerized classification tests (CCTs) that has been shown to be more efficient than the well-known Sequential Probability Ratio Test (SPRT). The performance of the SCSPRT depends on computing the probability that at a given stage in the test, an examinee’s current interim classification status will not change before the end of the test. Previous work discusses two methods of computing this probability, an exact method in which all potential responses to remaining items are considered and an approximation based on the central limit theorem (CLT) requiring less computation. Generally, the CLT method should be used early in the test when the number of remaining items is large, and the exact method is more appropriate at later stages of the test when few items remain. However, there is currently a dearth of information as to the performance of the SCSPRT when using the two methods. For the first time, the exact and CLT methods of computing the crucial probability are compared in a simulation study to explore whether there is any effect on the accuracy or efficiency of the CCT. The article is focused toward practitioners and researchers interested in using the SCSPRT as a termination criterion in an operational CCT.1 aHuebner, Alan, R.1 aFinkelman, Matthew, D. uhttp://apm.sagepub.com/content/40/2/142.abstract01723nas a2200145 4500008003900000245015500039210006900194300001000263490000700273520118100280100001701461700002701478700002001505856005201525 2016 d00aStochastic Curtailment of Questionnaires for Three-Level Classification: Shortening the CES-D for Assessing Low, Moderate, and High Risk of Depression0 aStochastic Curtailment of Questionnaires for ThreeLevel Classifi a22-360 v403 aIn clinical assessment, efficient screeners are needed to ensure low respondent burden. In this article, Stochastic Curtailment (SC), a method for efficient computerized testing for classification into two classes for observable outcomes, was extended to three classes. In a post hoc simulation study using the item scores on the Center for Epidemiologic Studies–Depression Scale (CES-D) of a large sample, three versions of SC, SC via Empirical Proportions (SC-EP), SC via Simple Ordinal Regression (SC-SOR), and SC via Multiple Ordinal Regression (SC-MOR) were compared at both respondent burden and classification accuracy. All methods were applied under the regular item order of the CES-D and under an ordering that was optimal in terms of the predictive power of the items. Under the regular item ordering, the three methods were equally accurate, but SC-SOR and SC-MOR needed less items. Under the optimal ordering, additional gains in efficiency were found, but SC-MOR suffered from capitalization on chance substantially. It was concluded that SC-SOR is an efficient and accurate method for clinical screening. Strengths and weaknesses of the methods are discussed.1 aSmits, Niels1 aFinkelman, Matthew, D.1 aKelderman, Henk uhttp://apm.sagepub.com/content/40/1/22.abstract01433nas a2200145 4500008003900000245011700039210006900156300001200225490000700237520092600244100002601170700001401196700002401210856005301234 2015 d00aComparing Simple Scoring With IRT Scoring of Personality Measures: The Navy Computer Adaptive Personality Scales0 aComparing Simple Scoring With IRT Scoring of Personality Measure a144-1540 v393 a

This article analyzes data from U.S. Navy sailors (N = 8,956), with the central measure being the Navy Computer Adaptive Personality Scales (NCAPS). Analyses and results from this article extend and qualify those from previous research efforts by examining the properties of the NCAPS and its adaptive structure in more detail. Specifically, this article examines item exposure rates, the efficiency of item use based on item response theory (IRT)–based Expected A Posteriori (EAP) scoring, and a comparison of IRT-EAP scoring with much more parsimonious scoring methods that appear to work just as well (stem-level scoring and dichotomous scoring). The cutting-edge nature of adaptive personality testing will necessitate a series of future efforts like this: to examine the benefits of adaptive scoring schemes and novel measurement methods continually, while pushing testing technology further ahead.

1 aOswald, Frederick, L.1 aShaw, Amy1 aFarmer, William, L. uhttp://apm.sagepub.com/content/39/2/144.abstract01379nas a2200157 4500008003900000245012700039210006900166300001200235490000700247520082800254100001701082700002701099700001801126700002401144856005301168 2015 d00aStochastic Curtailment in Adaptive Mastery Testing: Improving the Efficiency of Confidence Interval–Based Stopping Rules0 aStochastic Curtailment in Adaptive Mastery Testing Improving the a278-2920 v393 aA well-known stopping rule in adaptive mastery testing is to terminate the assessment once the examinee’s ability confidence interval lies entirely above or below the cut-off score. This article proposes new procedures that seek to improve such a variable-length stopping rule by coupling it with curtailment and stochastic curtailment. Under the new procedures, test termination can occur earlier if the probability is high enough that the current classification decision remains the same should the test continue. Computation of this probability utilizes normality of an asymptotically equivalent version of the maximum likelihood ability estimate. In two simulation sets, the new procedures showed a substantial reduction in average test length while maintaining similar classification accuracy to the original method.1 aSie, Haskell1 aFinkelman, Matthew, D.1 aBartroff, Jay1 aThompson, Nathan, A uhttp://apm.sagepub.com/content/39/4/278.abstract01461nas a2200157 4500008003900000245006800039210006800107300001200175490000700187520097800194100001701172700002701189700001701216700001701233856005301250 2015 d00aUtilizing Response Times in Computerized Classification Testing0 aUtilizing Response Times in Computerized Classification Testing a389-4050 v393 aA well-known approach in computerized mastery testing is to combine the Sequential Probability Ratio Test (SPRT) stopping rule with item selection to maximize Fisher information at the mastery threshold. This article proposes a new approach in which a time limit is defined for the test and examinees’ response times are considered in both item selection and test termination. Item selection is performed by maximizing Fisher information per time unit, rather than Fisher information itself. The test is terminated once the SPRT makes a classification decision, the time limit is exceeded, or there is no remaining item that has a high enough probability of being answered before the time limit. In a simulation study, the new procedure showed a substantial reduction in average testing time while slightly improving classification accuracy compared with the original method. In addition, the new procedure reduced the percentage of examinees who exceeded the time limit.1 aSie, Haskell1 aFinkelman, Matthew, D.1 aRiley, Barth1 aSmits, Niels uhttp://apm.sagepub.com/content/39/5/389.abstract00532nas a2200145 4500008004500000245013100045210006900176300001000245490000600255100001900261700001100280700001600291700001500307856006400322 2014 Engldsh 00aCognitive Diagnostic Models and Computerized Adaptive Testing: Two New Item-Selection Methods That Incorporate Response Times0 aCognitive Diagnostic Models and Computerized Adaptive Testing Tw a59-760 v21 aFinkelman, M D1 aKim, W1 aWeissman, A1 aCook, R.J. uhttp://www.iacat.org/jcat/index.php/jcat/article/view/43/2100521nas a2200121 4500008004500000245011300045210006900158300001000227490000600237100001300243700001900256856012400275 2013 Engldsh 00aA Comparison of Computerized Classification Testing and Computerized Adaptive Testing in Clinical Psychology0 aComparison of Computerized Classification Testing and Computeriz a19-370 v11 aSmits, N1 aFinkelman, M D uhttp://mail.iacat.org/content/comparison-computerized-classification-testing-and-computerized-adaptive-testing-clinical00504nas a2200133 4500008003900000245011400039210006900153300001200222490000700234100001900241700001800260700002400278856006800302 2013 d00aA Comparison of Exposure Control Procedures in CAT Systems Based on Different Measurement Models for Testlets0 aComparison of Exposure Control Procedures in CAT Systems Based o a113-1350 v261 aBoyd, Aimee, M1 aDodd, Barbara1 aFitzpatrick, Steven uhttp://www.tandfonline.com/doi/abs/10.1080/08957347.2013.76543400534nas a2200145 4500008004100000245009500041210006900136300001000205490000600215100001900221700001100240700001000251700001300261856011400274 2013 en d00aItem Ordering in Stochastically Curtailed Health Questionnaires With an Observable Outcome0 aItem Ordering in Stochastically Curtailed Health Questionnaires  a38-660 v11 aFinkelman, M D1 aKim, W1 aHe, Y1 aLai, A M uhttp://mail.iacat.org/content/item-ordering-stochastically-curtailed-health-questionnaires-observable-outcome00517nas a2200121 4500008004100000245009900041210006900140260002300209100001200232700001500244700001500259856012100274 2013 eng d00aReporting differentiated literacy results in PISA by using multidimensional adaptive testing. 0 aReporting differentiated literacy results in PISA by using multi bDodrecht: Springer1 aFrey, A1 aSeitz, N-N1 aKröhne, U uhttp://mail.iacat.org/content/reporting-differentiated-literacy-results-pisa-using-multidimensional-adaptive-testing01630nas a2200157 4500008003900000245010100039210006900140300001200209490000700221520111200228100001501340700001601355700001901371700002501390856005701415 2013 d00aA Semiparametric Model for Jointly Analyzing Response Times and Accuracy in Computerized Testing0 aSemiparametric Model for Jointly Analyzing Response Times and Ac a381-4170 v383 a

The item response times (RTs) collected from computerized testing represent an underutilized type of information about items and examinees. In addition to knowing the examinees’ responses to each item, we can investigate the amount of time examinees spend on each item. Current models for RTs mainly focus on parametric models, which have the advantage of conciseness, but may suffer from reduced flexibility to fit real data. We propose a semiparametric approach, specifically, the Cox proportional hazards model with a latent speed covariate to model the RTs, embedded within the hierarchical framework proposed by van der Linden to model the RTs and response accuracy simultaneously. This semiparametric approach combines the flexibility of nonparametric modeling and the brevity and interpretability of the parametric modeling. A Markov chain Monte Carlo method for parameter estimation is given and may be used with sparse data obtained by computerized adaptive testing. Both simulation studies and real data analysis are carried out to demonstrate the applicability of the new model.

1 aWang, Chun1 aFan, Zhewen1 aChang, Hua-Hua1 aDouglas, Jeffrey, A. uhttp://jeb.sagepub.com/cgi/content/abstract/38/4/38100331nas a2200097 4500008004100000245004100041210003800082260003300120100001200153856006800165 2012 eng d00aAdaptives Testen [Adaptive testing].0 aAdaptives Testen Adaptive testing aBerlinbHeidelberg: Springer1 aFrey, A uhttp://mail.iacat.org/content/adaptives-testen-adaptive-testing00541nas a2200181 4500008004500000245006300045210006300108300001400171490000700185100002300192700002000215700002200235700001700257700001600274700001800290700002100308856003000329 2012 Engldsh 00aDevelopment of a computerized adaptive test for depression0 aDevelopment of a computerized adaptive test for depression a1105-11120 v691 aGibbons, Robert, D1 aWeiss, David, J1 aPilkonis, Paul, A1 aFrank, Ellen1 aMoore, Tara1 aKim, Jong Bae1 aKupfer, David, J uWWW.ARCHGENPSYCHIATRY.COM00464nas a2200133 4500008003900000245007200039210006900111300001200180490000700192100002400199700002000223700001900243856006800262 2012 d00aMultistage Computerized Adaptive Testing With Uniform Item Exposure0 aMultistage Computerized Adaptive Testing With Uniform Item Expos a118-1410 v251 aEdwards, Michael, C1 aFlora, David, B1 aThissen, David uhttp://www.tandfonline.com/doi/abs/10.1080/08957347.2012.66036300507nas a2200121 4500008003900000245011000039210006900149300001200218490000700230100001200237700001500249856012100264 2011 d00aHypothetical use of multidimensional adaptive testing for the assessment of student achievement in PISA. 0 aHypothetical use of multidimensional adaptive testing for the as a503-5220 v711 aFrey, A1 aSeitz, N-N uhttp://mail.iacat.org/content/hypothetical-use-multidimensional-adaptive-testing-assessment-student-achievement-pisa02121nas a2200193 4500008004100000245007900041210006900120260001200189520146800201653002801669653000801697653001801705100002001723700001701743700002301760700002301783700002301806856009801829 2011 eng d00aThe Use of Decision Trees for Adaptive Item Selection and Score Estimation0 aUse of Decision Trees for Adaptive Item Selection and Score Esti c10/20113 a

Conducted post-hoc simulations comparing the relative efficiency, and precision of decision trees (using CHAID and CART) vs. IRT-based CAT.

Conclusions

Decision tree methods were more efficient than CAT

But,...

Conclusions

CAT selects items based on two criteria: Item location relative to current estimate of theta, Item discrimination

Decision Trees select items that best discriminate between groups defined by the total score.

CAT is optimal only when trait level is well estimated.
Findings suggest that combining decision tree followed by CAT item selection may be advantageous.

10aadaptive item selection10aCAT10adecision tree1 aRiley, Barth, B1 aFunk, Rodney1 aDennis, Michael, L1 aLennox, Richard, D1 aFinkelman, Matthew uhttp://mail.iacat.org/content/use-decision-trees-adaptive-item-selection-and-score-estimation02224nas a2200289 4500008004100000020004600041245010800087210006900195250001500264300001200279490000700291520131000298100001801608700001701626700001801643700001401661700001401675700001801689700001401707700001701721700001501738700001301753700001401766700001601780700001301796856012501809 2010 Eng d a1573-2649 (Electronic)0962-9343 (Linking)00aDevelopment of computerized adaptive testing (CAT) for the EORTC QLQ-C30 physical functioning dimension0 aDevelopment of computerized adaptive testing CAT for the EORTC Q a2010/10/26 a479-4900 v203 aPURPOSE: Computerized adaptive test (CAT) methods, based on item response theory (IRT), enable a patient-reported outcome instrument to be adapted to the individual patient while maintaining direct comparability of scores. The EORTC Quality of Life Group is developing a CAT version of the widely used EORTC QLQ-C30. We present the development and psychometric validation of the item pool for the first of the scales, physical functioning (PF). METHODS: Initial developments (including literature search and patient and expert evaluations) resulted in 56 candidate items. Responses to these items were collected from 1,176 patients with cancer from Denmark, France, Germany, Italy, Taiwan, and the United Kingdom. The items were evaluated with regard to psychometric properties. RESULTS: Evaluations showed that 31 of the items could be included in a unidimensional IRT model with acceptable fit and good content coverage, although the pool may lack items at the upper extreme (good PF). There were several findings of significant differential item functioning (DIF). However, the DIF findings appeared to have little impact on the PF estimation. CONCLUSIONS: We have established an item pool for CAT measurement of PF and believe that this CAT instrument will clearly improve the EORTC measurement of PF.1 aPetersen, M A1 aGroenvold, M1 aAaronson, N K1 aChie, W C1 aConroy, T1 aCostantini, A1 aFayers, P1 aHelbostad, J1 aHolzner, B1 aKaasa, S1 aSinger, S1 aVelikova, G1 aYoung, T uhttp://mail.iacat.org/content/development-computerized-adaptive-testing-cat-eortc-qlq-c30-physical-functioning-dimension01512nas a2200217 4500008004100000245008100041210006900122300001200191490000700203520078900210653001100999653003401010653002201044653003501066653002101101653002101122100001901143700001401162700001601176856010201192 2010 eng d00aItem Selection and Hypothesis Testing for the Adaptive Measurement of Change0 aItem Selection and Hypothesis Testing for the Adaptive Measureme a238-2540 v343 a

Assessing individual change is an important topic in both psychological and educational measurement. An adaptive measurement of change (AMC) method had previously been shown to exhibit greater efficiency in detecting change than conventional nonadaptive methods. However, little work had been done to compare different procedures within the AMC framework. This study introduced a new item selection criterion and two new test statistics for detecting change with AMC that were specifically designed for the paradigm of hypothesis testing. In two simulation sets, the new methods for detecting significant change improved on existing procedures by demonstrating better adherence to Type I error rates and substantially better power for detecting relatively small change. 

10achange10acomputerized adaptive testing10aindividual change10aKullback–Leibler information10alikelihood ratio10ameasuring change1 aFinkelman, M D1 aWeiss, DJ1 aKim-Kang, G uhttp://mail.iacat.org/content/item-selection-and-hypothesis-testing-adaptive-measurement-change-000582nas a2200121 4500008004400000245017600044210006900220300001000289490000700299100001200306700001500318856012700333 2010 Germdn 00aMultidimensionale adaptive Kompetenzdiagnostik: Ergebnisse zur Messeffizienz [Multidimensional adaptive testing of competencies: Results regarding measurement efficiency].0 aMultidimensionale adaptive Kompetenzdiagnostik Ergebnisse zur Me a40-510 v561 aFrey, A1 aSeitz, N-N uhttp://mail.iacat.org/content/multidimensionale-adaptive-kompetenzdiagnostik-ergebnisse-zur-messeffizienz-multidimensional01276nas a2200121 4500008003900000245007100039210006900110300001000179490000700189520087700196100002901073856005201102 2010 d00aVariations on Stochastic Curtailment in Sequential Mastery Testing0 aVariations on Stochastic Curtailment in Sequential Mastery Testi a27-450 v343 a

In sequential mastery testing (SMT), assessment via computer is used to classify examinees into one of two mutually exclusive categories. Unlike paper-and-pencil tests, SMT has the capability to use variable-length stopping rules. One approach to shortening variable-length tests is stochastic curtailment, which halts examination if the probability of changing classification decisions is low. The estimation of such a probability is therefore a critical component of a stochastically curtailed test. This article examines several variations on stochastic curtailment where the key probability is estimated more aggressively than the standard formulation, resulting in additional savings in average test length (ATL). In two simulation sets, the variations successfully reduced the ATL, and in many cases the average loss, compared with the standard formulation.

1 aFinkelman, Matthew David uhttp://apm.sagepub.com/content/34/1/27.abstract01700nas a2200157 4500008003900000022001400039245008000053210006900133300001300202490000700215520119700222100002301419700002301442700002201465856005501487 2009 d a1745-398400aA Conditional Exposure Control Method for Multidimensional Adaptive Testing0 aConditional Exposure Control Method for Multidimensional Adaptiv a84–1030 v463 a

In computerized adaptive testing (CAT), ensuring the security of test items is a crucial practical consideration. A common approach to reducing item theft is to define maximum item exposure rates, i.e., to limit the proportion of examinees to whom a given item can be administered. Numerous methods for controlling exposure rates have been proposed for tests employing the unidimensional 3-PL model. The present article explores the issues associated with controlling exposure rates when a multidimensional item response theory (MIRT) model is utilized and exposure rates must be controlled conditional upon ability. This situation is complicated by the exponentially increasing number of possible ability values in multiple dimensions. The article introduces a new procedure, called the generalized Stocking-Lewis method, that controls the exposure rate for students of comparable ability as well as with respect to the overall population. A realistic simulation set compares the new method with three other approaches: Kullback-Leibler information with no exposure control, Kullback-Leibler information with unconditional Sympson-Hetter exposure control, and random item selection.

1 aFinkelman, Matthew1 aNering, Michael, L1 aRoussos, Louis, A uhttp://dx.doi.org/10.1111/j.1745-3984.2009.01070.x00496nas a2200133 4500008004100000245008000041210006900121300001100190490000700201100001700208700001600225700001700241856010400258 2009 eng d00aA conditional exposure control method for multidimensional adaptive testing0 aconditional exposure control method for multidimensional adaptiv a84-1030 v461 aFinkelman, M1 aNering, M L1 aRoussos, L A uhttp://mail.iacat.org/content/conditional-exposure-control-method-multidimensional-adaptive-testing01651nas a2200157 4500008003900000245010700039210006900146300001000215490000700225520113900232100001501371700001901386700002101405700001501426856005201441 2009 d00aConstraint-Weighted a-Stratification for Computerized Adaptive Testing With Nonstatistical Constraints0 aConstraintWeighted aStratification for Computerized Adaptive Tes a35-490 v693 a

a-stratification is a method that utilizes items with small discrimination (a) parameters early in an exam and those with higher a values when more is learned about the ability parameter. It can achieve much better item usage than the maximum information criterion (MIC). To make a-stratification more practical and more widely applicable, a method for weighting the item selection process in a-stratification as a means of satisfying multiple test constraints is proposed. This method is studied in simulation against an analogous method without stratification as well as a-stratification using descending-rather than ascending-a procedures. In addition, a variation of a-stratification that allows for unbalanced usage of a parameters is included in the study to examine the trade-off between efficiency and exposure control. Finally, MIC and randomized item selection are included as baseline measures. Results indicate that the weighting mechanism successfully addresses the constraints, that stratification helps to a great extent balancing exposure rates, and that the ascending-a design improves measurement precision.

1 aYing Cheng1 aChang, Hua-Hua1 aDouglas, Jeffrey1 aFanmin Guo uhttp://epm.sagepub.com/content/69/1/35.abstract02882nas a2200493 4500008004100000020004100041245014100082210006900223250001500292260000800307300001100315490000700326520125100333653003001584653001001614653000901624653004601633653003301679653001101712653003101723653001101754653000901765653003301774653001601807653002401823653004601847653005501893653005501948653004602003653001902049653003102068653001402099100001602113700001502129700001302144700001402157700001502171700001702186700001502203700001702218700001502235700001302250856012502263 2009 eng d a0090-5550 (Print)0090-5550 (Linking)00aDevelopment of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis0 aDevelopment of an item bank for the assessment of depression in  a2009/05/28 cMay a186-970 v543 aOBJECTIVE: The calibration of item banks provides the basis for computerized adaptive testing that ensures high diagnostic precision and minimizes participants' test burden. The present study aimed at developing a new item bank that allows for assessing depression in persons with mental and persons with somatic diseases. METHOD: The sample consisted of 161 participants treated for a depressive syndrome, and 206 participants with somatic illnesses (103 cardiologic, 103 otorhinolaryngologic; overall mean age = 44.1 years, SD =14.0; 44.7% women) to allow for validation of the item bank in both groups. Persons answered a pool of 182 depression items on a 5-point Likert scale. RESULTS: Evaluation of Rasch model fit (infit < 1.3), differential item functioning, dimensionality, local independence, item spread, item and person separation (>2.0), and reliability (>.80) resulted in a bank of 79 items with good psychometric properties. CONCLUSIONS: The bank provides items with a wide range of content coverage and may serve as a sound basis for computerized adaptive testing applications. It might also be useful for researchers who wish to develop new fixed-length scales for the assessment of depression in specific rehabilitation settings.10aAdaptation, Psychological10aAdult10aAged10aDepressive Disorder/*diagnosis/psychology10aDiagnosis, Computer-Assisted10aFemale10aHeart Diseases/*psychology10aHumans10aMale10aMental Disorders/*psychology10aMiddle Aged10aModels, Statistical10aOtorhinolaryngologic Diseases/*psychology10aPersonality Assessment/statistics & numerical data10aPersonality Inventory/*statistics & numerical data10aPsychometrics/statistics & numerical data10aQuestionnaires10aReproducibility of Results10aSick Role1 aForkmann, T1 aBoecker, M1 aNorra, C1 aEberle, N1 aKircher, T1 aSchauerte, P1 aMischke, K1 aWesthofen, M1 aGauggel, S1 aWirtz, M uhttp://mail.iacat.org/content/development-item-bank-assessment-depression-persons-mental-illnesses-and-physical-diseases00513nas a2200121 4500008003900000245011000039210006900149300001000218490000600228100001200234700002000246856012500266 2009 d00aDiagnostic classification models and multidimensional adaptive testing: A commentary on Rupp and Templin.0 aDiagnostic classification models and multidimensional adaptive t a58-610 v71 aFrey, A1 aCarstensen, C H uhttp://mail.iacat.org/content/diagnostic-classification-models-and-multidimensional-adaptive-testing-commentary-rupp-and00568nas a2200133 4500008004400000245013200044210007000176300001000246490000700256100001200263700001400275700001900289856012600308 2009 Germdn 00aEffekte des adaptiven Testens auf die Moti¬vation zur Testbearbeitung [Effects of adaptive testing on test taking motivation].0 aEffekte des adaptiven Testens auf die Moti¬vation zur Testbearbe a20-280 v551 aFrey, A1 aHartig, J1 aMoosbrugger, H uhttp://mail.iacat.org/content/effekte-des-adaptiven-testens-auf-die-moti%C2%ACvation-zur-testbearbeitung-effects-adaptive02371nas a2200217 4500008004100000020002200041245010800063210006900171250001500240260001000255300001200265490000700277520166400284100001401948700001401962700001601976700001201992700001702004700001502021856011702036 2009 Eng d a1049-8931 (Print)00aEvaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application0 aEvaluation of a computeradaptive test for the assessment of depr a2009/02/06 cFeb 4 a233-2360 v183 aIn the past, a German Computerized Adaptive Test, based on Item Response Theory (IRT), was developed for purposes of assessing the construct depression [Computer-adaptive test for depression (D-CAT)]. This study aims at testing the feasibility and validity of the real computer-adaptive application.The D-CAT, supplied by a bank of 64 items, was administered on personal digital assistants (PDAs) to 423 consecutive patients suffering from psychosomatic and other medical conditions (78 with depression). Items were adaptively administered until a predetermined reliability (r >/= 0.90) was attained. For validation purposes, the Hospital Anxiety and Depression Scale (HADS), the Centre for Epidemiological Studies Depression (CES-D) scale, and the Beck Depression Inventory (BDI) were administered. Another sample of 114 patients was evaluated using standardized diagnostic interviews [Composite International Diagnostic Interview (CIDI)].The D-CAT was quickly completed (mean 74 seconds), well accepted by the patients and reliable after an average administration of only six items. In 95% of the cases, 10 items or less were needed for a reliable score estimate. Correlations between the D-CAT and the HADS, CES-D, and BDI ranged between r = 0.68 and r = 0.77. The D-CAT distinguished between diagnostic groups as well as established questionnaires do.The D-CAT proved an efficient, well accepted and reliable tool. Discriminative power was comparable to other depression measures, whereby the CAT is shorter and more precise. Item usage raises questions of balancing the item selection for content in the future. Copyright (c) 2009 John Wiley & Sons, Ltd.1 aFliege, H1 aBecker, J1 aWalter, O B1 aRose, M1 aBjorner, J B1 aKlapp, B F uhttp://mail.iacat.org/content/evaluation-computer-adaptive-test-assessment-depression-d-cat-clinical-application02752nas a2200433 4500008004100000020004600041245012800087210006900215250001500284300001200299490000700311520139300318653003401711653001501745653001001760653000901770653002201779653002501801653001101826653001101837653000901848653001601857653001501873653003801888653001901926653003101945653002801976653004802004653002202052100002002074700001202094700001402106700001602120700001402136700001702150700001502167700001502182856012102197 2009 eng d a1878-5921 (Electronic)0895-4356 (Linking)00aAn evaluation of patient-reported outcomes found computerized adaptive testing was efficient in assessing stress perception0 aevaluation of patientreported outcomes found computerized adapti a2008/07/22 a278-2870 v623 aOBJECTIVES: This study aimed to develop and evaluate a first computerized adaptive test (CAT) for the measurement of stress perception (Stress-CAT), in terms of the two dimensions: exposure to stress and stress reaction. STUDY DESIGN AND SETTING: Item response theory modeling was performed using a two-parameter model (Generalized Partial Credit Model). The evaluation of the Stress-CAT comprised a simulation study and real clinical application. A total of 1,092 psychosomatic patients (N1) were studied. Two hundred simulees (N2) were generated for a simulated response data set. Then the Stress-CAT was given to n=116 inpatients, (N3) together with established stress questionnaires as validity criteria. RESULTS: The final banks included n=38 stress exposure items and n=31 stress reaction items. In the first simulation study, CAT scores could be estimated with a high measurement precision (SE<0.32; rho>0.90) using 7.0+/-2.3 (M+/-SD) stress reaction items and 11.6+/-1.7 stress exposure items. The second simulation study reanalyzed real patients data (N1) and showed an average use of items of 5.6+/-2.1 for the dimension stress reaction and 10.0+/-4.9 for the dimension stress exposure. Convergent validity showed significantly high correlations. CONCLUSIONS: The Stress-CAT is short and precise, potentially lowering the response burden of patients in clinical decision making.10a*Diagnosis, Computer-Assisted10aAdolescent10aAdult10aAged10aAged, 80 and over10aConfidence Intervals10aFemale10aHumans10aMale10aMiddle Aged10aPerception10aQuality of Health Care/*standards10aQuestionnaires10aReproducibility of Results10aSickness Impact Profile10aStress, Psychological/*diagnosis/psychology10aTreatment Outcome1 aKocalevent, R D1 aRose, M1 aBecker, J1 aWalter, O B1 aFliege, H1 aBjorner, J B1 aKleiber, D1 aKlapp, B F uhttp://mail.iacat.org/content/evaluation-patient-reported-outcomes-found-computerized-adaptive-testing-was-efficient00557nas a2200121 4500008004100000245008100041210006900122260009700191100001700288700001400305700001600319856010000335 2009 eng d00aItem selection and hypothesis testing for the adaptive measurement of change0 aItem selection and hypothesis testing for the adaptive measureme aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aFinkelman, M1 aWeiss, DJ1 aKim-Kang, G uhttp://mail.iacat.org/content/item-selection-and-hypothesis-testing-adaptive-measurement-change03148nas a2200457 4500008004100000020004100041245015500082210006900237250001500306260000800321300001200329490000700341520174100348653002502089653001902114653002502133653003002158653001502188653003602203653001002239653002102249653003302270653001102303653001102314653000902325653001802334653001702352653001902369653001602388100001502404700001002419700001502429700002502444700001802469700001702487700001602504700001602520700001402536700001602550856012402566 2009 eng d a0962-9343 (Print)0962-9343 (Linking)00aMeasuring global physical health in children with cerebral palsy: Illustration of a multidimensional bi-factor model and computerized adaptive testing0 aMeasuring global physical health in children with cerebral palsy a2009/02/18 cApr a359-3700 v183 aPURPOSE: The purposes of this study were to apply a bi-factor model for the determination of test dimensionality and a multidimensional CAT using computer simulations of real data for the assessment of a new global physical health measure for children with cerebral palsy (CP). METHODS: Parent respondents of 306 children with cerebral palsy were recruited from four pediatric rehabilitation hospitals and outpatient clinics. We compared confirmatory factor analysis results across four models: (1) one-factor unidimensional; (2) two-factor multidimensional (MIRT); (3) bi-factor MIRT with fixed slopes; and (4) bi-factor MIRT with varied slopes. We tested whether the general and content (fatigue and pain) person score estimates could discriminate across severity and types of CP, and whether score estimates from a simulated CAT were similar to estimates based on the total item bank, and whether they correlated as expected with external measures. RESULTS: Confirmatory factor analysis suggested separate pain and fatigue sub-factors; all 37 items were retained in the analyses. From the bi-factor MIRT model with fixed slopes, the full item bank scores discriminated across levels of severity and types of CP, and compared favorably to external instruments. CAT scores based on 10- and 15-item versions accurately captured the global physical health scores. CONCLUSIONS: The bi-factor MIRT CAT application, especially the 10- and 15-item versions, yielded accurate global physical health scores that discriminated across known severity groups and types of CP, and correlated as expected with concurrent measures. The CATs have potential for collecting complex data on the physical health of children with CP in an efficient manner.10a*Computer Simulation10a*Health Status10a*Models, Statistical10aAdaptation, Psychological10aAdolescent10aCerebral Palsy/*physiopathology10aChild10aChild, Preschool10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMassachusetts10aPennsylvania10aQuestionnaires10aYoung Adult1 aHaley, S M1 aNi, P1 aDumas, H M1 aFragala-Pinkham, M A1 aHambleton, RK1 aMontpetit, K1 aBilodeau, N1 aGorton, G E1 aWatson, K1 aTucker, C A uhttp://mail.iacat.org/content/measuring-global-physical-health-children-cerebral-palsy-illustration-multidimensional-bi01384nas a2200145 4500008004100000020001300041245012000054210006900174300001000243490000700253520082700260100001201087700001501099856012401114 2009 eng d a0191491X00aMultidimensional adaptive testing in educational and psychological measurement: Current state and future challenges0 aMultidimensional adaptive testing in educational and psychologic a89-940 v353 aThe paper gives an overview of multidimensional adaptive testing (MAT) and evaluates its applicability in educational and psychological testing. The approach of Segall (1996) is described as a general framework for MAT. The main advantage of MAT is its capability to increase measurement efficiency. In simulation studies conceptualizing situations typical to large scale assessments, the number of presented items was reduced by MAT by about 30–50% compared to unidimensional adaptive testing and by about 70% compared to fixed item testing holding measurement precision constant. Empirical results underline these findings. Before MAT is used routinely some open questions should be answered first. After that, MAT represents a very promising approach to highly efficient simultaneous testing of multiple competencies.1 aFrey, A1 aSeitz, N-N uhttp://mail.iacat.org/content/multidimensional-adaptive-testing-educational-and-psychological-measurement-current-state02905nas a2200289 4500008004100000020004100041245011100082210006900193250001500262260000800277300001400285490000700299520193300306653002702239653003802266653004102304653001902345653001102364653001402375653003102389100001502420700001302435700001202448700001602460700001302476856012602489 2009 eng d a0315-162X (Print)0315-162X (Linking)00aProgress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing0 aProgress in assessing physical function in arthritis PROMIS shor a2009/09/10 cSep a2061-20660 v363 aOBJECTIVE: Assessing self-reported physical function/disability with the Health Assessment Questionnaire Disability Index (HAQ) and other instruments has become central in arthritis research. Item response theory (IRT) and computerized adaptive testing (CAT) techniques can increase reliability and statistical power. IRT-based instruments can improve measurement precision substantially over a wider range of disease severity. These modern methods were applied and the magnitude of improvement was estimated. METHODS: A 199-item physical function/disability item bank was developed by distilling 1865 items to 124, including Legacy Health Assessment Questionnaire (HAQ) and Physical Function-10 items, and improving precision through qualitative and quantitative evaluation in over 21,000 subjects, which included about 1500 patients with rheumatoid arthritis and osteoarthritis. Four new instruments, (A) Patient-Reported Outcomes Measurement Information (PROMIS) HAQ, which evolved from the original (Legacy) HAQ; (B) "best" PROMIS 10; (C) 20-item static (short) forms; and (D) simulated PROMIS CAT, which sequentially selected the most informative item, were compared with the HAQ. RESULTS: Online and mailed administration modes yielded similar item and domain scores. The HAQ and PROMIS HAQ 20-item scales yielded greater information content versus other scales in patients with more severe disease. The "best" PROMIS 20-item scale outperformed the other 20-item static forms over a broad range of 4 standard deviations. The 10-item simulated PROMIS CAT outperformed all other forms. CONCLUSION: Improved items and instruments yielded better information. The PROMIS HAQ is currently available and considered validated. The new PROMIS short forms, after validation, are likely to represent further improvement. CAT-based physical function/disability assessment offers superior performance over static forms of equal length.10a*Disability Evaluation10a*Outcome Assessment (Health Care)10aArthritis/diagnosis/*physiopathology10aHealth Surveys10aHumans10aPrognosis10aReproducibility of Results1 aFries, J F1 aCella, D1 aRose, M1 aKrishnan, E1 aBruce, B uhttp://mail.iacat.org/content/progress-assessing-physical-function-arthritis-promis-short-forms-and-computerized-adaptive01675nas a2200157 4500008004100000020001400041245010500055210006900160300001200229490000600241520109700247100001601344700002001360700001601380856012101396 2009 eng d a1939-148X00aValidation of the MMPI-2 computerized adaptive version (MMPI-2-CA) in a correctional intake facility0 aValidation of the MMPI2 computerized adaptive version MMPI2CA in a279-2920 v63 aComputerized adaptive testing in personality assessment can improve efficiency by significantly reducing the number of items administered to answer an assessment question. The time savings afforded by this technique could be of particular benefit in settings where large numbers of psychological screenings are conducted, such as correctional facilities. In the current study, item and time savings, as well as the test–retest and extratest correlations associated with an audio augmented administration of all the scales of the Minnesota Multiphasic Personality Inventory (MMPI)-2 Computerized Adaptive (MMPI-2-CA) are reported. Participants include 366 men, ages 18 to 62 years (M = 33.04, SD = 10.40), undergoing intake into a large Midwestern state correctional facility. Results of the current study indicate considerable item and corresponding time savings for the MMPI-2-CA compared to conventional administration of the test, as well as comparability in terms of test–retest and correlations with external measures. Future directions of adaptive personality testing are discussed.1 aForbey, J D1 aBen-Porath, Y S1 aGartland, D uhttp://mail.iacat.org/content/validation-mmpi-2-computerized-adaptive-version-mmpi-2-ca-correctional-intake-facility03437nas a2200481 4500008004100000020004600041245013800087210006900225250001500294260000800309300001200317490000700329520191400336653002702250653002302277653003102300653001502331653001602346653001002362653002102372653002402393653002302417653003802440653001102478653002202489653001102511653001102522653000902533653003702542653002102579653003102600653002602631653001702657653003202674653001602706653002802722100001602750700001502766700001002781700001502791700002502806856012402831 2008 eng d a1532-821X (Electronic)0003-9993 (Linking)00aAssessing self-care and social function using a computer adaptive testing version of the pediatric evaluation of disability inventory0 aAssessing selfcare and social function using a computer adaptive a2008/04/01 cApr a622-6290 v893 aOBJECTIVE: To examine score agreement, validity, precision, and response burden of a prototype computer adaptive testing (CAT) version of the self-care and social function scales of the Pediatric Evaluation of Disability Inventory compared with the full-length version of these scales. DESIGN: Computer simulation analysis of cross-sectional and longitudinal retrospective data; cross-sectional prospective study. SETTING: Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics; community-based day care, preschool, and children's homes. PARTICIPANTS: Children with disabilities (n=469) and 412 children with no disabilities (analytic sample); 38 children with disabilities and 35 children without disabilities (cross-validation sample). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from prototype CAT applications of each scale using 15-, 10-, and 5-item stopping rules; scores from the full-length self-care and social function scales; time (in seconds) to complete assessments and respondent ratings of burden. RESULTS: Scores from both computer simulations and field administration of the prototype CATs were highly consistent with scores from full-length administration (r range, .94-.99). Using computer simulation of retrospective data, discriminant validity, and sensitivity to change of the CATs closely approximated that of the full-length scales, especially when the 15- and 10-item stopping rules were applied. In the cross-validation study the time to administer both CATs was 4 minutes, compared with over 16 minutes to complete the full-length scales. CONCLUSIONS: Self-care and social function score estimates from CAT administration are highly comparable with those obtained from full-length scale administration, with small losses in validity and precision and substantial decreases in administration time.10a*Disability Evaluation10a*Social Adjustment10aActivities of Daily Living10aAdolescent10aAge Factors10aChild10aChild, Preschool10aComputer Simulation10aCross-Over Studies10aDisabled Children/*rehabilitation10aFemale10aFollow-Up Studies10aHumans10aInfant10aMale10aOutcome Assessment (Health Care)10aReference Values10aReproducibility of Results10aRetrospective Studies10aRisk Factors10aSelf Care/*standards/trends10aSex Factors10aSickness Impact Profile1 aCoster, W J1 aHaley, S M1 aNi, P1 aDumas, H M1 aFragala-Pinkham, M A uhttp://mail.iacat.org/content/assessing-self-care-and-social-function-using-computer-adaptive-testing-version-pediatric00683nas a2200157 4500008004100000245017700041210006900218260003100287100001600318700001200334700001300346700001500359700001400374700001300388856012400401 2008 eng d00aDeveloping a progressive approach to using the GAIN in order to reduce the duration and cost of assessment with the GAIN short screener, Quick and computer adaptive testing0 aDeveloping a progressive approach to using the GAIN in order to  aWashington D.C., USAc20081 aDennis, M L1 aFunk, R1 aTitus, J1 aRiley, B B1 aHosman, S1 aKinne, S uhttp://mail.iacat.org/content/developing-progressive-approach-using-gain-order-reduce-duration-and-cost-assessment-gain02391nas a2200205 4500008004100000020001400041245008800055210006900143300001400212490000700226520173800233100001401971700001401985700002001999700001702019700001202036700001602048700001502064856010602079 2008 eng d a1520-639400aFunctioning and validity of a computerized adaptive test to measure anxiety (A CAT)0 aFunctioning and validity of a computerized adaptive test to meas aE182-E1940 v253 aBackground: The aim of this study was to evaluate the Computerized Adaptive Test to measure anxiety (A-CAT), a patient-reported outcome questionnaire that uses computerized adaptive testing to measure anxiety. Methods: The A-CAT builds on an item bank of 50 items that has been built using conventional item analyses and item response theory analyses. The A-CAT was administered on Personal Digital Assistants to n=357 patients diagnosed and treated at the department of Psychosomatic Medicine and Psychotherapy, Charité Berlin, Germany. For validation purposes, two subgroups of patients (n=110 and 125) answered the A-CAT along with established anxiety and depression questionnaires. Results: The A-CAT was fast to complete (on average in 2 min, 38 s) and a precise item response theory based CAT score (reliability>.9) could be estimated after 4–41 items. On average, the CAT displayed 6 items (SD=4.2). Convergent validity of the A-CAT was supported by correlations to existing tools (Hospital Anxiety and Depression Scale-A, Beck Anxiety Inventory, Berliner Stimmungs-Fragebogen A/D, and State Trait Anxiety Inventory: r=.56–.66); discriminant validity between diagnostic groups was higher for the A-CAT than for other anxiety measures. Conclusions: The German A-CAT is an efficient, reliable, and valid tool for assessing anxiety in patients suffering from anxiety disorders and other conditions with significant potential for initial assessment and long-term treatment monitoring. Future research directions are to explore content balancing of the item selection algorithm of the CAT, to norm the tool to a healthy sample, and to develop practical cutoff scores. Depression and Anxiety, 2008. © 2008 Wiley-Liss, Inc.1 aBecker, J1 aFliege, H1 aKocalevent, R D1 aBjorner, J B1 aRose, M1 aWalter, O B1 aKlapp, B F uhttp://mail.iacat.org/content/functioning-and-validity-computerized-adaptive-test-measure-anxiety-cat01082nas a2200145 4500008004100000245008400041210006900125300001200194490000700206520056600213100001600779700001700795700001300812856011100825 2008 eng d00aModern sequential analysis and its application to computerized adaptive testing0 aModern sequential analysis and its application to computerized a a473-4860 v733 aAfter a brief review of recent advances in sequential analysis involving sequential generalized likelihood ratio tests, we discuss their use in psychometric testing and extend the asymptotic optimality theory of these sequential tests to the case of sequentially generated experiments, of particular interest in computerized adaptive testing.We then show how these methods can be used to design adaptive mastery tests, which are asymptotically optimal and are also shown to provide substantial improvements over currently used sequential and fixed length tests.1 aBartroff, J1 aFinkelman, M1 aLai, T L uhttp://mail.iacat.org/content/modern-sequential-analysis-and-its-application-computerized-adaptive-testing01614nas a2200145 4500008003900000245009500039210006900134300001200203490000700215520113800222100001801360700001801378700001901396856005301415 2008 d00aA Strategy for Controlling Item Exposure in Multidimensional Computerized Adaptive Testing0 aStrategy for Controlling Item Exposure in Multidimensional Compu a215-2320 v683 a

Although computerized adaptive tests have enjoyed tremendous growth, solutions for important problems remain unavailable. One problem is the control of item exposure rate. Because adaptive algorithms are designed to select optimal items, they choose items with high discriminating power. Thus, these items are selected more often than others, leading to both overexposure and underutilization of some parts of the item pool. Overused items are often compromised, creating a security problem that could threaten the validity of a test. Building on a previously proposed stratification scheme to control the exposure rate for one-dimensional tests, the authors extend their method to multidimensional tests. A strategy is proposed based on stratification in accordance with a functional of the vector of the discrimination parameter, which can be implemented with minimal computational overhead. Both theoretical and empirical validation studies are provided. Empirical results indicate significant improvement over the commonly used method of controlling exposure rate that requires only a reasonable sacrifice in efficiency.

1 aLee, Yi-Hsuan1 aIp, Edward, H1 aFuh, Cheng-Der uhttp://epm.sagepub.com/content/68/2/215.abstract03158nas a2200493 4500008004100000020002200041245008900063210006900152250001500221260000800236300001000244490000700254520169600261653003401957653002001991653001502011653001002026653000902036653002602045653003202071653003102103653001102134653001102145653000902156653003202165653001602197653002902213653004402242653002902286653003102315653003102346653001702377100001702394700001402411700001602425700001302441700001702454700002202471700001702493700001402510700001402524700001702538856010902555 2008 eng d a1075-2730 (Print)00aUsing computerized adaptive testing to reduce the burden of mental health assessment0 aUsing computerized adaptive testing to reduce the burden of ment a2008/04/02 cApr a361-80 v593 aOBJECTIVE: This study investigated the combination of item response theory and computerized adaptive testing (CAT) for psychiatric measurement as a means of reducing the burden of research and clinical assessments. METHODS: Data were from 800 participants in outpatient treatment for a mood or anxiety disorder; they completed 616 items of the 626-item Mood and Anxiety Spectrum Scales (MASS) at two times. The first administration was used to design and evaluate a CAT version of the MASS by using post hoc simulation. The second confirmed the functioning of CAT in live testing. RESULTS: Tests of competing models based on item response theory supported the scale's bifactor structure, consisting of a primary dimension and four group factors (mood, panic-agoraphobia, obsessive-compulsive, and social phobia). Both simulated and live CAT showed a 95% average reduction (585 items) in items administered (24 and 30 items, respectively) compared with administration of the full MASS. The correlation between scores on the full MASS and the CAT version was .93. For the mood disorder subscale, differences in scores between two groups of depressed patients--one with bipolar disorder and one without--on the full scale and on the CAT showed effect sizes of .63 (p<.003) and 1.19 (p<.001) standard deviation units, respectively, indicating better discriminant validity for CAT. CONCLUSIONS: Instead of using small fixed-length tests, clinicians can create item banks with a large item pool, and a small set of the items most relevant for a given individual can be administered with no loss of information, yielding a dramatic reduction in administration time and patient and clinician burden.10a*Diagnosis, Computer-Assisted10a*Questionnaires10aAdolescent10aAdult10aAged10aAgoraphobia/diagnosis10aAnxiety Disorders/diagnosis10aBipolar Disorder/diagnosis10aFemale10aHumans10aMale10aMental Disorders/*diagnosis10aMiddle Aged10aMood Disorders/diagnosis10aObsessive-Compulsive Disorder/diagnosis10aPanic Disorder/diagnosis10aPhobic Disorders/diagnosis10aReproducibility of Results10aTime Factors1 aGibbons, R D1 aWeiss, DJ1 aKupfer, D J1 aFrank, E1 aFagiolini, A1 aGrochocinski, V J1 aBhaumik, D K1 aStover, A1 aBock, R D1 aImmekus, J C uhttp://mail.iacat.org/content/using-computerized-adaptive-testing-reduce-burden-mental-health-assessment02411nas a2200193 4500008004100000020002200041245011700063210006900180250001500249300001100264490000600275520172700281100001502008700001702023700001602040700001802056700001802074856012502092 2008 eng d a1740-7745 (Print)00aUsing item banks to construct measures of patient reported outcomes in clinical trials: investigator perceptions0 aUsing item banks to construct measures of patient reported outco a2008/11/26 a575-860 v53 aBACKGROUND: Item response theory (IRT) promises more sensitive and efficient measurement of patient-reported outcomes (PROs) than traditional approaches; however, the selection and use of PRO measures from IRT-based item banks differ from current methods of using PRO measures. PURPOSE: To anticipate barriers to the adoption of IRT item banks into clinical trials. METHODS: We conducted semistructured telephone or in-person interviews with 42 clinical researchers who published results from clinical trials in the Journal of the American Medical Association, the New England Journal of Medicine, or other leading clinical journals from July 2005 through May 2006. Interviews included a brief tutorial on IRT item banks. RESULTS: After the tutorial, 39 of 42 participants understood the novel products available from an IRT item bank, namely customized short forms and computerized adaptive testing. Most participants (38/42) thought that item banks could be useful in their clinical trials, but they mentioned several potential barriers to adoption, including economic and logistical constraints, concerns about whether item banks are better than current PRO measures, concerns about how to convince study personnel or statisticians to use item banks, concerns about FDA or sponsor acceptance, and the lack of availability of item banks validated in specific disease populations. LIMITATIONS: Selection bias might have led to more positive responses to the concept of item banks in clinical trials. CONCLUSIONS: Clinical investigators are open to a new method of PRO measurement offered in IRT item banks, but bank developers must address investigator and stakeholder concerns before widespread adoption can be expected.1 aFlynn, K E1 aDombeck, C B1 aDeWitt, E M1 aSchulman, K A1 aWeinfurt, K P uhttp://mail.iacat.org/content/using-item-banks-construct-measures-patient-reported-outcomes-clinical-trials-investigator00443nas a2200109 4500008004100000245008600041210006900127300000800196490000700204100001900211856010300230 2008 eng d00aOn using stochastic curtailment to shorten the SPRT in sequential mastery testing0 ausing stochastic curtailment to shorten the SPRT in sequential m a4420 v331 aFinkelman, M D uhttp://mail.iacat.org/content/using-stochastic-curtailment-shorten-sprt-sequential-mastery-testing00434nas a2200109 4500008004100000245007500041210007100116300001200187490000700199100001700206856010100223 2008 eng d00aThe Wald–Wolfowitz Theorem Is Violated in Sequential Mastery Testing0 aWald–Wolfowitz Theorem Is Violated in Sequential Mastery Testing a293-3030 v271 aFinkelman, M uhttp://mail.iacat.org/content/wald%E2%80%93wolfowitz-theorem-violated-sequential-mastery-testing02338nas a2200145 4500008004100000020002200041245011100063210006900174250001500243300001200258490000700270520177800277100001602055856012102071 2007 eng d a0962-9343 (Print)00aApplying item response theory and computer adaptive testing: The challenges for health outcomes assessment0 aApplying item response theory and computer adaptive testing The  a2007/04/10 a187-1940 v163 aOBJECTIVES: We review the papers presented at the NCI/DIA conference, to identify areas of controversy and uncertainty, and to highlight those aspects of item response theory (IRT) and computer adaptive testing (CAT) that require theoretical or empirical research in order to justify their application to patient reported outcomes (PROs). BACKGROUND: IRT and CAT offer exciting potential for the development of a new generation of PRO instruments. However, most of the research into these techniques has been in non-healthcare settings, notably in education. Educational tests are very different from PRO instruments, and consequently problematic issues arise when adapting IRT and CAT to healthcare research. RESULTS: Clinical scales differ appreciably from educational tests, and symptoms have characteristics distinctly different from examination questions. This affects the transferring of IRT technology. Particular areas of concern when applying IRT to PROs include inadequate software, difficulties in selecting models and communicating results, insufficient testing of local independence and other assumptions, and a need of guidelines for estimating sample size requirements. Similar concerns apply to differential item functioning (DIF), which is an important application of IRT. Multidimensional IRT is likely to be advantageous only for closely related PRO dimensions. CONCLUSIONS: Although IRT and CAT provide appreciable potential benefits, there is a need for circumspection. Not all PRO scales are necessarily appropriate targets for this methodology. Traditional psychometric methods, and especially qualitative methods, continue to have an important role alongside IRT. Research should be funded to address the specific concerns that have been identified.1 aFayers, P M uhttp://mail.iacat.org/content/applying-item-response-theory-and-computer-adaptive-testing-challenges-health-outcomes02309nas a2200301 4500008004100000020002200041245011900063210006900182250001500251260000800266300001000274490000700284520125000291653001501541653001001556653006201566653001101628653001101639653000901650653003801659653005601697653004601753653002101799653003101820100001601851700002001867856012001887 2007 eng d a1040-3590 (Print)00aComputerized adaptive personality testing: A review and illustration with the MMPI-2 Computerized Adaptive Version0 aComputerized adaptive personality testing A review and illustrat a2007/03/21 cMar a14-240 v193 aComputerized adaptive testing in personality assessment can improve efficiency by significantly reducing the number of items administered to answer an assessment question. Two approaches have been explored for adaptive testing in computerized personality assessment: item response theory and the countdown method. In this article, the authors review the literature on each and report the results of an investigation designed to explore the utility, in terms of item and time savings, and validity, in terms of correlations with external criterion measures, of an expanded countdown method-based research version of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2), the MMPI-2 Computerized Adaptive Version (MMPI-2-CA). Participants were 433 undergraduate college students (170 men and 263 women). Results indicated considerable item savings and corresponding time savings for the adaptive testing modalities compared with a conventional computerized MMPI-2 administration. Furthermore, computerized adaptive administration yielded comparable results to computerized conventional administration of the MMPI-2 in terms of both test scores and their validity. Future directions for computerized adaptive personality testing are discussed.10aAdolescent10aAdult10aDiagnosis, Computer-Assisted/*statistics & numerical data10aFemale10aHumans10aMale10aMMPI/*statistics & numerical data10aPersonality Assessment/*statistics & numerical data10aPsychometrics/statistics & numerical data10aReference Values10aReproducibility of Results1 aForbey, J D1 aBen-Porath, Y S uhttp://mail.iacat.org/content/computerized-adaptive-personality-testing-review-and-illustration-mmpi-2-computerized00600nas a2200169 4500008004100000245009100041210006900132300001200201490000700213100001600220700001400236700001700250700001400267700001500281700001200296856012200308 2007 eng d00aDevelopment and evaluation of a computer adaptive test for “Anxiety” (Anxiety-CAT)0 aDevelopment and evaluation of a computer adaptive test for Anxie a143-1550 v161 aWalter, O B1 aBecker, J1 aBjorner, J B1 aFliege, H1 aKlapp, B F1 aRose, M uhttp://mail.iacat.org/content/development-and-evaluation-computer-adaptive-test-%E2%80%9Canxiety%E2%80%9D-anxiety-cat01799nas a2200217 4500008004100000020004600041245017800087210006900265260002500334300001200359490000700371520094900378653001201327653004301339653001801382653000901400100001701409700001501426700001501441856012501456 2007 eng d a1062-7197 (Print); 1532-6977 (Electronic)00aThe effect of including pretest items in an operational computerized adaptive test: Do different ability examinees spend different amounts of time on embedded pretest items?0 aeffect of including pretest items in an operational computerized bLawrence Erlbaum: US a161-1730 v123 aThe purpose of this study was to examine the effect of pretest items on response time in an operational, fixed-length, time-limited computerized adaptive test (CAT). These pretest items are embedded within the CAT, but unlike the operational items, are not tailored to the examinee's ability level. If examinees with higher ability levels need less time to complete these items than do their counterparts with lower ability levels, they will have more time to devote to the operational test questions. Data were from a graduate admissions test that was administered worldwide. Data from both quantitative and verbal sections of the test were considered. For the verbal section, examinees in the lower ability groups spent systematically more time on their pretest items than did those in the higher ability groups, though for the quantitative section the differences were less clear. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aability10aoperational computerized adaptive test10apretest items10atime1 aFerdous, A A1 aPlake, B S1 aChang, S-R uhttp://mail.iacat.org/content/effect-including-pretest-items-operational-computerized-adaptive-test-do-different-ability00601nas a2200121 4500008004400000245019900044210006900243300001200312490000600324100001200330700001300342856012400355 2007 Germdn 00aHypothetischer Einsatz adaptiven Testens bei der Messung von Bildungsstandards in Mathematik [Hypothetical use of adaptive testing for the measurement of educational standards in mathematics] . 0 aHypothetischer Einsatz adaptiven Testens bei der Messung von Bil a169-1840 v81 aFrey, A1 aEhmke, T uhttp://mail.iacat.org/content/hypothetischer-einsatz-adaptiven-testens-bei-der-messung-von-bildungsstandards-mathematik02876nas a2200313 4500008004100000020002200041245010100063210006900164250001500233260000800248300001200256490000700268520179500275653005102070653002002121653003702141653002602178653001902204653001102223653003002234653004602264653003502310653002802345653001302373100002102386700001702407700001502424856012302439 2007 eng d a0315-162X (Print)00aImproving patient reported outcomes using item response theory and computerized adaptive testing0 aImproving patient reported outcomes using item response theory a a2007/06/07 cJun a1426-310 v343 aOBJECTIVE: Patient reported outcomes (PRO) are considered central outcome measures for both clinical trials and observational studies in rheumatology. More sophisticated statistical models, including item response theory (IRT) and computerized adaptive testing (CAT), will enable critical evaluation and reconstruction of currently utilized PRO instruments to improve measurement precision while reducing item burden on the individual patient. METHODS: We developed a domain hierarchy encompassing the latent trait of physical function/disability from the more general to most specific. Items collected from 165 English-language instruments were evaluated by a structured process including trained raters, modified Delphi expert consensus, and then patient evaluation. Each item in the refined data bank will undergo extensive analysis using IRT to evaluate response functions and measurement precision. CAT will allow for real-time questionnaires of potentially smaller numbers of questions tailored directly to each individual's level of physical function. RESULTS: Physical function/disability domain comprises 4 subdomains: upper extremity, trunk, lower extremity, and complex activities. Expert and patient review led to consensus favoring use of present-tense "capability" questions using a 4- or 5-item Likert response construct over past-tense "performance"items. Floor and ceiling effects, attribution of disability, and standardization of response categories were also addressed. CONCLUSION: By applying statistical techniques of IRT through use of CAT, existing PRO instruments may be improved to reduce questionnaire burden on the individual patients while increasing measurement precision that may ultimately lead to reduced sample size requirements for costly clinical trials.10a*Rheumatic Diseases/physiopathology/psychology10aClinical Trials10aData Interpretation, Statistical10aDisability Evaluation10aHealth Surveys10aHumans10aInternational Cooperation10aOutcome Assessment (Health Care)/*methods10aPatient Participation/*methods10aResearch Design/*trends10aSoftware1 aChakravarty, E F1 aBjorner, J B1 aFries, J F uhttp://mail.iacat.org/content/improving-patient-reported-outcomes-using-item-response-theory-and-computerized-adaptive01228nas a2200229 4500008004100000245014700041210006900188300001100257490000700268520046800275100001300743700001300756700001600769700001600785700001300801700001300814700001200827700001500839700001300854700001200867856011900879 2007 eng d00aThe Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years0 aPatientReported Outcomes Measurement Information System PROMIS p aS3-S110 v453 aThe National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS) Roadmap initiative (www.nihpromis.org) is a 5-year cooperative group program of research designed to develop, validate, and standardize item banks to measure patient-reported outcomes (PROs) relevant across common medical conditions. In this article, we will summarize the organization and scientific activity of the PROMIS network during its first 2 years.1 aCella, D1 aYount, S1 aRothrock, N1 aGershon, RC1 aCook, KF1 aReeve, B1 aAder, D1 aFries, J F1 aBruce, B1 aRose, M uhttp://mail.iacat.org/content/patient-reported-outcomes-measurement-information-system-promis-progress-nih-roadmap00586nas a2200121 4500008004100000245009300041210006900134260009700203100001300300700001600313700001900329856011600348 2007 eng d00aUp-and-down procedures for approximating optimal designs using person-response functions0 aUpanddown procedures for approximating optimal designs using per aD. J. Weiss (Ed.). Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing.1 aSheng, Y1 aFlournoy, N1 aOsterlind, S J uhttp://mail.iacat.org/content/and-down-procedures-approximating-optimal-designs-using-person-response-functions02568nas a2200349 4500008004100000020002200041245016600063210006900229250001500298260000800313300001100321490000700332520142900339653002701768653001601795653001501811653001001826653002101836653001401857653005201871653001501923653001101938653001101949653003701960653001801997653001402015100001502029700001002044700001602054700002502070856012302095 2006 eng d a0003-9993 (Print)00aMeasurement precision and efficiency of multidimensional computer adaptive testing of physical functioning using the pediatric evaluation of disability inventory0 aMeasurement precision and efficiency of multidimensional compute a2006/08/29 cSep a1223-90 v873 aOBJECTIVE: To compare the measurement efficiency and precision of a multidimensional computer adaptive testing (M-CAT) application to a unidimensional CAT (U-CAT) comparison using item bank data from 2 of the functional skills scales of the Pediatric Evaluation of Disability Inventory (PEDI). DESIGN: Using existing PEDI mobility and self-care item banks, we compared the stability of item calibrations and model fit between unidimensional and multidimensional Rasch models and compared the efficiency and precision of the U-CAT- and M-CAT-simulated assessments to a random draw of items. SETTING: Pediatric rehabilitation hospital and clinics. PARTICIPANTS: Clinical and normative samples. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Not applicable. RESULTS: The M-CAT had greater levels of precision and efficiency than the separate mobility and self-care U-CAT versions when using a similar number of items for each PEDI subdomain. Equivalent estimation of mobility and self-care scores can be achieved with a 25% to 40% item reduction with the M-CAT compared with the U-CAT. CONCLUSIONS: M-CAT applications appear to have both precision and efficiency advantages compared with separate U-CAT assessments when content subdomains have a high correlation. Practitioners may also realize interpretive advantages of reporting test score information for each subdomain when separate clinical inferences are desired.10a*Disability Evaluation10a*Pediatrics10aAdolescent10aChild10aChild, Preschool10aComputers10aDisabled Persons/*classification/rehabilitation10aEfficiency10aHumans10aInfant10aOutcome Assessment (Health Care)10aPsychometrics10aSelf Care1 aHaley, S M1 aNi, P1 aLudlow, L H1 aFragala-Pinkham, M A uhttp://mail.iacat.org/content/measurement-precision-and-efficiency-multidimensional-computer-adaptive-testing-physical02406nas a2200337 4500008004100000020002200041245010800063210006900171250001500240260000800255300001100263490000700274520139300281653002101674653002101695653001001716653001101726653001801737653001101755653000901766653001601775653003001791653002801821100001801849700001701867700001801884700001401902700001701916700001701933856011801950 2006 eng d a0962-9343 (Print)00aMultidimensional computerized adaptive testing of the EORTC QLQ-C30: basic developments and evaluations0 aMultidimensional computerized adaptive testing of the EORTC QLQC a2006/03/21 cApr a315-290 v153 aOBJECTIVE: Self-report questionnaires are widely used to measure health-related quality of life (HRQOL). Ideally, such questionnaires should be adapted to the individual patient and at the same time scores should be directly comparable across patients. This may be achieved using computerized adaptive testing (CAT). Usually, CAT is carried out for a single domain at a time. However, many HRQOL domains are highly correlated. Multidimensional CAT may utilize these correlations to improve measurement efficiency. We investigated the possible advantages and difficulties of multidimensional CAT. STUDY DESIGN AND SETTING: We evaluated multidimensional CAT of three scales from the EORTC QLQ-C30: the physical functioning, emotional functioning, and fatigue scales. Analyses utilised a database with 2958 European cancer patients. RESULTS: It was possible to obtain scores for the three domains with five to seven items administered using multidimensional CAT that were very close to the scores obtained using all 12 items and with no or little loss of measurement precision. CONCLUSION: The findings suggest that multidimensional CAT may significantly improve measurement precision and efficiency and encourage further research into multidimensional CAT. Particularly, the estimation of the model underlying the multidimensional CAT and the conceptual aspects need further investigations.10a*Quality of Life10a*Self Disclosure10aAdult10aFemale10aHealth Status10aHumans10aMale10aMiddle Aged10aQuestionnaires/*standards10aUser-Computer Interface1 aPetersen, M A1 aGroenvold, M1 aAaronson, N K1 aFayers, P1 aSprangers, M1 aBjorner, J B uhttp://mail.iacat.org/content/multidimensional-computerized-adaptive-testing-eortc-qlq-c30-basic-developments-and00579nas a2200133 4500008003900000245014600039210006900185300001200254490000700266100001500273700002500288700001000313856012200323 2006 d00aSensitivity of a computer adaptive assessment for measuring functional mobility changes in children enrolled in a community fitness programme0 aSensitivity of a computer adaptive assessment for measuring func a616-6220 v201 aHaley, S M1 aFragala-Pinkham, M A1 aNi, P uhttp://mail.iacat.org/content/sensitivity-computer-adaptive-assessment-measuring-functional-mobility-changes-children00426nas a2200085 4500008004100000245009500041210007000136100001200206856012200218 2006 eng d00aValiditätssteigerungen durch adaptives Testen [Increasing validity by adaptive testing]. 0 aValiditätssteigerungen durch adaptives Testen Increasing validit1 aFrey, A uhttp://mail.iacat.org/content/validit%C3%A4tssteigerungen-durch-adaptives-testen-increasing-validity-adaptive-testing00640nas a2200169 4500008004100000020001300041245012900054210006900183300001200252490000700264100001300271700001400284700001400298700001300312700002200325856012300347 2005 eng d a0003999300aAssessing Mobility in Children Using a Computer Adaptive Testing Version of the Pediatric Evaluation of Disability Inventory0 aAssessing Mobility in Children Using a Computer Adaptive Testing a932-9390 v861 aHaley, S1 aRaczek, A1 aCoster, W1 aDumas, H1 aFragalapinkham, M uhttp://mail.iacat.org/content/assessing-mobility-children-using-computer-adaptive-testing-version-pediatric-evaluation03124nas a2200385 4500008004100000020002200041245012900063210006900192250001500261260000800276300001000284490000700294520188400301653002502185653002702210653001502237653001002252653002102262653002802283653003802311653001102349653001102360653001102371653000902382653004602391653002702437653003002464653003202494100001502526700001602541700001602557700001502573700002502588856012502613 2005 eng d a0003-9993 (Print)00aAssessing mobility in children using a computer adaptive testing version of the pediatric evaluation of disability inventory0 aAssessing mobility in children using a computer adaptive testing a2005/05/17 cMay a932-90 v863 aOBJECTIVE: To assess score agreement, validity, precision, and response burden of a prototype computerized adaptive testing (CAT) version of the Mobility Functional Skills Scale (Mob-CAT) of the Pediatric Evaluation of Disability Inventory (PEDI) as compared with the full 59-item version (Mob-59). DESIGN: Computer simulation analysis of cross-sectional and longitudinal retrospective data; and cross-sectional prospective study. SETTING: Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics, community-based day care, preschool, and children's homes. PARTICIPANTS: Four hundred sixty-nine children with disabilities and 412 children with no disabilities (analytic sample); 41 children without disabilities and 39 with disabilities (cross-validation sample). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from a prototype Mob-CAT application and versions using 15-, 10-, and 5-item stopping rules; scores from the Mob-59; and number of items and time (in seconds) to administer assessments. RESULTS: Mob-CAT scores from both computer simulations (intraclass correlation coefficient [ICC] range, .94-.99) and field administrations (ICC=.98) were in high agreement with scores from the Mob-59. Using computer simulations of retrospective data, discriminant validity, and sensitivity to change of the Mob-CAT closely approximated that of the Mob-59, especially when using the 15- and 10-item stopping rule versions of the Mob-CAT. The Mob-CAT used no more than 15% of the items for any single administration, and required 20% of the time needed to administer the Mob-59. CONCLUSIONS: Comparable score estimates for the PEDI mobility scale can be obtained from CAT administrations, with losses in validity and precision for shorter forms, but with a considerable reduction in administration time.10a*Computer Simulation10a*Disability Evaluation10aAdolescent10aChild10aChild, Preschool10aCross-Sectional Studies10aDisabled Children/*rehabilitation10aFemale10aHumans10aInfant10aMale10aOutcome Assessment (Health Care)/*methods10aRehabilitation Centers10aRehabilitation/*standards10aSensitivity and Specificity1 aHaley, S M1 aRaczek, A E1 aCoster, W J1 aDumas, H M1 aFragala-Pinkham, M A uhttp://mail.iacat.org/content/assessing-mobility-children-using-computer-adaptive-testing-version-pediatric-evaluation-002792nas a2200469 4500008004100000020002200041245010400063210006900167250001500236260000800251300001200259490000700271520132800278653002201606653003101628653001501659653001601674653001001690653003401700653002101734653002401755653002501779653001501804653001101819653005301830653002901883653001101912653001101923653002001934653000901954653003101963653004601994653003102040653001402071653003202085100001502117700001002132700002502142700001702167700001302184856012502197 2005 eng d a0012-1622 (Print)00aA computer adaptive testing approach for assessing physical functioning in children and adolescents0 acomputer adaptive testing approach for assessing physical functi a2005/02/15 cFeb a113-1200 v473 aThe purpose of this article is to demonstrate: (1) the accuracy and (2) the reduction in amount of time and effort in assessing physical functioning (self-care and mobility domains) of children and adolescents using computer-adaptive testing (CAT). A CAT algorithm selects questions directly tailored to the child's ability level, based on previous responses. Using a CAT algorithm, a simulation study was used to determine the number of items necessary to approximate the score of a full-length assessment. We built simulated CAT (5-, 10-, 15-, and 20-item versions) for self-care and mobility domains and tested their accuracy in a normative sample (n=373; 190 males, 183 females; mean age 6y 11mo [SD 4y 2m], range 4mo to 14y 11mo) and a sample of children and adolescents with Pompe disease (n=26; 21 males, 5 females; mean age 6y 1mo [SD 3y 10mo], range 5mo to 14y 10mo). Results indicated that comparable score estimates (based on computer simulations) to the full-length tests can be achieved in a 20-item CAT version for all age ranges and for normative and clinical samples. No more than 13 to 16% of the items in the full-length tests were needed for any one administration. These results support further consideration of using CAT programs for accurate and efficient clinical assessments of physical functioning.10a*Computer Systems10aActivities of Daily Living10aAdolescent10aAge Factors10aChild10aChild Development/*physiology10aChild, Preschool10aComputer Simulation10aConfidence Intervals10aDemography10aFemale10aGlycogen Storage Disease Type II/physiopathology10aHealth Status Indicators10aHumans10aInfant10aInfant, Newborn10aMale10aMotor Activity/*physiology10aOutcome Assessment (Health Care)/*methods10aReproducibility of Results10aSelf Care10aSensitivity and Specificity1 aHaley, S M1 aNi, P1 aFragala-Pinkham, M A1 aSkrinar, A M1 aCorzo, D uhttp://mail.iacat.org/content/computer-adaptive-testing-approach-assessing-physical-functioning-children-and-adolescents00602nas a2200145 4500008004100000245014400041210006900185300001200254490000700266100001300273700001400286700002100300700001500321856012000336 2005 eng d00aComputerized adaptive testing with the partial credit model: Estimation procedures, population distributions, and item pool characteristics0 aComputerized adaptive testing with the partial credit model Esti a533-5460 v291 aGorin, J1 aDodd, B G1 aFitzpatrick, S J1 aShieh, Y Y uhttp://mail.iacat.org/content/computerized-adaptive-testing-partial-credit-model-estimation-procedures-population-001564nas a2200157 4500008003900000245014400039210006900183300001200252490000700264520099200271100002101263700002101284700002701305700002101332856005301353 2005 d00aComputerized Adaptive Testing With the Partial Credit Model: Estimation Procedures, Population Distributions, and Item Pool Characteristics0 aComputerized Adaptive Testing With the Partial Credit Model Esti a433-4560 v293 a

The primary purpose of this research is to examine the impact of estimation methods, actual latent trait distributions, and item pool characteristics on the performance of a simulated computerized adaptive testing (CAT) system. In this study, three estimation procedures are compared for accuracy of estimation: maximum likelihood estimation (MLE), expected a priori (EAP), and Warm's weighted likelihood estimation (WLE). Some research has shown that MLE and EAP perform equally well under certain conditions in polytomous CAT systems, such that they match the actual latent trait distribution. However, little research has compared these methods when prior estimates of. distributions are extremely poor. In general, it appears that MLE, EAP, and WLE procedures perform equally well when using an optimal item pool. However, the use of EAP procedures may be advantageous under nonoptimal testing conditions when the item pool is not appropriately matched to the examinees.

1 aGorin, Joanna, S1 aDodd, Barbara, G1 aFitzpatrick, Steven, J1 aShieh, Yann Yann uhttp://apm.sagepub.com/content/29/6/433.abstract00538nas a2200169 4500008004100000245006700041210006300108300001600171490000700187100001400194700001400208700001600222700001700238700001500255700001200270856008600282 2005 eng d00aDevelopment of a computer-adaptive test for depression (D-CAT)0 aDevelopment of a computeradaptive test for depression DCAT a2277–22910 v141 aFliege, H1 aBecker, J1 aWalter, O B1 aBjorner, J B1 aKlapp, B F1 aRose, M uhttp://mail.iacat.org/content/development-computer-adaptive-test-depression-d-cat01915nas a2200157 4500008004100000245010500041210006900146300001000215490000700225520132900232653003401561100001501595700001301610700001301623856012101636 2005 eng d00aThe promise of PROMIS: using item response theory to improve assessment of patient-reported outcomes0 apromise of PROMIS using item response theory to improve assessme aS53-70 v233 aPROMIS (Patient-Reported-Outcomes Measurement Information System) is an NIH Roadmap network project intended to improve the reliability, validity, and precision of PROs and to provide definitive new instruments that will exceed the capabilities of classic instruments and enable improved outcome measurement for clinical research across all NIH institutes. Item response theory (IRT) measurement models now permit us to transition conventional health status assessment into an era of item banking and computerized adaptive testing (CAT). Item banking uses IRT measurement models and methods to develop item banks from large pools of items from many available questionnaires. IRT allows the reduction and improvement of items and assembles domains of items which are unidimensional and not excessively redundant. CAT provides a model-driven algorithm and software to iteratively select the most informative remaining item in a domain until a desired degree of precision is obtained. Through these approaches the number of patients required for a clinical trial may be reduced while holding statistical power constant. PROMIS tools, expected to improve precision and enable assessment at the individual patient level which should broaden the appeal of PROs, will begin to be available to the general medical community in 2008.10acomputerized adaptive testing1 aFries, J F1 aBruce, B1 aCella, D uhttp://mail.iacat.org/content/promise-promis-using-item-response-theory-improve-assessment-patient-reported-outcomes10202nas a2200553 4500008004100000245016300041210006900204300001400273490000700287520862500294653001808919653003208937100001608969700001608985700001409001700001609015700001409031700001509045700001609060700001409076700001509090700001509105700001409120700001709134700001709151700001709168700001609185700001709201700001609218700001509234700001609249700001709265700002309282700001609305700002209321700001609343700001609359700001709375700001309392700001509405700001309420700001609433700001209449700001409461700001609475700002009491700001209511856012509523 2005 eng d00aToward efficient and comprehensive measurement of the alcohol problems continuum in college students: The Brief Young Adult Alcohol Consequences Questionnaire0 aToward efficient and comprehensive measurement of the alcohol pr a1180-11890 v293 aBackground: Although a number of measures of alcohol problems in college students have been studied, the psychometric development and validation of these scales have been limited, for the most part, to methods based on classical test theory. In this study, we conducted analyses based on item response theory to select a set of items for measuring the alcohol problem severity continuum in college students that balances comprehensiveness and efficiency and is free from significant gender bias., Method: We conducted Rasch model analyses of responses to the 48-item Young Adult Alcohol Consequences Questionnaire by 164 male and 176 female college students who drank on at least a weekly basis. An iterative process using item fit statistics, item severities, item discrimination parameters, model residuals, and analysis of differential item functioning by gender was used to pare the items down to those that best fit a Rasch model and that were most efficient in discriminating among levels of alcohol problems in the sample., Results: The process of iterative Rasch model analyses resulted in a final 24-item scale with the data fitting the unidimensional Rasch model very well. The scale showed excellent distributional properties, had items adequately matched to the severity of alcohol problems in the sample, covered a full range of problem severity, and appeared highly efficient in retaining all of the meaningful variance captured by the original set of 48 items., Conclusions: The use of Rasch model analyses to inform item selection produced a final scale that, in both its comprehensiveness and its efficiency, should be a useful tool for researchers studying alcohol problems in college students. To aid interpretation of raw scores, examples of the types of alcohol problems that are likely to be experienced across a range of selected scores are provided., (C)2005Research Society on AlcoholismAn important, sometimes controversial feature of all psychological phenomena is whether they are categorical or dimensional. A conceptual and psychometric framework is described for distinguishing whether the latent structure behind manifest categories (e.g., psychiatric diagnoses, attitude groups, or stages of development) is category-like or dimension-like. Being dimension-like requires (a) within-category heterogeneity and (b) between-category quantitative differences. Being category-like requires (a) within-category homogeneity and (b) between-category qualitative differences. The relation between this classification and abrupt versus smooth differences is discussed. Hybrid structures are possible. Being category-like is itself a matter of degree; the authors offer a formalized framework to determine this degree. Empirical applications to personality disorders, attitudes toward capital punishment, and stages of cognitive development illustrate the approach., (C) 2005 by the American Psychological AssociationThe authors conducted Rasch model ( G. Rasch, 1960) analyses of items from the Young Adult Alcohol Problems Screening Test (YAAPST; S. C. Hurlbut & K. J. Sher, 1992) to examine the relative severity and ordering of alcohol problems in 806 college students. Items appeared to measure a single dimension of alcohol problem severity, covering a broad range of the latent continuum. Items fit the Rasch model well, with less severe symptoms reliably preceding more severe symptoms in a potential progression toward increasing levels of problem severity. However, certain items did not index problem severity consistently across demographic subgroups. A shortened, alternative version of the YAAPST is proposed, and a norm table is provided that allows for a linking of total YAAPST scores to expected symptom expression., (C) 2004 by the American Psychological AssociationA didactic on latent growth curve modeling for ordinal outcomes is presented. The conceptual aspects of modeling growth with ordinal variables and the notion of threshold invariance are illustrated graphically using a hypothetical example. The ordinal growth model is described in terms of 3 nested models: (a) multivariate normality of the underlying continuous latent variables (yt) and its relationship with the observed ordinal response pattern (Yt), (b) threshold invariance over time, and (c) growth model for the continuous latent variable on a common scale. Algebraic implications of the model restrictions are derived, and practical aspects of fitting ordinal growth models are discussed with the help of an empirical example and Mx script ( M. C. Neale, S. M. Boker, G. Xie, & H. H. Maes, 1999). The necessary conditions for the identification of growth models with ordinal data and the methodological implications of the model of threshold invariance are discussed., (C) 2004 by the American Psychological AssociationRecent research points toward the viability of conceptualizing alcohol problems as arrayed along a continuum. Nevertheless, modern statistical techniques designed to scale multiple problems along a continuum (latent trait modeling; LTM) have rarely been applied to alcohol problems. This study applies LTM methods to data on 110 problems reported during in-person interviews of 1,348 middle-aged men (mean age = 43) from the general population. The results revealed a continuum of severity linking the 110 problems, ranging from heavy and abusive drinking, through tolerance and withdrawal, to serious complications of alcoholism. These results indicate that alcohol problems can be arrayed along a dimension of severity and emphasize the relevance of LTM to informing the conceptualization and assessment of alcohol problems., (C) 2004 by the American Psychological AssociationItem response theory (IRT) is supplanting classical test theory as the basis for measures development. This study demonstrated the utility of IRT for evaluating DSM-IV diagnostic criteria. Data on alcohol, cannabis, and cocaine symptoms from 372 adult clinical participants interviewed with the Composite International Diagnostic Interview-Expanded Substance Abuse Module (CIDI-SAM) were analyzed with Mplus ( B. Muthen & L. Muthen, 1998) and MULTILOG ( D. Thissen, 1991) software. Tolerance and legal problems criteria were dropped because of poor fit with a unidimensional model. Item response curves, test information curves, and testing of variously constrained models suggested that DSM-IV criteria in the CIDI-SAM discriminate between only impaired and less impaired cases and may not be useful to scale case severity. IRT can be used to study the construct validity of DSM-IV diagnoses and to identify diagnostic criteria with poor performance., (C) 2004 by the American Psychological AssociationThis study examined the psychometric characteristics of an index of substance use involvement using item response theory. The sample consisted of 292 men and 140 women who qualified for a Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; American Psychiatric Association, 1987) substance use disorder (SUD) diagnosis and 293 men and 445 women who did not qualify for a SUD diagnosis. The results indicated that men had a higher probability of endorsing substance use compared with women. The index significantly predicted health, psychiatric, and psychosocial disturbances as well as level of substance use behavior and severity of SUD after a 2-year follow-up. Finally, this index is a reliable and useful prognostic indicator of the risk for SUD and the medical and psychosocial sequelae of drug consumption., (C) 2002 by the American Psychological AssociationComparability, validity, and impact of loss of information of a computerized adaptive administration of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 140 Veterans Affairs hospital patients. The countdown method ( Butcher, Keller, & Bacon, 1985) was used to adaptively administer Scales L (Lie) and F (Frequency), the 10 clinical scales, and the 15 content scales. Participants completed the MMPI-2 twice, in 1 of 2 conditions: computerized conventional test-retest, or computerized conventional-computerized adaptive. Mean profiles and test-retest correlations across modalities were comparable. Correlations between MMPI-2 scales and criterion measures supported the validity of the countdown method, although some attenuation of validity was suggested for certain health-related items. Loss of information incurred with this mode of adaptive testing has minimal impact on test validity. Item and time savings were substantial., (C) 1999 by the American Psychological Association10aPsychometrics10aSubstance-Related Disorders1 aKahler, C W1 aStrong, D R1 aRead, J P1 aDe Boeck, P1 aWilson, M1 aActon, G S1 aPalfai, T P1 aWood, M D1 aMehta, P D1 aNeale, M C1 aFlay, B R1 aConklin, C A1 aClayton, R R1 aTiffany, S T1 aShiffman, S1 aKrueger, R F1 aNichol, P E1 aHicks, B M1 aMarkon, K E1 aPatrick, C J1 aIacono, William, G1 aMcGue, Matt1 aLangenbucher, J W1 aLabouvie, E1 aMartin, C S1 aSanjuan, P M1 aBavly, L1 aKirisci, L1 aChung, T1 aVanyukov, M1 aDunn, M1 aTarter, R1 aHandel, R W1 aBen-Porath, Y S1 aWatt, M uhttp://mail.iacat.org/content/toward-efficient-and-comprehensive-measurement-alcohol-problems-continuum-college-students02594nas a2200469 4500008004100000245007200041210006900113300001000182490000600192520108600198653002501284653001001309653001501319653002101334653002201355653005901377653007001436653003301506653001101539653001101550653001301561653000901574653002701583653002201610653005501632653001901687653001501706653006601721653001801787653003701805653004101842653003001883653001301913100001501926700001301941700001801954700001501972700001401987700001402001700001302015856009602028 2004 eng d00aComputerized adaptive measurement of depression: A simulation study0 aComputerized adaptive measurement of depression A simulation stu a13-230 v43 aBackground: Efficient, accurate instruments for measuring depression are increasingly importantin clinical practice. We developed a computerized adaptive version of the Beck DepressionInventory (BDI). We examined its efficiency and its usefulness in identifying Major DepressiveEpisodes (MDE) and in measuring depression severity.Methods: Subjects were 744 participants in research studies in which each subject completed boththe BDI and the SCID. In addition, 285 patients completed the Hamilton Depression Rating Scale.Results: The adaptive BDI had an AUC as an indicator of a SCID diagnosis of MDE of 88%,equivalent to the full BDI. The adaptive BDI asked fewer questions than the full BDI (5.6 versus 21items). The adaptive latent depression score correlated r = .92 with the BDI total score and thelatent depression score correlated more highly with the Hamilton (r = .74) than the BDI total scoredid (r = .70).Conclusions: Adaptive testing for depression may provide greatly increased efficiency withoutloss of accuracy in identifying MDE or in measuring depression severity.10a*Computer Simulation10aAdult10aAlgorithms10aArea Under Curve10aComparative Study10aDepressive Disorder/*diagnosis/epidemiology/psychology10aDiagnosis, Computer-Assisted/*methods/statistics & numerical data10aFactor Analysis, Statistical10aFemale10aHumans10aInternet10aMale10aMass Screening/methods10aPatient Selection10aPersonality Inventory/*statistics & numerical data10aPilot Projects10aPrevalence10aPsychiatric Status Rating Scales/*statistics & numerical data10aPsychometrics10aResearch Support, Non-U.S. Gov't10aResearch Support, U.S. Gov't, P.H.S.10aSeverity of Illness Index10aSoftware1 aGardner, W1 aShear, K1 aKelleher, K J1 aPajer, K A1 aMammen, O1 aBuysse, D1 aFrank, E uhttp://mail.iacat.org/content/computerized-adaptive-measurement-depression-simulation-study01774nas a2200193 4500008004100000245023000041210006900271300000900340490000700349520093900356653002101295653003001316653001801346653001601364653004201380100001201422700001901434856012701453 2004 eng d00aKann die Konfundierung von Konzentrationsleistung und Aktivierung durch adaptives Testen mit dern FAKT vermieden werden? [Avoiding the confounding of concentration performance and activation by adaptive testing with the FACT]0 aKann die Konfundierung von Konzentrationsleistung und Aktivierun a1-170 v253 aThe study investigates the effect of computerized adaptive testing strategies on the confounding of concentration performance with activation. A sample of 54 participants was administered 1 out of 3 versions (2 adaptive, 1 non-adaptive) of the computerized Frankfurt Adaptive Concentration Test FACT (Moosbrugger & Heyden, 1997) at three subsequent points in time. During the test administration changes in activation (electrodermal activity) were recorded. The results pinpoint a confounding of concentration performance with activation for the non-adaptive test version, but not for the adaptive test versions (p = .01). Thus, adaptive FACT testing strategies can remove the confounding of concentration performance with activation, thereby increasing the discriminant validity. In conclusion, an attention-focusing-hypothesis is formulated to explain the observed effect. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10aAdaptive Testing10aComputer Assisted Testing10aConcentration10aPerformance10aTesting computerized adaptive testing1 aFrey, A1 aMoosbrugger, H uhttp://mail.iacat.org/content/kann-die-konfundierung-von-konzentrationsleistung-und-aktivierung-durch-adaptives-testen-mit00639nas a2200193 4500008004100000245009100041210006900132300000900201490000700210100001400217700001600231700001400247700001700261700002000278700001400298700001500312700001200327856010600339 2004 eng d00aValidating the German computerized adaptive test for anxiety on healthy sample (A-CAT)0 aValidating the German computerized adaptive test for anxiety on  a15150 v131 aBecker, J1 aWalter, O B1 aFliege, H1 aBjorner, J B1 aKocalevent, R D1 aSchmid, G1 aKlapp, B F1 aRose, M uhttp://mail.iacat.org/content/validating-german-computerized-adaptive-test-anxiety-healthy-sample-cat01391nas a2200121 4500008004100000245010300041210006900144260011000213300000900323520079300332100001701125856012701142 2003 eng d00aAn adaptation of stochastic curtailment to truncate Wald’s SPRT in computerized adaptive testing0 aadaptation of stochastic curtailment to truncate Wald s SPRT in  aLos AngelesbNational Center for Research on Evaluation, Standards, and Student TestingcSteptember, 2003 a1-263 a

Computerized adaptive testing (CAT) has been shown to increase eÆciency in educational measurement. One common application of CAT is to classify students as either pro cient or not proficient in ability. A truncated form of Wald's sequential probability ratio test (SPRT), in which examination is halted after a prespeci ed number of questions, has been proposed to provide a diagnosis of prociency. This article studies the further truncation provided by stochastic curtailment, where an exam is stopped early if completion of the remaining questions would be unlikely to alter the classi cation of the examinee. In a simulation study presented, the increased truncation is shown to offer substantial improvement in test length with only a slight decrease in accuracy.

1 aFinkelman, M uhttp://mail.iacat.org/content/adaptation-stochastic-curtailment-truncate-wald%E2%80%99s-sprt-computerized-adaptive-testing00577nas a2200121 4500008004100000245016100041210006900202260001500271100001400286700001400300700002100314856012000335 2003 eng d00aA comparison of exposure control procedures in CAT systems based on different measurement models for testlets using the verbal reasoning section of the MCAT0 acomparison of exposure control procedures in CAT systems based o aChicago IL1 aBoyd, A M1 aDodd, B G1 aFitzpatrick, S J uhttp://mail.iacat.org/content/comparison-exposure-control-procedures-cat-systems-based-different-measurement-models00432nas a2200109 4500008003900000245007600039210006900115260001500184100001600199700001800215856008900233 2003 d00aThe evaluation of exposure control procedures for an operational CAT. 0 aevaluation of exposure control procedures for an operational CAT aChicago IL1 aFrench, B F1 aThompson, T T uhttp://mail.iacat.org/content/evaluation-exposure-control-procedures-operational-cat01817nas a2200253 4500008004100000245013100041210006900172300001000241490000600251520095700257653001501214653002901229653002501258653001501283653002001298653001101318653003101329100001401360700001601374700001401390700001401404700002101418856012401439 2003 eng d00aAn examination of exposure control and content balancing restrictions on item selection in CATs using the partial credit model0 aexamination of exposure control and content balancing restrictio a24-420 v43 aThe purpose of the present investigation was to systematically examine the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system (CAT) based on the partial credit model. A series of simulated fixed and variable length CATs were run using two data sets generated to multiple content areas for three sizes of item pools. The 2 (exposure control) X 2 (content rotation) X 2 (test length) X 3 (item pool size) X 2 (data sets) yielded a total of 48 conditions. Results show that while both procedures can be used with no deleterious effect on measurement precision, the gains in exposure control, pool utilization, and item overlap appear quite modest. Difficulties involved with setting the exposure control parameters in small item pools make questionable the utility of the Sympson-Hetter technique with similar item pools.10a*Computers10a*Educational Measurement10a*Models, Theoretical10aAutomation10aDecision Making10aHumans10aReproducibility of Results1 aDavis, LL1 aPastor, D A1 aDodd, B G1 aChiang, C1 aFitzpatrick, S J uhttp://mail.iacat.org/content/examination-exposure-control-and-content-balancing-restrictions-item-selection-cats-using02981nas a2200121 4500008004100000245010700041210006900148300000900217490000700226520249100233100001202724856012302736 2003 eng d00aStatistical detection and estimation of differential item functioning in computerized adaptive testing0 aStatistical detection and estimation of differential item functi a27360 v643 aDifferential item functioning (DIF) is an important issue in large scale standardized testing. DIF refers to the unexpected difference in item performances among groups of equally proficient examinees, usually classified by ethnicity or gender. Its presence could seriously affect the validity of inferences drawn from a test. Various statistical methods have been proposed to detect and estimate DIF. This dissertation addresses DIF analysis in the context of computerized adaptive testing (CAT), whose item selection algorithm adapts to the ability level of each individual examinee. In a CAT, a DIF item may be more consequential and more detrimental be cause fewer items are administered in a CAT than in a traditional paper-and-pencil test and because the remaining sequence of items presented to examinees depends in part on their responses to the DIF item. Consequently, an efficient, stable and flexible method to detect and estimate CAT DIF becomes necessary and increasingly important. We propose simultaneous implementations of online calibration and DIF testing. The idea is to perform online calibration of an item of interest separately in the focal and reference groups. Under any specific parametric IRT model, we can use the (online) estimated latent traits as covariates and fit a nonlinear regression model to each of the two groups. Because of the use of the estimated, not the true , the regression fit has to adjust for the covariate "measurement errors". It turns out that this situation fits nicely into the framework of nonlinear error-in-variable modelling, which has been extensively studied in statistical literature. We develop two bias-correction methods using asymptotic expansion and conditional score theory. After correcting the bias caused by measurement error, one can perform a significance test to detect DIF with the parameter estimates for different groups. This dissertation also discusses some general techniques to handle measurement error modelling with different IRT models, including the three-parameter normal ogive model and polytomous response models. Several methods of estimating DIF are studied as well. Large sample properties are established to justify the proposed methods. Extensive simulation studies show that the resulting methods perform well in terms of Type-I error rate control, accuracy in estimating DIF and power against both unidirectional and crossing DIF. (PsycINFO Database Record (c) 2004 APA, all rights reserved).1 aFeng, X uhttp://mail.iacat.org/content/statistical-detection-and-estimation-differential-item-functioning-computerized-adaptive00464nas a2200109 4500008004100000245009200041210006900133260001900202100001100221700000900232856011300241 2002 eng d00aA further study on adjusting CAT item selection starting point for individual examinees0 afurther study on adjusting CAT item selection starting point for aNew Orleans LA1 aFan, M1 aZhu. uhttp://mail.iacat.org/content/further-study-adjusting-cat-item-selection-starting-point-individual-examinees00521nas a2200133 4500008004100000245009700041210006900138260001900207100001500226700001100241700001300252700001100265856011100276 2002 eng d00aAn investigation of procedures for estimating error indexes in proficiency estimation in CAT0 ainvestigation of procedures for estimating error indexes in prof aNew Orleans LA1 aShyu, C -Y1 aFan, M1 aThompson1 aHsu, Y uhttp://mail.iacat.org/content/investigation-procedures-estimating-error-indexes-proficiency-estimation-cat00563nas a2200121 4500008004100000245009500041210006900136260008200205100001300287700001200300700001300312856011600325 2002 eng d00aA strategy for controlling item exposure in multidimensional computerized adaptive testing0 astrategy for controlling item exposure in multidimensional compu aAvailable from http://www3. tat.sinica.edu.tw/library/c_tec_rep/c-2002-11.pdf1 aLee, Y H1 aIp, E H1 aFuh, C D uhttp://mail.iacat.org/content/strategy-controlling-item-exposure-multidimensional-computerized-adaptive-testing01150nas a2200205 4500008004100000245008200041210006900123260005600192520043100248653002100679653003000700653001600730653001600746653001800762100001500780700001700795700001700812700001400829856010100843 2002 eng d00aThe work ahead: A psychometric infrastructure for computerized adaptive tests0 awork ahead A psychometric infrastructure for computerized adapti aMahwah, N.J. USAbLawrence Erlbaum Associates, Inc.3 a(From the chapter) Considers the past and future of computerized adaptive tests and computer-based tests and looks at issues and challenges confronting a testing program as it implements and operates a computer-based test. Recommendations for testing programs from The National Council of Measurement in Education Ad Hoc Committee on Computerized Adaptive Test Disclosure are appended. (PsycINFO Database Record (c) 2005 APA )10aAdaptive Testing10aComputer Assisted Testing10aEducational10aMeasurement10aPsychometrics1 aDrasgow, F1 aPotenza, M P1 aFreemer, J J1 aWard, W C uhttp://mail.iacat.org/content/work-ahead-psychometric-infrastructure-computerized-adaptive-tests00575nas a2200133 4500008004100000245014400041210006900185260001500254100001500269700001100284700001300295700000900308856012400317 2001 eng d00aAn investigation of procedures for estimating error indexes in proficiency estimation in a realistic second-order equitable CAT environment0 ainvestigation of procedures for estimating error indexes in prof aSeattle WA1 aShyu, C -Y1 aFan, M1 aThompson1 aHsu. uhttp://mail.iacat.org/content/investigation-procedures-estimating-error-indexes-proficiency-estimation-realistic-second00494nas a2200121 4500008004100000245009500041210006900136260001500205100001800220700001400238700001900252856010100271 2001 eng d00aAn investigation of the impact of items that exhibit mild DIF on ability estimation in CAT0 ainvestigation of the impact of items that exhibit mild DIF on ab aSeattle WA1 aJennings, J A1 aDodd, B G1 aFitzpatrick, S uhttp://mail.iacat.org/content/investigation-impact-items-exhibit-mild-dif-ability-estimation-cat00471nas a2200133 4500008004100000245006900041210006900110260001600179100001200195700001100207700001300218700001100231856009500242 2000 eng d00aAssembling parallel item pools for computerized adaptive testing0 aAssembling parallel item pools for computerized adaptive testing aNew Orleans1 aWang, T1 aFan, Q1 aBan, J C1 aZhu, D uhttp://mail.iacat.org/content/assembling-parallel-item-pools-computerized-adaptive-testing00588nam a2200181 4500008004100000245005800041210005500099260005100154100001100205700001400216700001600230700001600246700001400262700001500276700001700291700001500308856008300323 2000 eng d00aComputerized adaptive testing: A primer (2nd edition)0 aComputerized adaptive testing A primer 2nd edition aHillsdale, N. J. : Lawrence Erlbaum Associates1 aWainer1 aDorans, N1 aEignor, D R1 aFlaugher, R1 aGreen, BF1 aMislevy, R1 aSteinberg, L1 aThissen, D uhttp://mail.iacat.org/content/computerized-adaptive-testing-primer-2nd-edition00610nas a2200145 4500008004100000245013100041210006900172260002000241100001400261700001600275700001400291700001400305700001900319856012600338 2000 eng d00aAn examination of exposure control and content balancing restrictions on item selection in CATs using the partial credit model0 aexamination of exposure control and content balancing restrictio aNew Orleans, LA1 aDavis, LL1 aPastor, D A1 aDodd, B G1 aChiang, C1 aFitzpatrick, S uhttp://mail.iacat.org/content/examination-exposure-control-and-content-balancing-restrictions-item-selection-cats-using-000315nas a2200097 4500008004100000245001500041210001500056260008500071100001600156856004500172 2000 eng d00aItem pools0 aItem pools aWainer, H. (2000). Computerized adaptive testing: a primer. Mahwah, NJ: Erlbaum.1 aFlaugher, R uhttp://mail.iacat.org/content/item-pools00493nas a2200133 4500008004100000245008100041210006900122300001000191490000700201100001600208700001600224700002000240856009900260 2000 eng d00aA real data simulation of computerized adaptive administration of the MMPI-A0 areal data simulation of computerized adaptive administration of  a83-960 v161 aForbey, J D1 aHandel, R W1 aBen-Porath, Y S uhttp://mail.iacat.org/content/real-data-simulation-computerized-adaptive-administration-mmpi-102580nas a2200145 4500008004100000245008100041210006900122300001000191490000700201520207600208100001502284700001602299700002002315856009902335 2000 eng d00aA real data simulation of computerized adaptive administration of the MMPI-A0 areal data simulation of computerized adaptive administration of  a83-960 v163 aA real data simulation of computerized adaptive administration of the Minnesota Multiphasic Inventory-Adolescent (MMPI-A) was conducted using item responses from three groups of participants. The first group included 196 adolescents (age range 14-18) tested at a midwestern residential treatment facility for adolescents. The second group was the normative sample used in the standardization of the MMPI-A (Butcher, Williams, Graham, Archer, Tellegen, Ben-Porath, & Kaemmer, 1992. Minnesota Multiphasic Inventory-Adolescent (MMPI-A): manual for administration, scoring, and interpretation. Minneapolis: University of Minnesota Press.). The third group was the clinical sample: used in the validation of the MMPI-A (Williams & Butcher, 1989. An MMPI study of adolescents: I. Empirical validation of the study's scales. Personality assessment, 1, 251-259.). The MMPI-A data for each group of participants were run through a modified version of the MMPI-2 adaptive testing computer program (Roper, Ben-Porath & Butcher, 1995. Comparability and validity of computerized adaptive testing with the MMPI-2. Journal of Personality Assessment, 65, 358-371.). To determine the optimal amount of item savings, each group's MMPI-A item responses were used to simulate three different orderings of the items: (1) from least to most frequently endorsed in the keyed direction; (2) from least to most frequently endorsed in the keyed direction with the first 120 items rearranged into their booklet order; and (3) all items in booklet order. The mean number of items administered for each group was computed for both classification and full- scale elevations for T-score cut-off values of 60 and 65. Substantial item administration savings were achieved for all three groups, and the mean number of items saved ranged from 50 items (10.7% of the administered items) to 123 items (26.4% of the administered items), depending upon the T-score cut-off, classification method (i.e. classification only or full-scale elevation), and group. (C) 2000 Elsevier Science Ltd. All rights reserved.1 aFobey, J D1 aHandel, R W1 aBen-Porath, Y S uhttp://mail.iacat.org/content/real-data-simulation-computerized-adaptive-administration-mmpi-000400nas a2200109 4500008004100000245006100041210006100102260001600163100001300179700001100192856008700203 2000 eng d00aSpecific information item selection for adaptive testing0 aSpecific information item selection for adaptive testing aNew Orleans1 aDavey, T1 aFan, M uhttp://mail.iacat.org/content/specific-information-item-selection-adaptive-testing00443nas a2200121 4500008004100000245006600041210006600107260001300173100001100186700001600197700001300213856009500226 1999 eng d00aConstructing adaptive tests to parallel conventional programs0 aConstructing adaptive tests to parallel conventional programs aMontreal1 aFan, M1 aThompson, T1 aDavey, T uhttp://mail.iacat.org/content/constructing-adaptive-tests-parallel-conventional-programs-002156nas a2200277 4500008004100000020002200041245009600063210006900159250001500228260000800243300001100251490000700262520122800269653001601497653003901513653003701552653001101589653003301600653002501633653002701658653003101685100001701716700001601733700001701749856011201766 1999 eng d a1040-2446 (Print)00aEvaluating the usefulness of computerized adaptive testing for medical in-course assessment0 aEvaluating the usefulness of computerized adaptive testing for m a1999/10/28 cOct a1125-80 v743 aPURPOSE: This study investigated the feasibility of converting an existing computer-administered, in-course internal medicine test to an adaptive format. METHOD: A 200-item internal medicine extended matching test was used for this research. Parameters were estimated with commercially available software with responses from 621 examinees. A specially developed simulation program was used to retrospectively estimate the efficiency of the computer-adaptive exam format. RESULTS: It was found that the average test length could be shortened by almost half with measurement precision approximately equal to that of the full 200-item paper-and-pencil test. However, computer-adaptive testing with this item bank provided little advantage for examinees at the upper end of the ability continuum. An examination of classical item statistics and IRT item statistics suggested that adding more difficult items might extend the advantage to this group of examinees. CONCLUSIONS: Medical item banks presently used for incourse assessment might be advantageously employed in adaptive testing. However, it is important to evaluate the match between the items and the measurement objective of the test before implementing this format.10a*Automation10a*Education, Medical, Undergraduate10aEducational Measurement/*methods10aHumans10aInternal Medicine/*education10aLikelihood Functions10aPsychometrics/*methods10aReproducibility of Results1 aKreiter, C D1 aFerguson, K1 aGruppen, L D uhttp://mail.iacat.org/content/evaluating-usefulness-computerized-adaptive-testing-medical-course-assessment00604nas a2200157 4500008004100000245011600041210006900157300001200226490000700238100001400245700001100259700001600270700001700286700001900303856012400322 1999 eng d00aExaminee judgments of changes in item difficulty: Implications for item review in computerized adaptive testing0 aExaminee judgments of changes in item difficulty Implications fo a185-1980 v121 aWise, S L1 aFinney1 aEnders, C K1 aFreeman, S A1 aSeverance, D D uhttp://mail.iacat.org/content/examinee-judgments-changes-item-difficulty-implications-item-review-computerized-adaptive00405nas a2200109 4500008004100000245005700041210005700098260002000155100001400175700002100189856008500210 1998 eng d00aAlternatives for scoring computerized adaptive tests0 aAlternatives for scoring computerized adaptive tests aPhiladelphia PA1 aDodd, B G1 aFitzpatrick, S J uhttp://mail.iacat.org/content/alternatives-scoring-computerized-adaptive-tests-000494nas a2200133 4500008004100000245005700041210005700098260005700155100001400212700002100226700001600247700001400263856008300277 1998 eng d00aAlternatives for scoring computerized adaptive tests0 aAlternatives for scoring computerized adaptive tests aMahwah, N.J., USAbLawrence Erlbaum Associates, Inc.1 aDodd, B G1 aFitzpatrick, S J1 aFremer, J J1 aWard, W C uhttp://mail.iacat.org/content/alternatives-scoring-computerized-adaptive-tests00558nas a2200157 4500008004100000245007600041210006900117260001400186100001600200700001600216700002000232700001500252700001400267700001800281856010100299 1998 eng d00aComputerized adaptive rating scales that measure contextual performance0 aComputerized adaptive rating scales that measure contextual perf aDallas TX1 aBorman, W C1 aHanson, M A1 aMontowidlo, S J1 aDrasgow, F1 aFoster, L1 aKubisiak, U C uhttp://mail.iacat.org/content/computerized-adaptive-rating-scales-measure-contextual-performance00558nas a2200145 4500008004100000245010200041210006900143300001000212490000700222100001600229700001600245700001400261700001400275856012300289 1998 eng d00aTesting word knowledge by telephone to estimate general cognitive aptitude using an adaptive test0 aTesting word knowledge by telephone to estimate general cognitiv a91-980 v261 aLegree, P J1 aFischl, M A1 aGade, P A1 aWilson, M uhttp://mail.iacat.org/content/testing-word-knowledge-telephone-estimate-general-cognitive-aptitude-using-adaptive-test00585nas a2200145 4500008004100000245011400041210006900155260001200224100001400236700001700250700001600267700001600283700001900299856012100318 1997 eng d00aThe accuracy of examinee judgments of relative item difficulty: Implication for computerized adaptive testing0 aaccuracy of examinee judgments of relative item difficulty Impli aChicago1 aWise, S L1 aFreeman, S A1 aFinney, S J1 aEnders, C K1 aSeverance, D D uhttp://mail.iacat.org/content/accuracy-examinee-judgments-relative-item-difficulty-implication-computerized-adaptive01800nas a2200169 4500008004100000245014100041210006900182300001200251490000700263520113700270653003401407100001401441700001301455700002101468700001401489856012701503 1997 eng d00aThe effect of population distribution and method of theta estimation on computerized adaptive testing (CAT) using the rating scale model0 aeffect of population distribution and method of theta estimation a422-4390 v573 aInvestigated the effect of population distribution on maximum likelihood estimation (MLE) and expected a posteriori estimation (EAP) in a simulation study of computerized adaptive testing (CAT) based on D. Andrich's (1978) rating scale model. Comparisons were made among MLE and EAP with a normal prior distribution and EAP with a uniform prior distribution within 2 data sets: one generated using a normal trait distribution and the other using a negatively skewed trait distribution. Descriptive statistics, correlations, scattergrams, and accuracy indices were used to compare the different methods of trait estimation. The EAP estimation with a normal prior or uniform prior yielded results similar to those obtained with MLE, even though the prior did not match the underlying trait distribution. An additional simulation study based on real data suggested that more work is needed to determine the optimal number of quadrature points for EAP in CAT based on the rating scale model. The choice between MLE and EAP for particular measurement situations is discussed. (PsycINFO Database Record (c) 2003 APA, all rights reserved).10acomputerized adaptive testing1 aChen, S-K1 aHou, L Y1 aFitzpatrick, S J1 aDodd, B G uhttp://mail.iacat.org/content/effect-population-distribution-and-method-theta-estimation-computerized-adaptive-testing-cat00597nas a2200145 4500008004100000245014200041210006900183300001200252490000700264100001200271700001100283700002100294700001200315856012400327 1997 eng d00aThe effect of population distribution and methods of theta estimation on computerized adaptive testing (CAT) using the rating scale model0 aeffect of population distribution and methods of theta estimatio a422-4390 v571 aChen, S1 aHou, L1 aFitzpatrick, S J1 aDodd, B uhttp://mail.iacat.org/content/effect-population-distribution-and-methods-theta-estimation-computerized-adaptive-testing00543nas a2200109 4500008004100000245011600041210006900157260004600226100001600272700001800288856012700306 1997 eng d00aLinking scores for computer-adaptive and paper-and-pencil administrations of the SAT (Research Report No 97-12)0 aLinking scores for computeradaptive and paperandpencil administr aPrinceton NJ: Educational Testing Service1 aLawrence, I1 aFeigenbaum, M uhttp://mail.iacat.org/content/linking-scores-computer-adaptive-and-paper-and-pencil-administrations-sat-research-report-no01319nas a2200265 4500008004100000245005500041210005400096300001200150490000600162520053000168653003800698653002000736653001400756653003500770653003100805653001100836653001900847653001800866653002800884100001300912700001500925700001700940700001400957856008200971 1997 eng d00aOn-line performance assessment using rating scales0 aOnline performance assessment using rating scales a173-1910 v13 aThe purpose of this paper is to report on the development of the on-line performance assessment instrument--the Assessment of Motor and Process Skills (AMPS). Issues that will be addressed in the paper include: (a) the establishment of the scoring rubric and its implementation in an extended Rasch model, (b) training of raters, (c) validation of the scoring rubric and procedures for monitoring the internal consistency of raters, and (d) technological implementation of the assessment instrument in a computerized program.10a*Outcome Assessment (Health Care)10a*Rehabilitation10a*Software10a*Task Performance and Analysis10aActivities of Daily Living10aHumans10aMicrocomputers10aPsychometrics10aPsychomotor Performance1 aStahl, J1 aShumway, R1 aBergstrom, B1 aFisher, A uhttp://mail.iacat.org/content/line-performance-assessment-using-rating-scales00608nas a2200145 4500008004100000245012900041210006900170260001500239100002000254700002000274700001400294700001500308700001700323856012200340 1997 eng d00aRelationship of response latency to test design, examinee ability, and item difficulty in computer-based test administration0 aRelationship of response latency to test design examinee ability aChicago IL1 aSwanson, D., B.1 aFeatherman, C M1 aCase, A M1 aLuecht, RM1 aNungester, R uhttp://mail.iacat.org/content/relationship-response-latency-test-design-examinee-ability-and-item-difficulty-computer00571nas a2200121 4500008004100000245015700041210006900198100001700267700001600284700001300300700001500313856012100328 1996 eng d00aEffects of answer feedback and test anxiety on the psychometric and motivational characteristics of computer-adaptive and self-adaptive vocabulary tests0 aEffects of answer feedback and test anxiety on the psychometric 1 aVispoel, W P1 aBrunsman, B1 aForte, E1 aBleiler, T uhttp://mail.iacat.org/content/effects-answer-feedback-and-test-anxiety-psychometric-and-motivational-characteristics00558nas a2200121 4500008004100000245015500041210006900196260001300265100001500278700001300293700001100306856011900317 1996 eng d00aEffects of answer review and test anxiety on the psychometric and motivational characteristics of computer-adaptive and self-adaptive vocabulary tests0 aEffects of answer review and test anxiety on the psychometric an aNew York1 aVispoel, W1 aForte, E1 aBoo, J uhttp://mail.iacat.org/content/effects-answer-review-and-test-anxiety-psychometric-and-motivational-characteristics00585nas a2200133 4500008004100000245013900041210006900180260001600249100001100265700001200276700001700288700002100305856012500326 1996 eng d00aThe effects of methods of theta estimation, prior distribution, and number of quadrature points on CAT using the graded response model0 aeffects of methods of theta estimation prior distribution and nu aNew York NY1 aHou, L1 aChen, S1 aG., Dodd., B1 aFitzpatrick, S J uhttp://mail.iacat.org/content/effects-methods-theta-estimation-prior-distribution-and-number-quadrature-points-cat-using00544nas a2200121 4500008004100000245012100041210006900162260001300231100002000244700001800264700001400282856012600296 1996 eng d00aEffects of randomesque item selection on CAT item exposure rates and proficiency estimation under 1- and 2-PL models0 aEffects of randomesque item selection on CAT item exposure rates aNew York1 aFeatherman, C M1 aSubhiyah, R G1 aHadadi, A uhttp://mail.iacat.org/content/effects-randomesque-item-selection-cat-item-exposure-rates-and-proficiency-estimation-under01529nas a2200229 4500008004100000020004100041245010500082210006900187250001500256260001200271300000900283490000700292520069800299653002500997653002501022653004301047653003701090653001101127100001601138700001801154856012701172 1996 eng d a0363-3624 (Print)0363-3624 (Linking)00aMethodologic trends in the healthcare professions: computer adaptive and computer simulation testing0 aMethodologic trends in the healthcare professions computer adapt a1996/07/01 cJul-Aug a13-40 v213 aAssessing knowledge and performance on computer is rapidly becoming a common phenomenon in testing and measurement. Computer adaptive testing presents an individualized test format in accordance with the examinee's ability level. The efficiency of the testing process enables a more precise estimate of performance, often with fewer items than traditional paper-and-pencil testing methodologies. Computer simulation testing involves performance-based, or authentic, assessment of the examinee's clinical decision-making abilities. The authors discuss the trends in assessing performance through computerized means and the application of these methodologies to community-based nursing practice.10a*Clinical Competence10a*Computer Simulation10aComputer-Assisted Instruction/*methods10aEducational Measurement/*methods10aHumans1 aForker, J E1 aMcDonald, M E uhttp://mail.iacat.org/content/methodologic-trends-healthcare-professions-computer-adaptive-and-computer-simulation-testing00360nas a2200109 4500008004100000245004700041210004700088260001600135100001100151700001100162856007700173 1996 eng d00aMultidimensional computer adaptive testing0 aMultidimensional computer adaptive testing aNew York NY1 aFan, M1 aHsu, Y uhttp://mail.iacat.org/content/multidimensional-computer-adaptive-testing00521nas a2200121 4500008004100000245010300041210006900144260001300213100002000226700001800246700001400264856012100278 1996 eng d00aNew algorithms for item selection and exposure and proficiency estimation under 1- and 2-PL models0 aNew algorithms for item selection and exposure and proficiency e aNew York1 aFeatherman, C M1 aSubhiyah, R G1 aHadadi, A uhttp://mail.iacat.org/content/new-algorithms-item-selection-and-exposure-and-proficiency-estimation-under-1-and-2-pl00479nas a2200109 4500008004100000245009900041210006900140260001600209100001100225700001100236856012200247 1996 eng d00aUtility of Fisher information, global information and different starting abilities in mini CAT0 aUtility of Fisher information global information and different s aNew York NY1 aFan, M1 aHsu, Y uhttp://mail.iacat.org/content/utility-fisher-information-global-information-and-different-starting-abilities-mini-cat02610nas a2200133 4500008004100000245012000041210006900161300000900230490000700239520205500246653003402301100001602335856012502351 1995 eng d00aAssessment of scaled score consistency in adaptive testing from a multidimensional item response theory perspective0 aAssessment of scaled score consistency in adaptive testing from  a55980 v553 aThe purpose of this study was twofold: (a) to examine whether the unidimensional adaptive testing estimates are comparable for different ability levels of examinees when the true examinee-item interaction is correctly modeled using a compensatory multidimensional item response theory (MIRT) model; and (b) to investigate the effects of adaptive testing estimation when the procedure of item selection of computerized adaptive testing (CAT) is controlled by either content-balancing or selecting the most informative item in a user specified direction at the current estimate of unidimensional ability. A series of Monte Carlo simulations were conducted in this study. Deviation from the reference composite angle was used as an index of the theta1,theta2-composite consistency across the different levels of unidimensional CAT estimates. In addition, the effect of the content-balancing item selection procedure and the fixed-direction item selection procedure were compared across the different ability levels. The characteristics of item selection, test information and the relationship between unidimensional and multidimensional models were also investigated. In addition to employing statistical analysis to examine the robustness of the CAT procedure violations of unidimensionality, this research also included graphical analyses to present the results. The results were summarized as follows: (a) the reference angles for the no-control-item-selection method were disparate across the unidimensional ability groups; (b) the unidimensional CAT estimates from the content-balancing item selection method did not offer much improvement; (c) the fixed-direction-item selection method did provide greater consistency for the unidimensional CAT estimates across the different levels of ability; (d) and, increasing the CAT test length did not provide greater score scale consistency. Based on the results of this study, the following conclusions were drawn: (a) without any controlling (PsycINFO Database Record (c) 2003 APA, all rights reserved).10acomputerized adaptive testing1 aFan, Miechu uhttp://mail.iacat.org/content/assessment-scaled-score-consistency-adaptive-testing-multidimensional-item-response-theory00453nas a2200145 4500008004100000245005700041210005500098300001400153490000700167100001200174700001400186700001300200700001300213856008100226 1995 eng d00aComputer-adaptive testing: A new breed of assessment0 aComputeradaptive testing A new breed of assessment a1326-13270 v951 aRuiz, B1 aFitz, P A1 aLewis, C1 aReidy, C uhttp://mail.iacat.org/content/computer-adaptive-testing-new-breed-assessment00455nas a2200145 4500008004100000245005700041210005500098300001400153490000700167100001200174700001400186700001300200700001300213856008300226 1995 eng d00aComputer-adaptive testing: A new breed of assessment0 aComputeradaptive testing A new breed of assessment a1326-13270 v951 aRuiz, B1 aFitz, P A1 aLewis, C1 aReidy, C uhttp://mail.iacat.org/content/computer-adaptive-testing-new-breed-assessment-000467nas a2200109 4500008004100000245009500041210006900136260001900205100001100224700001100235856011100246 1995 eng d00aThe effect of ability estimation for polytomous CAT in different item selection procedures0 aeffect of ability estimation for polytomous CAT in different ite aMinneapolis MN1 aFan, M1 aHsu, Y uhttp://mail.iacat.org/content/effect-ability-estimation-polytomous-cat-different-item-selection-procedures00593nas a2200133 4500008004100000245013900041210006900180260002000249100001500269700001600284700001400300700001800314856012700332 1995 eng d00aThe effect of model misspecification on classification decisions made using a computerized test: 3-PLM vs. 1PLM (and UIRT versus MIRT)0 aeffect of model misspecification on classification decisions mad aMinneapolis, MN1 aSpray, J A1 aKalohn, J C1 aSchulz, M1 aFleer, Jr., P uhttp://mail.iacat.org/content/effect-model-misspecification-classification-decisions-made-using-computerized-test-3-plm-vs00553nas a2200133 4500008004100000245011000041210006900151260001800220100001200238700001100250700002100261700001400282856012300296 1995 eng d00aThe effect of population distribution and methods of theta estimation on CAT using the rating scale model0 aeffect of population distribution and methods of theta estimatio aSan Francisco1 aChen, S1 aHou, L1 aFitzpatrick, S J1 aDodd, B G uhttp://mail.iacat.org/content/effect-population-distribution-and-methods-theta-estimation-cat-using-rating-scale-model01698nas a2200229 4500008004100000020004100041245006400082210006200146250001500208260000800223300001100231490000700242520102000249653003101269653002501300653001001325653001101335653001101346653000901357100001601366856008601382 1995 jpn d a0021-5236 (Print)0021-5236 (Linking)00aA study of psychologically optimal level of item difficulty0 astudy of psychologically optimal level of item difficulty a1995/02/01 cFeb a446-530 v653 aFor the purpose of selecting items in a test, this study presented a viewpoint of psychologically optimal difficulty level, as well as measurement efficiency, of items. A paper-and-pencil test (P & P) composed of hard, moderate and easy subtests was administered to 298 students at a university. A computerized adaptive test (CAT) was also administered to 79 students. The items of both tests were selected from Shiba's Word Meaning Comprehension Test, for which the estimates of parameters of two-parameter item response model were available. The results of P & P research showed that the psychologically optimal success level would be such that the proportion of right answers is somewhere between .75 and .85. A similar result was obtained from CAT research, where the proportion of about .8 might be desirable. Traditionally a success rate of .5 has been recommended in adaptive testing. In this study, however, it was suggested that the items of such level would be too hard psychologically for many examinees.10a*Adaptation, Psychological10a*Psychological Tests10aAdult10aFemale10aHumans10aMale1 aFujimori, S uhttp://mail.iacat.org/content/study-psychologically-optimal-level-item-difficulty00498nas a2200133 4500008003900000245007500039210006900114260002000183100001600203700000900219700001300228700001800241856010500259 1994 d00aPinpointing PRAXIS I CAT characteristics through simulation procedures0 aPinpointing PRAXIS I CAT characteristics through simulation proc aNew Orleans, LA1 aEignor, D R1 aFolk1 aLi, M -Y1 aStocking, M L uhttp://mail.iacat.org/content/pinpointing-praxis-i-cat-characteristics-through-simulation-procedures00413nas a2200121 4500008004100000245006000041210006000101300001000161490001000171100001000181700001300191856008700204 1993 eng d00aComputerized adaptive testing in instructional settings0 aComputerized adaptive testing in instructional settings a47-620 v41(3)1 aWelch1 aFrick, T uhttp://mail.iacat.org/content/computerized-adaptive-testing-instructional-settings00758nas a2200241 4500008004100000020002200041245006700063210006400130250001500194260000800209300001100217490000700228653001500235653002600250653003700276653002300313653001800336100002100354700001400375700002400389700001400413856008900427 1993 eng d a0744-6314 (Print)00aMoving in a new direction: Computerized adaptive testing (CAT)0 aMoving in a new direction Computerized adaptive testing CAT a1993/01/01 cJan a80, 820 v2410a*Computers10aAccreditation/methods10aEducational Measurement/*methods10aLicensure, Nursing10aUnited States1 aJones-Dickson, C1 aDorsey, D1 aCampbell-Warnock, J1 aFields, F uhttp://mail.iacat.org/content/moving-new-direction-computerized-adaptive-testing-cat00386nas a2200109 4500008004100000245005800041210005800099300001300157490000600170100001500176856008500191 1992 eng d00aComputerized adaptive mastery tests as expert systems0 aComputerized adaptive mastery tests as expert systems a187-213.0 v81 aFrick, T W uhttp://mail.iacat.org/content/computerized-adaptive-mastery-tests-expert-systems00390nas a2200109 4500008004100000245005800041210005800099300001200157490000900169100001500178856008700193 1992 eng d00aComputerized adaptive mastery tests as expert systems0 aComputerized adaptive mastery tests as expert systems a187-2130 v8(2)1 aFrick, T W uhttp://mail.iacat.org/content/computerized-adaptive-mastery-tests-expert-systems-000615nas a2200205 4500008004100000020002200041245004700063210004600110250001500156260000800171300000900179490000700188653001500195653002800210653003700238653001100275653003400286100001600320856007300336 1992 eng d a0022-3867 (Print)00aComputerized adaptive testing for NCLEX-PN0 aComputerized adaptive testing for NCLEXPN a1992/06/01 cJun a8-100 v4210a*Licensure10a*Programmed Instruction10aEducational Measurement/*methods10aHumans10aNursing, Practical/*education1 aFields, F A uhttp://mail.iacat.org/content/computerized-adaptive-testing-nclex-pn00458nas a2200121 4500008004100000245006700041210006600108260002100174100001300195700001700208700001400225856009700239 1992 eng d00aStudent attitudes toward computer-adaptive test administration0 aStudent attitudes toward computeradaptive test administration aSan Francisco CA1 aBaghi, H1 aFerrara, S F1 aGabrys, R uhttp://mail.iacat.org/content/student-attitudes-toward-computer-adaptive-test-administration00417nas a2200121 4500008004100000245005800041210005700099260001500156100001300171700001400184700001500198856008200213 1991 eng d00aApplications of computer-adaptive testing in Maryland0 aApplications of computeradaptive testing in Maryland aChicago IL1 aBaghi, H1 aGabrys, R1 aFerrara, S uhttp://mail.iacat.org/content/applications-computer-adaptive-testing-maryland01607nas a2200121 4500008004100000245010800041210006900149260003700218520108800255100001501343700001301358856011401371 1991 eng d00aThe use of the graded response model in computerized adaptive testing of the attitudes to science scale0 ause of the graded response model in computerized adaptive testin aChicago, IL USAcApril 3-7, 19913 aThe graded response model for two-stage testing was applied to an attitudes toward science scale using real-data simulation. The 48-item scale was administered to 920 students at a grade-8 equivalent in Singapore. A two-stage 16-item computerized adaptive test was developed. In two-stage testing an initial, or routing, test is followed by a second-stage testlet of greater or lesser difficulty based on performance. A conventional test of the same length as the adaptive two-stage test was selected from the 48-item pool. Responses to the conventional test, the routing test, and a testlet were simulated. The algorithm of E. Balas (1965) and the multidimensional knapsack problem of optimization theory were used in test development. The simulation showed the efficiency and accuracy of the two-stage test with the graded response model in estimating attitude trait levels, as evidenced by better results from the two-stage test than its conventional counterpart and the reduction to one-third of the length of the original measure. Six tables and three graphs are included. (SLD)1 aFoong, Y-Y1 aLam, T-L uhttp://mail.iacat.org/content/use-graded-response-model-computerized-adaptive-testing-attitudes-science-scale00463nas a2200109 4500008004100000245009800041210006900139300001200208490000600220100001500226856011200241 1990 eng d00aA comparison of three decision models for adapting the length of computer-based mastery tests0 acomparison of three decision models for adapting the length of c a479-5130 v61 aFrick, T W uhttp://mail.iacat.org/content/comparison-three-decision-models-adapting-length-computer-based-mastery-tests00421nas a2200133 4500008004100000245005100041210005100092300001000143490000700153100001400160700001400174700002100188856007800209 1990 eng d00aComputerized adaptive measurement of attitudes0 aComputerized adaptive measurement of attitudes a20-300 v231 aKoch, W R1 aDodd, B G1 aFitzpatrick, S J uhttp://mail.iacat.org/content/computerized-adaptive-measurement-attitudes00516nam a2200169 4500008003900000245005100039210004700090260002600137100001100163700001600174700001600190700001400206700001700220700001700237700001500254856007700269 1990 d00aComputerized adaptive testing: A primer (Eds.)0 aComputerized adaptive testing A primer Eds aHillsdale NJ: Erlbaum1 aWainer1 aDorans, N J1 aFlaugher, R1 aGreen, BF1 aMislevy, R J1 aSteinberg, L1 aThissen, D uhttp://mail.iacat.org/content/computerized-adaptive-testing-primer-eds-200467nas a2200121 4500008004500000245008100045210006900126300001200195490000700207100001400214700001400228856010300242 1989 Engldsh 00aAdaptive Estimation When the Unidimensionality Assumption of IRT is Violated0 aAdaptive Estimation When the Unidimensionality Assumption of IRT a373-3900 v131 aFolk, V G1 aGreen, BF uhttp://mail.iacat.org/content/adaptive-estimation-when-unidimensionality-assumption-irt-violated-000456nas a2200121 4500008004100000245008100041210006900122300001200191490000700203100000900210700001400219856010100233 1989 eng d00aAdaptive estimation when the unidimensionality assumption of IRT is violated0 aAdaptive estimation when the unidimensionality assumption of IRT a373-3890 v131 aFolk1 aGreen, BF uhttp://mail.iacat.org/content/adaptive-estimation-when-unidimensionality-assumption-irt-violated00467nas a2200109 4500008004100000245009100041210006900132300001100201490000900212100001500221856012100236 1989 eng d00aBayesian adaptation during computer-based tests and computer-guided practice exercises0 aBayesian adaptation during computerbased tests and computerguide a89-1140 v5(1)1 aFrick, T W uhttp://mail.iacat.org/content/bayesian-adaptation-during-computer-based-tests-and-computer-guided-practice-exercises00513nas a2200097 4500008004100000245009700041210006900138260008000207100001500287856011300302 1989 eng d00aA comparison of an expert systems approach to computerized adaptive testing and an IRT model0 acomparison of an expert systems approach to computerized adaptiv aUnpublished manuscript (submitted to American Educational Research Journal)1 aFrick, T W uhttp://mail.iacat.org/content/comparison-expert-systems-approach-computerized-adaptive-testing-and-irt-model00465nas a2200121 4500008004100000245007400041210006900115490001900184100001500203700001400218700001400232856009700246 1989 eng d00aEXSPRT: An expert systems approach to computer-based adaptive testing0 aEXSPRT An expert systems approach to computerbased adaptive test0 vSan Francisco.1 aFrick, T W1 aPlew, G T1 aLuk, H -K uhttp://mail.iacat.org/content/exsprt-expert-systems-approach-computer-based-adaptive-testing00568nas a2200121 4500008004100000245011900041210006900160260004800229100001400277700001500291700001600306856012400322 1986 eng d00aCollege Board computerized placement tests: Validation of an adaptive test of basic skills (Research Report 86-29)0 aCollege Board computerized placement tests Validation of an adap aPrinceton NJ: Educational Testing Service.1 aWard, W C1 aKline, R G1 aFlaugher, J uhttp://mail.iacat.org/content/college-board-computerized-placement-tests-validation-adaptive-test-basic-skills-research00469nas a2200121 4500008004100000245004000041210004000081260011500121100001600236700001400252700001300266856006800279 1981 eng d00aAdaptive testing without a computer0 aAdaptive testing without a computer aCatalog of Selected Documents in Psychology, Nov 1981, 11, 74-75 (Ms. No. 2350). AFHRL Technical Report 80-66.1 aFriedman, D1 aSteinberg1 aRee, M J uhttp://mail.iacat.org/content/adaptive-testing-without-computer00507nas a2200109 4500008004100000245005900041210005900100260013300159100001700292700001300309856007500322 1980 eng d00aIndividualized testing on the basis of the Rasch model0 aIndividualized testing on the basis of the Rasch model aIn J. Th. Van der Kamp, W. F. Langerak, and D. N. M. de Gruijter (Eds.). Psychometrics for educational debates. New York: Wiley.1 aFischer, G H1 aPendl, P uhttp://mail.iacat.org/content/individualized-testing-basis-rasch-model00741nas a2200145 4500008004100000245018400041210006900225260010800294100001600402700001700418700001500435700001100450700001200461856012200473 1974 eng d00aComputer-based adaptive testing models for the Air Force technical training environment: Phase I: Development of a computerized measurement system for Air Force technical Training0 aComputerbased adaptive testing models for the Air Force technica aJSAS Catalogue of Selected Documents in Psychology, 5, 1-86 (MS No. 882). AFHRL Technical Report 74-48.1 aHansen, D N1 aJohnson, B F1 aFagan, R L1 aTan, P1 aDick, W uhttp://mail.iacat.org/content/computer-based-adaptive-testing-models-air-force-technical-training-environment-phase-i00544nas a2200121 4500008004100000245006900041210006700110260010600177100001700283700001400300700001600314856009200330 1974 eng d00aDevelopment of a programmed testing system (Technical Paper 259)0 aDevelopment of a programmed testing system Technical Paper 259 aArlington VA: US Army Research Institute for the Behavioral and Social Sciences. NTIS No. AD A001534)1 aBayroff, A G1 aRoss, R M1 aFischl, M A uhttp://mail.iacat.org/content/development-programmed-testing-system-technical-paper-25900570nas a2200109 4500008004100000245013800041210006900179260005100248100001800299700001600317856012700333 1973 eng d00aImplementation of a Bayesian system for decision analysis in a program of individually prescribed instruction (Research Report No 60)0 aImplementation of a Bayesian system for decision analysis in a p aIowa City IA: American College Testing Program1 aFerguson, R L1 aNovick, M R uhttp://mail.iacat.org/content/implementation-bayesian-system-decision-analysis-program-individually-prescribed-instruction00567nas a2200109 4500008004100000245011200041210006900153260008500222100001800307700001100325856012100336 1971 eng d00aThe application of item generators for individualizing mathematics testing and instruction (Report 1971/14)0 aapplication of item generators for individualizing mathematics t aPittsburgh PA: University of Pittsburgh Learning Research and Development Center1 aFerguson, R L1 aHsu, T uhttp://mail.iacat.org/content/application-item-generators-individualizing-mathematics-testing-and-instruction-report00412nas a2200097 4500008004100000245005600041210005600097260005900153100001800212856008400230 1971 eng d00aComputer assistance for individualizing measurement0 aComputer assistance for individualizing measurement aPittsburgh PA: University of Pittsburgh R and D Center1 aFerguson, R L uhttp://mail.iacat.org/content/computer-assistance-individualizing-measurement-100407nas a2200109 4500008004100000245006700041210006300108300001000171490000700181100001800188856009100206 1971 eng d00aA model for computer-assisted criterion-referenced measurement0 amodel for computerassisted criterionreferenced measurement a25-310 v811 aFerguson, R L uhttp://mail.iacat.org/content/model-computer-assisted-criterion-referenced-measurement00385nas a2200109 4500008004100000245005600041210005600097300000700153490001500160100001800175856008200193 1970 eng d00aComputer assistance for individualizing measurement0 aComputer assistance for individualizing measurement a190 vMarch 19701 aFerguson, R L uhttp://mail.iacat.org/content/computer-assistance-individualizing-measurement00439nas a2200097 4500008004100000245005600041210005600097260008600153100001800239856008400257 1970 eng d00aComputer assistance for individualizing measurement0 aComputer assistance for individualizing measurement aPittsburgh PA: University of Pittsburgh, Learning Research and Development Center1 aFerguson, R L uhttp://mail.iacat.org/content/computer-assistance-individualizing-measurement-000397nas a2200097 4500008003900000245006700039210006300106260001900169100001800188856009300206 1970 d00aA model for computer-assisted criterion-referenced measurement0 amodel for computerassisted criterionreferenced measurement aMinneapolis MN1 aFerguson, R L uhttp://mail.iacat.org/content/model-computer-assisted-criterion-referenced-measurement-000517nas a2200097 4500008004100000245007700041210006900118260010900187100001800296856010500314 1969 eng d00aComputer-assisted criterion-referenced measurement (Working Paper No 49)0 aComputerassisted criterionreferenced measurement Working Paper N aPittsburgh PA: University of Pittsburgh, Learning and Research Development Center. (ERIC No. ED 037 089)1 aFerguson, R L uhttp://mail.iacat.org/content/computer-assisted-criterion-referenced-measurement-working-paper-no-4900624nam a2200097 4500008003900000245014200039210006900181260014200250100001800392856011600410 1969 d00aThe development, implementation, and evaluation of a computer-assisted branched test for a program of individually prescribed instruction0 adevelopment implementation and evaluation of a computerassisted  aDoctoral dissertation, University of Pittsburgh. Dissertation Abstracts International, 30-09A, 3856. (University Microfilms No. 70-4530).1 aFerguson, R L uhttp://mail.iacat.org/content/development-implementation-and-evaluation-computer-assisted-branched-test-program