03184nas a2200157 4500008004100000245010000041210006900141260005500210520260800265653002002873653001602893653001102909100001902920700001602939856007102955 2017 eng d00aThe Implementation of Nationwide High Stakes Computerized (adaptive) Testing in the Netherlands0 aImplementation of Nationwide High Stakes Computerized adaptive T aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

In this presentation the challenges of implementation of (adaptive) digital testing in the Facet system in the Netherlands is discussed. In the Netherlands there is a long tradition of implementing adaptive testing in educational settings. Already since the late nineties of the last century adaptive testing was used mostly in low stakes testing. Several CATs were implemented in student monitoring systems for primary education and in the general subjects language and arithmetic in vocational education. The only nationwide implemented high stakes CAT is the WISCAT-pabo: an arithmetic test for students in the first year of primary school teacher colleges. The psychometric advantages of item based adaptive testing are obvious. For example efficiency and high measurement precision. But there are also some disadvantages such as the impossibility of reviewing items during and after the test. During the test the student is not in control of his own test; e.q . he can only navigate forward to the next item. This is one of the reasons other methods of testing, such as multistage-testing, with adaptivity not on the item level but on subtest level, has become more popular to use in high stakes testing.

A main challenge of computerized (adaptive) testing is the implementation of the item bank and the test workflow in a digital system. Since 2014 a nationwide new digital system (Facet) was introduced in the Netherlands, with connections to the digital systems of different parties based on international standards (LTI and QTI). The first nationwide tests in the Facet-system were flexible exams Dutch and arithmetic for vocational (and secondary) education, taken as item response theory-based equated linear multiple forms tests, which are administered during 5 periods in a year. Nowadays there are some implementations of different methods of (multistage) adaptive testing in the same Facet system (DTT en Acet).

In this conference, other presenters of Cito will elaborate on the psychometric characteristics of this other adaptive testing methods. In this contribution, the system architecture and interoperability of the Facet system will be explained. The emphasis is on the implementation and the problems to be solved by using this digital system in all phases of the (adaptive) testing process: item banking, test construction, designing, publication, test taking, analyzing and reporting to the student. An evaluation of the use of the system will be presented.

Session Video

10aHigh stakes CAT10aNetherlands10aWISCAT1 avan Boxel, Mia1 aEggen, Theo uhttps://drive.google.com/open?id=1Kn1PvgioUYaOJ5pykq-_XWnwDU15rRsf01252nas a2200181 4500008004100000245012100041210006900162260001200231520055600243653003300799653000800832653001900840653003500859100001800894700001600912700002200928856012000950 2011 eng d00aItem Selection Methods based on Multiple Objective Approaches for Classification of Respondents into Multiple Levels0 aItem Selection Methods based on Multiple Objective Approaches fo c10/20113 a

Is it possible to develop new item selection methods which take advantage of the fact that we want to classify into multiple categories? New methods: Taking multiple points on the ability scale into account; Based on multiple objective approaches.

Conclusions

10aadaptive classification test10aCAT10aitem selection10asequential classification test1 aGroen, Maaike1 aEggen, Theo1 aVeldkamp, Bernard uhttp://mail.iacat.org/content/item-selection-methods-based-multiple-objective-approaches-classification-respondents00437nas a2200109 4500008004100000245008200041210006900123300001200192490000700204100001600211856010000227 1999 eng d00aItem selection in adaptive testing with the sequential probability ratio test0 aItem selection in adaptive testing with the sequential probabili a249-2610 v231 aEggen, Theo uhttp://mail.iacat.org/content/item-selection-adaptive-testing-sequential-probability-ratio-test00517nas a2200097 4500008004100000245013300041210006900174260003500243100001600278856012500294 1998 eng d00aItem selection in adaptive testing with the sequential probability ratio test (Measurement and Research Department Report, 98-1)0 aItem selection in adaptive testing with the sequential probabili aArnhem, The Netherlands: Cito.1 aEggen, Theo uhttp://mail.iacat.org/content/item-selection-adaptive-testing-sequential-probability-ratio-test-measurement-and-research