03050nas a2200241   4500008004100000020004100041245017000082210007100252250001500323300001000338490000700348520214300355653001402498653006602512653001102578653001302589100001402602700001202616700001402628700001502642700001702657856013402674       2010                        spa d  a0214-9915 (Print)0214-9915 (Linking)00aDeterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT [Item parameter drift in computerized adaptive testing: Study with eCAT]0 aDeterioro de parámetros de los ítems en tests adaptativos inform  a2010/04/29  a340-70 v223 a<p>En el presente trabajo se muestra el an&aacute;lisis realizado sobre un Test Adaptativo Informatizado (TAI) dise&ntilde;ado para la evaluaci&oacute;n del nivel de ingl&eacute;s, denominado eCAT, con el objetivo de estudiar el deterioro de par&aacute;metros (parameter drift) producido desde la calibraci&oacute;n inicial del banco de &iacute;tems. Se ha comparado la calibraci&oacute;n original desarrollada para la puesta en servicio del TAI (N= 3224) y la calibraci&oacute;n actual obtenida con las aplicaciones reales del TAI (N= 7254). Se ha analizado el Funcionamiento Diferencial de los &Iacute;tems (FDI) en funci&oacute;n de los par&aacute;metros utilizados y se ha simulado el impacto que sobre el nivel de rasgo estimado tiene la variaci&oacute;n en los par&aacute;metros. Los resultados muestran que se produce especialmente un deterioro de los par&aacute;metros a y c, que hay unimportante n&uacute;mero de &iacute;tems del banco para los que existe FDI y que la variaci&oacute;n de los par&aacute;metros produce un impacto moderado en la estimaci&oacute;n de &theta; de los evaluados con nivel de ingl&eacute;s alto. Se concluye que los par&aacute;metros de los &iacute;tems se han deteriorado y deben ser actualizados.Item parameter drift in computerized adaptive testing: Study with eCAT. This study describes the parameter drift analysis conducted on eCAT (a Computerized Adaptive Test to assess the written English level of Spanish speakers). The original calibration of the item bank (N = 3224) was compared to a new calibration obtained from the data provided by most eCAT operative administrations (N =7254). A Differential Item Functioning (DIF) study was conducted between the original and the new calibrations. The impact that the new parameters have on the trait level estimates was obtained by simulation. Results show that parameter drift is found especially for a and c parameters, an important number of bank items show DIF, and the parameter change has a moderate impact on high-level-English &theta; estimates. It is then recommended to replace the original estimates by the new set. by the new set.</p>
10a*Software10aEducational Measurement/*methods/*statistics & numerical data10aHumans10aLanguage1 aAbad, F J1 aOlea, J1 aAguado, D1 aPonsoda, V1 aBarrada, J R  uhttp://mail.iacat.org/content/deterioro-de-par%C3%A1metros-de-los-%C3%ADtems-en-tests-adaptativos-informatizados-estudio-con-ecat02175nas a2200301   4500008004100000020001400041245010200055210006900157250001500226300001200241490000700253520109000260653001501350653001501365653002101380653004801401653002401449653002801473653006201501653005701563653001101620653002701631653004601658100001701704700001201721700001401733856012601747       2008                        eng d  a1138-741600aRotating item banks versus restriction of maximum exposure rates in computerized adaptive testing0 aRotating item banks versus restriction of maximum exposure rates  a2008/11/08  a618-6250 v113 a<p>If examinees were to know, beforehand, part of the content of a computerized adaptive test, their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp &amp; van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy, However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson &amp; Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.</p>
10a*Character10a*Databases10a*Software Design10aAptitude Tests/*statistics & numerical data10aBias (Epidemiology)10aComputing Methodologies10aDiagnosis, Computer-Assisted/*statistics & numerical data10aEducational Measurement/*statistics & numerical data10aHumans10aMathematical Computing10aPsychometrics/statistics & numerical data1 aBarrada, J R1 aOlea, J1 aAbad, F J  uhttp://mail.iacat.org/content/rotating-item-banks-versus-restriction-maximum-exposure-rates-computerized-adaptive-testing