TitleEvaluation of computer adaptive testing systems
Publication TypeJournal Article
Year of Publication2007
AuthorsEconomides, AA, Roupas, C
JournalInternational Journal of Web-Based Learning and Teaching Technologies
Volume2
Number1
Pagination70-87
Publication Languageeng
ISBN Number1548-1093 (Print); 1548-1107 (Electronic)
Accession Number2007-04391-004
Keywordscomputer adaptive testing systems, examination organizations, systems evaluation
Abstract

Many educational organizations are trying to reduce the cost of the exams, the workload and delay of scoring, and the human errors. Also, they try to increase the accuracy and efficiency of the testing. Recently, most examination organizations use computer adaptive testing (CAT) as the method for large scale testing. This article investigates the current state of CAT systems and identifies their strengths and weaknesses. It evaluates 10 CAT systems using an evaluation framework of 15 domains categorized into three dimensions: educational, technical, and economical. The results show that the majority of the CAT systems give priority to security, reliability, and maintainability. However, they do not offer to the examinee any advanced support and functionalities. Also, the feedback to the examinee is limited and the presentation of the items is poor. Recommendations are made in order to enhance the overall quality of a CAT system. For example, alternative multimedia items should be available so that the examinee would choose a preferred media type. Feedback could be improved by providing more information to the examinee or providing information anytime the examinee wished. (PsycINFO Database Record (c) 2007 APA, all rights reserved)