TitleWalking the Tightrope: Using Better Content Control to Improve CAT
Publication TypeConference Paper
Year of Publication2011
AuthorsGialluca, KA
Conference NameAnnual Conference of the International Association for Computerized Adaptive Testing
Date Published10/2011
KeywordsCAT, CAT evolution, test content

All testing involves a balance between measurement precision and content considerations. CAT item-selection algorithms have evolved to accommodate content considerations. Reviews CAT evolution including: Original/”Pure” adaptive exams, Constrained CAT, Weighted-deviations method, Shadow-Test Approach, Testlets instead of fully adapted tests, Administration of one item may preclude the administration of other item(s), and item relationships.

Research Questions

  • How do the (new) item-selection algorithms perform in terms of measurement precision? item exposure? item-pool usage?
  • Do we know the best way to incorporate item sets into adaptive exams?
  • Consider exams with multiple item types. Must the item types be treated separately in a CAT, or can we adapt exams across item types?