Multistage testing explained

Multistage testing is an algorithm-based approach to administering tests. It is very similar to computer-adaptive testing in that items are interactively selected for each examinee by the algorithm, but rather than selecting individual items, groups of items are selected, building the test in stages. These groups are called testlets or panels.^[1]

While multistage tests could theoretically be administered by a human, the extensive computations required (often using item response theory) mean that multistage tests are administered by computer.

The number of stages or testlets can vary. If the testlets are relatively small, such as five items, ten or more could easily be used in a test. Some multistage tests are designed with the minimum of two stages (one stage would be a conventional fixed-form test).^[2]

In response to the increasing use of multistage testing, the scholarly journal Applied Measurement in Education published a special edition on the topic in 2006.^[3]

References

• Yan, D., von Davier, A., and Lewis, C (2014). Computerized Multistage Testing: Theory and Applications. Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences.
• Magis, D., Yan, D., and von Davier, A. (2017). Computerized Adaptive and Multistage Testing with R. Springer.

Further reading

• Book: Wainer, Howard . Howard Wainer

. Testlet Response Theory and its Applications . Howard Wainer . New York . Cambridge University Press . 2007 .

Notes and References

1. Luecht, R. M. & Nungester, R. J. (1998). "Some practical examples of computer-adaptive sequential testing." Journal of Educational Measurement, 35, 229-249.
2. Castle, R.A. (1997). "The Relative Efficiency of Two-Stage Testing Versus Traditional Multiple Choice Testing Using Item Response Theory in Licensure." Unpublished doctoral dissertation.http://dwb.unl.edu/Diss/RCastle/ReedCastleDiss.html
3. Applied Measurement in Education edition on multistage testing http://www.leaonline.com/toc/ame/19/3