Scoring and classifying examinees using measurement decision theory

Practical Assessment, Research and Evaluation

Volumn 14, Issue 8, 2009, Pages

  Rudner, Lawrence M ^a  

^a Graduate Management Admission Council   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84864882918     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. Allen, N. L., Carlson, J. E. and Zelenak, C.A. (2000). The NAEP 1996 technical report. Washington, DC: National Center for Educational Statistics. Available online: http://nces.ed.gov/nationsreportcard/pubs/main1996/1999452.asp
2. Birnbaum, A. (1968). Some latent trait models. In F.M. Lord & M.R. Novick, (Eds.), Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
3. Chang, H.-H., and Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 213-229.
4. Colorado State Department of Education (2000). Colorado Student Assessment Program (CSAP), technical report, grade 5 mathematics. Available online:http://www.cde.state.co.us/cdeassess/download/pdf/as_csaptech5math99.pdf
5. Cover, T.M. and J.A. Thomas, Elements of information theory. New York: Wiley, 1991.
6. Cronbach, L.J. and Gleser, G.C. (1957). Psychological tests and personnel decisions. Urbana: University of Illinois Press.
7. Domingos P. and M. Pazzani (1997). On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29, 103--130. Available online:http://citeseer.nj.nec.com/48.html .
8. Eggen, T. J. H. M. (1999). Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement, 23(3), 249-61.
9. Ferguson, R.L. (1969). The development, implementation, and evaluation of a computer assisted branched test for individually prescribed instruction. Doctoral dissertation. University of Pittsburgh, Pittsburgh, P.A.
10. Hambleton, R. and Novick, M (1973). Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement, 10, 159-170.
11. Huyhn, H. (1976). Statistical considerations for mastery scores. Psychometrika, 41, 65-79.
12. Kingsbury, G. G., & Weiss, D. J. (1983). A comparison of IRT-based adaptive mastery testing and a sequential mastery testing procedure. In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 257-283). New York: Academic Press.
13. Kullback, S. & Leibler, R.A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79-86.
14. Lewis, C. and Sheehan, K. (1990). Using Bayesian decision theory to design a computerized mastery test. Applied Psychological Measurement, 14(2), 367-86.
15. Lin, C.-J. and Spray, J. (2000). Effects of item-selection criteria on classification testing with the sequential probability ratio test. ACT Research Report Series.
16. Lord, Frederick M. (1980). Applications of Item Response Theory to Practical Testing Problems. Hillsdale, NJ: Erlbaum.
17. Macready, G. and Dayton C. M. (1977). The use of probabilitistic models in the assessment of mastery. Journal of Educational Statistics. 2(2), 99-120.
18. Macready, G. and Dayton C. M. (1992). The application of latent class models in adaptive testing. Psychometrika, 57(1), 71-88.
19. Melsa, J.L and Cohn, D.L. (1978). Decision and Estimation Theory. New York: McGraw-Hill Book Company.
20. Mislevy, R. J., & Gitomer, D. H. (1996). The role of probability-based inference in an intelligent tutoring system. User-Mediated and User-Adapted Interaction, 5, 253-282.
21. Parshall, C. G., Spray, J. A., Kalohn, J. C., & Davey, T. (2006). Practical considerations in computer-based testing. New York: Springer.
22. Reckase, M. D. (1983). A procedure for decision making using tailored testing. In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 237-255). New York: Academic Press.
23. Shannon, C.E. (1948). A mathematical theory of communication, Bell System Technical Journal, 27, 379-423 and 623-656, July and October. Available online: http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html
24. Sheehan, K. and Lewis, C. (1992). Computerized mastery testing with nonequivalent testlets. Applied Psychological Measurement, 16(1), 65-76.
25. Spray, J.A. and Reckase, M.D. (1996). Comparison of SPRT and sequential Bayes procedures for classifying examinees into two categories using a computerized test. Journal of Educational and Behavioral Statistics, 21(4), 405-14.
26. Spray, J.A. and Reckase, M.D. (1994). The selection of test items for decision making with a computer adaptive test. Paper presented at the Annual Meeting of the National Council on Measurement in Education (New Orleans, LA, April 5-7, 1994).
27. Thompson, Nathan A. (2007). A Practitioner's Guide for Variable-length Computerized Classification Testing. Practical Assessment Research & Evaluation, 12(1). Available online: http://pareonline.net/getvn.asp?v=12&n=1
28. van der Linden, W. J. and Mellenbergh, G.J. (1978). Coefficients for tests from a decision-theoretic point of view. Applied Psychological Measurement, 2, 119-134.
29. van der Linden, W. J. and Vos, H. J. (1966) A compensatory approach to optimal selection with mastery scores. Psychometrika, 61(1), 155-72.
30. Vos, H. J. (1999). Applications of Bayesian decision theory to sequential mastery testing. Journal of Educational and Behavioral Statistics, 24(3), 271-92.
31. Wald, A. (1939). A New Formula for the Index of Cost of Living,. Econometrica 7(4), 319-331.
32. Wald, A. (1947). Sequential analysis. New York: Wiley.
33. Wald, A. (1950). Statistical Decision Functions. New York: Wiley.
34. Welch, R.E. & Frick, T. (1993). Computerized adaptive testing in instructional settings. Educational Technology Research & Development, 41(3), 47-62.
35. Wood, R. (1976). Adaptive testing: A Bayesian procedure for the efficient measurement of ability. Programmed Learning and Educational Technology, 13, 2, 36-48.