Using latent class analysis to set academic performance standards

Educational Assessment

Volumn 12, Issue 3-4, 2007, Pages 283-301

  Brown, Richard S ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 35948933543     PISSN: 10627197     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (41)

1. Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52, 317-332.
2. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600). Washington, DC: American Council on Education.
3. Baker, E. L., Freeman, F., & Clayton, S. (1991). Cognitive assessment of history for large-scale testing. In M. C. Wittrock & E. L. Baker (Eds.), Testing and cognition (pp. 131-153). Englewood Cliffs, NJ: Prentice Hall.
4. Bergan, J. R. (1983). Latent-class models in educational research. In E. W. Gordon (Ed.), Review of research in education (Vol. 10, pp. 305-360). Washington, DC: American Educational Research Association.
5. Bergan, J. R., & Stone, C. A. ( 1985). Latent class models for knowledge domains. Psychological Bulletin, 98, 166-184.
6. Berk, R. A. (1986). A consumer's guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56, 137-172.
7. Berk, R. A. (1996). Standard setting: The next generation (Where few psychometricians have gone before!), Applied Measurement in Education, 9, 215-235.
8. Bontempo, B. D., Marks, C. M., & Karabatsos, G. (1998, April). A meta-analytic assessment of empirical differences in standard setting procedures. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
9. Cizek, G. J. (Ed.). (2001). Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum Associates.
10. Dayton, C. M. (1991). Educational applications of latent class analysis. Measurement and Evaluation in Counseling and Development, 24, 131-141.
11. Dayton, C. M., & MacReady, G. B. (1976). A probabilistic model for validation of behavior hierarchies. Psychometrika, 41, 189-204.
12. Ebel, R. L. (1972). Essentials of educational measurement. Englewood Cliffs, NJ: Prentice Hall.
13. Garrido, M. (1985). An experimental study of the effect of judges' knowledge of item performance data on two forms of the Angoff standard setting method. Dissertation Abstracts International, 1985 Nov. 46 5-A, 1228-1229.
14. Haertel, E. (1984). An application of latent class models to assessment data. Applied Psychological Measurement, 8, 333-346.
15. Haertel, E. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 301-321.
16. Hamberlin, M. K. (1985). Influence of item response theory and type of judge on a standard set using the iterative Angoff standard setting method. Dissertation Abstracts International, 1993 Feb. 53 8-A, 2781.
17. Hambleton, R. K., & Plake, B. S. (1995). Using an extended Angoff procedure to set standards on complex performance assessments. Applied Measurement in Education, 8, 41-55.
18. Hurtz, G. M., Sanders, L. M., & Hertz, N. R. (1996, April). An investigation of the optimal number of raters for setting pass points with the Angoff method. Paper presented at the annual meeting of the Society of Industrial and Organizational Psychologists, San Diego, CA.
19. Impara, J. C., & Plake, B. S. (1995). Editor's note. Applied Measurement in Education, 8, 1-2.
20. Jaeger, R. M. (1982). An iterative structured judgment process for establishing standards on competency tests: Theory and application. Educational Evaluation and Policy Analysis, 4, 461-476.
21. Jaeger, R. M. (1995). Setting performance standards through two-stage judgmental policy capturing. Applied Measurement in Education, 8, 15-40.
22. Kingsbury, G. G., Olsen, A., Cronin, J., Hauser, C., & Houser, R. (2003). The state of state standards (Research Brief). Lake Oswego, OR: Northwest Evaluation Association. Retrieved November 17, 2006, from www.nwea.org/research/national.asp
23. Longford, N. T. (1996). Reconciling experts' differences in setting cut scores for pass-fail decisions. Journal of Educational and Behavioral Statistics, 21, 203-213.
24. Luecht, R. M., & DeChamplain, A. ( 1998, April). Applications of latent class analysis to mastery decisions using complex performance assessments. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
25. Muthén, L. K., & Muthén, B. O. (1998). Mplus: A comprehensive modeling program for applied researchers. Los Angeles: Muthén & Muthén.
26. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
27. Niemi, D. (1996). Assessing conceptual understanding in mathematics: Representations, problem solutions, justifications, and explanations. Journal of Educational Research, 89, 351-363.
28. Norcini, J. ( 1987). The answer key as a source of error in examinations of professionals. Journal of Educational Measurement, 24, 321-331.
29. Plake, B. S., Hambleton, R. K., & Jaeger, R. M. (1997). A new standard-setting method for performance assessments: The dominant profile judgment method and some field-test results. Educational and Psychological Measurement, 57, 400-411.
30. Plake. B. S., Impara, J. C., & Potenza, M. T. (1994). Content specificity of expert judgments in a standard-setting study. Journal of Educational Measurement, 31, 339-347.
31. Plake, B. S., & Melican, G.J. (1989). Effects of item context on intrajudge consistency of expert judgments via the Nedelsky Standard Setting Method. Educational and Psychological Measurement, 49, 45-51.
32. Putnam, S. E., Pence, P., & Jaeger, R. M. (1995). A multi-stage dominant profile method for setting standards on complex performance assessments. Applied Measurement in Education, 8, 57-83.
33. Reckase, M. D. (2006a). A conceptual framework for a psychometric theory for standard setting with examples of its use for evaluating the functioning of two standard setting methods. Educational Measurement: Issues and Practice, 25(2), 4-18.
34. Reckase, M. D. (2006b). Rejoinder: Evaluating standard setting methods using error models proposed by Shulz. Educational Measurement: Issues and Practice, 25(3), 14-17.
35. Schulz, E. M. (2006). Commentary: A response to Reckase's conceptual framework and examples for evaluating standard setting methods. Educational Measurement: Issues and Practice, 25(3), 4-13.
36. Schwartz, G. (1978). Estimating the dimensions of a model. Annals of Statistics, 6, 461-464.
37. Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333-343.
38. Sireci, S. G., Robin, F., & Patelis, T. (1999). Using cluster analysis to facilitate standard setting. Applied Measurement in Education, 12, 301-325.
39. Smith, R. L. (1987). The item characteristics judges use when setting standards. Dissertation Abstracts International, 47 8-A, 2966.
40. Smith, R. L., & Smith, J. K. (1988). Differential use of item information by judges using Angoff and Nedelsky procedures. Journal of Educational Measurement, 25, 259-274.
41. Taylor, C. S. (1987). The relationship between test length, standard setting method and decision consistency reliability. Dissertation Abstracts International, 48 4-B, 1183.