A Binomial Trials Model for Examining the Ratings of Standard-Setting Judges

Applied Measurement in Education

Volumn 11, Issue 3, 1998, Pages 209-230

  Engelhard Jr , George ^a   Anderson, David W ^b  

^a EMORY UNIVERSITY   (United States)

^b Stt Med Education Board of Georgia   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0032390668     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15324818ame1103_1     Document Type: Article

References (32)

1. Andrich, D. ( 1978a). A binomial latent trait model for the study of Likert-style attitude questionnaires. British Journal of Mathematical and Statistical Psychology, 31, 84-98.
2. Andrich, D. (1978b). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
3. Andrich, D. (1982a). An extension of the Rasch model for ratings providing for both location and dispersion parameters. Psychometrika, 47, 105-113.
4. Andrich, D. (1982b). An index of person separation in latent trait theory, the traditional KR.20 index and the Gunman scale response pattern. Education Research and Perspectives, 9, 95-104.
5. Andrich, D. (1988). Rasch models for measurement. Newbury Park, CA: Sage.
6. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thomdike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council of Education.
7. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51
8. Brennan, R. L. (1994, October). Standard setting from the perspective of generalizability theory. Paper presented at the Joint Conference on Standard Setting for Large-Scale Assessments sponsored by the National Assessment Governing Board and the National Center for Educational Statistics, Washington, DC.
9. Ebel, R. L. (1972). Essentials of educational measurement. Englewood Cliffs, NJ: Prentice Hall.
10. Engelhard, G. (1994). Examining rater errors in the assessment of written composition with a many-faceted Rasch model. Journal of Educational Measurement, 31, 93-112.
11. Feller, W. (1968). An introduction to probability theory and its applications (3rd ed.). New York: Wiley.
12. Georgia Department of Education. (1993). Georgia High School Graduation Test: Content description for mathematics. Atlanta, GA: Author.
13. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
14. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic.
15. Impara, J. C., & Plake, B. S. (Eds.). (1995). Standard setting for complex performance tasks [Special issue]. Applied Measurement in Education, 8(1).
16. Jaeger, R. M. (1982). An iterative structured judgment process for establishing standards on competency tests: Theory and application. Educational Evaluation and Policy Analysis, 4, 461-476.
17. Jaeger, R. M. (1988). Use and effect of caution indices in detecting aberrant patterns of standard-setting judgments. Applied Measurement in Education, 1, 17-31.
18. Kane, M. T. (1987). On the use of IRT models with judgmental standard setting procedures. Journal of Educational Measurement, 24, 333-345.
19. Linacre, J. M., Engelhard, G., Tatum, D. S., & Myford, C. M. (1994). Measurement with judges: Many-faceted conjoint measurement. International Journal of Educational Research, 21, 569-577.
20. Linacre, J. M., & Wright, B. D. (1994). A user' guide to FACETS: Roach measurement computer program. Chicago: MESA.
21. Livingston, S. A., & Zieky, M. J. (1982). Passing scores: A manual for setting standards of performance on educational and occupational tests. Princeton, NJ: Educational Testing Service.
22. Lunz, M. E., Wright, B. D., & Linacre, J. M. (1990). Measuring the impact of judge severity on examination scores. Applied Measurement in Education, 3, 331-345.
23. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
24. Moore, D. S., & McCabe, G. P. (1993). Introduction to the practice of statistics (2nd ed.). New York: Freeman.
25. Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
26. Myford, C. M., & Mislevy, R. J. (1995). Monitoring and improving a portfolio assessment system. Princeton, NJ: Educational Testing Service.
27. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
28. Plake, B. S. (1989). Effects of item context on intrajudge consistency of expert judgments via the Nedelsky standard setting method. Educational and Psychological Measurement, 49, 295-308.
29. Rasch, G. (1980). Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press.
30. van der Linden, W. J. (1982). A latent trait method for determining intrajudge consistency in the Angoff and Nedelsky techniques of standard setting. Journal of Educational Measurement, 19, 295-308.
31. Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago: Mesa.
32. Zieky, M. J. (1994, October). A historical perspective on standard setting. Paper presented at the Joint Conference on Standard Setting for Large-Scale Assessments sponsored by the National Assessment Governing Board and the National Center for Educational Statistics, Washington, DC.