Relations between observed item difficulty levels and angoff minimum passing levels for a group of borderline examinees

Applied Measurement in Education

Volumn 12, Issue 1, 1999, Pages 13-28

  Goodwin, Laura D ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0033477286     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15324818ame1201_2     Document Type: Article

References (41)

1. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
2. Bejar, I. I. (1983). Subject matter experts' assessment of item statistics. Applied Psychological Measurement, 7, 303-310.
3. Berk, R. A. (1986). A consumer's guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56, 137-172.
4. Berk, R. A. (1996). Standard setting: The next generation (where few psychometricians have gone before!). Applied Measurement in Education, 9, 215-235.
5. Bernknopf, S., Curry, A., & Bashaw, W. L. (1979, April). A defensible model for determining a minimal cut-off score for criterion-referenced tests. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco.
6. Busch, J. C., & Jaeger, R. M. (1990). Influence of type of judge, normative information, and discussion on standards recommended for the National Teacher Examination. Journal of Educational Measurement, 27, 145-163.
7. Certified Financial Planner Board of Standards. (1995). General information booklet. Denver, CO: Author.
8. Cizek, G. J. (1996a). Setting passing scores. Educational Measurement: Issues and Practice, 15(2), 20-31.
9. Cizek, G. J. (1996b). Standard-setting guidelines. Educational Measurement: Issues and Practice, 15(1), 13-21.
10. Cross, L. H., Impara, J. C., Frary, R. B., & Jaeger, R. M. (1984). A comparison of three methods for establishing standards on the National Teacher Examinations. Journal of Educational Measurement, 21, 113-129.
11. Ebel, R. L. (1972). Essentials of educational measurement. Englewood Cliffs, NJ: Prentice-Hall.
12. Educational Testing Service. (1976). Report on a study of the use of the National Teachers' Examination by the state of South Carolina. Princeton, NJ: Author.
13. Glass, G. V. (1978). Standards and criteria. Journal of Educational Measurement, 15, 237-261.
14. Halpin, G., & Halpin, G. (1987). An analysis of the reliability and validity of procedures for setting minimum competency standards. Educational and Psychological Measurement, 47, 977-983.
15. Hambleton, R. K. (1980). Test score validity and standard-setting methods. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art (pp. 80-123). Baltimore: Johns Hopkins University Press.
16. Hambleton, R. K., & Plake, B. S. (1995). Using an extended Angoff procedure to set standards on complex performance assessments. Applied Measurement in Education, 8, 41-45.
17. Hambleton, R. K., Swaminathan, H., Algina, J., & Coulson, D. B. (1978). Criterion-referenced testing and measurement: A review of technical issues and developments. Review of Educational Research, 48, 1-47.
18. Impara, J. C., & Plake, B. S. (1996, April). Teachers' ability to estimate item difficulty: A test of the assumptions in the Angoff standard setting method. Paper presented at the annual meeting of the National Council on Measurement in Education, New York.
19. Jaeger, R. M. (1979). Measurement consequences of selected standard-setting models. In M. A. Bunda & J. R. Sanders (Eds.), Practices and problems in competency-based measurement (pp. 48-58). Washington, DC: National Council on Measurement in Education.
20. Jaeger, R. M. (1982). An iterative structured judgment process for establishing standards on competency tests: Theory and application. Educational Evaluation and Policy Analysis, 4, 461-475.
21. Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 485-514). New York: American Council on Education and Macmillan.
22. Jaeger, R. M. (1990). Establishing standards for teacher certification tests. Educational Measurement: Issues and Practice, 9(4), 15-20.
23. Jaeger, R. M. (1991). Selection of judges for standard-setting. Educational Measurement: Issues and Practice, 10(2), 3-6, 10, 14.
24. Kane, M. T. (1994). Validating the performance standards associated with passing scores. Review of Educational Research, 64, 425-461.
25. Kane, M. T., & Wilson, J. (1984). Errors of measurement and standard setting in mastery testing. Applied Psychological Measurement, 8, 107-115.
26. Livingston, S. A., & Zieky, M. J. (1982). Passing scores: A manual for setting standards of performance on educational and occupational tests. Princeton, NJ: Educational Testing Service.
27. Mills, C. N. (1995). Establishing passing standards. In J. C. Impara (Ed.), Licensure testing: Purposes, procedures, and practices (pp. 219-252). Lincoln: University of Nebraska, Buros Institute of Mental Measurements.
28. Mills, C. N., Melican, G. J., & Ahluwalia, N. T. (1991). Defining minimal competence. Educational Measurement: Issues and Practice, 10(2), 7-10.
29. Most, B. (1993). The new CFP examination: Pass or fail? Financial Planning, 22(9), p. 57.
30. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
31. Norcini, J. J. (1994). Research on standards for professional license and certification examinations. Evaluation & The Health Professions, 17, 160-177.
32. Norcini, J. J., Lipner, R. S., Langdon, L. O., & Strecker, C. A. (1987). A comparison of three variations on a standard-setting method. Journal of Educational Measurement, 24, 56-64.
33. Norcini, J. J., Shea, J. A., & Kanya, D. T. (1988). The effect of various factors in standard setting. Journal of Educational Measurement, 25, 57-65.
34. Plake, B. S., Melican, G. J., & Mills, C. N. (1991). Factors influencing intrajudge consistency during standard-setting. Educational Measurement: Issues and Practice, 10(2), 15-16, 22, 25-26.
35. Reid, J. B. (1991a). Standard setting study conducted for the International Board of Standards and Practices for Certified Financial Planners, Inc. Denver, CO: Certified Financial Planner Board of Standards.
36. Reid, J.B. (1991b). Training judges to generate standard-setting data. Educational Measurement: Issues and Practice, 10(2), 11-14.
37. Shepard, L. A. (1984). Setting performance standards. In R. A. Berk (Ed.), A guide to criterion-referenced test construction (pp. 169-198). Baltimore: Johns Hopkins University Press.
38. Shepard, L., Glaser, R., Linn, R., & Bohrnstedt, G. (1993). Setting performance standards for student achievement. Stanford, CA: National Academy of Education.
39. Sireci, R. L., & Biskin, B. H. (1992). Measurement practices in national licensing examination programs: A survey. CLEAR Exam Review, 3(1), 21-25.
40. Smith, R. L., & Smith, J. K. (1988). Differential use of item information by judges using Angoff and Nedelsky procedures. Journal of Educational Measurement, 25, 259-274.
41. van der Linden, W. J. (1982). A latent trait method for determining intrajudge inconsistency in the Angoff and Nedelsky techniques of standard setting. Journal of Educational Measurement, 19, 295-308.