Using resampling to estimate the precision of an empirical standard-setting method

Applied Measurement in Education

Volumn 16, Issue 3, 2003, Pages 245-256

  Muijtjens, Arno M M ^a   Kramer, Anneke W M ^c   Kaufman, David M ^b   Van der Vleuten, Cees P M ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b SIMON FRASER UNIVERSITY   (Canada)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0042074096     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15324818AME1603_5     Document Type: Review

References (16)

1. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational Measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
2. Berk, R. A. (1986). A consumer's guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56(1) 137-172.
3. Cohen, A. S., Kane, M. T., & Crooks, T. J. (1999). A generalized examinee-centered method for setting standards on achievement tests. Applied Measurement in Education, 12(4), 343-366.
4. Draper, N. R., & Smith, H. (1981). Applied regression analysis. New York: Wiley.
5. Hambleton, R. K., & Rogers, H. J. (1991). Advances in criterion-referenced measurement. In R. K. Hambleton and J. N. Zaal (Eds.), Advances in educational and psychological testing (pp. 3-43). Boston: Kluwer Academic.
6. Harden, R. M., & Gleeson, F. A. (1979). Assessment of clinical competence using an objective structured clinical examination (OSCE). Medical Education, 13, 41-54.
7. Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational Measurement (3rd ed., pp. 485-514). New York: American Council on Education.
8. Kane, M. T. (1994). Validating the performance standards associated with passing scores. Review of Educational Research, 64, 425-461.
9. Kaufman, D. M., Mann, K. V., Muijtjens, A. M. M., & Van der Vleuten, C. P. M. (2000). A comparison of standard-setting procedures for an OSCE in undergraduate medical education. Academic Medicine, 75(3), 267-271.
10. Kramer, A. W. M., Muijtjens, A. M. M., Jansen, K. J. M., Düsman, H., Tan, L. H. C., & Van der Vleuten, C. P. M. (2003). Comparison of a rational and an empirical standard setting procedure for an OSCE. Medical Education, 37(2), 132-139.
11. Livingston, S. A., & Zieky, M. J. (1989). A comparative study of standard-setting methods. Applied Measurement in Education, 2(2), 121-141.
12. Norcini, J. J., Lipner, R. S., Langdon, L. O., & Strecker, C. A. (1987). A comparison of three variations on a standard-setting method. Journal of Educational Measurement, 24(1), 56-64.
13. Norcini, J. J., & Shea, J. A. (1997). The credibility and compatibility of standards. Applied Measurement in Education, 10(1), 39-59.
14. Van der Vleuten, C. P. M., & Swanson, D. B. (1990). Assessment of clinical skills with standardized patients: State of the art. Teaching and Learning in Medicine, 2(2), 58-76.
15. Verhoeven, B. H., Van der Steeg, A. F. W., Scherpbier, A. J. J. A., Muijtjens, A. M. M., Verwijnen, G. W., & Van der Vleuten, C. P. M. (1999). Reliability and credibility of an Angoff standard setting procedure in progress testing using recent graduates as judges. Medical Education, 33, 832-837.
16. Woehr, D. J., & Fehrmann, M. L. (1991). An empirical comparison of cutoff score methods for content-related and criterion-related validity settings. Educational and Psychological Measurement, 51, 1029-1039.