Is an angoff standard an indication of minimal competence of examinees or of judges?

Advances in Health Sciences Education

Volumn 13, Issue 2, 2008, Pages 203-211

  Verheggen, M M ^a   Muijtjens, A M M ^a   Van Os, J ^a   Schuwirth, L W T ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Angoff procedure; Selection of judges; Standard setting

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; DECISION MAKING; EDUCATION; HUMAN; KNOWLEDGE; METHODOLOGY; OBSERVER VARIATION; REPRODUCIBILITY;

CLINICAL COMPETENCE; EDUCATIONAL MEASUREMENT; HUMANS; JUDGMENT; KNOWLEDGE; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS;

EID: 42149105001     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-006-9035-1     Document Type: Article

References (13)

1. Angoff W.H. (1971) Scales, norms and equivalent scores. In: Thorndike R.L. (eds) Educational Measurement. American Council on Education, Washington DC, pp 508-600
2. Chang L., Dziuban C.D., Hynes M.C. (1996) Does a standard reflect minimal competency of examines or judge competency? Applied Measurement in Education 9(2):161-173
3. Cusimano M.D. (1996) Standard-setting in medical education. Academic Medicine 71(10 Suppl):112-120
4. Cusimano M.D., Rothman A.I. (2003) The effect of incorporating normative data into a criterion-referenced standard setting in medical education. Academic Medicine 78(10 Suppl):88-90
5. Downing S.M., Tekian A., Yudkowsky R. (2006) Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teaching and Learning in Medicine 18(1):50-57
6. Norcini J.J., Lipner R.S., Langdon L.O., Strecker C.A. (1987) A comparison of three variations on a standard-setting method. Journal of Educational Measurement 24(1):56-64
7. Norcini J.J., Shea J.A., Ping J.C. (1988). A note on the application of multiple matrix sampling to standard-setting. Journal of Educational Measurement 25(2):159-164
8. Norcini J.J., Shea J.A. (1992) The reproducibility of standards over groups and occasions. Applied Measurement in Education 5: 63-72
9. Norcini J.J., Shea J.A. (1997) The credibility and comparibility of standards. Applied Measurement in Education 10:39-59
10. Plake, B.S., Melican, G.J. & Mills, C.N. (1991). Factors influencing intrajudge consistency during standard-setting. Educational Measurement Issues and practice 10(2): 15-16, 22, 25-26
11. Saunders J.C., Ryan J.P., Huynh H. (1981) A comparison of two approaches to setting passing scores based on the Nedelsky procedure. Applied Psychological Measurement 5:209-217
12. Verhoeven B.H., Verwijnen G.M., Muijtjens A.M.M., Scherpbier A.J.J.A., Van der Vleuten C.P.M. (2002) Panel expertise for an Angoff standard-setting procedure in progress testing. Item writers compared to recently graduated students. Medical Education 36(9):860-867
13. Williams R.G., Klamen D.A., McGaghie W.C. (2003) Cognitive, social and environmental sources of bias in clinical performance ratings. Teaching and Learning in Medicine 15(4):270-292