On the reliability of a dental OSCE, using SEM: Effect of different days

European Journal of Dental Education

Volumn 12, Issue 3, 2008, Pages 131-137

  Schoonheim Klein, M ^a,d   Muijtens, A ^b   Habets, L ^a   Manogue, M ^c   Van Der Vleuten, C ^b   Hoogstraten, J ^a   Van Der Velden, U ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

^c LEEDS DENTAL INSTITUTE   (United Kingdom)

^d NONE   (Netherlands)

Author keywords

Assessment; Dental education; Generalizability; Objective structured clinical examination; Reliability; Standard error of measurement

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; DENTAL CARE; DENTAL EDUCATION; EDUCATION; HEALTH CARE QUALITY; HEALTH PROMOTION; HUMAN; INTERPERSONAL COMMUNICATION; MANAGEMENT; METHODOLOGY; MOUTH DISEASE; QUALITY CONTROL; REPRODUCIBILITY; STANDARD; STATISTICS; TIME; TOOTH RADIOGRAPHY; VALIDATION STUDY;

BENCHMARKING; CLINICAL COMPETENCE; COMMUNICATION; COMPREHENSIVE DENTAL CARE; DIAGNOSIS, ORAL; EDUCATION, DENTAL; EDUCATIONAL MEASUREMENT; HEALTH PROMOTION; HUMANS; PRACTICE MANAGEMENT, DENTAL; PROGRAM EVALUATION; RADIOGRAPHY, DENTAL; REPRODUCIBILITY OF RESULTS; TIME FACTORS;

EID: 53149091330     PISSN: 13965883     EISSN: 16000579     Source Type: Journal    
DOI: 10.1111/j.1600-0579.2008.00507.x     Document Type: Article

References (34)

1. Chambers DW. Portfolios for determining initial licensure competency. J Am Dent Assoc 2004: 135: 173-184.
2. Harden RM, Gleeson F. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979: 13: 41-54.
3. Clauser BE, Clyman SG, Swanson DB. Components of Rater Error in a Complex Performance Assessment. J Educ Meas 1999: 36: 2945.
4. Roberts J, Norman G. Reliability and learning from the objective structured clinical examination. Med Educ 1990: 24: 219-223.
5. Swanson DB, Norman GR, Linn RL. Performance-based assessment: lessons from the health professions. Educ Res 1995: 24: 5-11.
6. Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996: 1: 41-67.
7. Norman G, Bordage G, Page G, Keane D. How specific is case specifity? Med Educ 2006: 40: 618-623.
8. Govaerts MJ, van der Vleuten CP, Schuwirth LW. Optimising the reproducibility of a performance-based assessment test in midwifery education. Adv Health Sci Educ Theory Pract 2002: 7: 133-145.
9. Swanson DB, Norcini JJ. Factors influencing reproducibility of tests using standardized patients. Teach Learn Med 1989: 1: 158-166.
10. Schoonheim-Klein ME, Hoogstraten J, Habets LLMH, et al.Language background in relation to OSCE performance, a study of potential bias. Eur J Dent Educ 2007: 11: 222-229.
11. Haq I, Higham J, Morris R, Dacre J. Effect of ethnicity and gender on performance in undergraduate medical examinations. Med Educ 2005: 39: 1126-1128.
12. Wass V, Roberts C, Hoogenboom R, Jones R, Van der Vleuten C. Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study. BMJ 2003: 326: 800-803.
13. Humphris GM, Kaney SExaminer fatigue in communication skills objective structured clinical examinations. Med Educ 2001: 35: 444-449.
14. LeBlanc VR, Bandiera GW. The effects of examination stress on the performance of emergency medicine residents. Med Educ 2007: 41: 556-564.
15. Petrusa ERCiinical performance assessment. In: Norman GR VdVC, Newble DIed. International handbook of research in medical education. Dordrecht: Kluwer Academic Publications, 2002.
16. Bogeis SM, van Mourik TGC, Van der Vleuten CPM. Authentic assessment of interviewing and counseling skills: effect of testing time per station on generalizability and validity. Teach Learn Med 1995: 7: 155-162.
17. Downing, Steven M. Reliability: on the reproducibility of assessment data. doi:10.1111/j.l365-2929.2004.01932.x. Med Educ 2004: 38: 1006-1012.
18. Manogue M, Brown G, Foster H. Clinical assessment of dental students: values and practices of teachers in restorative dentistry. Med Educ 2001: 35: 364-370.
19. Manogue M, Brown G. Developing and implementing an OSCE in dentistry. Eur J Dent Educ 1998: 2: 51-57.
20. Schoonheim-Klein M, Walmsley AD, Habets L, van der Velden U, Manogue M. An implementation strategy for introducing an OSCE into a dental school. Eur J Dent Educ 2005: 9: 143-149.
21. Manogue M, Kelly M., Bartakova Masaryk S, et al. Evolving methods of assessment. Eur J Dent Educ 2002: 6(Suppi. 3): 53-66.
22. Brown G, Manogue M, Muir M. The validity and reliability of an OSCE in dentistry. Eur J Dent Educ 1999: 3: 117-125.
23. Gerrow JD, Murphy HJ, Boyd MA, Scott DA. Concurrent validity of written and OSCE components of the Canadian dental certification examinations. J Dent Educ 2003: 67: 896-901.
24. Kramer A, Muijtjens A, Jansen K, Dusman H, Tan L, van der Vleuten C. Comparison of a rational and an empirical standard setting procedure for an OSCE. Eur Med Educ 2003: 2: 132-139.
25. Norcini JJ. Standards and reliability in evaluation: when rules of thumb don't apply. Acad Med 1999: 74: 1088-1090.
26. Gispert R, Rue M, Roma J, Martinez-Carretero J. Gender, sequence of cases and day effects on clinical skills assessment with standardized patients. Med Educ 1999: 33: 499-503.
27. Rutala PJ, Witzke DB, Leko EO, Fulginiti MA, Taylor PJ. Sharing of information by students in an objective structured clinical examination. Arch Intern Med 1991: 151: 541-544.
28. Van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardized patients: the state of the art. Teach Learn Med 1990: 2: 58-76.
29. Kane MT. The precision of measurements. Appl Meas Educ Meas 1996: 9: 355-379.
30. Van der Vleuten CPM, Schuwirth LWT. Assessment of professional competence: from methods to programmes. Med Educ 2005: 39: 309-317.
31. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 2003: 15: 270-292.
32. Wass V, McGibbon D, Van der Vleuten C. Composite undergraduate clinical examinations: how should the components be combined to maximize reliability. Med Educ 2001: 35: 326-330.
33. Verhoeven BH, Hamers JG, Scherpbier AJ, Hoogenboom RJ, van der Vleuten CP. The effect on reliability of adding a separate written assessment component to an objective structured clinical examination. Med Educ 2000: 34: 501-502.
34. Brennan RL. Elements of generalisability theory. Iowa City, Iowa: ACT Publications, 1983.