Undesired variance due to examiner stringency/leniency effect in communication skill scores assessed in OSCEs

Advances in Health Sciences Education

Volumn 13, Issue 5, 2008, Pages 617-632

  Harasym, Peter H ^a   Woloschuk, Wayne ^a   Cunning, Leslie ^b  

^a UNIVERSITY OF CALGARY   (Canada)

^b UNIVERSITY OF CALGARY   (Canada)

Author keywords

Communication skills; Error variance; Item response theory; Leniency; OSCE; Rasch; Stringency; True score

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; CLINICAL EDUCATION; DECISION MAKING; EDUCATION; FEMALE; GENERAL PRACTICE; HUMAN; INTERPERSONAL COMMUNICATION; MALE; MEDICAL SCHOOL; METHODOLOGY; OBSERVER VARIATION; REPRODUCIBILITY; SELF CONCEPT; STANDARD; STATISTICAL MODEL;

CLINICAL CLERKSHIP; CLINICAL COMPETENCE; COMMUNICATION; EDUCATIONAL MEASUREMENT; FACULTY, MEDICAL; FAMILY PRACTICE; FEMALE; HUMANS; JUDGMENT; LOGISTIC MODELS; MALE; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; SELF CONCEPT;

EID: 57649207883     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-007-9068-0     Document Type: Article

References (43)

1. T. E. Adamson D. S. Gullion 1984 Physician-patient communication and medical malpractice Mobius 4 33 37
2. E. B. Bass A. H. Fortin 4th G. Morrison S. Wills L. M. Mumford A. H. Goroll 1997 National survey of clerkship directors in internal medicine on the competencies that should be addressed in the medicine core clerkship American Journal of Medicine 102 564 571
3. Bond T. G., & Fox C. M. (2001). Applying the Rasch model: Fundamental measurements in human sciences. New Jersey: Lawrence Erlbaum Associates, Publishers Mahwah.
4. R. Bowers 1993 From lab tests to lawsuits: Improving physician-patient communication. TMA communications and public service committee Journal of the Tennessee Medical Association 86 112
5. G. Brown M. Manogue M. Martin 1999 The validity and reliability of an OSCE in dentistry European Journal of Dental Education 3 117 125
6. L. Candib 1999 When the doctor takes off her clothes: Reflections on being seen by patients in the exercise setting Families, Systems, & Health 17 349 363
7. R. Cohen 2001 Assessing professional behaviour and medical error Medical Teacher 23 145 151
8. R. Cohen R. K. Reznick B. R. Taylor J. Provan A. Rothman 1990 Reliability and validity of the objective structured clinical examination in assessing surgical residents American Journal of Surgery 160 302 305
9. J. W. Frymoyer N. P. Frymoyer 2002 Physician-patient communication: A lost art? The Journal of the American Academy of Orthopaedic Surgeons 10 95 105
10. G. H. Gordon L. Baker W. Levinson 1995 Physician-patient communication in managed care The Western Journal of Medicine 163 527 531
11. A. Hagihara K. Nobutomo 2002 Physician-patient communication and malpractice claims Fukuoka Igaku Zasshi 93 79 84
12. J. H. Herndon K. J. Pollick 2002 Continuing concerns, new challenges, and next steps in physician-patient communication The Journal of Bone and Joint Surgery American 84-A 309 315
13. B. Hodges J. Turnbull R. Cohen A. Bienenstock G. Norman 1996 Evaluating communication skills in the OSCE format: Reliability and generalizability Medical Education 30 38 43
14. S. M. Kurtz 2002 Doctor-patient communication: Principles and practices The Canadian Journal of Neurological Sciences 29 S23 S29
15. Kurtz, S, Silverman, J, & Draper, J. (2005). Teaching and learning communication skills in medicine (2nd ed.). Abingdon, Oxon, U.K.: Radcliffe Medical Press.
16. Lawson, D. M. (2003). Use of the multifaceted Rasch model to adjust for the error variance due to the examiner stringency-leniency effects in OSCEs. Masters Thesis, University of Calgary, Calgary AB.
17. Lawson, D. M., & Harasym, P. H. (2003). Standardized patients: Their role in evaluating interexaminer reliability, consistency of performance of standardized patients and candidate anxiety on licensure examinations. Poster presented at the American Medical Association's Research in Medical Education Conference (Washington DC)..
18. W. Levinson 1994 Physician-patient communication. A key to malpractice prevention Journal of the American Medical Association 272 1619 1620
19. W. Levinson D. L. Roter J. P. Mullooly V. T. Dull R. M. Frankel 1997 Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons Journal of the American Medical Association 277 553 559
20. Linacre, J. M. (2006). Many-facet Rasch analysis. WINSTEPS® & Facets Rasch Software [On-line]. Retrieved November 22, 2006, from www.winsteps.com/facpass.htm.
21. D. G. Matsell N. M. Wolfish E. Hsu 1991 Reliability and validity of the objective structured clinical examination in paediatrics Medical Education 25 293 299
22. I. C. McManus M. Thompson J. Mollon 2006 Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling BMC Medical Education 6 1272 1294
23. C. M. Myford E. W. Wolfe 2003 Detecting and measuring rater effects using many-facet Rasch measurement: Part I Journal of Applied Measurement 4 386 422
24. C. M. Myford E. W. Wolfe 2004 Detecting and measuring rater effects using many-facet Rasch measurement: Part II Journal of Applied Measurement 5 189 227
25. Z. E. Neuwirth 1999 An essential understanding of physician-patient communication. Part I The Journal of Medical Practice Management 15 14 18
26. Z. E. Neuwirth 1999 An essential understanding of physician-patient communication. Part II The Journal of Medical Practice Management 15 68 72
27. W. Osler 1913 Examinations, examiners and examinees Lancet 182 1047 1050
28. T. Peskin C. Micklitsch M. Quirk H. Sims W. Primack 1995 Malpractice, patient satisfaction, and physician-patient communication Journal of the American Medical Association 274 22
29. E. R. Petrusa T. A. Blackwell M. A. Ainsworth 1990 Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents Archives of Internal Medicine 150 573 577
30. E. R. Petrusa T.A. Blackwell L.P. Rogers C. Sayjari S. Parcel J.C. Guckian 1987 An objective measure of clinical performance American Journal of Medicine 83 34 42
31. G. Regehr R. Freeman B. Hodges L. Russell 1999 Assessing the generalizability of OSCE measures across content domains Academic Medicine 74 1320 1322
32. K. Robb A.I. Rothman 1985 Assessment of clinical skills in general internal medicine residents - comparison of the objective structured clinical examination to a conventional oral examination Annals of the Royal College of Physicians and Surgeons of Canada 18 235 238
33. S. E. Scullen M. K. Mount M. Goff 2000 Understanding the latent structure of job performance ratings Journal of Applied Psychology 85 956 970
34. J. Silverman D. F. Wood 2004 New approaches to learning clinical skills Medical Education 38 1021 1023
35. Smith, R. M., & Miao, C. Y. (1994). Assessing unidimensionality for Rasch measurement. In M. Wilson (Ed.), Objective measurement: Theory into practice (Vol. 2). Greenwich: Ablex.
36. B. Starfield C. Wray K. Hess R. Gross P. S. Birk B. C. D'Lugoff 1981 The influence of patient-practitioner agreement on outcome of care American Journal of Public Health 71 127 131
37. Statistica 6.0 (2001). [Computer software]. Tulsa OK: StatSoft Inc.
38. M. A. Stewart 1995 Effective physician-patient communication and health outcomes: A review Canadian Medical Association Journal 152 1423 1433
39. M. A. Stewart I. R. McWhinney C.W. Buck 1979 The doctor/patient relationship and its effect upon outcome The Journal of the Royal College of General Practitioners 29 77 82
40. C. M. Valente A. M. Antlitz M. D. Boyd A. J. Troisi 1988 The importance of physician-patient communication in reducing medical liability Maryland Medical Journal 37 75 78
41. K. F. Weyrauch 1995 Malpractice, patient satisfaction, and physician-patient communication Journal of the American Medical Association 274 22 23
42. Workshop Planning Committee 1992 Consensus statement Workshop on the Teaching and Assessment of Communication Skills in Canadian Medical Schools 147 1149 1152
43. K. Zoppi R. M. Epstein 2002 Is communication a skill? Communication behaviors and being in relation Family Medicine 34 319 324