Evaluating the spoken English proficiency of international medical graduates: Detecting threats to the validity of standardised patient ratings

Medical Education

Volumn 37, Issue 1, 2003, Pages 69-76

  Van Zanten, Marta ^a,b   Boulet, John R ^a   McKinley, Danette ^a   Whelan, Gerald P ^a  

^a Educational Commission for Foreign Medical Graduates   (United States)

^b Clinical Skills Assessment   (United States)

Author keywords

*Communication; *Speech; Clinical competence; Foreign medical graduates *standards; Physician patient relations; Reproducibility of results; Sex; USA

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; EVALUATION; FEMALE; GENDER; HUMAN; LANGUAGE; MALE; MEDICAL EDUCATION; MEDICAL STUDENT; PATIENT; VALIDATION PROCESS;

ADULT; CLINICAL COMPETENCE; COMMUNICATION; EDUCATIONAL MEASUREMENT; FEMALE; FOREIGN MEDICAL GRADUATES; HUMANS; LANGUAGE; MALE; MIDDLE AGED; PATIENT SIMULATION; PHYSICIAN-PATIENT RELATIONS; REPRODUCIBILITY OF RESULTS; SEX FACTORS; SPEECH;

EID: 0037253314     PISSN: 03080110     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.1365-2923.2003.01400.x     Document Type: Article

References (29)

1. Ong LM, de Haes JC, Hoos AM, Lammes FB. Doctor-patient communication: a review of the literature. Soc Sci Med 1995;40 (7):903-18.
2. Rowland-Morin PA, Carroll JG. Verbal communication skills and patient satisfaction. A study of doctor-patient interviews. Eval Health Prof 1990;13 (2):168-85.
3. Williams S, Weinman J, Dale J. Doctor-patient communication and patient satisfaction: A review. Fam Pract 1998;15 (5):480-92.
4. Colliver JA, Swartz MH, Robbs RS, Cohen DS. Relationship between clinical competence and interpersonal and communication skills in standardised-patient assessment. Acad Med 1999;74 (3):271-4.
5. Humphris GM, Kaney S. The Objective Structured Video Exam for assessment of communication skills. Med Educ 2000;34 (11):939-45.
6. Kosower E. An assessment and teaching tool for interpersonal communication skills. Acad Med 1995;70 (5):452-3.
7. Boulet JR, Ben David MF, Ziv A et al. Using standardised patients to assess the interpersonal skills of physicians. Acad Med 1998;73 (10 Suppl):S94-S96.
8. Whelan GP. Educational commission for foreign medical graduates: clinical skills assessment prototype. Med Teacher 1999;21 (2):156-60.
9. Reznick RK, Blackmore D, Dauphinee WD, Rothman AI, Smee S. Large-scale high-stakes testing with an OSCE: report from the Medical Council of Canada. Acad Med 1996;71 (1 Suppl):S19-S21.
10. Ben David MF, Klass DJ, Boulet J, De Champlain A, King AM, Pohl HS et al. The performance of foreign medical graduates on the National Board of Medical Examiners (NBME) standardised patient examination prototype: a collaborative study of the NBME and the Educational Commission for Foreign Medical Graduates (ECFMG). Med Educ 1999;33 (6):439-46.
11. Rothman AI, Cusimano M. Assessment of English proficiency in international medical graduates by physician examiners and standardised patients. Med Educ 2001;35 (8):762-6.
12. Boulet JR, van Zanten M, McKinley DW, Gary NE. Evaluating the spoken English proficiency of graduates of foreign medical schools. Med Educ 2001;35 (8):767-73.
13. Rothman AI, Cusimano M. A comparison of physician examiners', standardised patients' and communication experts' ratings of international medical graduates' English proficiency. Acad Med 2000;75 (12):1206-11.
14. Chur-Hansen A, Vernon-Roberts J. Using standardised patients to evaluate undergraduate medical students' proficiency in speaking English. Acad Med 1999;74 (7):829-34.
15. Friedman M, Sutnick AI, Stillman PL et al. The use of standardised patients to evaluate the spoken English proficiency of foreign medical graduates. Acad Med 1991;66 (9 Suppl):S61-S63.
16. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, District of Columbia: American Educational Research Association 1999.
17. Gispert R, Rue M, Roma J, Martinez-Carretero JM. Gender, sequence of cases and day effects on clinical skills assessment with standardised patients. Med Educ 1999;33 (7):499-503.
18. Colliver JA, Marcy ML, Travis TA, Robbs RS. The interaction of student gender and standardised patient gender on a performance-based examination of clinical competence. Acad Med 1991;66 (9 Suppl):S31-S33.
19. Chambers KA, Boulet J, Furman G. Are interpersonal skills ratings influenced by gender in a clinical skills assessment using standardised patients? Adv Health Sci Educ 2001;6 (3):231-241.
20. Colliver JA, Vu NV, Marcy ML, Travis TA, Robbs RS. Effects of examinee gender, standardised-patient gender and their interaction on standardised patients' ratings of examinees' interpersonal and communication skills. Acad Med 1993;68 (2):153-7.
21. Rutala PJ, Witzke DB, Leko EO, Fulginiti JV. The influences of student and standardised patient genders on scoring in an objective structured clinical examination. Acad Med 1991;66 (9 Suppl):S28-S30.
22. Chur-Hansen A, Vernon-Roberts J, Clark S. Language background, English language proficiency and medical communication skills of medical students. Med Educ 1997;31 (4):259-63.
23. O'Sullivan B, Porter D. Speech style, gender and oral proficiency interview performance. Presented at the Annual Meeting of the Southeast Asian Ministers of Education Organisation Regional Language Centre Seminar, Singapore 1996.
24. Porter D. Affective factors in the assessment of oral interaction: Gender and status. In Sarinee A, ed. Current developments in Language Testing, Anthology Series 25. SEAMEO Regional Language Centre: Singapore, 1991.
25. Brown A. The effect of rater variables in the development of an occupation-specific language performance test. Language Testing 1995;12 (1):1-15.
26. Barnwell D. 'Naive' native speakers and judgements of oral proficiency in Spanish. Language Testing 1989;6 (2):152-63.
27. Sheorey R. Goof gravity in ESL. native versus non-native perceptions. Presented at the 19th annual TESOL convention. New York 1985.
28. Fayer JM, Kransinski E. Native and non-native judgements of intelligibility and irritation. Language Learning 1987;37:313-26.
29. Shohamy E, Gordon CM, Kraemer R. The effect of raters' background and training on the reliability of direct writing tests. Modern Language J 1992;76:27-33.