Evaluating the effectiveness of rating instruments for a communication skills assessment of medical residents

Advances in Health Sciences Education

Volumn 14, Issue 4, 2009, Pages 575-594

  Iramaneerat, Cherdsak ^a   Myford, Carol M ^b   Yudkowsky, Rachel ^c   Lowenstein, Tali ^c  

^a MAHIDOL UNIVERSITY   (Thailand)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^c UNIVERSITY OF ILLINOIS   (United States)

Author keywords

Communication skills; Many faceted Rasch measurement; OSCE; Rating scale; Validity

Indexed keywords

ARTICLE; DOCTOR PATIENT RELATION; EVALUATION; FEMALE; HEALTH SURVEY; HUMAN; HUMAN RELATION; INTERPERSONAL COMMUNICATION; MALE; MEDICAL EDUCATION; PATIENT CARE; RESEARCH; RETROSPECTIVE STUDY; EVALUATION STUDY; HEALTH STATUS INDICATOR;

COMMUNICATION; FEMALE; HEALTH STATUS INDICATORS; HUMANS; INTERNSHIP AND RESIDENCY; INTERPERSONAL RELATIONS; MALE; PATIENT-CENTERED CARE; PHYSICIAN-PATIENT RELATIONS; RESEARCH; RETROSPECTIVE STUDIES;

EID: 70349497458     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-008-9142-2     Document Type: Article

References (26)

1. Accreditation Council for Graduate Medical Education (1999). The ACGME outcome project. Retrieved August 2007, from http://www.acgme.org/outcome/.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3. Bashook, P. G., & Swing, S. (2000). Toolbox of assessment methods. Retrieved August 2007, from http://www.acgme.org/outcome/assess/assHome.asp.
4. Bernadin, H. J., & Buckley, M. R. (1981). Strategies in rater training. Academy of Management Review, 6, 205-212. doi:10.2307/257876.
5. Bernardin, H. J., & Smith, P. C. (1981). A clarification of some issues regarding the development and use of behaviorally anchored rating scales (BARS). The Journal of Applied Psychology, 66, 458-463. doi:10.1037/0021-9010.66.4.458.
6. Burchard, K. W., & Rowland-Morin, P. A. (1990). A new method of assessing the interpersonal skills of surgeons. Academic Medicine, 65, 274-276. doi:10.1097/00001888-199004000-00012.
7. Cohen, D. S., Colliver, J. A., Marcy, M. S., Fried, E. D., & Scwartz, M. H. (1996). Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills. Academic Medicine, 71(1(Suppl)), S87-S89.
8. Heller, J. I., Sheingold, K., & Myford, C. M. (1998). Reasoning about evidence in portfolios: Cognitive foundations for valid and reliable assessment. Educational Assessment, 5, 5-40. doi:10.1207/s15326977ea0501_1.
9. Humphris, G. M. (2002). Communication skills knowledge, understanding and OSCE performance in medical trainees: A multivariate prospective study using structural equation modeling. Medical Education, 36, 842-852. doi:10.1046/j.1365-2923.2002.01295.x.
10. Humphris, G. M., & Kaney, S. (2001). The Liverpool Brief Assessment System for communication skills in the making of doctors. Advances in Health Sciences Education, 6, 69-80. doi:10.1023/A:1009879220949.
11. Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17-64). Westport, CT: Praeger.
12. Linacre, J. M. (1989). Many-faceted Rasch measurement. Chicago, IL: MESA Press.
13. Linacre, J. M. (2004). Optimizing rating scale category effectiveness. In E. V. Smith Jr. & R. M. Smith (Eds.), Introduction to Rasch measurement: Theory, models and applications (pp. 258-278). Maple Grove, MN: JAM Press.
14. Linacre, J. M. (2005). Facets (Version 3.57) [computer program]. Chicago, IL: Winsteps.
15. Linacre, J. M., & Wright, B. D. (1994). Chi-square fit statistics. Rasch Measurement Transactions, 8, 350.
16. Makoul, G. (2001). The SEGUE Framework for teaching and assessing communication skills. Patient Education and Counseling, 45, 23-34. doi:10.1016/S0738-3991(01)00136-7.
17. Schnabl, G. K., Hassard, T. H., & Kopelow, M. L. (1991). The assessment of interpersonal skills using standardized patients. Academic Medicine, 66(9 (Suppl)), S34-S36.
18. Sireci, S. G., Thissen, D., & Wainer, H. (1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 28, 237-247. doi:10.1111/j.1745-3984.1991.tb00356.x.
19. Smith, P. C., & Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. The Journal of Applied Psychology, 47, 149-155. doi:10.1037/h0047060.
20. Stillman, P. L., Sabers, D. L., & Redfield, D. L. (1976). The use of paraprofessionals to teach interviewing skills. Pediatrics, 57, 769-774.
21. Stillman, P. L., Swanson, D. B., Smee, S., Stillman, A. E., Ebert, T. H., Emmel, V. S., et al. (1986). Assessing clinical skills of residents with standardized patients. Annals of Internal Medicine, 105, 762-771.
22. Thissen, D., Steinberg, L., & Mooney, J. (1989). Trace lines for testlets: A use of multiple-categorical response models. Journal of Educational Measurement, 26(3), 247-260. doi:10.1111/j.1745-3984.1989.tb00331.x.
23. Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370. Available from: URL: http://www.rasch.org/rmt/rmt383b.htm.
24. Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago: MESA Press.
25. Yudkowsky, R., Alseidi, A., & Cintron, J. (2004). Beyond fulfilling the core competencies: An objective structured clinical examination to assess communication and interpersonal skills in a surgical residency. Current Surgery, 61, 499-503. doi:10.1016/j.cursur.2004.05.009.
26. Yudkowsky, R., Downing, S. M., & Sandlow, L. J. (2006). Developing an institution-based assessment of resident communication and interpersonal skills. Academic Medicine, 81(12), 1115-1122. doi:10.1097/01.ACM.0000246752.00689.bf.