Current perspectives in assessment: The assessment of performance at work

Medical Education

Volumn 39, Issue 9, 2005, Pages 880-889

  Norcini, John J ^a  

^a FOUNDATION FOR ADVANCEMENT OF INTERNATIONAL MEDICAL EDUCATION AND RESEARCH   (United States)

Author keywords

Clinical competence *standards; Physician family *standards; Quality control; Quality of health care *standards

Indexed keywords

HEALTH CARE QUALITY; HUMAN; INFORMATION PROCESSING; JOB PERFORMANCE; LEGAL LIABILITY; MEDICAL EDUCATION; MEDICAL PRACTICE; PSYCHOMETRY; REVIEW;

CLINICAL COMPETENCE; EMPLOYEE PERFORMANCE APPRAISAL; PHYSICIANS; REPRODUCIBILITY OF RESULTS; STAFF DEVELOPMENT;

EID: 24744468382     PISSN: 03080110     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1365-2929.2005.02182.x     Document Type: Review

References (53)

1. Downing SM. Assessment of knowledge with written test forms. In: Norman GR, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer 2002;647-72.
2. Petrusa ER. Clinical performance assessments. In: Norman GR, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer 2002;673-710.
3. Cushing A. Assessment of non-cognitive factors. In: Norman GR, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer 2002;711-56.
4. Wainer H. Computerized Adaptive Testing: A Primer. Hillsdale, New Jersey: Lawrence Erlbaum 1990.
5. Green BF. Adaptive testing by computer. In: Ekstrom RB, ed. Principles of Modern Psychological Measurement. San Francisco: Jossey-Bass 1983;5-12.
6. Tekian A, McGuire CH, McGaghie WC, eds. Innovative Simulations for Assessing Professional Competence: From Paper and Pencil to Virtual Reality. Chicago: University of Illinois 1999.
7. Satava RM. Accomplishments and challenges of surgical simulation. Surg Endosc 2001;15:232-41.
8. Elstein AS, Shulman LS, Sprafka SA. Medical Problem-solving: An Analysis of Clinical Reasoning. Cambridge, Massachusetts: Harvard University Press 1978.
9. Kolen MJ, Brennan RJ. Test Equating: Methods and Practices. New York: Springer 1995.
10. Norcini JJ, Guille R. Combining tests and setting standards. In: Norman GR, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer 2002;811-34.
11. Hambleton RK, Swaminathan H. Item Response Theory: Principles and Applications. Dordrecht: Kluwer 1985.
12. Brennan RL. Generalizability Theory. New York: Springer-Verlag 2001.
13. Norcini JJ, Boulet J. Methodological issues in the use of standardised patients for assessment. Teach Learn Med 2003;15:293-7.
14. Schuwirth LW, van der Vleuten CP. Changing education, changing assessment, changing research? Med Educ 2004;38:805-12.
15. Berwick DM, Godfrey AB, Rossener J. Curing Health Care: New Strategies for Quality Improvement. San Francisco: Jossey-Bass 1990.
16. Laffel G, Blumenthal D. The case for using industrial quality management science in health care organisations. JAMA 1989;262:2869-73.
17. Plsek PE. Quality improvement methods in clinical medicine. Pediatrics 1999;103 (Suppl):203-14.
18. Norcini JJ. Psychometric issues in the use of practice performance assessment for physician evaluation. In: Mancall EL, Bashook PG, eds. Evaluating Residents for Board Certification. Evanston, Illinois: American Board of Medical Specialties 1998.
19. Norcini JJ. Recertification in the United States. BMJ 1999;319:1183-5.
20. Norcini JJ. Work-based assessment. BMJ 2003;326:753-5.
21. Chassin MR. Achieving and sustaining improved quality: lessons from New York State and cardiac surgery. Health Aff 2002;21:40-51.
22. Mukamel DB, Mushlin AI. Quality of care information makes a difference: an analysis of market share and price changes after publication of the New York State Cardiac Surgery Mortality Reports. Med Care 1998;36:945-54.
23. US Preventive Services Task Force. Screening for lipid disorders, recommendations and rationale. Am J Prev Med 2001;20 (3S):73-6.
24. Centers for Disease Control. Recommended childhood and adolescent immunisation schedule - United States. January 2004 http://www.cdc.gov/nip/recs/ child-schedule.pdf.
25. Agency for Healthcare Research and Quality. Guide to Clinical Preventive Services. Periodic Updates. 3rd edn. AHRQ Publication No. 04-IP003. Rockville, Maryland: Agency for Healthcare Research and Quality. January 2004. http://www.ahrq.gov/clinic/periodorder.htm.
26. Halm EA, Lee C, Chassin MR. Is volume related to outcome in health care? A systematic review and methodologic critique of the literature. Ann Intern Med 2002;137:511-20.
27. Losina E, Barrett J, Mahomed NN, Baron JA, Katz JN. Early failures of total hip replacement: effect of surgeon volume. Arthritis Rheum 2004;50:1338-43.
28. Norcini JJ, Kimball HR, Lipner RS. Certification and specialisation: do they matter in the outcome of acute myocardial infarction? Acad Med 2000;75:1193-8.
29. Lorenzoni L, Da Gas R, Aparo UL. The quality of abstracting medical information from the medical record: the impact of training programmes. Int J Qual Health Care 1999;11:209-13.
30. Gordon NP, Hiatt RA, Lampert DI. Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst 1993;85:566-70.
31. Iezzoni LI. Assessing quality using administrative data. Ann Intern Med 1997;127:666-74.
32. Larson JL, Look R, Schiffman B. A hand-held computer-based procedure log. Acad Emerg Med 2001;8:583.
33. Nicolaou DD, Davis GL. A distributed asynchronous resident procedure log for hand-held devices. Acad Emerg Med 2001;8:583.
34. Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (Suppl):63-7.
35. Norcini JJ. Peer assessment of competence. Med Educ 2003;37:539-43.
36. Holmboe ES. Faculty and the observation of trainees' clinical skills: problems and opportunities. Acad Med 2004;79:16-22.
37. Sturmberg JP. General practice-specific care categories: a method to examine the impact of morbidity on general practice workload. Fam Pract 2002;19:85-92.
38. Tucker AM, Weiner JP, Honigfeld S, Parton RA. Profiling primary care physician resource use: examining the application of case mix adjustment. J Ambul Care Manage 1996;19:60-80.
39. Davenport JR, Dennis MS, Warlow CP. Effect of correcting outcome data for case mix: an example from stroke medicine. BMJ 1996;312:1503-5.
40. Orchard C. Comparing health outcomes. BMJ 1994;308:1493-6.
41. Hankey GJ, Dennis MS, Slattery JM, Warlow CP. Why is the outcome of transient ischaemic attacks different in different groups of patients? BMJ 1993;306:1107-11.
42. Kessner DM, Kalk CE, Singer J. Assessing health quality: the case for tracers. N Engl J Med 1973;288:189-94.
43. Greenfield S, Kaplan SH, Kahn R, Ninomiya J, Griffith JL. Profiling care provided by different groups of physicians: effects of patient case-mix (bias) and physician-level clustering on quality assessment results. Ann Int Med 2002;136:111-21.
44. Majeed A, Bindman AB, Weiner JP. Use of risk adjustment in setting budgets and measuring performance in primary care. II. Advantages, disadvantages and practicalities. BMJ 2001;323:607-10.
45. Starfield B, Lemke KW, Bernhardt T, Foldes SS, Forrest CB, Weiner JP. Comorbidity: implications for the importance of primary care in 'case' management. Ann Fam Med 2003;1:8-14.
46. Tekkis PP, Prytherch DR, Kocher HM, Senapati A, Poloniecki JD, Stamatakis JD, Windsor AC. Development of a dedicated risk-adjustment scoring system for colorectal surgery (colorectal POSSUM). Br J Surg 2004;91:1174-82.
47. Kuhlthau K, Ferris TG, Iezzoni LI. Risk adjustment for paediatric quality indicators. Pediatrics 2004;113:210-6.
48. Charlson ME, Pompei P, Ales AL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Clin Epidemiol 1993;46:1075-9.
49. Steen P, Cherney B. Evolution of analytical tools by MediQual Systems, Inc. Am J Med Qual 1996;11:S15-7.
50. Iezzoni LI. The risks of risk adjustment. JAMA 1997;278:1600-7.
51. Kremer BK. Physician recertification and outcomes assessment. Eval Health Prof 1991;14:187-200.
52. Norcini JJ. What should we do about unreliable tests? Med Educ 2000;34:501-2.
53. Hofer TP, Hayward RA, Greenfield S, Wagner EH, Kaplan SH, Mannin WG. The unreliability of individual physician 'report cards' for assessing the costs and quality of care of a chronic disease. JAMA 1999;281:2098-105.