Assessing the practising physician using patient surveys: A systematic review of instruments and feedback methods

Family Practice

Volumn 24, Issue 2, 2007, Pages 117-127

  Evans, Richard G ^a   Edwards, Adrian ^b   Evans, Sean ^b   Elwyn, Benjamin ^c   Elwyn, Glyn ^b  

^a SWANSEA UNIVERSITY   (United Kingdom)

^b CARDIFF UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Feedback of patient assessment; Patient surveys of clinician performance; Performance assessment

Indexed keywords

BIBLIOGRAPHIC DATABASE; CLINICAL ASSESSMENT TOOL; CLINICAL PRACTICE; DATA ANALYSIS; EVIDENCE BASED PRACTICE; GENERAL PRACTICE; HEALTH CARE QUALITY; HEALTH SURVEY; HUMAN; JOB PERFORMANCE; PATIENT SATISFACTION; RELIABILITY; REVIEW; STANDARDIZATION; VALIDATION PROCESS; EPIDEMIOLOGY; FEEDBACK SYSTEM;

FEEDBACK; HEALTH CARE SURVEYS; HUMANS; PATIENT SATISFACTION; QUALITY OF HEALTH CARE;

EID: 34447261906     PISSN: 02632136     EISSN: 14602229     Source Type: Journal    
DOI: 10.1093/fampra/cml072     Document Type: Review

References (91)

1. Keillor G. Lake Wobegon Days. New York: Antheneum, 1985.
2. Evans R, Elwyn G, Edwards A. Review of instruments for peer assessment of physicians. Br Med J 2004; 328: 1240-4243.
3. Pringle M. Re-evaluating revalidation and appraisal. Br J Gen Pract 2003; 53: 437-438.
4. Client-Focused Evaluations Program. Improving Practice Questionnaire 2003. CFEP-UK Surveys, University of Exeter, Exeter. www.cfep.net. Accessed July 2006.
5. General Practitioners Committee BMA and the NHS Confederation. New GMS Contract 2003. London: Investing in General Practice, 2003.
6. National Primary Care Research and Development Centre. GPAQ - A Questionnaire for the GP Contract. 2003. Manchester University, Manchester. www.gpaq.info. Accessed July 2006.
7. Lipner R, Blank L. The value of patient and peer ratings in recertification. Acad Med 2002; 77: S64-S66.
8. American Board of Medical Specialties. Maintenance of Certification American Board of Medical Specialities, Evanston. www.abms.org. Accessed July 2006.
9. Batmangelich S, Adamowski S. Maintenance of certification in the United States: A progress report. J Contin Educ Health Prof 2004; 24 134-138.
10. Lipner R, Bylsma W, Arnold G, Fortna G, Tooker J, Cassel C. Who is maintaining certification in internal medicine - and why? A national survey 10 years after initial certification. Ann Intern Med 2006; 144: 29-36.
11. Lipner R. The value of physician assessment. Ann Intern Med 2006; 144: Annals online, 3 Mar 2006.
12. Lakhani M. GMC and the future of revalidation: A way forward. Br Med J 2005; 330: 1326-1328.
13. Pringle M. Revalidation of Doctors: The Credibility Challenge. London: The Nuffield Trust, 2005.
14. Donaldson L. Good Doctors, Safer Patients: Proposals to Strengthen the System to Assure and Improve the Performance of Doctors and to Protect the Safety of Patients. Department of Health, 2006.
15. Feletti G, Firman D, Sanson-Fisher R. Patient satisfaction with primary care consultations. J Behav Med 1985; 9: 389-399.
16. Matthews D, Feinstein A. A new instrument for patients' ratings of physician performance in the hospital setting. J Gen Intern Med 1989; 4: 14-22.
17. Baker R. Development of a questionnaire to assess patients' satisfaction with consultations in general practice. Br J Gen Pract 1990; 40 487-490.
18. Greco M, Brownlea A, McGovern J. Impact of patient feedback on the interpersonal skills of general practice registrars: Results of a longitudinal study. Med Educ 2001; 35: 748-756.
19. Wensing M, Vingerhoets E, Grol R. Feedback based on patient evaluations: a tool for quality improvement? Patient Educ Couns 2003; 51: 149-153.
20. Greco M, Francis W, Buckley J, Brownlea A, McGovern J. Realpatient evaluation of communication skills teaching for GP registrars. Fam Pract 1998; 15: 51-57.
21. General Medical Council. Good Medical Practice. 2001. GMC, London.
22. King J. 360 degree appraisal. Br Med J Career Focus 2002; 324 S195.
23. Linder-Pelz M, Struening E. The multidimensionality of patient satisfaction with a clinic visit. J Community Health 1985; 10 42-54.
24. Slavin RE. Best evidence synthesis: An intelligent alternative to meta-analysis. J Clin Epidemiol 1995; 48: 9-18.
25. Safran DG, Kosinski M, Tarlov AR. The Primary Care Assessment Survey: tests of data quality and measurement performance. Med Care 1998; 36: 728-739.
26. Greco M, Sweeney K, Brownlea A, McGovern J. The Practice Accreditation And Improvement Survey (PAIS): What patients think. Aust Fam Physician 2001; 30: 1096-1100.
27. Darby C, Crofton C, Clancy C. Consumer Assessment of Health Providers and Systems (CAHPS): Evolving to meet stakeholder needs. Am J Med Qual 2006; 21: 144-147.
28. Hays R, Chong K, Brown J, Spritzer K, Horne K. Patient reports and ratings of individual physicians: An evaluation of the DoctorGuide and Consumer Assessment of Health Plans Study provider-level surveys. Am J Med Qual 2003; 18: 190-196.
29. Flocke SA. Measuring attributes of primary care: Development of a new instrument. J Fam Pract 1997; 45 (1): 64-74.
30. Narthorst-Boos J, Munck I, Eckerlund I. An evaluation of the QSP and the QPP: Two methods for measuring patient satisfaction. Intern J Qual Healthcare 2001; 13: 257-264.
31. Grogan S, Conner M, Willits D, Norman P. Development of a questionnaire to measure patients' satisfaction with general practitioners' services. Br J Gen Pract 1995; 45: 525-529.
32. Seid M, Varni J. Measuring primary care for children of Latino farmworkers: Reliability and validity of the Parent's Perceptions of Primary Care Measure (P3C). Matern Child Health J 2005; 9 49-57.
33. Bitzer E, Dierks M, Dorning H, Schwartz F. Patient satisfaction with ambulatory care physicians - psychometric testing of a standardized questionnaire. Z Gesundheitswiss 1999; 7: 196-209.
34. Gericke C, Schiffhorst G, Busse R, Haussler B. [A validated questionnaire for measuring patient satisfaction in general and specialist ambulatory medical care: The Qualiskope-A]. Gesundheitswesen 2004; 66: 723-731.
35. Bredart A, Razavi D, Delvaux N, Goodman V. A comprehensive assessment of satisfaction with care for cancer patients. Support Care Cancer 1998; 6: 518-523.
36. Etter J, Perneger T. Validating a satisfaction questionnaire using multiple approaches: A case study. Soc Sci Med 1997; 45: 879-885.
37. Yancy W, Macpherson D, Hanusa B. Patient satisfaction in resident and attending ambulatory care clinics. J Gen Intern Med 2001; 2001 755-762.
38. Mercer S, Maxwell M, Heaney D. The consultation and relational empathy (CARE) measure: Development and preliminary validation and reliability of an empathy-based consultation process measure. Fam Pract 2004; 21: 699-705.
39. Mercer S, McConnachie A, Maxwell M. Relevance and practical use of the Consultation and Relational Empathy (CARE) measure in general practice. Fam Pract 2005; 22: 328-334.
40. Howie JGR, Heaney DI, Maxwell M, Walker JJ. A comparison of a Patient Enablement Instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract 1998; 15: 165-71.
41. Howie JGR, Heaney DJ, Maxwell M, Walker JJ, Freeman GK. Developing a 'consultation quality index' (COI) for use in general practice. Fam Pract 2000; 17: 455-461.
42. Howie JGR, Heaney DJ, Maxwell M. Quality, core values and the general practice consultation: Issues of definition, measurement and delivery. Fam Pract 2004; 21: 458-468.
43. Howie JGR, Heaney DJ, Maxwell M. Measuring quality in general practice: pilot study of a needs, process and outcome measure. R Coll Gen Pract Occas Pap 1997: 75.
44. Howie JGR, Heaney DJ, Maxwell M. Quality at general practice consultations: Cross-sectional survey. Br Med J 1999; 319: 738-743.
45. Mercer S, Howie J. CQI-2-a new measure of holistic interpersonal care in primary care consultations. Br J Gen Pract 2006; 56: 262-268.
46. Van der Feltz-Cornelis CM, Van Oppen P, Van Marwijk H. A patient-doctor relationship questionnaire (PDRQ-9) in primary care: Development and psychometric evaluation. Gen Hosp Psychiatry 2004; 26: 115-120.
47. Meakin R, Weinman J. The 'Medical Interview Satisfaction Scale' (MISS-21) adapted for British general practice. Fam Pract 2002; 19: 257-263.
48. Wolf MH, Putnam SM, James SA. The medical interview satisfaction scale: development of a scale to measure patient perceptions of physician behaviour. J Behav Med 1978; 1: 391-401.
49. Steine S, Finset A, Laerum E. A new, brief questionnaire (PEQ) developed in primary health care for measuring patients' experience of interaction, emotion and consultation outcome. Fam Pract 2001; 18: 410-418.
50. Petterson K, Veenstra M, Guldvog B, Kolsatd A. The Patient Experiences Questionnaire: Development, validity and reliability. Intern J Qual Health care 2004; 16: 453-463.
51. Stump TE, Dexter PR, Tierrey WM. Measuring patient satisfaction with physicians among older and diseased adults in primary care municipal outpatient setting: An examination of three instruments. Med Care 1995; 33 (9): 958-972.
52. Williams S, Weinman J, Dale J, Newman S. Patient expectations: What do primary care patients want from the GP and how far does meeting expectations affect patient satisfaction. Fam Pract 1995; 12 193-201.
53. Weaver MJ, Ow CL, Walker DJ. A questionnaire for patients' evaluations of their physicians' humanistic behaviours. J Gen Intern Med 1993; 8 (3): 135-139.
54. Smith JK, Falvo D, McKillip J. Measuring patient perceptions of the patient-doctor interaction. Eval Health Prof 1984; 7: 77-94.
55. Crossley J, Eiser C, Davies H. Children and their parents assessing the doctor-patient interaction: A rating system for doctors' communication skills. Med Educ 2005; 39: 820-828.
56. Haddad S, Potvin L, Roberge D. Patient perception of quality following a visit to a doctor in a primary care unit. Fam Pract 2000; 17 21-29.
57. Woolliscroft J, Howell J. Resident-patient interactions: The humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors and nurses. Acad Med 1994; 69 216-224.
58. Fitzpatrick R. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess NHS R&D HTA programme 1998: 1-72.
59. Wass V. A guide to the new MRCGP exam. Br Med J Careers 2005; 331: 158-159.
60. Wensing M, Grol R, Van Weel C. Quality assessment using patients' evaluations of care. Eur J Gen Pract 1998; 4: 150-153.
61. Grol R, Wensing M. Patients Evaluate General/Family Practice: The ETROPEP Instrument: EQuiP: the Task Force on Patient Evaluations of General Practice Care. 2000 Centre for Quality Care Research, Nijmegen.
62. Ramsay J, Campbell J, Schroter S, Green J, Roland M. The General Practice Assessment Survey (GPAS): Tests of data quality and measurement properties. Fam Pract 2000; 17: 372-379.
63. Greco M, Powell R, Sweeney K. The Improving Practice Questionnaire (IPQ): A practical tool for general practices seeking patient views. Educ Prim Care 2003; 14: 440-448.
64. Baker R. The reliability and criterion validity of a measure of patients' satisfaction with their general practice. Fam Pract 1991; 8: 171-177.
65. Baker R, Whitfield M. Measuring patient satisfaction: A test of construct validity. Qual Health Care 1992; 1: 104-109.
66. Nelson E, Gentry M, Mook K, Spritzer K. How many patients are needed to provide reliable evaluations of individual clinicians? Med Care 2004; 42: 259-266.
67. Epstein KR, Laine C, Farber N, Nelson E, Davidoff F. Patients' perceptions of office medical practice: Judging quality through the patients' eyes. Am J Med Qual 1996; 11: 73-80.
68. Baker R. Characterisitics of practices, general practitioners and patients related to levels of patients' satisfaction with consultations. Br J Gen Pract 1996; 46: 601-605.
69. Baker R. Pragmatic model of patient satisfaction in general practice: progress towards a theory. Qual Health Care 1997; 6: 210-204.
70. Baker R, Streatfield J. What type of general practice do patients prefer? Exploration of practice characteristics influencing patient satisfaction. Br J Gen Pract 1995; 45: 654-659.
71. Bower P, Roland MO. Bias in patient assessments on general practice: General Practice Assessment Survey scores in surgery and postal responders. Br J Gen Pract 2003; 53: 126-128.
72. Bower P, Mead N, Roland M. What dimensions underlie patient responses to the general practice assessment survey? A factor analytic study. Fam Pract 2002; 19: 489-95.
73. Bower P, Roland M, Campbell J, Mead N. Setting standards based on patients views on access and continuity: Secondary analysis of data from the general practice assessment survey. Br Med J 2003.
74. Grol R, Wensing M, Mainz J. Patients' priorities with respect to general practice care: An internal comparison. European Task Force on Patient Evaluations of General Practice (EUROPEP). Fam Pract 1999; 16 4-11.
75. Wensing M, Jung H, Mainz J. Which aspects of general practice care are important for patients? A systematic literature review. Soc Sci Med 1998; 47: 1571-1588.
76. Greco M, Carter M. Improving Practice Questionnaire (IPQ) Tool Kit Chichester: Aeneas Press, 2002.
77. Greco M, Cavanagh M, Brownlea A, McGovern J. Validation studies of the Doctors' Interpersonal Skills Questionnaire. Educ Gen Pract 1999; 10: 256-264.
78. Greco M, Spike N, Powell R, Brownlea A. Assessment of GP registrars' communication skills: A comparison of patient and GP examiner ratings. Med Educ 2002; 36: 366-376.
79. Greco M, Brownlea A, McGovern J, Cavanagh M. Consumers as educators: implementation of patient feedback in general practice training. Health Commun 2000; 12: 173-93.
80. AI-Shawi A, MacEachern A, Greco M. Patient assessment of surgeons' interpersonal skills. A tool for appraisal and revalidation. Clin Govern Int J 2005; 10: 212-216.
81. Carter M, Greco M. Impact of systematic feedback on general practices, staff, patients and primary care trusts. Educ Prim Care 2004; 15: 30-38.
82. Greco M, Carter M. Does a patient survey make a difference? Educ Prim Care 2004; 15: 183-189.
83. McKinstry B, Walker J, Blaney D, D H. Do patients and expert doctors agree on the assessment of consultation skills? Fam Pract 2004; 21: 75-80.
84. Vingerhoets E, Wensing M, Grol R. Feedback of patients' evaluations of general practice care: A randomised trial. Qual Health Care 2001; 10: 224-228.
85. American Board of Internal Medicine. Recertification: Program for Continuous Professional Development. www.abim.org/cpd.
86. Stewart M, Brown J, Weston W (eds). Patient-Centred Medicine: Transforming the Clinical Method, 2nd edn. Oxford: Radcliffe Medical Press, 2003.
87. DeNisi A, Kluger A. Feedback effectiveness: Can 360-degree appraisals be improved? Acad Manage Exec 2000; 14: 129-139.
88. van den Bos K. Procedural and distributive justice: What is fair depends more on what comes first than on what comes next. J Pers Soc Psychol 1997; 72: 95-104.
89. Poulton B. Use of the consultation satisfaction questionnaire to examine patients' satisfaction with general practitioners and community nurses: reliability, replicability and discriminant validity. Br J Gen Pract 1996; 46: 26-31.
90. Kinnersley P, Stott N, Peters T. A comparison of methods for measuring patient satisfaction with consultations in primary care. Fam Pract 1996; 13: 41-51.
91. Campbell S, Hann M, Hacker J. Identifying predictors of high quality care in English general practice: Observational study. Br Med J 2001; 323: 1-6.