Pitfalls in the statistical examination and interpretation of the correspondence between physician and patient satisfaction ratings and their relevance for shared decision making research

BMC Medical Research Methodology

Volumn 11, Issue , 2011, Pages

  Hirsch, Oliver ^a   Keller, Heidemarie ^a   Albohn Kühne, Christina ^a   Krones, Tanja ^a   Donner Banzhoff, Norbert ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DECISION MAKING; DOCTOR PATIENT RELATION; HUMAN; NONPARAMETRIC TEST; PATIENT SATISFACTION; RANDOMIZED CONTROLLED TRIAL; STATISTICAL ANALYSIS; STATISTICS;

DATA INTERPRETATION, STATISTICAL; DECISION MAKING; HUMANS; PATIENT SATISFACTION; PHYSICIAN-PATIENT RELATIONS; STATISTICS AS TOPIC; STATISTICS, NONPARAMETRIC;

EID: 79955953552     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-11-71     Document Type: Article

References (57)

1. Beurteilerübereinstimmung und Beurteilerreliabilität.[Inter- rater agreement and inter-rater reliability]. M Wirtz F Caspar, Göttingen: Hogrefe 2002
2. Detecting systematic bias between two raters. J Ludbrook, Clin Exp Pharmacol Physiol 2004 31 1-2 113 115 10.1111/j.1440-1681.2004.03960.x 14756695 (Pubitemid 38230759)
3. An Introduction to Categorical Data Analysis. A Agresti, New York: Wiley 2007
4. A multisource and repeated measure approach to assessing patient-physician relationship and patient satisfaction. HC Weng, Eval Health Prof 2009 32 2 128 143 10.1177/0163278709333156 19448159
5. Satisfaction with the outpatient encounter - A comparison of patients' and physicians' views. LC Zandbelt EMA Smets FJ Oort MH Godfried HCJM De Haes, Journal of General Internal Medicine 2004 19 11 1088 1095 10.1111/j.1525-1497. 2004.30420.x 15566437 (Pubitemid 39552578)
6. The association between GP and patient ratings of quality of care at outpatient clinics. OA Bjertaes A Garratt H Iversen T Ruud, Fam Pract 2009 26 384 390 10.1093/fampra/cmp043 19584122
7. Statistical methods for psychology. DC Howell, Florence: Cengage Learning Services 2009
8. Statistical methods for assessing agreement between two methods of clinical measurement. JM Bland DG Altman, Lancet 1986 1 8476 307 310 2868172 (Pubitemid 16134762)
9. Measuring agreement in method comparison studies. JM Bland DG Altman, Stat Methods Med Res 1999 8 2 135 160 10.1191/096228099673819272 10501650 (Pubitemid 29425900)
10. Applying the right statistics: analyses of measurement studies. JM Bland DG Altman, Ultrasound Obstet Gynecol 2003 22 1 85 93 10.1002/uog.122 12858311 (Pubitemid 36886457)
11. Comparing methods of measurement: why plotting difference against standard method is misleading. JM Bland DG Altman, Lancet 1995 346 8982 1085 1087 10.1016/S0140-6736(95)91748-9 7564793
12. Congruent satisfaction: is there geographic correlation between patient and physician satisfaction? J DeVoe GE Fryer Jr A Straub J McCann G Fairbrother, Med Care 2007 45 1 88 94 10.1097/01.mlr.0000241048.85215.8b 17279025
13. Instruments to assess the perception of physicians in the decision-making process of specific clinical encounters: a systematic review. F Legare D Moher G Elwyn A LeBlanc K Gravel, BMC Med Inform Decis Mak 2007 7 30 10.1186/1472-6947-7-30 17937801
14. Measuring (shared) decision-making - a review of psychometric instruments. D Simon A Loh M Harter, Z Arztl Fortbild Qualitatssich 2007 101 4 259 267 17601182
15. Decision aids for people facing health treatment or screening decisions. AM O'Connor CL Bennett D Stacey M Barry NF Col KB Eden VA Entwistle V Fiset M Holmes-Rovner S Khangura, et al. Cochrane Database Syst Rev 2009 3 D001431
16. Measuring shared decision making in the consultation: a comparison of the OPTION and Informed Decision Making instruments. MC Weiss TJ Peters, Patient Educ Couns 2008 70 1 79 86 10.1016/j.pec.2007.09.001 17942270 (Pubitemid 350256921)
17. More than one statistical strategy to assess agreement of quantitative measurements may usefully be reported. RR Luiz M Szklo, J Clin Epidemiol 2005 58 3 215 216 10.1016/j.jclinepi.2004.07.007 15718108 (Pubitemid 40249461)
18. Absolute cardiovascular disease risk and shared decision making in primary care: A randomized controlled trial. T Krones H Keller A Sonnichsen EM Sadowski E Baum K Wegscheider J Rochon N Donner-Banzhoff, Annals of Family Medicine 2008 6 3 218 227 10.1370/afm.854 18474884 (Pubitemid 351720820)
19. Satisfaction of patients and primary care physicians with shared decision making. O Hirsch H Keller C Albohn-Kuhne T Krones N Donner-Banzhoff, Eval Health Prof 2010 33 3 321 342 10.1177/0163278710376662 20801975
20. A patient decision aid regarding antithrombotic therapy for stroke prevention in atrial fibrillation: a randomized controlled trial. M Man-Son-Hing A Laupacis AM O'Connor J Biggs E Drake E Yetisir RG Hart, JAMA 1999 282 8 737 743 10.1001/jama.282.8.737 10463708 (Pubitemid 29404379)
21. Patient satisfaction with healthcare provided by family doctors: primary dimensions and an attempt at typology. L Marcinowicz S Chlabicz R Grebowski, BMC Health Services Research 2009 9
22. A Study of Patient Satisfaction and Adherence to Preventive Care Practice Guidelines. SR Weingarten E Stone A Green M Pelter S Nessim HQ Huang R Kristopaitis, American Journal of Medicine 1995 99 6 590 596 10.1016/S0002-9343(99)80243-5 7503079 (Pubitemid 26006437)
23. Meta-Analysis of Satisfaction with Medical-Care - Description of Research Domain and Analysis of Overall Satisfaction Levels. JA Hall MC Dornan, Social Science & Medicine 1988 27 6 637 644 10.1016/0277-9536(88)90012-3 21595107
24. Does patient satisfaction of general practice change over a decade? J Allan P Schattner N Stocks E Ramsay, Bmc Family Practice 2009 10
25. Likert scales: how to (ab)use them. S Jamieson, Med Educ 2004 38 12 1217 1218 10.1111/j.1365-2929.2004.02012.x 15566531 (Pubitemid 39647371)
26. Resolving the 50-year debate around using and misusing Likert scales. J Carifio R Perla, Med Educ 2008 42 12 1150 1152 10.1111/j.1365-2923.2008.03172.x 19120943
27. Likert scales, levels of measurement and the "laws" of statistics. G Norman, Adv Health Sci Educ Theory Pract 2010 15 5 625 632 10.1007/s10459-010-9222-y 20146096
28. Effect sizes for research. A broad practical approach. RJ Grissom JJ Kim, Mahwah: Lawrence Erlbaum Associates 2005
29. Statistical Power Analysis for the Behavioral Sciences. J Cohen, Hillsdale: Lawrence Erlbaum Associates 1988
30. A test for homogeneity of the marginal distributions in a two-way classification. AA Stuart, Biometrika 1955 42 412 416
31. Comparing the classification of subjects by two independent judges. AE Maxwell, British Journal of Psychiatry 1970 116 651 655 10.1192/bjp.116.535.651 5452368
32. Verteilungsfreie Methoden in der Biostatistik.[Distribution free methods in Biostatistics]. J Bortz GA Lienert K Boehnke, Berlin: Springer 2008
33. ComKappa: A Windows 95 program for calculating kappa and related statistics. BF Robinson R Bakeman, Behavior Research Methods, Instruments, and Computers 1998 30 731 732 10.3758/BF03209495
34. Design and analysis of cluster randomization trials in health research. A Donner N Klar, London: Arnold 2000
35. Measurement in Medicine - the Analysis of Method Comparison Studies. DG Altman JM Bland, Statistician 1983 32 3 307 317 10.2307/2987937
36. Bar charts enhance Bland-Altman plots when value ranges are limited. MW Smith J Ma RS Stafford, J Clin Epidemiol 2010 63 2 180 184 10.1016/j.jclinepi. 2009.06.001 19716265
37. Detecting skewness from summary information. DG Altman JM Bland, BMJ 1996 313 7066 1200 8916760
38. Limitations of the Wilcoxon matched pairs signed ranks test for comparison studies. PJ Twomey A Viljoen, J Clin Pathol 2004 57 7 783 15220382 (Pubitemid 38901504)
39. Statistical Power Analysis. KR Murphy B Myors A Wolach, New York: Routledge 2009
40. The analysis of ordinal agreement data: beyond weighted kappa. P Graham R Jackson, J Clin Epidemiol 1993 46 9 1055 1062 10.1016/0895-4356(93)90173-X 8263578 (Pubitemid 23258904)
41. Good inter-rater reliability of the Frenchay Activities Index in stroke patients. MW Post LP de Witte, Clin Rehabil 2003 17 5 548 552 10.1191/0269215503cr648oa 12952162 (Pubitemid 37038300)
42. The reliability and validity of the physical activity questions in the WHO health behaviour in schoolchildren (HBSC) survey: a population study. ML Booth AD Okely T Chey A Bauman, Br J Sports Med 2001 35 4 263 267 10.1136/bjsm.35.4.263 11477024 (Pubitemid 32730438)
43. Interpretation of low kappa values. DK Donker A Hasman HP van Geijn, Int J Biomed Comput 1993 33 1 55 64 10.1016/0020-7101(93)90059-F 8349359 (Pubitemid 23210414)
44. Comparison of distribution, agreement and correlation between the original and modified Merle d'Aubigne-Postel Score and the Harris Hip Score after acetabular fracture treatment: moderate agreement, high ceiling effect and excellent correlation in 450 patients. S Ovre L Sandvik JE Madsen O Roise, Acta Orthop 2005 76 6 796 802 10.1080/17453670510045390 16470432
45. Physician patient questionnaire to assess physician patient agreement at the consultation. GC Ahlen B Mattsson RK Gunnarsson, Fam Pract 2007 24 5 498 503 10.1093/fampra/cmm043 17656632 (Pubitemid 350142649)
46. High agreement but low kappa: I. The problems of two paradoxes. AR Feinstein DV Cicchetti, J Clin Epidemiol 1990 43 6 543 549 10.1016/0895-4356(90) 90158-L 2348207 (Pubitemid 20178543)
47. High agreement but low kappa: II. Resolving the paradoxes. DV Cicchetti AR Feinstein, J Clin Epidemiol 1990 43 6 551 558 10.1016/0895-4356(90)90159-M 2189948 (Pubitemid 20178544)
48. Behavior and interpretation of the kappa statistic: resolution of the two paradoxes. CA Lantz E Nebenzahl, J Clin Epidemiol 1996 49 4 431 434 10.1016/0895-4356(95)00571-4 8621993 (Pubitemid 26149667)
49. A model for agreement between ratings on an ordinal scale. A Agresti, Biometrics 1988 44 539 548 10.2307/2531866
50. Statistical methods for the validation of questionnaires - discrepancy between theory and practice. ME Schmidt K Steindorf, Methods Inf Med 2006 45 4 409 413 16964357 (Pubitemid 44289522)
51. Validation of the Korean version of the Roland-Morris Disability Questionnaire. JS Lee DH Lee KT Suh JI Kim JM Lim TS Goh, Eur Spine J 2011
52. Test-retest reliability of the pain attitudes and beliefs scale and sensitivity to change in a general practitioner population. J Bowey-Morris G Purcell-Jones PJ Watson, Clin J Pain 2010 26 2 144 152 10.1097/AJP. 0b013e3181bada3d 20090442
53. Measurement consistency from magnetic resonance images. D Chung MK Chung RB Durtschi LR Gentry HK Vorperian, Acad Radiol 2008 15 10 1322 1330 10.1016/j.acra.2008.04.020 18790405
54. Interrater reliability of Glasgow Coma Scale scores in the emergency department. MR Gill DG Reiley SM Green, Ann Emerg Med 2004 43 2 215 223 10.1016/S0196-0644(03)00814-X 14747811 (Pubitemid 38141465)
55. Health care providers underestimate symptom intensities of cancer patients: a multicenter European study. EA Laugsand MA Sprangers K Bjordal F Skorpen S Kaasa P Klepstad, Health Qual Life Outcomes 2010 8 104 10.1186/1477-7525-8-104 20858248
56. Reliability, validity, and responsiveness of the locomotor capabilities index in adults with lower-limb amputation undergoing prosthetic training. F Franchignoni D Orlandini G Ferriero TA Moscato, Arch Phys Med Rehabil 2004 85 5 743 748 10.1016/j.apmr.2003.06.010 15129398 (Pubitemid 38857910)
57. Using a 0-10 scale for assessment of anxiety in patients with acute myocardial infarction. MM De Jong K An S McKinley BJ Garvin LA Hall DK Moser, Dimens Crit Care Nurs 2005 24 3 139 146 10.1097/00003465-200505000-00008 15912064