Evaluating health plan quality 2: Survey design principles for measuring health plan quality

American Journal of Managed Care

Volumn 9, Issue SPEC. ISS. 2, 2003, Pages

  Wholey, Douglas R ^a   Christianson, Jon B ^a   Finch, Michael ^b   Knutson, David ^c   Rockwood, Todd ^a   Warrick, Louise ^d  

^a UNIVERSITY OF MINNESOTA   (United States)

^b UNITEDHEALTH GROUP   (United States)

^c PARK NICOLLET INSTITUTE   (United States)

^d Park Nicollet Inst for Res/Educ ^*

Author keywords

[No Author keywords available]

Indexed keywords

COGNITION; HEALTH CARE MANAGEMENT; HEALTH CARE PLANNING; HEALTH CARE QUALITY; HEALTH MAINTENANCE ORGANIZATION; HEALTH SURVEY; INTERVIEW; MANAGED CARE; MEDICAL EXPERT; MEDICAL LITERATURE; PHYSICIAN; PRIORITY JOURNAL; RELIABILITY; REVIEW; STATISTICAL MODEL; VALIDATION PROCESS;

ATTITUDE OF HEALTH PERSONNEL; GUIDELINES; HEALTH CARE SURVEYS; HUMANS; MANAGED CARE PROGRAMS; MANAGEMENT AUDIT; PHYSICIANS; QUALITY ASSURANCE, HEALTH CARE; REPRODUCIBILITY OF RESULTS; UNITED STATES;

EID: 0037622979     PISSN: 10880224     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (106)

1. Wholey DR, Christianson JB, Finch M, et al. Evaluating health plan quality 1: A conceptual model. Am J Manag Care. 2003; 9(suppl):SP53-SP64.
2. Borowsky SJ, Davis MK, Goertz C, et al. Are all health plans created equal? The physician's view. JAMA. 1997;278:917-921.
3. Borowsky SJ, Goertz C, Lurie N. Can physicians diagnose strengths and weaknesses in health plans? Ann Intern Med. 1996;125:239-241.
4. Williams TV, Zaslavsky AM, Cleary PD. Physician experiences with, and ratings of, managed care organizations in Massachusetts. Med Care. 1999;37:589-600.
5. Blumenthal D, Epstein AM. Quality of health care, part 6: The role of physicians in the future of quality management. N Engl J Med. 1996;335:1328-1331.
6. Campbell SM, Roland MO, Buetow SA. Defining quality of care. Soc Sci Med. 2000;51:1611-1625.
7. Landon BE, Wilson IB, Cleary PD. A conceptual model of the effects of health care organizations on the quality of medical care. JAMA. 1998;279:1377-1382.
8. Carman KL, Short PF, Farley DO, et al. Epilogue: Early lessons from CAHPS Demonstrations and Evaluations. Consumer Assessment of Health Plans Study. JAMA. 1999;37:MS97-105.
9. Crofton C, Lubalin JS, Darby C. Consumer Assesment of Health Plans Study (CAHPS) [Foreword]. Med Care. 1999;37:MS1-9.
10. Berwick DM, Baker MW, Kramer E. The state of quality management in HMOs. HMO Pract. 1992;6:26-32.
11. Landon BE, Epstein AM. Quality management practices in Medicaid managed care: A national survey of Medicaid and commercial health plans participating in the Medicaid program. JAMA. 1999;282:1769-1775.
12. Kerr EA, Mittman BS, Hays RD, et al. Quality assurance in capitated physician groups. Where is the emphasis? JAMA. 1996;276:1236-1239.
13. Bell RA, Kravitz RL, Siefkin AD, et al. Physicians' attitudes toward managed care: Assessment and potential effects on practice behaviors. Am J Manag Care. 1997;3:1297-1304.
14. Friedenberg RM. The primary care physician's view of managed care in 1998. Radiology. 1999;210:297-300.
15. Ellsbury KE, Schneeweiss R. Physician knowledge and attitudes about health insurance after the introduction of capitated health care plans. J Fam Pract. 1988;26:57-59.
16. Roulidis ZC, Schulman KA. Physician communication in managed care organizations: Opinions of primary care physicians. J Fam Pract. 1994;39:446-451.
17. Simon SR, Pan RJ, Sullivan AM, et al. Views of managed care - A survey of students, residents, faculty, and deans at medical schools in the United States. N Engl J Med. 1999;340:928-936.
18. Stiffman MN, LeFevre ML. Are resident physicians serving as primary care providers for managed care patients? Fam Med. 1997;29:94-98.
19. Nadler ES, Sims S, Tyrance PH Jr, et al. Does a year make a difference? Changes in physician satisfaction and perception in an increasingly capitated environment. Am J Med. 1999;107:38-44.
20. Remler DK, Donelan K, Blendon RJ, et al. What do managed care plans do to affect care? Results from a survey of physicians. Inquiry. 1997;34:196-204.
21. Linzer M, Konrad TR, Douglas J, et al. Managed care, time presure, and physician job satisfaction: Results from the physician worklife study. J Gen Intern Med. 2000;15:441-450.
22. Kaiser Family Foundation/Harvard School of Public Health. Survey of Physicians and Nurses. Menlo Park, Calif: Kaiser Family Foundation/Harvard School of Public Health; 1999.
23. Collins KS, Schoen C, Sandman DR. The Commonwealth Fund Survey of Physician Experiences with Managed Care. Available at: http://www.cmwf.org/publist. Accessed March 23, 2003.
24. Galanter M. The impact of managed care on addiction treatment: Evaluating physician's views and the value of health plan benefits. J Addict Dis. 1999;18:1-4.
25. Scheckler WE, Schulz R, Moberg P. Physician satisfaction with the development of HMOs in Dane County: 1983-1993. Wis Med J 1994;93:444-446.
26. Warren MG, Weitz R, Kulis S. The impact of managed care on physicians. Health Care Manage Rev. 1999;24:44-56.
27. Johnson RE, Freeborn DK, Azevedo DJ. Physicians' attitudes toward an expanded role for pharmacists in an HMO. Group Health J. 1984;5:14-21.
28. Allison JJ, Kiefe CI, Cook EF, et al. The association of physician attitudes about uncertainty and risk taking with resource use in a Medicare HMO. Med Decis Making. 1998;18:320-329.
29. Wynia MK, Picken HA, Selker HP. Physicians' views on capitated payment for medical care: Does familiarity foster acceptance? Am J Manag Care. 1997;3:1497-1502.
30. Halm EA, Causino N, Blumenthal D. Is gatekeeping better than traditional care? A survey of physicians' attitudes JAMA. 1997;278:1677-1681.
31. Bailey JE, Bush AJ, Bertram PD, et al. Physicians' experiences with Medicaid managed care: The Tennessee American College of physicians survey on TennCare. Tenn Med. 1998;91:313-316.
32. Foulke GE, Bell RA, Siefkin AD, et al. Attitudes and behavioral intentions regarding managed care: A comparison of academic and community physicians. Am J Manag Care. 1998;4:555-563.
33. Taslimi MM, Miller PE, Hicks WH. Hamilton county physicians' experience with managed care. Tenn Med. 2000;93:133-135.
34. Dreher T, Whetten-Goldstein K. A survey of beliefs about managed care. North Carolina Med J. 1999;60:30-33.
35. Skootsky SA, Slavin S, Wilkes MS. Attitudes toward managed care and cost containment among primary care trainees at 3 training sites. Am J Manag Care. 1999;5:1397-1404.
36. Hojat M, Gonnella JS, Erdmann JB, et al. Physicians' perceptions of the changing health care system: Comparisons by gender and specialties. J Community Health. 2000;25:455-471.
37. Levine RA, Lieberson A. Physicians' perceptions of managed care. Am J Manag Care. 1998;4:171-180.
38. Eastman JK, Eastman KL, Tolson MA. The ethics of managed care. An initial look at physicians' perspectives. Mark Health Serv. 1997;17:26-39.
39. Ellsbury K, Montano D, Krafft K. A survey of the attitudes of physician specialists toward capitation-based health plans with primary care gatekeepers. QRB Qual Rev Bull. 1990;16:294-300.
40. Shye D, Brown JB. Primary care HMO clinicians' opinions about clinical practice guidelines. HMO Pract 1995;9:111-115.
41. Salem-Schatz SR, Gottlieb LK, Karp MA, et al. Attitudes about clinical practice guidelines in a mixed model HMO: The influence of physician and organizational characteristics. HMO Pract. 1997;11:111-117.
42. Inouye J, Kristopatis R, Stone E, et al. Physicians' changing attitudes toward guidelines. J Gen Intern Med. 1998;13:324-326.
43. Silverstein G, Kirkman-Liff B. Physician participation in Medicaid managed care. Soc Sci Med. 1995;41:355-363.
44. Meyer CM, Ladenson PW, Scharfstein JA, et al. Evaluation of common problems in primary care: Effects of physician, practice, and financial characteristics. Am J Manag Care. 2000;6:457-469.
45. Bucci RV. Has managed care changed the skills required for physicians to practice medicine? Manag Care Q. 1999;7:20-24.
46. Hasty M, Schrager J, Wrenn K. Physicians' perceptions about managed care restrictions on antibiotic prescribing. J Gen Intern Med. 1999;14:756-758.
47. DeMaria AN, Lee TH, Leon DF, et al. Effect of managed care on cardiovascular specialists: Involvement, attitudes and practice adaptations. J Am Coll Cardiol. 1996;28:1884-1895.
48. Grumbach K, Osmond D, Vranizan K, et al. Primary care physicians' experience of financial incentives in managed-care systems. N Engl J Med. 1998;339:1516-1521.
49. Sulmasy DP, Bloche MG, Mitchell JM, et al. Physicians' ethical beliefs about cost-control arrangements. Arch Intern Med. 2000;160:649-657.
50. Kao AC, Green DC, Zaslavsky AM, et al. The relationship between method of physician payment and patient trust. JAMA. 1998;280:1708-1714.
51. Leider PJ, Solberg R, Nesbitt T. Family physician perception of economic incentives for the provision of office procedures. Fam Med. 1997;29:318-320.
52. Tyrance PH Jr, Sims S, Ma'luf N, et al. Capitation and its effects on physician satisfaction. Cost Qual Q J. 1999;5:12-18.
53. Lohr KN, Brook RH, Kamberg CJ, et al. Use of medical care in the RAND Health Insurance Experiment. Diagnosis- and service-specific analyses in a randomized controlled trial, chapter 5: Effect of cost-sharing on use of medically effective and less effective care. Med Care. 1986;24:S1-87.
54. Hellinger FJ. The impact of financial incentives on physician behavior in managed care plans: A review of the evidence. Med Care Res Rev. 1996;53:294-314.
55. Giuffrida A, Gosden T, Forland F, et al. Target payments in primary care: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000:4.
56. Gosden T, Forland F, Kristiansen IS, et al. Capitation, salary, fee-for-service and mixed systems of payment: Effects on the behaviour of primary care physicians. Cochrane Database Syst Rev. 2000:4.
57. Freeborn DK. Physician satisfaction in a prepaid group practice HMO. Group Health J. 1985;6:3-12.
58. Baker LC, Cantor JC. Physician satisfaction under managed care. Health Aff (Millwood). 1993;12(suppl):258-270.
59. Ahern M. Survey of Florida physicians. Characteristics and satisfaction. J Fla Med Assoc. 1993;80:752-757.
60. Deckard GJ. A comparison of concurrent general and HMO-affiliated medical practice experience. J Health Soc Policy. 1995;7:69-79.
61. Weinberg DJ, Engasser PG. Dermatologists in Kaiser Permanente-northern California. Satisfaction, perceived constraints, and policy options. Arch Dermatol. 1996;132:1057-1063.
62. Collins KS, Schoen CA, Khoransanizadeh F. Practice satisfaction and experiences of women physicians in an era of managed care. J Am Med Womens Assoc. 1997;52:52-56.
63. Schulz R, Scheckler WE, Moberg DP, et al. Changing nature of physician satisfaction with health maintenance organization and fee-for-service practices. J Fam Pract. 1997;45:321-330.
64. Kerr EA, Hays RD, Mittman BS, et al. Primary care physicians' satisfaction with quality of care in California capitated medical groups. JAMA. 1997;278:308-312.
65. Conway T, Hu TC, Daugherty SR. Physicians' perceptions of managed care: A structural equation model assessment of key dimensions. Med Care. 1998;36:1430-1435.
66. Warren MG, Weitz R, Kulis S. Physician satisfaction in a changing health care environment: The impact of challenges to professional autonomy, authority, and dominance. J Health Soc Behav. 1998;39:356-367.
67. Bates AS, Harris LE, Tierney WM, et al. Dimensions and correlates of physician work satisfaction in a midwestern city. Med Care. 1998;36:610-617.
68. Hadley J, Mitchell JM, Sulmasy DP, et al. Perceived financial incentives, HMO market penetration, and physicians' practice styles and satisfaction. Health Serv Res. 1999;34:307-321.
69. Murray A, Montgomery JE, Chang H, et al. Doctor discontent a comparison of physician satisfaction in different delivery system settings, 1986 and 1997. J Gen Intern Med. 2001;16:452-459.
70. Gazewood JD, Longo DR, Madsen R. Physician satisfaction with Medicaid managed care: The Missouri experience. J Fam Pract. 2000;49:20-26.
71. Kerr EA, Mittman BS, Hays RD, et al. Associations between primary care physician satisfaction and self-reported aspects of utilization management. Health Serv Res. 2000;35:333-349.
72. Konrad TR, Williams ES, Linzer M, et al. Measuring physician job satisfaction in a changing workplace and a challenging environment. SGIM Career Satisfaction Study Group. Society of General Internal Medicine. Med Care. 1999;37:1174-1182.
73. Haas JS, Cook EF, Puopolo AL, et al. Is the professional satisfaction of general internists associated with patient satisfaction? J Gen Intern Med. 2000;15:122-128.
74. Kerr EA, Mittman BS, Hays RD, et al. Managed care and capitation in California: How do physicians at financial risk control their own utilization? Ann Intern Med. 1995;123:500-504.
75. Schectman JM Elinsky EG, Kanwal NK, et al. HMO physician attitudes toward drug cost containment strategies. HMO Pract. 1995;9:116-119.
76. Dixon MK, Kirschner PB, Edelberg HK, Aykanian, JZ, Wei JY. Physician perceptions of HMO care for older persons. Health Maintenance Organization. J Am Geriatr Soc. 2000;48(6):607-612.
77. Justice AC, Rabeneck L, Hays RD, et al. Sensitivity, specificity, reliability, and clinical validity of provider-reported symptoms: A comparison with self-reported symptoms. Outcomes Committee of the AIDS Clinical Trials Group. J Acquir Immune Defic Syndr. 1999;21:126-133.
78. Stange KC, Zyzanski SJ, Smith TF, et al. How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Med Care. 1998;36:851-867.
79. Groves RM, Beimer PP, Lyberg LE, et al. Telephone Survey Methodology. New York, NY: Wiley; 1988.
80. Aquilino WS, LoScuito LA. Effects of interview mode on self-reported drug use. Public Opin Q. 1990;54:362-395.
81. Biemer PP. Measurement Errors in Surveys. New York, NY: Wiley; 1991.
82. Schwarz N, Sudman S, Zentrum für Umfragen Methoden und Analysen (Germany), et al. Context Effects in Social and Psychological Research. New York, NY: Springer-Verlag; 1992.
83. Aquilino WS. Interview mode effects in surveys of drug and alcohol use: A field experiment. Public Opin Q. 1994;58:210-240.
84. Salant P, Dillman DA. How to Conduct Your Own Survey. New York, NY: Wiley; 1994.
85. Dillman DA, Sangster RL, Tarnai J, et al. Understanding differences in people's answers to telephone and mail surveys. In: Braverman MT, Slater JK, eds. Advances in Survey Research. Vol 70. San Francisco, Calif: Jossey-Bass, Inc; 1996:110.
86. Sudman S, Bradburn NM, Schwarz N. Thinking About Answers: The Application of Cognitive Processes to Survey Methodology. 1st ed. San Francisco, Calif: Jossey-Bass Inc; 1996.
87. Tourangeau R, Smith TW. Asking sensitive questions: The Impact of data collection mode, question format, and question context. Public Opin Q. 1996;60:275-304.
88. De Leeuw E, Collins M. Data collection methods and survey quality: An overview. In: Lyberg L, Biemer P, Collins M, et al, eds. Survey Measurement and Process Quality. New York, NY: Wiley; 1997:199-220.
89. Krosnick JA. Thinking about answers: The application of cognitive processes to survey methodology. Public Opin Q. 1997;61:664-667.
90. Krosnick JA. Answering questions: Methodology for determining cognitive and communicative processes in survey research. Public Opin Q. 1997;61:664-667.
91. Rockwood TH, Sangster RL, Dillman DA. The effect of response categories on questionnaire answers: Context and mode effects. Sociol Methods Res. 1997;26:118-140.
92. Fowler FJ Jr, Roman AM, Di ZX. Mode effects in a survey of Medicare prostate surgery patients. Public Opin Q. 1998;62:29-46.
93. Dillman DA. Mail and Electronic Surveys: The Tailored Design Method. 2nd ed. New York, NY: Wiley; 1999.
94. Tourangeau R, Rips LJ, Rasinski K. The Psychology of Survey Response. Cambridge, UK: Cambridge University Press; 2000.
95. Dillman DA, Tarnai J. Administrative issues in mixed mode surveys. In: Groves RM, Beimer PP, Lyberg LE, Massey JT, Nichols WLI, Waksberg J, eds. Telephone Survey Methodology. New York, NY: Wiley; 1988:581.
96. Dillman DA. The design and administration of mail surveys. Annu Rev Sociol. 1991;17:225-249.
97. Solomon DH, Hashimoto H, Daltroy L, et al. Techniques to improve physicians' use of diagnostic tests: A new conceptual framework. JAMA. 1998;280:2020-2027.
98. Trochim WMK. The Research Methods Knowledge Base. Cincinnati, Ohio: Atomic Dog Publishing; 2001.
99. Homer CJ, Marino B, Cleary PD, et al. Quality of care at a children's hospital: The parent's perspective. Arch Pediatr Adolesc Med. 1999;153:1123-1129.
100. Hays RD, Shaul JA, Williams VS, et al. Psychometric properties of the CAHPS 1.0 survey measures. Consumer Assessment of Health Plans Study. Med Care. 1999;37:MS22-31.
101. Centers for Medicare and Medicaid Services. Quality Improvement System for Managed Care (QISMC). Year 2000 Standards amd Guidelines. Domain 4: Delegation. July 26, 2000. Available at: http://www.cms.hhs.gov/cop/2d1.asp#domain4. Accessed May 10, 2003.
102. Prager LO. NCQA to accredit PPOs: Doctors may face new data demands. American Medical News. July 26, 1999;42(28):8.
103. Prager LO. NCQA expands accreditation to include PPOs. American Medical News. Sept 18, 2000;43(35):10.
104. Prager LO. Physician groups next goal for NCQA accreditation. American Medical News. August 23-30, 1999;42(32):9.
105. Kaiser Family Foundation/Harvard School of Public Health. Survey of Physicians and Nurses: Summary of Findings and Chart Pack. Menlo Park, Calif: Kaiser Family Foundation/Harvard School of Public Health; 1999;42(32):9.
106. Mechanic D, McAlpine DD, Rosenthal M. Are patient-physician visits getting shorter? 1989-1998. N Engl J Med 2001;3:198-204.