How Valid Are Medical Records and Patient Questionnaires for Physician Profiling and Health Services Research? A Comparison with Direct Observation of Patient Visits

Medical Care

Volumn 36, Issue 6, 1998, Pages 851-867

  Stange, Kurt C ^a,b,c   Zyzanski, Stephen J ^a,c   Smith, Tracy Fedirko ^b   Kelly, Robert ^a,c,d   Langa, Doreen M ^a,b   Flocke, Susan A ^a,c   Jaén, Carlos R ^e  

^a CASE WESTERN RESERVE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b CASE WESTERN RESERVE UNIVERSITY   (United States)

^c UNIVERSITY HOSPITALS OF CLEVELAND   (United States)

^d METROHEALTH MEDICAL CENTER   (United States)

^e UNIVERSITY AT BUFFALO   (United States)

Author keywords

Health services research; Medical record review; Physician profiling; Primary care; Research methodology; Survey research

Indexed keywords

ADULT; AMBULATORY CARE; ARTICLE; FEMALE; GENERAL PRACTICE; HEALTH SERVICES RESEARCH; HUMAN; MALE; MEDICAL AUDIT; MEDICAL RECORD; METHODOLOGY; MIDDLE AGED; OBSERVER VARIATION; PATIENT SATISFACTION; PRIMARY HEALTH CARE; QUESTIONNAIRE; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STANDARD; UNITED STATES; VIDEORECORDING;

ADULT; FAMILY PRACTICE; FEMALE; HEALTH SERVICES RESEARCH; HUMANS; MALE; MEDICAL AUDIT; MEDICAL RECORDS; MIDDLE AGED; OBSERVER VARIATION; OFFICE VISITS; OHIO; PATIENT SATISFACTION; PRIMARY HEALTH CARE; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEOTAPE RECORDING;

EID: 0032089115     PISSN: 00257079     EISSN: None     Source Type: Journal    
DOI: 10.1097/00005650-199806000-00009     Document Type: Article

References (62)

1. Clancy C, Gold M, Wall E. Primary care and health care reform: The next 100 days. J Fam Pract 1993;36:233.
2. Starfield B, Simpson L. Primary care as part of US health services reform. JAMA 1993;269:3136-3139.
3. Langsley DG. Medical competence and performance assessment: A new era. JAMA 1991:977.
4. Dauphinee WD. Assessing clinical performance: Where do we stand and what might we expect? JAMA 1995;274:741.
5. Kassirer JP. The use and abuse of practice profiles. N Engl J Med 1994;330:634.
6. Brand DA, Quam L, Leatherman S. Medical practice profiling: Concepts and caveats. Med Care Res Rev 1995;52:223.
7. McAuliffe WE. Studies of process-outcome correlations in medical care evaluations: A critique. Med Care 1978;16:907.
8. Brook RH, Williams KN, Avery AD. Quality assurance today and tomorrow: Forecast for the future. Ann Intern Med 1976;85:809.
9. Wingert TD, Krawlewski JE, Lindquist TJ, Knutson DJ. Constructing episodes of care from encounter and claims data: Some methodological issues. Inquiry 1995;32:430.
10. Weiner JP, Powe NR, Steinwachs DM, Dent G. Applying insurance claims data to assess quality of care: A compilation of potential indicators. Qual Rev Bull 1990;16:424.
11. Weiner JP, Parente ST, Garnick DW, et al.Variation in office-based quality: A claims-based profile of care provided to Medicare patients. JAMA 1995;273:1503.
12. Fisher ES, Whaley FS, Krushat M, et al. The accuracy of Medicare's hospital claims data: Progress has been made, but problems remain. Am J Public Health 1992;82:243.
13. Lawthers AG, Palmer RH, Edwards JE, Fowles J, Garnick DW, Weiner JP. Developing and evaluating performance measures for ambulatory care quality: A preliminary report of the DEMPAQ project. Joint Commission Journal on Quality Improvement 1993;19:552.
14. Romano PS, Roos LL, Luft HS, et al. A comparison of administrative versus clinical data: Coronary artery bypass surgery as an example. J Clin Epidemiol 1994;47:249.
15. Romano PS, Mark DH. Bias in the coding of hospital discharge data and its implications for quality assessment. Med Care 1994;32:81.
16. Garnick DW, Fowles J, Lawthers AG, Weiner JP, Parente ST, Palmer RH. Focus on quality: Profiling physicians'practice patterns. J Ambulatory Care Manage 1994;17:44.
17. Parente ST, Weiner JP, Garnick DW, et al. Developing a quality improvement database using health insurance data: A guided tour with application to Medicare's National Claims History file. Am J Med Qual 1995;10:162.
18. Fowles JB, Weiner JP, Knutson D, Fowler E, Tucker AM, Ireland M. Taking health status into account when setting capitation rates: A comparison of risk-adjustment methods. JAMA 1996;276:1316.
19. US Department of Health and Human Services. Report to Congress: The Feasibility of Linking Research-Related Data Bases to Federal and Non-Federal Medical Administrative Data Bases. Rockville, MD: US DHHS, Public Health Service, Agency for Health Care Policy and Research, 1991.
20. Stange KC. Primary care research: Barriers and opportunities. J Fam Pract 1996;42:192.
21. McPhee SJ, Richard RJ, Solkowitz SN. Performance of cancer screening in a university general internal medicine practice: Comparison with the 1980 American Cancer Society Guidelines. J Gen Intern Med 1986;1:275.
22. Woo B, Woo B, Cook EF, Weisberg M, Goldman L. Screening procedures in the asymptomatic adult: A comparison of physicians' recommendations, patients' desires, published guidelines, and actual practice. JAMA 1985;254:1480.
23. Montano DE, Phillips WR. Cancer screening by primary care physicians: A comparison of rates obtained from physician self-report, patient survey, and chart audit. Am J Public Health 1995;85:795.
24. Palmer RH, Hargraves JL. The ambulatory care medical audit demonstration project: Research design. Med Care 1996;34:SS12.
25. Starfield B, Steinwachs D, Morris I, Bause G, Siebert S, Westin C. Concordance between medical records and observations regarding information on coordination of care. Med Care 1979;17:758.
26. Zuckerman AE, Starfield B, Hochreiter C, Kovasznay B. Validating the content of pediatric outpatient medical records by means of tape-recording doctor-patient encounters. Pediatrics 1975;56:407.
27. Callahan EJ, Bertakis KD. Development and validation of the Davis Observation Code. Fam Med 1991;23:19.
28. Suarez L, Goldman DA, Weiss NS. Validity of Pap smear and mammogram: Self-reports in a low-income Hispanic population. Am J Prev Med 1995;11:94.
29. McKenna MT, Speers M, Mallin K, Warnecke R. Agreement between patient self-reports and medical records for Pap smear histories. Am J Prev Med 1992;8:287.
30. Sawyer JA, Earp JA, Fletcher RH, Daye FF, Wynn TM. Accuracy of women's self-report of their last Pap smear. Am J Public Health 1989;79:1036.
31. Gerbert B, Stone G, Stulbarg M, Gullion DS, Greenfield S. Agreement among physician assessment methods: Searching for the truth among fallible methods. Med Care 1988;26:519.
32. Johnson CS, Archer J, Campos-Outcalt D. Accuracy of Pap smear and mammogram self-reports in a southwestern native American tribe. Am Prev Med 1995;11:360.
33. Silagy C, Muir J, Coulter A, Thorogood M, Yudkin P, Roe L. Lifestyle advice in general practice: Rates recalled by patients. BMJ 1992;305:871.
34. Harlow SD, Linet MS. Agreement between questionnaire data and medical records: The evidence for accuracy of recall. Am J Epidemiol 1989;129:233.
35. Etzi S, Lane DS, Grimson R. The use of mammography vans by low-income women: The accuracy of self-reports. Am J Public Health 1994;84:107.
36. Degnan D, Harris R, Ranney J, Quade D, Earp JA, Gonzalez J. Measuring the use of mammography: Two methods compared. Am J Public Health 1992;82:1386.
37. Zapka JG, Bigelow C, Hurley T, et al. Mammography use among sociodemographically diverse women: The accuracy of self-report. Am J Public Health 1996;86:1016.
38. Rohrbaugh M, Rogers JC. What did the doctor do? When physicians and patients disagree. Arch Fam Med 1994;3:125.
39. Stange KC, Miller WL, Crabtree BF, O'Connor PJ, Zyzanski SJ. Multimethod research: Approaches for integrating qualitative and quantitative methods. J Gen Int Med 1994;9:278.
40. Stange KC. Practice-based research networks: Their current level of validity, generalizability, and potential for wider application. Arch Fam Med 1993;2:921.
41. Stange KC. "One size doesn't fit all." Multimethod research yields new insights into interventions to improve preventive service delivery in family practice. J Fam Pract 1996;43:358.
42. Stange KC, Zyzanski SJ, Jaén CR, et al. Illuminating the black box: A description of 4454 patient visits to 138 family physicians. J Fam Pract 1998;46(5). In press.
43. Ware J, Nelson E, Sherboume C, Stewart A. Preliminary tests of a 6-item general health survey: A patient application. In: Ware ASJ, ed. Measuring functioning and well-being. Durham: Duke University Press, 1992.
44. American Medical Association. Physicians' current procedural terminology: CPT '95. Chicago, IL: AMA, 1995.
45. St. Anthony's ICD-9-CM: Code book for physician payment. Alexandria, VA: St. Anthony Publishing, Inc. 1994:533;410.
46. Bogdewic SP. Participant observation. In: Crabtree BF, Miller WL, eds. Doing qualitative research: Multiple strategies. Newbury Park, CA: Sage Publications, 1992.
47. Schneider D, Appleton L, McLemore T. A reason for visit classification for ambulatory care. Vital Health Stat 2 1979;78:1.
48. Schappert SM. National ambulatory medical care survey: 1991 summary. Vital Health Stat 13 1993;116:1.
49. American Academy of Family Physicians. Facts about family practice. Kansas City, MO: American Academy of Family Physicians, 1996.
50. Schappert SM. National ambulatory medical care survey: 1994 summary. Advance data from vital and health statistics. Adv Data 1996;273:1.
51. Cogner AJ. Integration and generalization of kappas for multiple raters. Psych Bull 1980;88:322.
52. Strube MJ. A general program for the calculation of the kappa coefficient. Behavior Research Methods, Instruments & Computers 1989;21:643.
53. Fleiss JL. The use of mammography vans by low-income women: The accuracy of self-reports. Am J Public Health 1971;76:378.
54. Maclure M, Willett WC. Misinterpretation and misuse of the kappa statistic. Am J Epidemiol 1987;126:161.
55. Uebersax JS. A generalized kappa coefficient. Educ Psych Meas 1982;42:151.
56. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159.
57. Feinstein AR, Cicchetti DV. High agreement but low Kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990;43:543.
58. Cicchetti DV, Feinstein AR. High agreement but low Kappa: II. Resolving the paradoxes. J Clin Epidemiol 1990;43:551.
59. Brown JB, Adams ME. Patients as reliable reporters of medical care process: Recall of ambulatory encounter events. Med Care 1992;30:400.
60. Stange KC, Zyzanski SJ. Integrating quantitative and qualitative research methods. Fam Med 1989;22:183.
61. Iglehart JK. The National Committee for Quality Assurance. N Engl J Med 1996;335:995.
62. National Committee for Quality Assurance. HEDIS 3.0 Health Plan Employer Data & Info. Washington, DC: NCQA, 1996.