Tradeoffs between accuracy measures for electronic health care data algorithms

Journal of Clinical Epidemiology

Volumn 65, Issue 3, 2012, Pages 343-349.e2

  Chubak, Jessica ^a,b   Pocobelli, Gaia ^a,b   Weiss, Noel S ^b,c  

^a GROUP HEALTH RESEARCH INSTITUTE   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c Fred Hutchinson Cancer Research Center   (United States)

Author keywords

Algorithms; Bias; Databases, factual; Epidemiology; Medical records systems, computerized; Misclassification

Indexed keywords

ACCURACY; ALGORITHM; ARTICLE; AUTOMATION; ELECTRONIC MEDICAL RECORD; MEDICAL RESEARCH; PREDICTIVE VALUE; PRIORITY JOURNAL;

EID: 84856003959     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2011.09.002     Document Type: Article

References (58)

1. M.A. Raji, Y.-F. Kuo, J.L. Freeman, and J.S. Goodwin Effect of a dementia diagnosis on survival of older patients after a diagnosis of breast, colon, or prostate cancer: implications for cancer care Arch Intern Med 168 2008 2033 2040
2. E.B. Lamont, J.E. Herndon II, J.C. Weeks, I.C. Henderson, C.C. Earle, and R.L. Schilsky Measuring disease-free survival and cancer relapse using medicare claims from CALGB breast cancer trial participants (companion to 9344) J Natl Cancer Inst 98 2006 1335 1338 (Pubitemid 44530729)
3. S. Dublin, M.L. Jackson, J.C. Nelson, N.S. Weiss, E.B. Larson, and L.A. Jackson Statin use and risk of community acquired pneumonia in older people: population based case-control study BMJ 338 2009 b2137
4. K.L. Nichol, J. Nordin, J. Mullooly, R. Lask, K. Fillbrandt, and M. Iwane Influenza vaccination and reduction in hospitalizations for cardiac disease and stroke among the elderly N Engl J Med 348 2003 1322 1332 (Pubitemid 36384099)
5. A.B. Nattinger, P.W. Laud, R. Bajorunaite, R.A. Sparapani, and J.L. Freeman An algorithm for the use of Medicare claims data to identify women with incident breast cancer Health Serv Res 39 6 Pt 1 2004 1733 1749 (Pubitemid 39601249)
6. L.A. Petersen, S.L. Normand, B.G. Druss, and R.A. Rosenheck Process of care and outcome after acute myocardial infarction for patients with mental illness in the VA health care system: are there disparities? Health Serv Res 38 1 Pt 1 2003 41 63 (Pubitemid 36373298)
7. A.B. Beiderbeck, E.A. Holly, M.C. Sturkenboom, J.W. Coebergh, B.H. Stricker, and H.G. Leufkens Prescription medications associated with a decreased risk of non-Hodgkin's lymphoma Am J Epidemiol 157 2003 510 516 (Pubitemid 36292909)
8. T.L. Gary, M. Batts-Turner, L.R. Bone, H.C. Yeh, N.-Y. Wang, and F. Hill-Briggs A randomized controlled trial of the effects of nurse case manager and community health worker team interventions in urban African-Americans with type 2 diabetes Control Clin Trials 25 1 2004 53 66 (Pubitemid 38230103)
9. D. McClish, and L. Penberthy Using Medicare data to estimate the number of cases missed by a cancer registry: a 3-source capture-recapture model Med Care 42 2004 1111 1116 (Pubitemid 39472117)
10. L. Penberthy, D. McClish, C. Manning, S. Retchin, and T. Smith The added value of claims for cancer surveillance: results of varying case definitions Med Care 43 2005 705 712 (Pubitemid 40993766)
11. L. Penberthy, D. McClish, A. Pugh, W. Smith, C. Manning, and S. Retchin Using hospital discharge files to enhance cancer surveillance Am J Epidemiol 158 2003 27 34 (Pubitemid 36745328)
12. Y. Chen, J.J. Guo, and N.C. Patel Hemorrhagic stroke associated with antidepressant use in patients with depression: does degree of serotonin reuptake inhibition matter? Pharmacoepidemiol Drug Saf 18 2009 196 202
13. B.F. Gage, E. Birman-Deych, M.J. Radford, D.S. Nilasena, and E.F. Binder Risk of osteoporotic fracture in elderly patients taking warfarin: results from the National Registry of Atrial Fibrillation 2 Arch Intern Med 166 2006 241 246 (Pubitemid 43144951)
14. B.L. Nordstrom, H.S. Norman, T.J. Dube, M.A. Wilcox, and A.M. Walker Identification of abacavir hypersensitivity reaction in health care claims data Pharmacoepidemiol Drug Saf 16 2007 289 296 (Pubitemid 46431691)
15. W.J. Katon, E.H. Lin, L.H. Williams, P. Ciechanowski, S.R. Heckbert, and E. Ludman Comorbid depression is associated with an increased risk of dementia diagnosis in patients with diabetes: a prospective cohort study J Gen Intern Med 25 2010 423 429
16. J.P. Mullooly Misclassification model for person-time analysis of automated medical care databases Am J Epidemiol 144 1996 782 792 (Pubitemid 26349415)
17. W.A. Ray, and M.R. Griffin Use of Medicaid data for pharmacoepidemiology Am J Epidemiol 129 1989 837 849 (Pubitemid 19094261)
18. S. Schneeweiss, and J. Avorn A review of uses of health care utilization databases for epidemiologic research on therapeutics J Clin Epidemiol 58 2005 323 337 (Pubitemid 40601980)
19. M.C. Hornbrook, M.J. Goodman, P.A. Fishman, R.T. Meenan, M. O'Keeffe-Rosetti, and D.J. Bachman Building health plan databases to risk adjust outcomes and payments Int J Qual Health Care 10 1998 531 538 (Pubitemid 29037246)
20. M.A.P. Brookhart, T.M.D.M.P.H. Sturmer, R.J.P.S. Glynn, J.S. Rassen, and S.M.D.S. Schneeweiss Confounding control in healthcare database research: challenges and potential approaches Med Care 48 2010 S114 S120
21. L.I. Iezzoni Assessing quality using administrative data Ann Intern Med 127 8 Pt 2 1997 666 674
22. L.L. Roos, C.A. Mustard, J.P. Nicol, D.F. McLerran, D.J. Malenka, and T.K. Young Registries and administrative data: organization and accuracy Med Care 31 1993 201 212
23. J.W. Peabody, J. Luck, S. Jain, D. Bertenthal, and P. Glassman Assessing the accuracy of administrative data in health information systems Med Care 42 2004 1066 1072 (Pubitemid 39472113)
24. J.L. Warren, C.N. Klabunde, D. Schrag, P.B. Bach, and G.F. Riley Overview of the SEER-Medicare data: content, research applications, and generalizability to the United States elderly population Med Care 40 8 Suppl 2002 3 18
25. S. Suissa, and E. Garbe Primer: administrative health databases in observational studies of drug effects-advantages and disadvantages Nat Clin Pract Rheumatol 3 12 2007 725 732 (Pubitemid 350187018)
26. J.C. Nelson, M.L. Jackson, N.S. Weiss, and L.A. Jackson New strategies are needed to improve the accuracy of influenza vaccine effectiveness estimates among seniors J Clin Epidemiol 62 2009 687 694
27. L.A. Jackson, J.C. Nelson, P. Benson, K.M. Neuzil, R.J. Reid, and B.M. Psaty Functional status is a confounder of the association of influenza vaccine and risk of all cause mortality in seniors Int J Epidemiol 35 2006 345 352
28. M.A. Brookhart, T. Sturmer, R.J. Glynn, J. Rassen, and S. Schneeweiss Confounding control in healthcare database research: challenges and potential approaches Med Care 48 6 Suppl 2010 S114 S120
29. E.I. Benchimol, D.G. Manuel, T. To, A.M. Griffiths, L. Rabeneck, and A. Guttmann Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data J Clin Epidemiol 63 2010 1332 1341
30. J.M. Last A Dictionary of Statistics 2002 Oxford University Press Inc New York, NY
31. C.C. Earle, A.B. Nattinger, A.L. Potosky, K. Lang, R. Mallick, and M. Berger Identifying cancer relapse using SEER-Medicare data Med Care 40 8 Suppl 2002 75 81
32. C. van Walraven, P.C. Austin, D. Manuel, G. Knoll, and A. Jennings The usefulness of administrative databases for identifying disease cohorts is increased with a multivariate model J Clin Epidemiol 63 2010 1332 1341
33. T.D. Koepsell, and N.S. Weiss Epidemiologic methods: studying the occurrence of illness 2003 Oxford University Press New York, NY
34. S.M. Frayne, D.R. Miller, E.J. Sharkansky, V.W. Jackson, F. Wang, and J.H. Halanych Using administrative data to identify mental illness: what approach is best? Am J Med Qual 25 2010 42 50
35. A.M. Borzecki, A.T. Wong, E.C. Hickey, A.S. Ash, and D.R. Berlowitz Identifying hypertension-related comorbidities from administrative data: what's the optimal approach? Am J Med Qual 19 2004 201 206 (Pubitemid 39329962)
36. D. Aronsky, P.J. Haug, C. Lagor, and N.C. Dean Accuracy of administrative data for identifying patients with pneumonia Am J Med Qual 20 2005 319 328 (Pubitemid 41771782)
37. D.M. Reker, B.B. Hamilton, P.W. Duncan, S.C. Yeh, and A. Rosen Stroke: who's counting what? J Rehabil Res Dev 38 2 2001 281 289 (Pubitemid 34118861)
38. S. Setoguchi, D.H. Solomon, R.J. Glynn, E.F. Cook, R. Levin, and S. Schneeweiss Agreement of diagnosis and its date for hematologic malignancies and solid tumors between medicare claims and cancer registry data Cancer Causes Control 18 2007 561 569 (Pubitemid 46684827)
39. W.C. Winkelmayer, S. Schneeweiss, H. Mogun, A.R. Patrick, J. Avorn, and D.H. Solomon Identification of individuals with CKD from Medicare claims data: a validation study Am J Kidney Dis 46 2005 225 232 (Pubitemid 41040350)
40. J.L. Freeman, D. Zhang, D.H. Freeman, and J.S. Goodwin An approach to identifying incident breast cancer cases using Medicare claims data J Clin Epidemiol 53 2000 605 614 (Pubitemid 30394510)
41. J.L. Warren, E. Feuer, A.L. Potosky, G.F. Riley, and C.F. Lynch Use of Medicare hospital and physician data to assess breast cancer incidence Med Care 37 1999 445 456
42. J.L. Fleiss The design and analysis of clinical experiments 1986 John Wiley & Sons New York, NY
43. E. White, B.K. Armstrong, and R. Saracci Principles of exposure measurement in epidemiology. Collecting, evaluating, and improving measures of disease risk factors 2nd ed. 2008 Oxford University Press New York, NY
44. C.R. Weinberg, D.M. Umbach, and S. Greenland When will nondifferential misclassification of an exposure preserve the direction of a trend? Am J Epidemiol 140 1994 565 571 (Pubitemid 24285939)
45. A.M. Jurek, S. Greenland, G. Maldonado, and T.R. Church Proper interpretation of non-differential misclassification effects: expectations vs observations Int J Epidemiol 34 2005 680 687 (Pubitemid 40852588)
46. A.M. Jurek, S. Greenland, and G. Maldonado How far from non-differential does exposure or disease misclassification have to be to bias measures of association away from the null? Int J Epidemiol 37 2008 382 385 (Pubitemid 351494216)
47. H. Brenner, D.A. Savitz, and O. Gefeller The effects of joint misclassification of exposure and disease on epidemiologic measures of association J Clin Epidemiol 46 1993 1195 1202 (Pubitemid 23302087)
48. S. Greenland, and P. Gustafson Accounting for independent nondifferential misclassification does not increase certainty that an observed association is in the correct direction Am J Epidemiol 164 2006 63 68 (Pubitemid 43946292)
49. A. Correa-Villasenor, W.F. Stewart, F. Franco-Marina, and H. Seacat Bias from nondifferential misclassification in case-control studies with three exposure levels Epidemiology 6 1995 276 281
50. M. Chavance, G. Dellatolas, and J. Lellouch Correlated nondifferential misclassifications of disease and exposure: application to a cross-sectional study of the relation between handedness and immune disorders Int J Epidemiol 21 1992 537 546
51. M. Dosemeci, S. Wacholder, and J.H. Lubin Does nondifferential misclassification of exposure always bias a true effect toward the null value? Am J Epidemiol 132 1990 746 748 (Pubitemid 20344542)
52. P. Kristensen Bias from nondifferential but dependent misclassification of exposure and outcome Epidemiology 3 1992 210 215
53. S. Wacholder When measurement errors correlate with truth: surprising effects of nondifferential misclassification Epidemiology 6 1995 157 161
54. H. Brenner Inferences on the potential effects of presumed nondifferential exposure misclassification Ann Epidemiol 3 1993 289 294 (Pubitemid 23169434)
55. T. Sorahan, and M.S. Gilthorpe Non-differential misclassification of exposure always leads to an underestimate of risk: an incorrect conclusion Occup Environ Med 51 1994 839 840 (Pubitemid 24368136)
56. S. Wacholder, P. Hartge, J.H. Lubin, and M. Dosemeci Non-differential misclassification and bias towards the null: a clarification Occup Environ Med 52 1995 557 558
57. S. Greenland The effect of misclassification in the presence of covariates Am J Epidemiol 112 1980 564 569 (Pubitemid 10029558)
58. S. Greenland, and K.J. Rothman Modern epidemiology 2nd ed. 1998 Lippincott-Raven Philadelphia, PA