Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature

Medical Care Research and Review

Volumn 67, Issue 5, 2010, Pages 503-527

  Fowles, Jinnet B ^b   Weiner, Jonathan P ^a  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^b PARK NICOLLET INSTITUTE   (United States)

Author keywords

electronic health record; measurement; quality of care; reliability; validity

Indexed keywords

ELECTRONIC MEDICAL RECORD; HEALTH CARE QUALITY; HUMAN; METHODOLOGY; REPRODUCIBILITY; REVIEW; STANDARD; UNITED STATES;

ELECTRONIC HEALTH RECORDS; HUMANS; QUALITY ASSURANCE, HEALTH CARE; QUALITY INDICATORS, HEALTH CARE; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; UNITED STATES;

EID: 79951648577     PISSN: 10775587     EISSN: None     Source Type: Journal    
DOI: 10.1177/1077558709359007     Document Type: Review

References (44)

1. Agnew-Blais, J.C., Coblyn, J.S., Katz, J.N., Anderson, R.J., Mehta, J., & Solomon, D.H. (2009). Measuring quality of care for rheumatic diseases using an electronic medical record. Annals of the Rheumatic Diseases, 68, 680-684.
2. Baldwin, K.B. (2008). Evaluating healthcare quality using natural language processing. Journal for Healthcare Quality, 30, 24-29.
3. Baker, D.W., Persell, S.D., Thompson, J.A., Soman, N.S., Burgner, K.M., Liss, D., et al. (2007). Automated review of electronic health records to assess quality of care for outpatients with heart failure. Annals of Internal Medicine, 146, 270-277.
4. Baron, R.J. (2007). Quality improvement with an electronic health record: Achievable, but not automatic. Annals of Internal Medicine, 147, 549-552.
5. Benin, A.L., Vitkauskas, G., Thornquist, E., Shapiro, E.D., Concato, J., Aslan, M., et al. (2005). Validity of using an electronic medical record for assessing quality of care in an outpatient setting. Medical Care, 43, 691-698.
6. Conroy, M.B., Majchrzak, N.E., Silverman, C.B., Chang, Y., Regan, S., Schneider, L.I., et al. (2005). Measuring provider adherence to tobacco treatment guidelines: A comparison of electronic medical record review, patient survey, and provider survey. Nicotine and Tobacco Research, 7(Supplement 1), S35-S43.
7. Dean, B.B., Lam, J., Natoli, J.L., Butler, Q., Aguilar, D., & Nordyke, R.J. (2009). Use of electronic medical records for health outcomes research: A literature review. Medical Care Research and Review, 66, 611-638.
8. de Lusignan, S., Chan, T., Wood, O., Hague, N., Valentin, T., & Van Vlymen, J. (2005). Quality and variability of osteoporosis data in general practice computer records: Implications for disease registers. Public Health, 119, 771-780.
9. de Lusignan, S., Hague, N., Brown, A., & Majeed, A. (2004). An educational intervention to improve data recording in the management of ischaemic heart disease in primary care. Journal of Public Health, 26, 34-37.
10. des Roches, C.M., Campbell, E.G., Rao, S.R., Donelan, K., Ferris, T.G., Jha, A., et al. (2008). Electronic health records in ambulatory care: A national survey of physicians. New England Journal of Medicine, 359, 50-60.
11. Faulconer, E.R., & de Lusignan, S. (2004). An eight-step method for assessing diagnostic data quality in practice: Chronic obstructive pulmonary disease as an exemplar. Informatics in Primary Care, 12, 243-253.
12. Fishman, P.A., Hornbrook, M.C., Meenan, R.T., & Goodman, M.J. (2004). Opportunities and challenges for measuring cost, quality and clinical effectiveness in health care. Medical Care Research and Review, 61, 124S-143S.
13. Forster, M., Bailey, C., Brinkhof, M.W., Graber, C., Boulle, A., Spohr, M., et al. (2008). Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. Bulletin of the World Health Organization, 86, 939-947.
14. Goodyear-Smith, F., Grant, C., York, D., Kenealy, T., Copp, J., Petousis-Harris, H., et al. (2008). Determining immunisation coverage rates in primary health care practices: a simple goal but a complex task. International Journal of Medical Informatics, 77, 477-485.
15. Goulet, J.L., Erdos, J., Kancir, S., Levin, F.L., Wright, S.M., Daniels, S.M., et al. (2007). Measuring performance directly using the Veterans health administration electronic medical record: A comparison with external peer review. Medical Care, 45, 73-79.
16. Hazlehurst, B., Sittig, D.F., Stevens, V.J., Smith, K.S., Hollis, J.F., Vogt, T.M., et al. (2005). Natural language processing in the electronic medical record: Assessing clinician adherence to tobacco treatment guidelines. American Journal of Preventive Medicine, 29, 434-439.
17. Hicken, V.N., Thornton, S.N., & Rocha, R.A. (2004). Integration challenges of clinical information systems developed without a shared data dictionary. Studies in Health Technology and Informatics, 107, 1053-1057.
18. Institute of Medicine. (2006). Rewarding provider performance: Aligning incentives in Medicare. Washington, DC: National Academies Press.
19. Kaboli, P.J., McClimon, B.J., Hoth, A.B., & Barnett, M.J. (2004). Assessing the accuracy of computerized medication histories. American Journal of Managed Care, 10, 872-877.
20. Linder, J.A., Kaleba, E.O., & Kmetik, K.S. (2009). Using electronic health records to measure physician performance for acute conditions in primary care: Empirical evaluation of the community-acquired pneumonia clinical quality measure set. Medical Care, 47, 208-216.
21. McGinnis, K.A., Skanderson, M., Levin, F.L., Brandt, C., Erdos, J., & Justice, A.C. (2009). Comparison of two VA laboratory data repositories indicates that missing data vary despite originating from the same source. Medical Care, 47, 121-124.
22. Owen, R.R., Thrush, C.R., Cannon, D., Sloan, K.L., Curran, G., Hudson, T., et al. (2004). Use of electronic medical record data for quality improvement in schizophrenia treatment. Journal of the American Medical Informatics Association, 11, 351-357.
23. Pakhomov, S., Bjornsen, S., Hanson, P., & Smith, S. (2008). Quality performance measurement using the text of electronic medical records. Medical Decision Making, 28, 462-470.
24. Pakhomov, S.V., Jacobsen, S.J., Chute, C.G., & Roger, V.L. (2008). Agreement between patient-reported symptoms and their documentation in the medical record. American Journal of Managed Care, 14, 530-539.
25. Persell, S.D., Dunne, A.P., Lloyd-Jones, D.M., & Baker, D.W. (2009). Electronic health record-based cardiac risk assessment and identification of unmet preventive needs. Medical Care, 47, 418-424.
26. Persell, S.D., Kho, A.N., Thompson, J.A., & Baker, D.W. (2009). Improving hypertension quality measurement using electronic health records. Medical Care, 47, 388-394.
27. Persell, S.D., Wright, J.M., Thompson, J.A., Kmetik, K.S., & Baker, D.W. (2006). Assessing the validity of national quality measures for coronary artery disease using an electronic health record. Archives of Internal Medicine, 166, 2272-2277.
28. Powell, J., Fitton, R., & Fitton, C. (2006). Sharing electronic health records: The patient view. Informatics in Primary Care, 14, 55-57.
29. Pringle, M., Ward, P., & Chilvers, C. (1995). Assessment of the completeness and accuracy of computer medical records in four practices committed to recording data on computer. British Journal of General Practice, 45, 537-541.
30. Ricciardi, T.N., Lieberman, M.I., Kahn, M.G., & Masarie, F.E., Jr. (2005). Clinical terminology support for a national ambulatory practice outcomes research network. AMIA Annual Symposium Proceedings, 2005, 629-633.
31. Rosenman, M.B., Tao, G., Szucs, K.A., Wang, J., Ambuehl, R., & Mahon, B.E. (2008). Prenatal syphilis screening rates measured using Medicaid claims and electronic medical records. Sexually Transmitted Diseases, 35, 387-392.
32. Roukema, J., Los, R.K., Bleeker, S.E., van Ginneken, A.M., van der Lei, J., & Moll, H.A. (2006). Paper versus computer: Feasibility of an electronic medical record in general pediatrics. Pediatrics, 117, 15-21.
33. Saigh, O., Triola, M.M., & Link, R.N. (2006). Brief report: Failure of an electronic medical record tool to improve pain assessment documentation. Journal of General Internal Medicine, 21, 185-188.
34. Schneider, E.C., Riehl, V., Courte-Wienecke, S., Eddy, D.M., & Sennett, C. (1999). Enhancing performance measurement: NCQA’s road map for a health information framework. Journal of the American Medical Association, 282, 1184-1190.
35. Staes, C.J., Bennett, S.T., Evans, R.S., Narus, S.P., Huff, S.M., & Sorensen, J.B. (2006). A case for manual entry of structured, coded laboratory data from multiple sources into an ambulatory electronic health record. Journal of the American Medical Informatics Association, 13, 12-15.
36. Staroselsky, M., Volk, L.A., Tsurikova, R., Newmark, L.P., Lippincott, M., Litvak, I., et al. (2008). An effort to improve electronic health record medication list accuracy between visits: Patients’ and physicians’ response. International Journal of Medical Informatics, 77, 153-160.
37. Staroselsky, M., Volk, L.A., Tsurikova, R., Pizziferri, L., Lippincott, M., Wald, J., et al. (2006). Improving electronic health record (EHR) accuracy and increasing compliance with health maintenance clinical guidelines through patient access and input. International Journal of Medical Informatics, 75, 693-700.
38. Szpunar, S., Williams, P., Dagroso, D., Enberg, R., & Chesney, J. (2008). Improving the documentation of vital signs: A business reengineering efficiency study. Joint Commission Journal on Quality and Patient Safety, 34, 171-178.
39. Tang, P.C., Ralston, M., Arrigotti, M.F., Qureshi, L., & Graham, J. (2007). Comparison of methodologies for calculating quality measures based on administrative data versus clinical data from an electronic health record system: Implications for performance measures. Journal of the American Medical Informatics Association, 14, 10-15.
40. Thielke, S., Hammond, K., & Helbig, S. (2007). Copying and pasting of examinations within the electronic medical record. International Journal of Medical Informatics, 76(Supplement 1), S122-S128.
41. Thiru, K., Hassey, A., & Sullivan, F. (2003). Systematic review of scope and quality of electronic patient record data in primary care. British Medical Journal, 326, 1070-1074.
42. Varkey, P., Cunningham, J., & Bisping, D.S. (2007). Improving medication reconciliation in the outpatient setting. Joint Commission Journal on Quality and Patient Safety, 33, 286-292.
43. Weingart, S.N., Cleary, A., Seger, A., Eng, T.K., Saadeh, M., Gross, A., et al. (2007). Medication reconciliation in ambulatory on cology. Joint Commission Journal on Quality and Patient Safety, 33, 750-757.
44. Williams, J.G. (2003). Measuring the completeness and currency of codified clinical information. Methods of Information in Medicine, 42, 482-488.