How good are the data? feasible approach to validation of metrics of quality derived from an outpatient electronic health record

American Journal of Medical Quality

Volumn 26, Issue 6, 2011, Pages 441-451

  Benin, Andrea L ^a,b   Fenick, Ada ^a   Herrin, Jeph ^a   Vitkauskas, Grace ^b   Chen, John ^b   Brandt, Cynthia ^a,c  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b YALE NEW HAVEN HEALTH SYSTEM   (United States)

^c VA CONNECTICUT HEALTHCARE SYSTEM   (United States)

Author keywords

electronic health record; quality indicators; quality measurement; validation

Indexed keywords

ADOLESCENT; AMBULATORY CARE; ARTICLE; CHILD; ELECTRONIC MEDICAL RECORD; HEALTH CARE QUALITY; HUMAN; INFANT; MASS SCREENING; ORGANIZATION AND MANAGEMENT; OUTPATIENT; PATIENT SAFETY; PEDIATRICS; PRACTICE GUIDELINE; PRESCHOOL CHILD; REPRODUCIBILITY; STATISTICS; TREATMENT OUTCOME;

ADOLESCENT; AMBULATORY CARE; CHILD; CHILD, PRESCHOOL; GUIDELINE ADHERENCE; HUMANS; INFANT; MASS SCREENING; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); OUTPATIENTS; PATIENT SAFETY; PEDIATRICS; PRACTICE GUIDELINES AS TOPIC; QUALITY INDICATORS, HEALTH CARE; QUALITY OF HEALTH CARE; REPRODUCIBILITY OF RESULTS;

EID: 80455135047     PISSN: 10628606     EISSN: 1555824X     Source Type: Journal    
DOI: 10.1177/1062860611403136     Document Type: Article

References (42)

1. Institute of Medicine, To Err Is Human: Building a Safer Health System. Washington, DC: National Academies Press; 2000:.
2. Institute of Medicine, Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001:.
3. United States General Accounting Office. Information technology: benefits realized for selected health care functions. http://www.gao.gov/cgi-bin/getrpt?GAO-04-224. Accessed February 15, 2011.
4. Institute of Medicine. Leadership by Example: Coordinating Government Roles in Improving Health Care Quality. Washington, DC: National Academies Press; 2003:.
5. Institute of Medicine. The Computer-Based Patient Record: An Essential Technology for Health Care. 1997.Washington, DC: National Academies Press; 1997:.
6. Perrin JM,Homer CJ.Leadership by example: The Institute of Medicine's view of how federal health care programs can improve quality of care.Ambul Pediatr. 2003;3:162-163.
7. BushGW. President's state of the union message to Congress and the nation. http://www.nytimes.com/2004/01/21/us/state-union-president-s-state-union-message-congress-nation.html?src=pm. Accessed February 10, 2011.
8. Lanier DC,Roland M,Burstin H,Knottnerus JA.Doctor performance and public accountability.Lancet. 2003;362:1404-1408.
9. Bakken S,Cimino JJ,Hripcsak G.Promoting patient safety and enabling evidence-based practice through informatics.Med Care. 2004;42:II49-II56.
10. United States Senate, 111th Congress, 1st Session. American Recovery and Reinvestment Act of2009. http://readthestimulus.org/amdth1.pdf. Accessed June 6, 2009.
11. Office of the National Coordinator HIT Policy Committee (Meaningful Use Workgroup). Meaningful use matrix. http://healthit.hhs.gov/portal/server.pt/gateway/PTARGS_0_10741_876940_0_0_18/Meaningful%20Use%20Matrix%2007162009.pdf. Accessed August 7, 2009.
12. Centers for Medicare and Medicaid Services. Centers for Medicare and Medicaid Services' FY 2011 IPPS Proposed Rule: CMS-1498-P. https://www.cms.gov/AcuteInpatientPPS/IPPS2010/itemdetail.asp?filterType=none&filterByDID=-99&sortByDID=1&sortOrder=ascending&itemID=CMS1234657&intNumPerPage=10. Accessed May 12, 2010.
13. United States Senate, 111th Congress, 2nd Session. The Patient Protection and Affordable Care Act. http://democrats.senate.gov/reform/patient-protection-affordable-care-act-as-passed.pdf. Accessed May 28, 2010.
14. McDonald CJ.The barriers to electronic medical record systems and how to overcome them.J Am Med Inform Assoc. 1997;4:213-221.
15. Fisk JM,Mutalik P,Levin FW,Erdos J,Taylor C,Nadkarni P.Integrating query of relational and textual data in clinical databases: a case study.J Am Med Inform Assoc. 2003;10:21-38.
16. Zingmond D,Lenert LA.Monitoring free-text data using medical language processing.Comput Biomed Res. 1993;26:467-481.
17. Hripcsak G,Friedman C,Alderson PO,DuMouchel W,Johnson SB,Clayton PD.Unlocking clinical data from narrative reports: a study of natural language processing.Ann Intern Med. 1995;122:681-688.
18. Benin AL,Vitkauskas G,Thornquist E, et al.Validity of using an electronic medical record for assessing quality of care in an outpatient setting.Med Care. 2005;43:691-698.
19. Tayi GK,Ballou DP.Examining data quality.Commun ACM. 1998;41:54-57.
20. Thiru K,Hassey A,Sullivan F.Systematic review of scope and quality of electronic patient record data in primary care.BMJ. 2003 1070;326:.
21. Hassey A,Gerrett D,Wilson A.A survey of validity and utility of electronic patient records in a general practice.BMJ. 2001;322:1401-1405.
22. Hogan WR,Wagner MM.Accuracy of data in computer-based patient records.J Am Med Inform Assoc. 1997;5:342-355.
23. Wagner MM,Hogan WR.The accuracy of medication data in an outpatient electronic medical record.J Am Med Inform Assoc. 1996;3:234-244.
24. Wilton R,Pennisi AJ.Evaluating the accuracy of transcribed computer-stored immunization data.Pediatrics. 1994;94:902-906.
25. Chan LS,Schonfeld N.How much information is lost during processing? A case study of pediatric emergency department records.Comput Biomed Res. 1993;26:582-591.
26. Brandt CA,Morse R,Matthews K, et al.Metadata-driven creation of data marts from an EAV-modeled clinical research database.Int J Med Inform. 2002;65:225-241.
27. Ash JS,Berg M,Coiera E.Some unintended consequences of information technology in health care: the nature of patient care information system-related errors.J Am Med Inform Assoc. 2004;11:104-112.
28. Kerr EA,Smith DM,Hogan MM, et al.Comparing clinical automated, medical record, and hybrid data sources for diabetes quality measures.Jt Comm J Qual Improv. 2002;28:555-565.
29. Nadkarni PM,Brandt C.Data extraction and ad hoc query of an entity-attribute-value database.J Am Med Inform Assoc. 1998;5:511-527.
30. Tang PC,Ralston M,Arrigotti MF,Qureshi L,Graham J.Comparison of methodologies for calculating quality measures based on administrative data versus clinical data from an electronic health record system: implications for performance measures.J Am Med Inform Assoc. 2007;14:10-15.
31. Rubenstein LV,Kahn KL,Reinisch EJ, et al.Changes in quality of care for five diseases measured by implicit review.JAMA. 1990;264:1974-1980.
32. Dans PE,Weiner JP,Otter SE.Peer review organizations: promises and potential pitfalls.N Engl J Med. 1985;313:1131-1137.
33. Benin AL,Vitkauskas G,Krumholz HM,Shapiro ED,Brandt C. Validation of a System for Quality Improvement: Preliminary Data. Washington, DC: Proceedings of the American Medical Informatics Association, Annual Symposium; Washington, DC;.
34. Cockburn A. Writing Effective Use Cases. Boston, MA: Addison-Wesley; 2001:.
35. Logan JR,Gorman PN,Middleton B.Measuring the quality of medical records: a method for comparing completeness and correctness of clinical encounter data.Proc AMIA Symp. 2001:408-412.
36. Romm FJ,Putnam SM.The validity of the medical record.Med Care. 1981;19:310-315.
37. Bentsen BG.The accuracy of recording patient problems in family practice.J Med Educ. 1976;51:311-316.
38. Manley HJ,Drayer DK,McClaran M,Bender W,Muther RS.Drug record discrepancies in an outpatient electronic medical record: frequency, type, and potential impact on patient care at a hemodialysis center.Pharmacotherapy. 2003;23:231-239.
39. Soto CM,Kleinman KP,Simon SR.Quality and correlates of medical record documentation in the ambulatory care setting.BMC Health Serv Res. 2002;2:22.
40. Haley RW,Schaberg DR,McClish DK, et al.The accuracy of retrospective chart review in measuring nosocomial infection rates: results of validation studies in pilot hospitals.Am J Epidemiol. 1980;111:516-533.
41. Whaley FS,Quade D,Haley RW.Effects of method error on the power of a statistical test: implications of imperfect sensitivity and specificity in retrospective chart review.Am J Epidemiol. 1980;111:534-542.
42. Brook RH,McGlynn EA,Cleary PD.Measuring quality of care.N Engl J Med. 1996;335:966-970.