Beyond the threshold: Real-time use of evidence in practice

BMC Medical Informatics and Decision Making

Volumn 13, Issue 1, 2013, Pages

  Jones, James B ^a   Stewart, Walter F ^a   Darer, Jonathan D ^a   Sittig, Dean F ^b  

^a GEISINGER MEDICAL CENTER   (United States)

^b UNIVERSITY OF TEXAS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPUTER SYSTEM; EVIDENCE BASED PRACTICE; HUMAN;

COMPUTER SYSTEMS; EVIDENCE-BASED PRACTICE; HUMANS;

MLCS; MLOWN;

EID: 84876122651     PISSN: None     EISSN: 14726947     Source Type: Journal    
DOI: 10.1186/1472-6947-13-47     Document Type: Article

References (83)

1. Development of evidence-based clinical practice guidelines (CPGs): comparing approaches. Turner T, Misso M, Harris C, Green S, Implement Sci 2008 3 45 10.1186/1748-5908-3-45 18954465
2. Continuing medical education effect on clinical outcomes: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Mazmanian PE, Davis DA, Galbraith R, American College of Chest Physicians Health and Science Policy Committee, Chest 2009 135 49S 55S 10.1378/chest.08-2518 19265076
3. HealthCare.gov. Available at: http://www.healthcare.gov/index.html. Accessed 4/19/2013
4. Center for Medicare and Medicaid Services. Medicare and Medicaid Programs; Electronic Health Record Incentive Program Final Rule 2010 Available from: http://www.gpo.gov/fdsys/pkg/FR-2010-01-13/pdf/E9-31217.pdf. Accessed 4/19/2013. 23360957
5. National Guideline Clearinghouse Guideline Index Available at: http://guideline.gov/browse/by-topic.aspx. Accessed 4/19/2013.
6. Status of practice guidelines in the United States: CDC guidelines as an example. Larson E, Prev Med 2003 36 519 524 10.1016/S0091-7435(03)00014-8 12689796
7. National Heart, Lung, and Blood Institute. National Asthma Education Program. Expert Panel on the Management of Asthma, United States. Dept. of Health and Human Services, National Institutes of Health. Expert Panel report 3 Bethesda, Md: U.S. Dept. of Health and Human Services, National Institutes of Health, National Heart, Lung, and Blood Institute 2007 07-4051:417 Available from: http://purl.access.gpo.gov/GPO/LPS93956
8. The quality of health care delivered to adults in the United States. McGlynn EA, Asch SM, Adams J, N Engl J Med 2003 348 2635 2645 10.1056/NEJMsa022615 12826639
9. The quality of ambulatory care delivered to children in the United States. Mangione-Smith R, DeCristofaro AH, Setodji CM, N Engl J Med 2007 357 1515 1523 10.1056/NEJMsa064637 17928599
10. Flexner A, Medical Education in the United States and Canada: A Report to the Carnegie Foundation for the Advancement of Teaching (Bulletin No. 4) New York, NY: Carnegie Foundation 1910
11. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. Shiffman RN, Dixon J, Brandt C, BMC Med Inform Decis Mak 2005 5 23 10.1186/1472-6947-5-23 16048653
12. Why don't physicians follow clinical practice guidelines? A framework for improvement. Cabana MD, Rand CS, Powe NR, JAMA 1999 282 1458 1465 10.1001/jama.282.15.1458 10535437
13. A meta-analysis of continuing medical education effectiveness. Mansouri M, Lockyer J, J Contin Educ Health Prof 2007 27 6 15 10.1002/chp.88 17385735
14. Stead WW, Lin H, National Research Council. Committee on Engaging the Computer Science Research Community in Health Care Informatics, Computational technology for effective health care: immediate steps and strategic directions Washington, D.C.: National Academies Press 2009
15. A New Socio-technical Model for Studying Health Information Technology in Complex Adaptive Healthcare Systems. Sittig D, Singh H, Quality & Safety in Healthcare 2010 19 Suppl 3 68 i74 PMID: 20959322 10.1136/qshc.2010.042085 23620898
16. Clinical decision support capabilities of commercially-available clinical information systems. Wright A, Sittig DF, Ash JS, Sharma S, Pang JE, Middleton B, J Am Med Inform Assoc 2009 16 637 644 10.1197/jamia.M3111 19567796
17. Sittig DF, Wright A, Ash JS, Middleton B, A Set of Preliminary Standards Recommended for Achieving a National Repository of Clinical Decision Support Interventions AMIA Fall Symposium 2009 614 618
18. Osheroff JA, Pifer EA, Teich JM, Sittig DF, Jenders RA, Improving Outcomes with Clinical Decision Support: An Implementer's Guide: An Implementer's Guide. Health Information Management and Systems Society 2005
19. Berg M, Rationalizing medical work: decision-support techniques and medical practices Cambridge, Mass: MIT Press 1997
20. Berner ES, Clinical decision support systems: State of the art. Rockville Maryland: Agency for Healthcare Research and Quality. AHRQ Publication No. 09-0069-EF 2009
21. Modeling the Arden syntax for medical decisions in XML. Kim S, Haug PJ, Rocha RA, Choi I, Int J Med Inform 2008 77 650 656 10.1016/j.ijmedinf.2008.01. 001 18321775
22. Writing Arden syntax medical logic modules. Hripcsak G, Comput Biol Med 1994 24 331 363 10.1016/0010-4825(94)90002-7 7705066
23. A description and functional taxonomy of rule-based decision support content at a large integrated delivery network. Wright A, Goldberg H, Hongsermeier T, Middleton B, J Am Med Inform Assoc 2007 14 489 496 10.1197/jamia.M2364 17460131
24. RxNorm Files Available at: http://www.nlm.nih.gov/research/umls/rxnorm/ docs/rxnormfiles.html. Accessed: 4/19/2013.
25. The International Health Terminology Standards Development Organisation. SNOMED Clinical Terms® User Guide Available at: http://ihtsdo.org/fileadmin/ user-upload/doc/. Accessed: 4/19/2013. 23175621
26. Logical observation identifier names and codes (LOINC) database: a public use set of codes and names for electronic reporting of clinical laboratory test results. Forrey AW, McDonald CJ, DeMoor G, Clin Chem 1996 42 81 90 8565239
27. Issues in the design of Internet-based systems for collecting patient-reported outcomes. Jones JB, Snyder CF, Wu AW, Qual Life Res 2007 16 1407 1417 10.1007/s11136-007-9235-z 17668293
28. The state of the art in clinical knowledge management: an inventory of tools and techniques. Sittig DF, Wright A, Simonaitis L, Int J Med Inform 2010 79 44 57 10.1016/j.ijmedinf.2009.09.003 19828364
29. Overriding of drug safety alerts in computerized physician order entry. van der Sijs H, Aarts J, Vulto A, Berg M, J Am Med Inform Assoc 2006 13 138 147 10.1197/jamia.M1809 16357358
30. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. Bates DW, Kuperman GJ, Wang S, J Am Med Inform Assoc 2003 10 523 530 10.1197/jamia.M1370 12925543
31. Improving allergy alerting in a computerized physician order entry system. Abookire SA, Teich JM, Sandige H, Proc AMIA Symp 2000 2 6
32. Maintaining and incrementally revalidating a computer-based clinical guideline: a case study. Miller PL, Frawley SJ, Sayward FG, J Biomed Inform 2001 34 99 111 10.1006/jbin.2001.1011 11515416
33. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Kawamoto K, Houlihan CA, Balas EA, Lobach DF, BMJ 2005 330 765 10.1136/bmj.38398.500764. 8F 15767266
34. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. Garg AX, Adhikari NK, McDonald H, JAMA 2005 293 1223 1238 10.1001/jama.293.10.1223 15755945
35. United States Department of Health and Human Services. Personalized Health Care: Opportunities, Pathways, Resources 2007 Available from: http://www.hhs.gov/myhealthcare/news/phc-report.pdf. Accessed July 26, 2010
36. Approaching CDS in Medication Management Available at: http://healthit.ahrq.gov/images/mar09-cds-book-chapter/CDS-MedMgmnt-ch-1-sec-2- five-rights.htm. Accessed 8/26, 2010
37. DEMS-a second generation diabetes electronic management system. Gorman CA, Zimmerman BR, Smith SA, Comput Methods Programs Biomed 2000 62 127 140 10.1016/S0169-2607(99)00054-1 10764939
38. Electronic medical record reminder improves osteoporosis management after a fracture: a randomized, controlled trial. Feldstein A, Elmer PJ, Smith DH, J Am Geriatr Soc 2006 54 450 457 10.1111/j.1532-5415.2005.00618.x 16551312
39. Learning with computerized guidelines in general practice?: A randomized controlled trial. Butzlaff M, Vollmar HC, Floer B, Koneczny N, Isfort J, Lange S, Fam Pract 2004 21 183 188 10.1093/fampra/cmh214 15020389
40. Evaluation of an Internet-based decision-support system for applying the ATS/CDC guidelines for tuberculosis preventive therapy. Dayton CS, Ferguson JS, Hornick DB, Peterson MW, Med Decis Making 2000 20 1 6 10.1177/0272989X0002000101 10638531
41. A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. Sequist TD, Gandhi TK, Karson AS, J Am Med Inform Assoc 2005 12 431 437 10.1197/jamia.M1788 15802479
42. Computed critiquing integrated into daily clinical practice affects physicians' behavior-a randomized clinical trial with AsthmaCritic. Kuilboer MM, van Wijk MA, Mosseveld M, Methods Inf Med 2006 45 447 454 16964364
43. Randomized clinical trial of pressure-controlled inverse ratio ventilation and extracorporeal CO2 removal for adult respiratory distress syndrome. Morris AH, Wallace CJ, Menlove RL, Am J Respir Crit Care Med 1994 149 295 305 10.1164/ajrccm.149.2.8306022 8306022
44. Measuring the impact of diagnostic decision support on the quality of clinical decision making: development of a reliable and valid composite score. Ramnarayan P, Kapoor RR, Coren M, J Am Med Inform Assoc 2003 10 563 572 10.1197/jamia.M1338 12925549
45. Reasoning foundations of medical diagnosis; symbolic logic, probability, and value theory aid our understanding of how physicians reason. Ledley RS, Lusted LB, Science 1959 130 9 21 10.1126/science.130.3366.9 13668531
46. A four-phase model of the evolution of clinical decision support architectures. Wright A, Sittig DF, Int J Med Inform 2008 77 641 649 10.1016/j.ijmedinf.2008.01.004 18353713
47. Diagnostic decision support systems: why aren't they used more and what can we do about it? Berner ES, AMIA Annu Symp Proc 2006 1167 1168
48. The demise of the "Greek Oracle" model for medical diagnostic systems. Miller RA, Masarie FE Jr, Methods Inf Med 1990 29 1 2 2407929
49. Protocol-based computer reminders, the quality of care and the non-perfectability of man. McDonald CJ, N Engl J Med 1976 295 1351 1355 10.1056/NEJM197612092952405 988482
50. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. Shea S, DuMouchel W, Bahamonde L, J Am Med Inform Assoc 1996 3 399 409 10.1136/jamia.1996.97084513 8930856
51. Effect of point-of-care computer reminders on physician behaviour: a systematic review. Shojania KG, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J, CMAJ 2010 182 216 E225 20212028
52. Communication outcomes of critical imaging results in a computerized notification system. Singh H, Arora HS, Vij MS, Rao R, Khan MM, Petersen LA, J Am Med Inform Assoc 2007 14 459 466 10.1197/jamia.M2280 17460135
53. Automated evidence-based critiquing of orders for abdominal radiographs: impact on utilization and appropriateness. Harpole LH, Khorasani R, Fiskio J, Kuperman GJ, Bates DW, J Am Med Inform Assoc 1997 4 511 521 10.1136/jamia.1997. 0040511 9391938
54. Health insurers and medical-imaging policy-a work in progress. Iglehart JK, N Engl J Med 2009 360 1030 1037 10.1056/NEJMhpr0808703 19264694
55. A technology solution for the high-tech diagnostic imaging conundrum. Solberg LI, Vinz C, Trevis JE, Am J Manag Care 2012 18 8 421 425 22928757
56. Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. Sistrom CL, Dang PA, Weilburg JB, Dreyer KJ, Rosenthal DI, Thrall JH, Radiology 2009 251 147 155 10.1148/radiol.2511081174 19221058
57. Guided medication dosing for inpatients with renal insufficiency. Chertow GM, Lee J, Kuperman GJ, JAMA 2001 286 2839 2844 10.1001/jama.286.22.2839 11735759
58. Reducing warfarin medication interactions: an interrupted time series evaluation. Feldstein AC, Smith DH, Perrin N, Arch Intern Med 2006 166 1009 1015 10.1001/archinte.166.9.1009 16682575
59. The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. Ammenwerth E, Schnell-Inderst P, Machan C, Siebert U, J Am Med Inform Assoc 2008 15 585 600 10.1197/jamia.M2667 18579832
60. The "Meaningful Use" Regulation for Electronic Health Records. Blumenthal D, Tavenner M, N Engl J Med 2010 363 501 504 10.1056/NEJMp1006114 20647183
61. Interface terminologies: facilitating direct entry of clinical data into electronic health record systems. Rosenbloom ST, Miller RA, Johnson KB, Elkin PL, Brown SH, J Am Med Inform Assoc 2006 13 277 288 10.1197/jamia.M1957 16501181
62. "Smart forms" in an electronic medical record: documentation-based clinical decision support to improve disease management. Schnipper JL, Linder JA, Palchuk MB, J Am Med Inform Assoc 2008 15 513 523 10.1197/jamia.M2501 18436911
63. The regenstrief medical record system: a quarter century experience. McDonald CJ, Overhage JM, Tierney WM, Int J Med Inform 1999 54 225 253 10.1016/S1386-5056(99)00009-X 10405881
64. Integrating "best of care" protocols into clinicians' workflow via care provider order entry: impact on quality-of-care indicators for acute myocardial infarction. Ozdas A, Speroff T, Waitman LR, Ozbolt J, Butler J, Miller RA, J Am Med Inform Assoc 2006 13 188 196 10.1197/jamia.M1656 16357360
65. Association of a clinical knowledge support system with improved patient safety, reduced complications and shorter length of stay among Medicare beneficiaries in acute care hospitals in the United States. Bonis PA, Pickens GT, Rind DM, Foster DA, Int J Med Inform 2008 77 745 753 10.1016/j.ijmedinf. 2008.04.002 18565788
66. Infobuttons: anticipatory passive decision support. Cimino JJ, AMIA Annu Symp Proc 2008 1203 1204
67. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Chaudhry B, Wang J, Wu S, Ann Intern Med 2006 144 742 752 10.7326/0003-4819-144-10-200605160-00125 16702590
68. Initial Set of Standards, Implementation Specifications, and Certification Criteria for Electronic Health Record Technology. Department of Health and Human Services. 45 CFR Part 170 RIN 0991-AB58. Health Information Technology, Federal Register 2010 77 144 44590 44654 Available at: http://www.gpo.gov/fdsys/pkg/FR-2010-07-28/pdf/2010-17210.pdf. Accessed 4/19/2013
69. Use of electronic health records in U.S. hospitals. Jha AK, DesRoches CM, Campbell EG, N Engl J Med 2009 360 1628 1638 10.1056/NEJMsa0900592 19321858
70. Electronic health records in ambulatory care-a national survey of physicians. DesRoches CM, Campbell EG, Rao SR, N Engl J Med 2008 359 50 60 10.1056/NEJMsa0802005 18565855
71. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J, Cochrane Database Syst Rev 2009 3 D001096 19588323
72. Stimulating the adoption of health information technology. Blumenthal D, N Engl J Med 2009 360 1477 1479 10.1056/NEJMp0901592 19321856
73. Launching HITECH. Blumenthal D, N Engl J Med 2010 362 382 385 10.1056/NEJMp0912825 20042745
74. Eight rights of safe electronic health record use. Sittig DF, Singh H, JAMA 2009 302 1111 1113 10.1001/jama.2009.1311 19738098
75. Measuring safety culture in the ambulatory setting: the safety attitudes questionnaire-ambulatory version. Modak I, Sexton JB, Lux TR, Helmreich RL, Thomas EJ, J Gen Intern Med 2007 22 1 5 18193534
76. Improving clinical quality indicators through electronic health records: it takes more than just a reminder. Sittig DF, Teich JM, Osheroff JA, Singh H, Pediatrics 2009 124 375 377 10.1542/peds.2009-0339 19564321
77. Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? Singh H, Thomas EJ, Sittig DF, Am J Med 2010 123 238 244 10.1016/j.amjmed.2009.07.027 20193832
78. Design of a national distributed health data network. Maro JC, Platt R, Holmes JH, Ann Intern Med 2009 151 341 344 10.7326/0003-4819-151-5-200909010- 00139 19638403
79. Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential? Singh H, Thomas EJ, Mani S, Arch Intern Med 2009 169 1578 1586 19786677
80. An unintended consequence of CPOE implementation: shifts in power, control, and autonomy. Ash JS, Sittig DF, Campbell E, Guappone K, Dykstra RH, AMIA Annu Symp Proc 2006 11 15
81. A computerized reminder system to increase the use of preventive care for hospitalized patients. Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ, N Engl J Med 2001 345 965 970 10.1056/NEJMsa010181 11575289
82. Institute of Medicine, Committee on Quality of Health Care in America, Crossing the quality chasm: a new health system for the 21st century Washington, D.C: National Academy Press 2001
83. Kohn LT, Corrigan J, Donaldson MS, To err is human: building a safer health system Washington, D.C.: National Academy Press 2000