Standards for reporting randomized controlled trials in medical informatics: A systematic review of CONSORT adherence in RCTs on clinical decision support

Journal of the American Medical Informatics Association

Volumn 19, Issue 1, 2012, Pages 13-21

  Augestad, K M ^a   Berntsen, G ^a   Lassen, K ^a,b   Bellika, J G ^a,b   Wootton, R ^a   Lindsetmo, R O ^a,b  

^a UNIVERSITY HOSPITAL OF NORTH NORWAY   (Norway)

^b UNIVERSITY OF TROMSØ   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

ASTHMA; CLINICAL DECISION MAKING; DECISION SUPPORT SYSTEM; DIABETES MELLITUS; ELECTRONIC MEDICAL RECORD; HYPERLIPIDEMIA; INFORMATION PROCESSING; MEDICAL INFORMATICS; METHODOLOGY; NONHUMAN; OUTCOME ASSESSMENT; PRACTICE GUIDELINE; PRIMARY MEDICAL CARE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; STANDARDIZATION; SYSTEMATIC REVIEW;

DECISION SUPPORT SYSTEMS, CLINICAL; EVIDENCE-BASED MEDICINE; GUIDELINE ADHERENCE; GUIDELINES AS TOPIC; HUMANS; MEDICAL INFORMATICS; PUBLISHING; QUALITY CONTROL; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 84856807791     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2011-000411     Document Type: Review

References (90)

1. Moher D, Jones A, Lepage L. Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 2001;285:1992-5.
2. Kassell NF, Dumont AS. Randomized controlled trials in surgery: comic opera no more? J Thorac Cardiovasc Surg 2006;132:243-4.
3. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 1996;17:1-12.
4. Consort 2010. Lancet 2010;375:1136.
5. Moher D, Schulz KF, Altman D. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA 2001;285:1987-91.
6. Boutron I, Moher D, Altman DG, et al. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008;148:295-309.
7. Kiehna EN, Starke RM, Pouratian N, et al. Standards for reporting randomized controlled trials in neurosurgery. J Neurosurg 2010;114:280-5.
8. Balasubramanian SP, Wiener M, Alshameeri Z, et al. Standards of reporting of randomized controlled trials in general surgery: can we do better? Ann Surg 2006;244:663-7.
9. Horton R. Surgical research or comic opera: questions, but few answers. Lancet 1996;347:984-5.
10. Neugebauer EA, Morino M, Habermalz B. Surgical research or comic opera? Let's give answers! Surg Endosc 2008;22:1411-12.
11. Sade RM. "Surgical research or comic opera" redux. Ann Thorac Surg 2006;82:1173-4.
12. Sellar R, Whittle I. The lessons learnt from ISAT: surgical research is rescued from comic opera. Br J Neurosurg 2004;18:405-6.
13. Moher D, Pham B, Jones A, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet, 1998;352:609-13.
14. Schulz KF, Chalmers I, Hayes RJ, et al. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995;273:408-12.
15. Colditz GA, Miller JN, Mosteller F. How study design affects outcomes in comparisons of therapy. I: Medical. Stat Med 1989;8:441-54.
16. Hunt DL, Haynes RB, Hanna SE, et al. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 1998;280:1339-46.
17. Garg AX, Adhikari NK, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 2005;293:1223-38.
18. Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med 2003;348:2526-34.
19. Bennett JW, Glasziou PP. Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials. Med J Aust 2003;178:217-22.
20. Simon SR, Kaushal R, Cleary PD, et al. Physicians and electronic health records: a statewide survey. Arch Intern Med 2007;167:507-12.
21. Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med 2003;163:1409-16.
22. Shea S, DuMouchel W, Bahamonde L. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc 1996;3:399-409.
23. Shiffman RN, Liaw Y, Brandt CA, et al. Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. J Am Med Inform Assoc 1999;6:104-14.
24. Weingarten SR, Henning JM, Badamgarav E, et al. Interventions used in disease management programmes for patients with chronic illness-which ones work? Metaanalysis of published reports. BMJ 2002;325:925.
25. Shcherbatykh I, Holbrook A, Thabane L, et al. Methodologic issues in health informatics trials: the complexities of complex interventions. J Am Med Inform Assoc 2008;15:575-80.
26. Talmon J, Ammenwerth E, Brender J, et al. STARE-HI -Statement on Reporting of Evaluation Studies in Health Informatics. Yearb Med Inform 2009:23-31.
27. Bates DW, Kuperman GJ, Wang S, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003;10:523-30.
28. Liu JL, Wyatt JC. The case for randomized controlled trials to assess the impact of clinical information systems. J Am Med Inform Assoc 2011;18:173-80.
29. Emery JD. Effect of computerised evidence based guidelines. Computer support is complex intervention. BMJ 2003;326:394; author reply 94.
30. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol 2009;62:1006-12.
31. Lassen K, Kjaeve J, Fetveit T, et al. Allowing normal food at will after major upper gastrointestinal surgery does not increase morbidity: a randomized multicenter trial. Ann Surg 2008;247:721-9.
32. Wootton R, Bloomer SE, Corbett R, et al. Multicentre randomised control trial comparing real time teledermatology with conventional outpatient dermatological care: societal cost-benefit analysis. BMJ 2000;320:1252-6.
33. Johansen MA, Johnsen JA, Hartvigsen G, et al. Bridging the gap between patients' expectations and general practitioners' knowledge through disease surveillance. Stud Health Technol Inform 2009;150:423-7.
34. Bellika JG, Sue H, Bird L, et al. Properties of a federated epidemiology query system. Int J Med Inform 2007;76:664-76.
35. Bellika JG, Hasvold T, Hartvigsen G. Propagation of program control: a tool for distributed disease surveillance. Int J Med Inform 2007;76:313-29.
36. Bellika JG, Hartvigsen G. The oncological nurse assistant: a web-based intelligent oncological nurse advisor. Int J Med Inform 2005;74:587-95.
37. Augestad KM, Revhaug A, Vonen B, et al. The one-stop trial: does electronic referral and booking by the general practitioner (GPs) to outpatient day case surgery reduce waiting time and costs? A randomized controlled trial protocol. BMC Surg 2008;8:14.
38. Emaus N, Omsland TK, Ahmed LA, et al. Bone mineral density at the hip in Norwegian women and meneprevalence of osteoporosis depends on chosen references: the Tromso Study. Eur J Epidemiol 2009;24:321-8.
39. Wilsgaard T, Emaus N, Ahmed LA, et al. Lifestyle impact on lifetime bone loss in women and men: the Tromso Study. Am J Epidemiol 2009;169:877-86.
40. Emaus N, Berntsen GK, Joakimsen R, et al. Longitudinal changes in forearm bone mineral density in women and men aged 45-84 years: the Tromso Study, a population-based study. Am J Epidemiol 2006;163:441-9.
41. Berntsen GK, Fonnebo V, Tollan A, et al. Forearm bone mineral density by age in 7,620 men and women: the Tromso study, a population-based study. Am J Epidemiol 2001;153:465-73.
42. Kawamoto K, Houlihan CA, Balas EA, et al. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005;330:765.
43. Kastner M, Straus SE. Clinical decision support tools for osteoporosis disease management: a systematic review of randomized controlled trials. J Gen Intern Med 2008;23:2095-105.
44. O'Connor AM, Bennett CL, Stacey D, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev 2009;(3):CD001431.
45. Bertoni AG, Bonds DE, Chen H, et al. Impact of a multifaceted intervention on cholesterol management in primary care practices: guideline adherence for heart health randomized trial. Arch Intern Med 2009;169:678-86.
46. Apkon M, Mattera JA, Lin Z, et al. A randomized outpatient trial of a decisionsupport information technology tool. Arch Intern Med 2005;165:2388-94.
47. Bell LM, Grundmeier R, Localio R, et al. Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics 2010;125: e770-7.
48. Bosworth HB, Olsen MK, Dudley T, et al. Patient education and provider decision support to control blood pressure in primary care: a cluster randomized trial. Am Heart J 2009;157:450-6.
49. Cleveringa FG, Gorter KJ, van den Donk M, et al. Combined task delegation, computerized decision support, and feedback improve cardiovascular risk for type 2 diabetic patients: a cluster randomized trial in primary care. Diabetes Care 2008;31:2273-5.
50. Dexter PR, Perkins S, Overhage JM, et al. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med 2001;345:965-70.
51. Emery J, Morris H, Goodchild R, et al. The GRAIDS Trial: a cluster randomised controlled trial of computer decision support for the management of familial cancer risk in primary care. Br J Cancer 2007;97:486-93.
52. Feldstein A, Elmer PJ, Smith DH, et al. Electronic medical record reminder improves osteoporosis management after a fracture: a randomized, controlled trial. J Am Geriatr Soc 2006;54:450-7.
53. Flottorp S, Oxman AD, Havelsrud K, et al. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ 2002;325:367.
54. Frijling BD, Lobo CM, Hulscher ME, et al. Multifaceted support to improve clinical decision making in diabetes care: a randomized controlled trial in general practice. Diabet Med 2002;19:836-42.
55. Gilutz H, Novack L, Shvartzman P, et al. Computerized community cholesterol control (4C): meeting the challenge of secondary prevention. Isr Med Assoc J 2009;11:23-9.
56. Hicks LS, Sequist TD, Ayanian JZ, et al. Impact of computerized decision support on blood pressure management and control: a randomized controlled trial. J Gen Intern Med 2008;23:429-41.
57. Holbrook A, Thabane L, Keshavjee K, et al. Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. CMAJ 2009;181:37-44.
58. Kuilboer MM, van Wijk MA, Mosseveld M, et al. Computed critiquing integrated into daily clinical practice affects physicians' behaviorea randomized clinical trial with AsthmaCritic. Methods Inf Med 2006;45:447-54.
59. Maclean CD, Gagnon M, Callas P, et al. The Vermont diabetes information system: a cluster randomized trial of a population based decision support system. J Gen Intern Med 2009;24:1303-10.
60. McGowan J, Hogg W, Campbell C, et al. Just-in-time information improved decision-making in primary care: a randomized controlled trial. PLoS One 2008;3: e3785.
61. McKinley BA, Moore FA, Sailors RM, et al. Computerized decision support for mechanical ventilation of trauma induced ARDS: results of a randomized clinical trial. J Trauma 2001;50:415-24; discussion 25.
62. Mulvaney SA, Bickman L, Giuse NB, et al. A randomized effectiveness trial of a clinical informatics consult service: impact on evidence-based decision-making and knowledge implementation. J Am Med Inform Assoc 2008;15:203-11.
63. Poels PJ, Schermer TR, Schellekens DP, et al. Impact of a spirometry expert system on general practitioners' decision making. Eur Respir J 2008;31:84-92.
64. Rollman BL, Hanusa BH, Lowe HJ, et al. A randomized trial using computerized decision support to improve treatment of major depression in primary care. J Gen Intern Med 2002;17:493-503.
65. Rosenbloom ST, Geissbuhler AJ, Dupont WD, et al. Effect of CPOE user interface design on user-initiated access to educational and patient information during clinical care. J Am Med Inform Assoc 2005;12:458-73.
66. Roukema J, Steyerberg EW, van der Lei J, et al. Randomized trial of a clinical decision support system: impact on the management of children with fever without apparent source. J Am Med Inform Assoc 2008;15:107-13.
67. Roy PM, Durieux P, Gillaizeau F, et al. A computerized handheld decision-support system to improve pulmonary embolism diagnosis: a randomized trial. Ann Intern Med 2009;151:677-86.
68. Thomas RE, Grimshaw JM, Mollison J, et al. Cluster randomized trial of a guideline-based open access urological investigation service. Fam Pract 2003;20:646-54.
69. Tierney WM, Overhage JM, Murray MD, et al. Can computer-generated evidencebased care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. Health Serv Res 2005;40:477-97.
70. Unrod M, Smith M, Spring B, et al. Randomized controlled trial of a computer-based, tailored intervention to increase smoking cessation counseling by primary care physicians. J Gen Intern Med 2007;22:478-84.
71. van Steenkiste B, van der Weijden T, Stoffers HE, et al. Improving cardiovascular risk management: a randomized, controlled trial on the effect of a decision support tool for patients and physicians. Eur J Cardiovasc Prev Rehabil 2007;14:44-50.
72. van Wyk JT, van Wijk MA, Sturkenboom MC, et al. Electronic alerts versus ondemand decision support to improve dyslipidemia treatment: a cluster randomized controlled trial. Circulation 2008;117:371-8.
73. Watson E, Clements A, Yudkin P, et al. Evaluation of the impact of two educational interventions on GP management of familial breast/ovarian cancer cases: a cluster randomised controlled trial. Br J Gen Pract 2001;51:817-21.
74. Weir CJ, Lees KR, MacWalter RS, et al. Cluster-randomized, controlled trial of computer-based decision support for selecting long-term anti-thrombotic therapy after acute ischaemic stroke. QJM 2003;96:143-53.
75. Whelan T, Levine M, Willan A, et al. Effect of a decision aid on knowledge and treatment decision making for breast cancer surgery: a randomized trial. JAMA 2004;292:435-41.
76. Wilson BJ, Torrance N, Mollison J, et al. Cluster randomized trial of a multifaceted primary care decision-support intervention for inherited breast cancer risk. Fam Pract 2006;23:537-44.
77. Campbell M, Fitzpatrick R, Haines A, et al. Framework for design and evaluation of complex interventions to improve health. BMJ 2000;321:694-6.
78. Ukoumunne OC, Gulliford MC, Chinn S, et al. Methods in health service research. Evaluation of health interventions at area and organisation level. BMJ 1999;319:376-9.
79. Kernick D. Assessing complex interventions. Guidelines perpetuate inappropriate methods. BMJ 2008;337:a2473.
80. Ukoumunne OC, Gulliford MC, Chinn S, et al. Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess 1999;3:iii-92.
81. Campbell NC, Murray E, Darbyshire J, et al. Designing and evaluating complex interventions to improve health care. BMJ 2007;334:455-9.
82. Bond L, Craig P, Egan M, et al. Evaluating complex interventions. Health improvement programmes: really too complex to evaluate? BMJ 2010;340:c1332.
83. Mackenzie M, O'Donnell C, Halliday E, et al. Do health improvement programmes fit with MRC guidance on evaluating complex interventions? BMJ 2010;340:c185.
84. Shiell A, Hawe P, Gold L. Complex interventions or complex systems? Implications for health economic evaluation. BMJ 2008;336:1281-3.
85. Thomson R. Evidence based implementation of complex interventions. BMJ 2009;339:b3124.
86. West PA. Evaluating complex interventions. What is and what could be. BMJ 2010;340:c1340.
87. Friedman CP. Where's the science in medical informatics? J Am Med Inform Assoc 1995;2:65-7.
88. Naunheim MR, Walcott BP, Nahed BV, et al. The Quality of Randomized Controlled Trial Reporting in Spine Literature. Spine (Phila Pa 1976) 2011;36:1326-30.
89. Reveiz L, Cortes-Jofre M, Asenjo Lobos C, et al. Influence of trial registration on reporting quality of randomized trials: study from highest ranked journals. J Clin Epidemiol 2010;63:1216-22.
90. Mills EJ, Wu P, Gagnier J, et al. The quality of randomized trial reporting in leading medical journals since the revised CONSORT statement. Contemp Clin Trials 2005;26:480-7.