Evidence at a glance: Error matrix approach for overviewing available evidence

BMC Medical Research Methodology

Volumn 10, Issue , 2010, Pages

  Keus, Frederik ^a,b   Wetterslev, Jørn ^a   Gluud, Christian ^a   Van Laarhoven, Cornelis Jhm ^a,b  

^a Rigshospitalet   (Denmark)

^b RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ANTIARRHYTHMIC AGENT; BETA ADRENERGIC RECEPTOR BLOCKING AGENT;

ARTICLE; EPIDEMIOLOGY; EVIDENCE BASED MEDICINE; HEART ATRIUM FIBRILLATION; HUMAN; METHODOLOGY; PERIOPERATIVE PERIOD; RISK; SURGERY; TREATMENT OUTCOME;

ADRENERGIC BETA-ANTAGONISTS; ANTI-ARRHYTHMIA AGENTS; ATRIAL FIBRILLATION; BIAS (EPIDEMIOLOGY); EVIDENCE-BASED MEDICINE; HUMANS; ODDS RATIO; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PERIOPERATIVE CARE; RESEARCH DESIGN; SURGICAL PROCEDURES, OPERATIVE;

EID: 77957199918     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-10-90     Document Type: Article

References (77)

1. Evidence-based medicine. A new approach to teaching the practice of medicine. Evidence-Based Medicine Working Group, JAMA 1992 268 2420 5 10.1001/jama.268.17.2420 1404801
2. Recent developments in meta-analysis. AJ Sutton JPT Higgins, Stat Med 2008 27 625 50 10.1002/sim.2934 17590884
3. SE Straus WS Richardson P Glasziou RB Haynes, Evidence-based medicine. How to practice and teach EBM Edinburgh, UK: Churchill Livingstone 2005
4. JPT Higgins S Green, Cochrane Handbook for Systematic Reviews of Interventions The Cochrane Collaboration 2008
5. KR Popper, Logik der Forschung Vienna: Springer 1959
6. T Kuhn, The Structure of Scientific Revolutions Chicago: The University of Chicago Press 1962
7. A philosophical analysis of the evidence-based medicine debate. SR Sehon DE Stanley, BMC Health Serv Res 2003 3 14 10.1186/1472-6963-3-14 12873351
8. WV Quine, From a logical point of view Cambridge: Harvard University Press 1953
9. The culture of designing hepato-biliary randomised trials. C Gluud, J Hepatol 2006 44 607 15 10.1016/j.jhep.2005.12.006 16434120
10. Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches. The GRADE Working Group. D Atkins M Eccles S Flottorp GH Guyatt D Henry S Hill A Liberati D O'Connell AD Oxman B Phillips H Schünemann TT Edejer GE Vist JW Williams Jr GRADE Working Group, BMC Health Serv Res 2004 4 38 10.1186/1472-6963-4-38 15615589
11. Systems for grading the quality of evidence and the strength of recommendations II: pilot study of a new system. D Atkins PA Briss M Eccles S Flottorp GH Guyatt RT Harbour S Hill R Jaeschke A Liberati N Magrini J Mason D O'Connell AD Oxman B Phillips H Schünemann TT Edejer GE Vist JW Williams Jr GRADE Working Group, BMC Health Serv Res 2005 5 25 10.1186/1472-6963-5-25 15788089
12. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. GH Guyatt AD Oxman GE Vist R Kunz Y Falck-Ytter P Alonso-Coello HJ Schünemann GRADE Working Group, BMJ 2008 336 924 6 10.1136/bmj.39489.470347.AD 18436948
13. What is "quality of evidence" and why is it important to clinicians? GH Guyatt AD Oxman R Kunz GE Vist Y Falck-Ytter HJ Schünemann GRADE Working Group, BMJ 2008 336 995 8 10.1136/bmj.39490.551019.BE 18456631
14. An overview of clinical research: the lay of the land. DA Grimes KF Schulz, Lancet 2002 359 57 61 10.1016/S0140-6736(02)07283-5 11809203
15. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. LL Kjaergard J Villumsen C Gluud, Ann Intern Med 2001 135 982 9 11730399
16. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. KF Schulz I Chalmers RJ Hayes DG Altman, JAMA 1995 273 408 12 10.1001/jama.273.5.408 7823387
17. Assessing the quality of research. P Glasziou JP Vandenbroucke I Chalmers, BMJ 2004 328 39 41 10.1136/bmj.328.7430.39 14703546
18. Randomisation. Essential for reducing bias. DG Altman, BMJ 1991 302 1481 2 10.1136/bmj.302.6791.1481 1855013
19. Randomisation to protect against selection bias in healthcare trials. R Kunz G Vist AD Oxman, Cochrane Database of Methodology Reviews 2002 4
20. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. L Wood M Egger LL Gluud KF Schulz P Jüni DG Altman C Gluud RM Martin AJ Wood JA Sterne, BMJ 2008 336 601 5 10.1136/bmj.39465.451748.AD 18316340
21. Bias and causal associations in observational research. DA Grimes KF Schulz, Lancet 2002 359 248 52 10.1016/S0140-6736(02)07451-2 11812579
22. Cohort studies: marching towards outcomes. DA Grimes KF Schulz, Lancet 2002 359 341 5 10.1016/S0140-6736(02)07500-1 11830217
23. Descriptive studies: what they can and cannot do. DA Grimes KF Schulz, Lancet 2002 359 145 9 10.1016/S0140-6736(02)07373-7 11809274
24. Generation of allocation sequences in randomised trials: chance, not choice. KF Schulz DA Grimes, Lancet 2002 359 515 9 10.1016/S0140-6736(02)07683-3 11853818
25. Allocation concealment in randomised trials: defending against deciphering. KF Schulz DA Grimes, Lancet 2002 359 614 8 10.1016/S0140-6736(02) 07750-4 11867132
26. Blinding in randomised trials: hiding who got what. KF Schulz DA Grimes, Lancet 2002 359 696 700 10.1016/S0140-6736(02)07816-9 11879884
27. Assessing the quality of randomized controlled trials. Current issues and future directions. D Moher AR Jadad P Tugwell, Int J Technol Assess Health Care 1996 12 195 208 10.1017/S0266462300009570 8707495
28. Assessing the quality of reports of randomized clinical trials: is blinding necessary? AR Jadad RA Moore D Carroll C Jenkinson DJ Reynolds DJ Gavaghan HJ McQuay, Control Clin Trials 1996 17 1 12 10.1016/0197-2456(95)00134- 4 8721797
29. Bias in clinical intervention research. LL Gluud, Am J Epidemiol 2006 163 493 501 10.1093/aje/kwj069 16443796
30. Ethical issues in stopping randomized trials early because of apparent benefit. PS Mueller VM Montori D Bassler BA Koenig GH Guyatt, Ann Intern Med 2007 146 878 81 17577007
31. Stopping at nothing? Some dilemmas of data monitoring in clinical trials. SN Goodman, Ann Intern Med 2007 146 882 7 17577008
32. Randomized trials stopped early for benefit: a systematic review. VM Montori PJ Devereaux NK Adhikari KE Burns CH Eggert M Briel C Lacchetti TW Leung E Darling DM Bryant HC Bucher HJ Schünemann MO Meade DJ Cook PJ Erwin A Sood R Sood B Lo CA Thompson Q Zhou E Mills GH Guyatt, JAMA 2005 294 2203 9 10.1001/jama.294.17.2203 16264162
33. Systematic reviews in health care: Assessing the quality of controlled clinical trials. P Jüni DG Altman M Egger, BMJ 2001 323 42 6 10.1136/bmj.323.7303.42 11440947
34. Systematic reviewers neglect bias that results from trials stopped early for benefit. D Bassler I Ferreira-Gonzalez M Briel DJ Cook PJ Devereaux D Heels-Ansdell H Kirpalani MO Meade VM Montori A Rozenberg HJ Schünemann GH Guyatt, J Clin Epidemiol 2007 60 869 73 10.1016/j.jclinepi.2006.12.006 17689802
35. Early stopping of randomized clinical trials for overt efficacy is problematic. D Bassler VM Montori M Briel P Glasziou GH Guyatt, J Clin Epidemiol 2008 61 241 6 10.1016/j.jclinepi.2007.07.016 18226746
36. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Wetterslev K Thorlund J Brok C Gluud, J Clin Epidemiol 2008 61 64 75 10.1016/j.jclinepi.2007.03.013 18083463
37. Toward evidence-based medical statistics. 1: The P value fallacy. SN Goodman, Ann Intern Med 1999 130 995 1004 10383371
38. Standard statistical algorithms in Cochrane reviews, Version 5. J Deeks J Higgins on behalf of the statistical methods group of the Cochrane collaboration, The Cochrane Collaboration 2005 http://ims.cochrane.org/revman/ documentation/Statistical-methods-in-RevMan-5.pdf
39. Underpowering in randomized trials reporting a sample size calculation. AJ Vickers, J Clin Epidemiol 2003 56 717 20 10.1016/S0895-4356(03)00141-0 12954462
40. Multiplicity in randomised trials II: subgroup and interim analyses. KF Schulz DA Grimes, Lancet 2005 365 1657 61 10.1016/S0140-6736(05)66516-6 15885299
41. Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. JM Pogue S Yusuf, Control Clin Trials 1997 18 580 93 10.1016/S0197-2456(97)00051-2 9408720
42. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Brok K Thorlund C Gluud J Wetterslev, J Clin Epidemiol 2008 61 763 9 10.1016/j.jclinepi.2007.10. 007 18411040
43. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? K Thorlund PJ Devereaux J Wetterslev GH Guyatt JP Ioannidis L Thabane LL Gluud B Als-Nielsen C Gluud, Int J Epidemiol 2009 38 276 86 10.1093/ije/dyn179 18824467
44. Apparently conclusive meta-analyses may be inconclusive - Trial sequential analysis adjustment of random error risk due to repetetive testing of accumulating data in apparently conclusive neonatal meta-analyses. J Brok K Thorlund J Wetterslev C Gluud, Int J Epidemiol 2009 38 287 98 10.1093/ije/dyn188 18824466
45. Uncertainty of the time of first significance in random effects cumulative meta-analysis. CS Berkey F Mosteller J Lau EM Antman, Control Clin Trials 1996 17 357 71 10.1016/S0197-2456(96)00014-1 8932970
46. Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. J Lau CH Schmid TC Chalmers, J Clin Epidemiol 1995 48 45 57 10.1016/0895-4356(94)00106-Z 7853047
47. Secondary endpoints cannot be validly analyzed if the primary endpoint does not demonstrate clear statistical significance. RT O'Neill, Control Clin Trials 1997 18 550 6 10.1016/S0197-2456(97)00075-5 9408717
48. Multiplicity in randomised trials I: endpoints and treatments. KF Schulz DA Grimes, Lancet 2005 365 1591 5 10.1016/S0140-6736(05)66461-6 15866314
49. LM Friedman CD Furberg DL Demets, Fundamentals of clinical trials New York: Springer Verlag 1998
50. Peri-operative beta-blockers in patients undergoing non-cardiac surgery. A meta-analysis and trial sequential analysis of 12,306 patients from randomised trials. S Bangalore J Wetterslev S Pranesh S Sawhney C Gluud FH Messerli, Lancet 2008 372 1962 76 10.1016/S0140-6736(08)61560-3 19012955
51. Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial. POISE Study Group PJ Devereaux H Yang S Yusuf G Guyatt K Leslie JC Villar D Xavier S Chrolavicius L Greenspan J Pogue P Pais L Liu S Xu G Mlaga A Avezum M Chan VM Montori M Jacka P Choi, Lancet 2008 371 1839 47 10.1016/S0140-6736(08)60601-7 18479744
52. The effects of perioperative beta-blockade: results of the Metoprolol after Vascular Surgery (MaVS) study, a randomized controlled trial. H Yang K Raymer R Butler J Parlow R Roberts, Am Heart J 2006 152 983 90 10.1016/j.ahj.2006.07.024 17070177
53. Effect of perioperative beta blockade in patients with diabetes undergoing major non-cardiac surgery: randomised placebo controlled, blinded multicentre trial. AB Juul J Wetterslev C Gluud A Kofoed-Enevoldsen G Jensen T Callesen P Nørgaard K Fruergaard M Bestle R Vedelsdal A Miran J Jacobsen J Roed MB Mortensen L Jørgensen J Jørgensen ML Rovsing PL Petersen F Pott M Haas R Albret LL Nielsen G Johansson P Stjernholm Y Mølgaard NB Foss J Elkjaer B Dehlie K Boysen D Zaric DIPOM Trial Group, et al. BMJ 2006 332 1482 10.1136/bmj.332.7556.1482 16793810
54. Effect of atenolol on mortality and cardiovascular morbidity after noncardiac surgery. Multicenter Study of Perioperative Ischemia Research Group. DT Mangano EL Layug A Wallace I Tateo, N Engl J Med 1996 335 1713 20 10.1056/NEJM199612053352301 8929262
55. Benefit and harms of perioperative b-blockade. J Wetterslev AB Juul, Best Pract Res Clin Anaesthesiol 2006 20 285 302 10.1016/j.bpa.2005.10.006 16850778
56. The effect of bisoprolol on perioperative mortality and myocardial infarction in high-risk patients undergoing vascular surgery. Dutch Echocardiographic Cardiac Risk Evaluation Applying Stress Echocardiography Study Group. D Poldermans E Boersma JJ Bax IR Thomson LL van de Ven JD Blankensteijn HF Baars TI Yo G Trocino C Vigna JR Roelandt H van Urk, N Engl J Med 1999 341 1789 94 10.1056/NEJM199912093412402 10588963
57. Perioperative beta-blocker therapy and mortality after major noncardiac surgery. PK Lindenauer P Pekow K Wang DK Mamidi B Gutierrez EM Benjamin, N Engl J Med 2005 353 349 61 10.1056/NEJMoa041895 16049209
58. ACC/AHA 2007 Guidelines on Perioperative Cardiovascular Evaluation and Care for Noncardiac Surgery: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines on Perioperative Cardiovascular Evaluation for Noncardiac Surgery) Developed in Collaboration With the American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society of Cardiovascular Anesthesiologists, Society for Cardiovascular Angiography and Interventions, Society for Vascular Medicine and Biology, and Society for Vascular Surgery. LA Fleisher JA Beckman KA Brown H Calkins EL Chaikof KE Fleischmann WK Freeman JB Froehlich EK Kasper JR Kersten B Riegel JF Robb SC Smith Jr AK Jacobs CD Adams JL Anderson EM Antman CE Buller MA Creager SM Ettinger DP Faxon V Fuster JL Halperin LF Hiratzka SA Hunt BW Lytle R Nishimura JP Ornato RL Page B Riegel, et al. J Am Coll Cardiol 2007 50 1707 32 10.1016/j.jacc.2007.09.001 17950159
59. Antiarrhythmics for maintaining sinus rhythm after cardioversion of atrial fibrillation. C Lafuente-Lafuente S Mouly MA Longas-Tejero JF Bergmann, Cochrane Database Syst Rev 2007 4 D005049 17943835
60. Maintenance of sinus rhythm after DC reversion of atrial fibrilllation. A double-blind controlled trial of long-acting quinidine bisulphate. E Byrne-Quinn AJ Wing, Br Heart J 1970 32 370 6 10.1136/hrt.32.3.370 4911757
61. Quinidine in maintenance of sinus rhythm after electroconversion of chronic atrial fibrillation. A controlled clinical study. L Hillestad C Bjerkelund J Dale J Maltau O Storstein, Br Heart J 1971 33 518 21 10.1136/hrt.33.4.518 4934041
62. Disopyramide in the maintenance of sinus rhythm after electroconversion of atrial fibrillation. A placebo-controlled one year follow-up study. BW Karlson I Torstensson C Abjorn SO Jansson LE Peterson, Eur Heart J 1988 9 284 90 3289932
63. The efficacy of quinidine and disopyramide in the maintenance of sinus rhythm after electroconversion from atrial fibrillation. A double-blind study comparing quinidine, disopyramide and placebo. EA Lloyd BJ Gersh R Forman, S Afr Med J 1984 65 367 9 6367096
64. Prevention of atrial fibrillation after cardioversion: results of the PAFAC trial. T Fetsch P Bauer R Engberding HP Koch J Lukl T Meinertz M Oeff L Seipel HJ Trappe N Treese G Breithardt Prevention of Atrial Fibrillation after Cardioversion Investigators, Eur Heart J 2004 25 1385 94 10.1016/j.ehj.2004.04. 015 15302102
65. Effect of quinidine on maintaining sinus rhythm after conversion of atrial fibrillation or flutter. A multicentre study from Stockholm. T Södermark B Jonsson A Olsson L Orö H Wallin O Edhag A Sjögren M Danielsson G Rosenhamer, Br Heart J 1975 37 486 92 10.1136/hrt.37.5.486 1093559
66. Suppression of paroxysmal atrial tachyarrhythmias-results of the SOPAT trial. M Patten R Maas P Bauer B Lüderitz F Sonntag M Dluzniewski R Hatala G Opolski HW Müller T Meinertz SOPAT Investigators, Eur Heart J 2004 25 1395 404 10.1016/j.ehj.2004.06.014 15321697
67. Therapy of paroxysmal atrial fibrillation. Cardiac glycosides alone or combined with antiarrhythmia agents? G Steinbeck R Doliwa P Bach, Dtsch Med Wochenschr 1988 113 1867 71 10.1055/s-2008-1067903 3143539
68. Toward evidence-based medical statistics. 2: The Bayes factor. SN Goodman, Ann Intern Med 1999 130 1005 13 10383350
69. Bayes factors for genome-wide association studies: comparison with P-values. J Wakefield, Genet Epidemiol 2008 33 79 86 10.1002/gepi.20359
70. Evaluating non-randomised intervention studies. JJ Deeks J Dinnes R D'Amico AJ Sowden C Sakarovitch F Song M Petticrew DG Altman International Stroke Trial Collaborative Group; European Carotid Surgery Trial Collaborative Group, Health Technol Assess 2003 7 iii-x,1-173. 14499048
71. Risk of cardiovascular events and rofecoxib: cumulative meta-analysis. P Jüni L Nartey S Reichenbach R Sterchi PA Dieppe M Egger, Lancet 2004 364 2021 9 10.1016/S0140-6736(04)17514-4 15582059
72. An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. PJ Devereaux PT Choi S El Dika M Bhandari VM Montori HJ Schünemann AX Garg JW Busse D Heels-Ansdell WA Ghali BJ Manns GH Guyatt, J Clin Epidemiol 2004 57 1232 6 10.1016/j.jclinepi.2004.03.017 15617948
73. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. KF Schulz DG Altman D Moher CONSORT Group, BMC Med 2010 8 18 http://www.consort-statement.org 10.1186/1741-7015-8-18 20334633
74. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. D Moher A Liberati J Tetzlaff DG Altman Group PRISMA, BMJ 2009 339 2535 http://www.prisma-statement.org 10.1136/bmj.b2535 19622551
75. Meta-analysis of observational studies in epidemiology: a proposal for reporting. DF Stroup JA Berlin SC Morton I Olkin GD Williamson D Rennie D Moher BJ Becker TA Sipe SB Thacker, JAMA 2000 283 2008 12 10.1001/jama.283.15.2008 10789670
76. Quantifying heterogeneity in a meta-analysis. JP Higgins SG Thompson, Stat Med 2002 21 1539 58 10.1002/sim.1186 12111919
77. Estimating required information size by quantifying diversity in random-effects model meta-analyses. J Wetterslev K Thorlund J Brok C Gluud, BMC Med Res Methodol 2009 9 86 10.1186/1471-2288-9-86 20042080