Overview of data-synthesis in systematic reviews of studies on outcome prediction models

BMC Medical Research Methodology

Volumn 13, Issue 1, 2013, Pages

  Van Den Berg, Tobias ^a   Heymans, Martijn W ^a   Leone, Stephanie S ^a   Vergouw, David ^a   Hayden, Jill A ^b   Verhagen, Arianne P ^c   De Vet, Henrica Cw ^a  

^a VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^b DALHOUSIE UNIVERSITY   (Canada)

^c ERASMUS MEDICAL CENTER   (Netherlands)

Author keywords

Forecasting; Meta analysis; Methods; Prediction; Prognosis; Review; Systematic

Indexed keywords

ARTICLE; FACTUAL DATABASE; HUMAN; MEDICAL RESEARCH; PREDICTIVE VALUE; TREATMENT OUTCOME;

BIOMEDICAL RESEARCH; DATABASES, FACTUAL; HUMANS; PREDICTIVE VALUE OF TESTS; TREATMENT OUTCOME;

MLCS; MLOWN;

EID: 84874939555     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-13-42     Document Type: Review

References (84)

1. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Harrell FEJ, Lee KL, Mark DB, Stat Med 1996 15 361 387 10.1002/(SICI)1097-0258(19960229)15: 4<361::AID-SIM168>3.0.CO;2-4 8668867
2. Ten steps towards improving prognosis research. Hemingway H, Riley RD, Altman DG, BMJ 2009 339 4184 10.1136/bmj.b4184 20042483
3. Penalized maximum likelihood estimation to directly adjust diagnostic and prognostic prediction models for overoptimism: a clinical example. Moons KGM, Donders AR, Steyerberg EW, Harrell FE, J Clin Epidemiol 2004 57 1262 1270 10.1016/j.jclinepi.2004.01.020 15617952
4. Dichotomizing continuous predictors in multiple regression: a bad idea. Royston P, Altman DG, Sauerbrei W, Stat Med 2006 25 127 141 10.1002/sim.2331 16217841
5. Steyerberg EW, Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating New York: Springer 2009
6. Prognosis and prognostic research: Developing a prognostic model. Royston P, Moons KGM, Altman DG, Vergouwe Y, BMJ 2009 338 604 10.1136/bmj.b604 19336487
7. Prognosis and prognostic research: what, why, and how? Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG, BMJ 2009 338 375 10.1136/bmj.b375 19237405
8. What is the prognosis of back pain? Hayden JA, Dunn KM, van der Windt DA, Shaw WS, Best Pract Res Clin Rheumatol 2010 24 167 179 10.1016/j.berh.2009.12. 005 20227639
9. Systematic reviews of low back pain prognosis had variable methods and results: guidance for future prognosis reviews. Hayden JA, Chou R, Hogg-Johnson S, Bombardier C, J Clin Epidemiol 2009 62 781 796 10.1016/j.jclinepi.2008.09.004 19136234
10. Aspirin "resistance" and risk of cardiovascular morbidity: systematic review and meta-analysis. Krasopoulos G, Brister SJ, Beattie WS, Buchanan MR, BMJ 2008 336 195 198 10.1136/bmj.39430.529549.BE 18202034
11. Evaluation of the quality of prognosis studies in systematic reviews. Hayden JA, Cote P, Bombardier C, Ann Intern Med 2006 144 427 437 10.7326/0003-4819-144-6-200603210-00010 16549855
12. Reporting of prognostic studies of tumour markers: a review of published articles in relation to REMARK guidelines. Mallett S, Timmer A, Sauerbrei W, Altman DG, Br J Cancer 2010 102 173 180 10.1038/sj.bjc.6605462 19997101
13. Reporting performance of prognostic models in cancer: a review. Mallett S, Royston P, Waters R, Dutton S, Altman DG, BMC Med 2010 8 21 10.1186/1741-7015-8-21 20353579
14. Reporting methods in studies developing prognostic models in cancer: a review. Mallett S, Royston P, Dutton S, Waters R, Altman DG, BMC Med 2010 8 20 10.1186/1741-7015-8-20 20353578
15. Searching for clinical prediction rules in MEDLINE. Ingui BJ, Rogers MA, J Am Med Inform Assoc 2001 8 391 397 10.1136/jamia.2001.0080391 11418546
16. Natural History and Prognosis. Wilczynski NL, PDQ, Evidence-Based Principles and Practice Shelton, Connecticut: People's Medical Publishing House, McKibbon KA, Wilczynski NL, Eady A, Marks S, 2009
17. Automated variable selection methods for logistic regression produced unstable models for predicting acute myocardial infarction mortality. Austin PC, Tu JV, J Clin Epidemiol 2004 57 1138 1146 10.1016/j.jclinepi.2004.04.003 15567629
18. Dementia and life expectancy: what do we know? Lee M, Chodosh J, J Am Med Dir Assoc 2009 10 466 471 10.1016/j.jamda.2009.03.014 19716062
19. Prediction of Mortality in Acute Pancreatitis: A Systematic Review of the Published Evidence. Gravante G, Garcea G, Ong S, Pancreatology 2009 9 601 614 10.1159/000212097 19657215
20. Pretreatment psychosocial variables as predictors of outcomes following lumbar surgery and spinal cord stimulation: a systematic review and literature synthesis. Celestin J, Edwards RR, Jamison RN, Pain Med 2009 10 639 653 10.1111/j.1526-4637.2009.00632.x 19638142
21. Variables associated with the progression of hip osteoarthritis: a systematic review. Wright AA, Cook C, Abbott JH, Arthritis Rheum 2009 61 925 936 10.1002/art.24641 19565541
22. Comparison of risk factors predicting return to work between patients with subacute and chronic non-specific low back pain: systematic review. Heitz C, Hilfiker R, Bachmann L, Eur Spine J 2009 18 1829 35 10.1007/s00586-009-1083-9 19565277
23. Predicting walking ability following lower limb amputation: a systematic review of the literature. Sansam K, Neumann V, O'Connor R, Bhakta B, J Rehabil Med 2009 41 593 603 10.2340/16501977-0393 19565152
24. Common prognostic factors of work disability among employees with a chronic somatic disease: a systematic review of cohort studies. Detaille SI, Heerkens YF, Engels JA, van der Gulden JWJ, van Dijk FJH, Scand J Work Environ Health 2009 35 261 281 10.5271/sjweh.1337 19562236
25. Risk factors for persistent problems following whiplash injury: results of a systematic review and meta-analysis. Walton DM, Pretty J, MacDermid JC, Teasell RW, J Orthop Sports Phys Ther 2009 39 334 350 19411766
26. Prognostic factors of return to work after acquired brain injury: a systematic review. van Velzen JM, van Bennekom CAM, Edelaar MJA, Sluiter JK, Frings-Dresen MHW, Brain Inj 2009 23 385 395 10.1080/02699050902838165 19408163
27. Medically unexplained symptoms, somatisation disorder and hypochondriasis: course and prognosis. A systematic review. Borghuis MS, Lucassen PLBJ, van de Laar FA, Speckens AE, van Weel C, olde Hartman TC, J Psychosom Res 2009 66 363 377 10.1016/j.jpsychores.2008.09.018 19379952
28. Prognostic factors in localized extremity osteosarcoma: a systematic review. Bramer JAM, van Linge JH, Grimer RJ, Scholten RJPM, Eur J Surg Oncol 2009 35 1030 1036 10.1016/j.ejso.2009.01.011 19232880
29. Prognostic indicators in hepatocellular carcinoma: a systematic review of 72 studies. Tandon P, Garcia-Tsao G, Liver Int 2009 29 502 510 10.1111/j.1478-3231.2008.01957.x 19141028
30. Patient characteristics affecting the prognosis of total hip and knee joint arthroplasty: a systematic review. Santaguida PL, Hawker GA, Hudak PL, Can J Surg 2008 51 428 436 19057730
31. Systematic review of the predictors of recurrent hemorrhage after endoscopic hemostatic therapy for bleeding peptic ulcers. Elmunzer BJ, Young SD, Inadomi JM, Schoenfeld P, Laine L, Am J Gastroenterol 2008 103 2625 2632 10.1111/j.1572-0241.2008.02070.x 18684171
32. Patient predictors of alcohol treatment outcome: a systematic review. Adamson SJ, Sellman JD, Frampton CMA, J Subst Abuse Treat 2009 36 75 86 10.1016/j.jsat.2008.05.007 18657940
33. Risk factors associated with mortality of infections caused by Stenotrophomonas maltophilia: a systematic review. Paez JIG, Costa SF, J Hosp Infect 2008 70 101 108 10.1016/j.jhin.2008.05.020 18621440
34. Prognostic factors for survival in scleroderma associated pulmonary arterial hypertension. Johnson SR, Swiston JR, Granton JT, J Rheumatol 2008 35 1584 1590 18597400
35. Health-related quality of life in survivors of BMT for paediatric malignancy: a systematic review of the literature. Clarke SA, Eiser C, Skinner R, Bone Marrow Transplant 2008 42 73 82 10.1038/bmt.2008.156 18500369
36. Clinical factors to predict the outcome of external cephalic version: a metaanalysis. Kok M, Cnossen J, Gravendeel L, van der Post J, Opmeer B, Mol BW, Am J Obstet Gynecol 2008 199 630 637 18456227
37. Proliferation markers and survival in early breast cancer: a systematic review and meta-analysis of 85 studies in 32,825 patients. Stuart-Harris R, Caldas C, Pinder SE, Pharoah P, Breast 2008 17 323 334 10.1016/j.breast.2008.02. 002 18455396
38. Course and prognostic factors of whiplash: a systematic review and meta-analysis. Kamper SJ, Rebbeck TJ, Maher CG, McAuley JH, Sterling M, Pain 2008 138 617 629 10.1016/j.pain.2008.02.019 18407412
39. Prognosis of fatigue. Nijrolder I, van der Horst H, van der Windt D, A systematic review. J Psychosom Res 2008 64 335 349 10.1016/j.jpsychores.2007.11. 001
40. A systematic literature review of physical prognostic factors for the development of Late Whiplash Syndrome. Williams M, Williamson E, Gates S, Lamb S, Cooke M, Spine (Phila Pa 1976) 2007 32 764 E780 10.1097/BRS.0b013e31815b6565
41. Prognostic factors of long-term functioning and productivity after traumatic brain injury: a systematic review of prospective cohort studies. Willemse-van Son AHP, Ribbers GM, Verhagen AP, Stam HJ, Clin Rehabil 2007 21 1024 1037 10.1177/0269215507077603 17984154
42. Outcome Predictors for Pediatric Dilated Cardiomyopathy: A Systematic Review. Alvarez J, Wilkinson J, Lipshultz S, Prog Pediatr Cardiol 2007 23 25 32 10.1016/j.ppedcard.2007.05.009 19701490
43. Prognostic factors for musculoskeletal pain in primary care: a systematic review. Mallen CD, Peat G, Thomas E, Dunn KM, Croft PR, Br J Gen Pract 2007 57 655 661 17688762
44. Independent predictors of stroke in patients with atrial fibrillation: a systematic review. Stroke Risk in Atrial Fibrillation Working Group, Neurology 2007 69 546 554 17679673
45. Can we predict poor recovery from recent-onset nonspecific low back pain? A systematic review. Kent PM, Keating JL, Man Ther 2008 13 12 28 10.1016/j.math.2007.05.009 17658288
46. Predictors of mortality after aortic valve replacement. Tjang YS, van Hees Y, Korfer R, Grobbee DE, van der Heijden GJMG, Eur J Cardiothorac Surg 2007 32 469 474 10.1016/j.ejcts.2007.06.012 17658266
47. Surgical resection of pulmonary metastases from colorectal cancer: a systematic review of published series. Pfannschmidt J, Dienemann H, Hoffmann H, Ann Thorac Surg 2007 84 324 338 10.1016/j.athoracsur.2007.02.093 17588454
48. A systematic literature review of psychological factors and the development of late whiplash syndrome. Williamson E, Williams M, Gates S, Lamb SE, Pain 2008 135 20 30 10.1016/j.pain.2007.04.035 17570588
49. Prognostic factors of disability in older people: a systematic review. Tas U, Verhagen AP, Bierma-Zeinstra SMA, Odding E, Koes BW, Br J Gen Pract 2007 57 319 323 17394736
50. Predictors of mortality in chronic Chagas disease: a systematic review of observational studies. Rassi AJ, Rassi A, Rassi SG, Circulation 2007 115 1101 1108 10.1161/CIRCULATIONAHA.106.627265 17339568
51. Prognostic factors of progression of osteoarthritis of the knee: a systematic review of observational studies. Belo JN, Berger MY, Reijman M, Koes BW, Bierma-Zeinstra SMA, Arthritis Rheum 2007 57 13 26 10.1002/art.22475 17266080
52. Clinical and demographic predictors of long-term disability in patients with relapsing-remitting multiple sclerosis: a systematic review. Langer-Gould A, Popat RA, Huang SM, Arch Neurol 2006 63 1686 1691 10.1001/archneur.63.12.1686 17172607
53. Clinical predictors of ongoing infection in secondary peritonitis: systematic review. Lamme B, Mahler CW, van Ruler O, Gouma DJ, Reitsma JB, Boermeester MA, World J Surg 2006 30 2170 2181 10.1007/s00268-005-0333-1 17102920
54. Course of functional status and pain in osteoarthritis of the hip or knee: a systematic review of the literature. van Dijk GM, Dekker J, Veenhof C, van den Ende CHM, Arthritis Rheum 2006 55 779 785 10.1002/art.22244 17013827
55. Preoperative predictors for postoperative clinical outcome in lumbar spinal stenosis: systematic review. Aalto TJ, Malmivaara A, Kovacs F, Spine (Phila Pa 1976) 2006 31 648 E663 10.1097/01.brs.0000231727.88477.da
56. Prognostic factors in patients with recently diagnosed incurable cancer: a systematic review. Hauser CA, Stockler MR, Tattersall MHN, Support Care Cancer 2006 14 999 1011 10.1007/s00520-006-0079-9 16708213
57. Systematic review of determinants of mortality in high frequency oscillatory ventilation in acute respiratory distress syndrome. Bollen CW, Uiterwaal CSPM, van Vught AJ, Crit Care 2006 10 34 10.1186/cc4824 16507163
58. Prognostic factors for duration of sick leave in patients sick listed with acute low back pain: a systematic review of the literature. Steenstra IA, Verbeek JH, Heymans MW, Bongers PM, Occup Environ Med 2005 62 851 860 10.1136/oem.2004.015842 16299094
59. Predictors of hepatic encephalopathy after transjugular intrahepatic portosystemic shunt in cirrhotic patients: a systematic review. Bai M, Qi X, Yang Z, J Gastroenterol Hepatol 2011 26 943 51 10.1111/j.1440-1746.2011.06663.x 21251067
60. Risk stratification systems for diabetic foot ulcers: a systematic review. Monteiro-Soares M, Boyko E, Ribeiro J, Ribeiro I, Dinis-Ribeiro M, Diabetologia 2011 54 1190 1199 10.1007/s00125-010-2030-3 21249490
61. Predictors of hospital readmission after stroke: a systematic review. Lichtman JH, Leifheit-Limson EC, Jones SB, Stroke 2010 41 2525 2533 10.1161/STROKEAHA.110.599159 20930150
62. Predictors of clinical outcome after stent placement in atherosclerotic renal artery stenosis: a systematic review and meta-analysis of prospective studies. Ronden RA, Houben AJ, Kessels AG, Stehouwer CD, de Leeuw PW, Kroon AA, J Hypertens 2010 28 2370 2377 20811293
63. Predicting sequelae and death after bacterial meningitis in childhood: a systematic review of prognostic studies. de Jonge RCJ, van Furth AM, Wassenaar M, Gemke RJBJ, Terwee CB, BMC Infect Dis 2010 10 232 10.1186/1471-2334-10-232 20684796
64. Predicting prognosis in thermal burns with associated inhalational injury: a systematic review of prognostic factors in adult burn victims. Colohan SM, J Burn Care Res 2010 31 529 539 10.1097/BCR.0b013e3181e4d680 20523229
65. A systematic review of early prognostic factors for return to work following acute orthopaedic trauma. Clay FJ, Newstead SV, McClure RJ, Injury 2010 41 787 803 10.1016/j.injury.2010.04.005 20435304
66. Risk scoring systems for adults admitted to the emergency department: a systematic review. Brabrand M, Folkestad L, Clausen NG, Knudsen T, Hallas J, Scand J Trauma Resusc Emerg Med 2010 18 8 10.1186/1757-7241-18-8 20146829
67. Quality of life data as prognostic indicators of survival in cancer patients: an overview of the literature from 1982 to 2008. Montazeri A, Health Qual Life Outcomes 2009 7 102 10.1186/1477-7525-7-102 20030832
68. Prediction and Shrinkage. Copas JB, J R Stat Soc Ser B (methodological) 1983 45 311 354
69. Grading quality of evidence and strength of recommendations. Atkins D, Best D, Briss PA, BMJ 2004 328 1490 15205295
70. Evaluating non-randomised intervention studies. Deeks JJ, Dinnes J, D'Amico R, Health Technol Assess 2003 7 ii-173
71. Uptake of methods to deal with publication bias in systematic reviews has increased over time, but there is still much scope for improvement. Parekh-Bhurke S, Kwok CS, Pang C, J Clin Epidemiol 2011 64 349 57 10.1016/j.jclinepi.2010.04.022 20800992
72. Steyerberg EW, Selection of main effects. Clinicical Prediction Models: A Practical Approach to Development, Validation, and Updating New York: Springer 2009
73. Model Uncertainty, Data Mining and Statistical Inference. Chatfield C, J R Stat Soc Ser A 1995 158 419 466 10.2307/2983440
74. Stepwise selection in small data sets: a simulation study of bias in logistic regression analysis. Steyerberg EW, Eijkemans MJ, Habbema JD, J Clin Epidemiol 1999 52 935 942 10.1016/S0895-4356(99)00103-1 10513756
75. Systematic reviews of evaluations of prognostic variables. Altman DG, BMJ 2001 323 224 228 10.1136/bmj.323.7306.224 11473921
76. Quality of reporting of cancer prognostic marker studies: association with reported prognostic effect. Kyzas PA, Ioannidis JPA, axa-Kyza D, J Natl Cancer Inst 2007 99 236 243 10.1093/jnci/djk032 17284718
77. Almost all articles on cancer prognostic markers report statistically significant results. Kyzas PA, Ioannidis JPA, axa-Kyza D, Eur J Cancer 2007 43 2559 2579 10.1016/j.ejca.2007.08.030 17981458
78. Reporting bias in diagnostic and prognostic studies: time for action. Rifai N, Altman DG, Bossuyt PM, Clin Chem 2008 54 1101 1103 10.1373/clinchem. 2008.108993 18593957
79. Validity of prognostic models: when is a model clinically useful? Vergouwe Y, Steyerberg EW, Eijkemans MJC, Habbema JD, Semin Urol Oncol 2002 20 96 107 10.1053/suro.2002.32521 12012295
80. Prognosis and prognostic research: validating a prognostic model. Altman DG, Vergouwe Y, Royston P, Moons KGM, BMJ 2009 338 605 10.1136/bmj.b605 19477892
81. Systematic reviews of evaluations of prognostic variables. Altman DG, Systematic Reviews in Health Care London: BMJ Publishing Group, Egger M, Smith GD, Altman DG, 2001 228 47
82. The limitations of risk factors as prognostic tools. Ware JH, N Engl J Med 2006 355 2615 2617 10.1056/NEJMp068249 17182986
83. Harrell FE, Multivariable modeling strategies. Regression modeling strategies with applications to linear models, logistic regression, and survival analysis New York: Springer 2001
84. Reporting of prognostic markers: current problems and development of guidelines for evidence-based practice in the future. Riley RD, Abrams KR, Sutton AJ, Br J Cancer 2003 88 1191 1198 10.1038/sj.bjc.6600886 12698183