The search for stable prognostic models in multiple imputed data sets

BMC Medical Research Methodology

Volumn 10, Issue , 2010, Pages

  Vergouw, David ^a   Heymans, Martijn W ^a,b   Peat, George M ^c   Kuijpers, Ton ^d   Croft, Peter R ^c   De Vet, Henrica C W ^a   Van Der Horst, Henritte E ^a   Van Der Windt, Danille A W M ^a,c  

^a VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^b VU UNIVERSITY AMSTERDAM   (Netherlands)

^c KEELE UNIVERSITY   (United Kingdom)

^d Dutch Institute for Healthcare Improvement CBO   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BELGIUM; GENERAL PRACTITIONER; HEALTH SERVICES RESEARCH; HUMAN; INTERVIEW; MIDDLE AGED; POLYPHARMACY; PSYCHOLOGICAL ASPECT; RURAL POPULATION; URBAN POPULATION;

ADULT; BELGIUM; HEALTH SERVICES RESEARCH; HUMANS; INTERVIEWS AS TOPIC; MIDDLE AGED; PHYSICIANS, FAMILY; POLYPHARMACY; RURAL POPULATION; URBAN POPULATION;

EID: 77957740758     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-10-81     Document Type: Article

References (42)

1. Long-term prognosis of acute low back pain in patients seen in general practice: a 1-year prospective follow-up study. B Schiøttz-Christensen GL Nielsen VK Hansen T Schødt HT Sørensen F Olesen, Fam Pract 1999 16 223 32 10.1093/fampra/16.3.223 10439974
2. Prediction of an unfavourable course of low back pain in general practice: comparison of four instruments. P Jellema DA van der Windt HE van der Horst WA Stalman LM Bouter, Br J Gen Pract 2007 57 15 22 17244419
3. Return to work in a cohort of low back pain patients: development and validation of a clinical prediction rule. MW Heymans JR Anema S van Buuren DL Knol W van Mechelen HC de Vet, J Occup Rehabil 2009 19 155 65 10.1007/s10926-009-9166-3 19224347
4. A clinical return-to-work rule for patients with back pain. CE Dionne R Bourbonnais P Frémont M Rossignol SR Stock I Larocque, CMAJ 2005 172 1559 67 15939915
5. A prognostic approach to defining chronic pain: Application to knee pain in older adults. E Thomas KM Dunn C Mallen G Peat, Pain 2008 139 389 97 10.1016/j.pain.2008.05.010 18583051
6. Clinical prediction rules for the prognosis of shoulder pain in general practice. T Kuijpers DA van der Windt AJ Boeke JWR Twisk Y Vergouwe LM Bouter GJMG van der Heijden, Pain 2006 120 276 85 10.1016/j.pain.2005.11.004 16426760
7. Automated variable selection methods for logistic regression produced unstable models for predicting acute myocardial infarction mortality. PC Austin JV Tu, J Clin Epidemiol 2004 57 1138 46 10.1016/j.jclinepi.2004.04.003 15567629
8. The use of resampling methods to simplify regression models in medical statistics. W Sauerbrei, Applied Statistics 1999 48 313 329
9. A bootstrap resampling procedure for model building: application to the Cox regression model. Stat Med. W Sauerbrei M Schumacher, 1992 11 2093 109 1293671
10. Stability of multivariable fractional polynomial models with selection of variables and transformations: a bootstrap investigation. P Royston W Sauerbrei, Stat Med 2003 22 639 59 10.1002/sim.1310 12590419
11. The practical utility of incorporating model selection uncertainty into prognostic models for survival data. NH Augustin W Sauerbrei M Schumacher, Statistical Modelling 2005 5 95 118 10.1191/1471082X05st089oa (Pubitemid 40876072)
12. Review: a gentle introduction to imputation of missing values. AR Donders GJ van der Heijden T Stijnen KG Moons, J Clin Epidemiol 2006 59 1087 91 10.1016/j.jclinepi.2006.01.014 16980149 (Pubitemid 44374314)
13. Using the outcome for imputation of missing predictor values was preferred. KG Moons RA Donders T Stijnen FE Harrell Jr, J Clin Epidemiol 2006 59 1092 101 10.1016/j.jclinepi.2006.01.009 16980150
14. Variable selection under multiple imputation using the bootstrap in a prognostic study. MW Heymans S van Buuren DL Knol W van Mechelen HC de Vet, BMC Med Res Methodol 2007 7 33 10.1186/1471-2288-7-33 17629912
15. Good generalizability of a prediction rule for prediction of persistent shoulder pain in the short term. T Kuijpers GJMG van der Heijden Y Vergouwe JWR Twist AJP Boeke LM Bouter DAWM van der Windt, J Clin Epidemiol 2007 60 947 53 10.1016/j.jclinepi.2006.11.015 17689811
16. Shoulder disability questionnaire design and responsiveness of a functional status measure. GJ Van der Heijden P Leffers LM Bouter, J Clin Epidemiol 2000 53 29 38 10.1016/S0895-4356(99)00078-5 10693901
17. Effectiveness of corticosteroid injections versus physiotherapy for treatment of painful stiff shoulder in primary care: randomised trial. DA Van der Windt BW Koes W Devillé AJ Boeke BA de Jong LM Bouter, BMJ 1998 317 1292 6 9804720
18. Minimal clinically important change for pain intensity, functional status, and general health status in patients with nonspecific low back pain. N Van der Roer RW Ostelo GE Bekkering MW van Tulder HC de Vet, Spine 2006 31 578 582 10.1097/01.brs.0000201293.57439.47 16508555
19. Systematic review of prognostic cohort studies on shoulder disorders. T Kuijpers DA van der Windt GJ van der Heijden LM Bouter, Pain 2004 109 420 31 10.1016/j.pain.2004.02.017 15157703
20. Instruments for measuring chronic pain, part 2. Pain Coping and Cognition List. SGM Berg JWS Vlaeyen MM Ter Kuil P Spinhoven G van Breukelen AMJ Kole-Snijders, Dutch: Meetinstrument chronische pijn, deel 2. Pijn Coping Cognitie Lijst Maastricht: Pijn Kennis Centrum 2001
21. The four-Dimensional symptom questionnaire (4DSQ): measuring distress and other mental health problems in a working population. B Terluin W van Rhenen W Schaufeli M de Haan, Work & Stress 2004 18 187 207
22. A Fear-Avoidance Beliefs Questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. G Waddell M Newton I Henderson D Somerville CJ Main, Pain 1993 52 157 68 10.1016/0304-3959(93)90127-B 8455963
23. Kinesiophobia: A new view of chronic pain behaviour. SH Kori RP Miller DD Todd, Pain Management 1990 35 43
24. Fear of movement/(re)injury and muscular reactivity in chronic low back pain patients: an experimental investigation. JW Vlaeyen HA Seelen M Peters P de Jong E Aretz E Beisiegel WEJ Weber, Pain 1999 82 297 304 10.1016/S0304-3959(99) 00054-8 10488681
25. Dichotomizing continuous predictors in multiple regression: a bad idea. P Royston DG Altman W Sauerbrei, Stat Med 2006 25 127 41 10.1002/sim.2331 16217841
26. Multiple regression for physiological data analysis: the problem of multicollinearity. BK Slinker SA Glantz, American Journal of Physiology 1985 249 1 R12 4014489
27. H Akaike, sor 2nd Int. Symp. on Information Theory Budapest: Akademiai Kiado, Petrov BN, Csaki F, 1973 267 81 Bozdogan H 1987 Psychometrika 52 345-70
28. A simulation study of the number of events per variable in logistic regression analysis. P Peduzzi J Concato E Kemper TR Holford AR Feinstein, J Clin Epidemiol 1996 49 1373 9 10.1016/S0895-4356(96)00236-3 8970487
29. Checklist for Authors: Statistical Problems to Document and to Avoid. FE Harrell Jr, Vanderbilt University Department of biostatistics 2007 http://biostat.mc.vanderbilt.edu/twiki/bin/view/Main/ManuscriptChecklist
30. Flexible multivariate imputation by MICE. Leiden. S Van Buuren CGM Oudshoorn, TNO Prevention and Health 1999 http://www.multiple-imputation.com/ Accessed 2007 August 14
31. Performing likelihood ratio tests with multiply-imputed data sets. X Meng DB Rubin, Biometrika 1992 79 103 111 10.1093/biomet/79.1.103
32. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. FE Harrell Jr KL Lee DB Mark, Stat Med 1996 15 361 87 10.1002/(SICI)1097-0258(19960229)15: 4<361::AID-SIM168>3.0.CO;2-4 8668867
33. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. EW Steyerberg FE Harrell Jr GJ Borsboom MJ Eijkemans Y Vergouwe JD Habbema, J Clin Epidemiol 2001 54 774 81 10.1016/S0895-4356(01)00341-9 11470385
34. Evaluating the yield of medical tests'. FE Harell Jr RM Califf DB Pryor KL Lee RA Rosati, Journal of the American Medical Association 1982 247 2543 6 10.1001/jama.247.18.2543 7069920
35. Bootstrap methods for developing predictive models. PC Austin JV Tu, The American Statistician 2004 58 131 7 10.1198/0003130043277
36. Determining relative importance of variables in developing and validating predictive models. J Beyene EG Atenafu JS Hamid T To LL Sung, BMC Med Res Methodol 2009 9 64 10.1186/1471-2288-9-64 19751506
37. Bootstrap model selection had similar performance for selecting authentic and noise variables compared to backward variable elimination: a simulation study. PC Austin, J Clin Epidemiol 2008 61 1009 17 10.1016/j.jclinepi.2007.11. 014 18539429
38. A comparison of analytic methods for non-random missingness of outcome data. SL Crawford SL Tennstedt JB McKinlay, J Clin Epidemiol 1995 48 209 19 10.1016/0895-4356(94)00124-9 7869067
39. Developing a prognostic model in the presence of missing data: an ovarian cancer case study. TG Clark DG Altman, J Clin Epidemiol 2003 56 28 37 10.1016/S0895-4356(02)00539-5 12589867
40. Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: a clinical example. GJ Van der Heijden AR Donders T Stijnen KG Moons, J Clin Epidemiol 2006 59 1102 9 10.1016/j.jclinepi.2006.01.015 16980151
41. A comparison of imputation techniques for handling missing predictor values in a risk model with a binary outcome. G Ambler RZ Omar P Royston, Stat Methods Med Res 2007 16 277 98 10.1177/0962280206074466 17621472
42. How should variable selection be performed with multiply imputed data? AM Wood IR White P Royston, Stat Med 2008 27 3227 46 10.1002/sim.3177 18203127