External validation of prediction models for pneumonia in primary care patients with lower respiratory tract infection: An individual patient data meta-analysis

PLoS ONE

Volumn 11, Issue 2, 2016, Pages

  Schierenberg, Alwin ^a   Minnaard, Margaretha C ^a   Hopstaken, Rogier M ^b   Van De Pol, Alma C ^a   Broekhuizen, Berna D L ^a   De Wit, Niek J ^a   Reitsma, Johannes B ^a   Van Vugt, Saskia F ^a   Graffelman, Aleida W ^c   Melbye, Hasse ^d   Rainer, Timothy H ^e,j   Steurer, Johann ^f   Holm, Anette ^g   Gonzales, Ralph ^h   Dinant, Geert Jan ⁱ   De Groot, Joris A H ^a   Verheij, Theo J M ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b Thrombosis Service and Primary Care Diagnostic Centre Saltro   (Netherlands)

^c LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

^d UNIVERSITY OF TROMSØ   (Norway)

^e CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^f UNIVERSITY OF ZURICH   (Switzerland)

^g ODENSE UNIVERSITY HOSPITAL   (Denmark)

^h UNIVERSITY OF CALIFORNIA   (United States)

ⁱ MAASTRICHT UNIVERSITY MEDICAL CENTER   (Netherlands)

^j CARDIFF UNIVERSITY   (United Kingdom)

more..

Author keywords

[No Author keywords available]

Indexed keywords

C REACTIVE PROTEIN;

AGE DISTRIBUTION; ANALYTIC METHOD; ARTICLE; COMPUTER ASSISTED TOMOGRAPHY; CROSS-SECTIONAL STUDY; DIAGNOSTIC ACCURACY; HUMAN; LOWER RESPIRATORY TRACT INFECTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PNEUMONIA; PREDICTION; PREVALENCE; PRIMARY MEDICAL CARE; PROBABILITY; PROSPECTIVE STUDY; SEX DIFFERENCE; SYMPTOMATOLOGY; SYSTEMATIC REVIEW; THORAX RADIOGRAPHY; VALIDATION STUDY; AREA UNDER THE CURVE; BIOLOGICAL MODEL; CALIBRATION; DATA BASE; META ANALYSIS; PRIMARY HEALTH CARE; RECEIVER OPERATING CHARACTERISTIC; REPRODUCIBILITY;

AREA UNDER CURVE; CALIBRATION; DATABASES AS TOPIC; HUMANS; MODELS, BIOLOGICAL; PNEUMONIA; PRIMARY HEALTH CARE; PROBABILITY; REPRODUCIBILITY OF RESULTS; ROC CURVE;

EID: 84960347437     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0149895     Document Type: Article

References (43)

1. Mortensen EM, Coley CM, Singer DE, Marrie TJ, Obrosky DS, Kapoor WN, et al. Causes of death for patients with community-acquired pneumonia: results from the Pneumonia Patient Outcomes Research Team cohort study. Arch Intern Med. 2002; 162: 1059-64. PMID: 11996618
2. Niederman MS, Mandell LA, Anzueto A, Bass JB, Broughton WA, Campbell GD, et al. Guidelines for the management of adults with community-acquired pneumonia. Diagnosis, assessment of severity, antimicrobial therapy, and prevention. Am J Respir Crit Care Med. 2001; 163: 1730-54. PMID: 11401897
3. Smucny J, Fahey T, Becker L, Glazier R. Antibiotics for acute bronchitis. Cochrane Database Syst Rev. 2004; CD000245. doi: 10.1002/14651858.CD000245.pub2 PMID: 15494994
4. Bradley JS, Guidos R, Baragona S, Bartlett JG, Rubinstein E, Zhanel GG, et al. Anti-infective research and development-problems, challenges, and solutions. Lancet Infect Dis. 2007; 7: 68-78. doi: 10. 1016/s1473-3099(06)70689-2 PMID: 17182346
5. Tacconelli E, De Angelis G. Fighting antibiotic resistance all over Europe. Expert Rev Anti Infect Ther. 2010; 8: 761-3. doi: 10.1586/eri.10.57 PMID: 20586561
6. Cals JWL, de Bock L, Beckers P-JHW, Francis NA, Hopstaken RM, Hood K, et al. Enhanced communication skills and C-reactive protein point-of-care testing for respiratory tract infection: 3.5-year follow-up of a cluster randomized trial. Ann Fam Med. 11: 157-64. doi: 10.1370/afm.1477 PMID: 23508603
7. Cals JWL, Butler CC, Hopstaken RM, Hood K, Dinant G-J. Effect of point of care testing for C reactive protein and training in communication skills on antibiotic use in lower respiratory tract infections: cluster randomised trial. BMJ. 2009; 338: b1374. doi: 10.1136/bmj.b1374 PMID: 19416992
8. Steyerberg EW, Moons KGM, van der Windt DA, Hayden JA, Perel P, Schroter S, et al. Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med. 2013; 10: e1001381. doi: 10.1371/journal.pmed.1001381 PMID: 23393430
9. Altman DG, Vergouwe Y, Royston P, Moons KGM. Prognosis and prognostic research: validating a prognostic model. BMJ. 2009; 338: b605. doi: 10.1136/bmj.b605 PMID: 19477892
10. Altman DG, Royston P. What do we mean by validating a prognostic model? Stat Med. 2000; 19: 453-73. PMID: 10694730
11. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010; 21: 128-38. doi: 10.1097/EDE.0b013e3181c30fb2 PMID: 20010215
12. Steyerberg EW. Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. Springer Science & Business Media; 2008.
13. Collins GS, de Groot JA, Dutton S, Omar O, Shanyinde M, Tajar A, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014; 14: 40. doi: 10.1186/1471-2288-14-40 PMID: 24645774
14. Harrell FE, Lee KL, Mark DB. Tutorial in biostatistics multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. John Wiley & Sons LTD; 1996; 15: 361-387. PMID: 8668867
15. Bleeker SE, Moll HA, Steyerberg EW, Donders ART, Derksen-Lubsen G, Grobbee DE, et al. External validation is necessary in prediction research:: A clinical example. J Clin Epidemiol. 2003; 56: 826-832. doi: 10.1016/S0895-4356(03)00207-5 PMID: 14505766
16. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement. Ann Intern Med. 2015; 162: 55. doi: 10.7326/M14-0697 PMID: 25560714
17. Graffelman AW, le Cessie S, Neven AK, Willemssen FEJA, Zonderland HM, van den Broek PJ. Can history and exam alone reliably predict pneumonia? J Fam Pract. 2007; 56: 465-470. PMID: 17543257
18. Heckerling PS, Tape TG, Wigton RS, Hissong KK, Leikin JB, Ornato JP, et al. Clinical prediction rule for pulmonary infiltrates. Ann Intern Med. 1990; 113: 664-70. PMID: 2221647
19. van Vugt SF, Broekhuizen BDL, Lammens C, Zuithoff NPA, de Jong PA, Coenen S, et al. Use of serum C reactive protein and procalcitonin concentrations in addition to symptoms and signs to predict pneumonia in patients presenting to primary care with acute cough: diagnostic study. BMJ. 2013; 346: f2450-f2450. doi: 10.1136/bmj.f2450 PMID: 23633005
20. Woodhead M, Blasi F, Ewig S, Garau J, Huchon G, Ieven M, et al. Guidelines for the management of adult lower respiratory tract infections-Full version. Clin Microbiol Infect. 2011; 17: E1-E59.
21. Haynes RB, Wilczynski NL. Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey. BMJ. 2004; 328: 1040. doi: 10.1136/bmj.38068.557998.EE PMID: 15073027
22. Wilczynski Nancy L, Haynes R Brian, the Hedges Team, Wilczynski NL, Haynes RB. EMBASE search strategies for identifying methodologically sound diagnostic studies for use by clinicians and researchers. BMC Med. 2005; 3: 7. doi: 10.1186/1741-7015-3-7 PMID: 15796772
23. Mandell LA, Wunderink RG. Infectious Diseases Society of America/American Thoracic Society consensus guidelines on the management of community-acquired pneumonia in adults. Clin Infect Dis. 2007 Mar 1; 44 Suppl 2:S27-72. PMID: 17278083
24. Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. American College of Physicians; 2011; 155: 529-36. doi: 10.7326/0003-4819-155-8-201110180-00009 PMID: 22007046
25. Rubin, Donald B. Multiple Imputation for Nonresponse in Surveys. Vol. 307. John Wiley & Sons LTD; 2009.
26. Janes H, Pepe MS. Adjusting for covariates in studies of diagnostic, screening, or prognostic markers: an old concept in a new setting. Am J Epidemiol. 2008; 168: 89-97. doi: 10.1093/aje/kwn099 PMID: 18477651
27. Hedges LV. A random effects model for effect sizes. Psychol Bull. 1983; 93: 388.
28. Mathew T, Nordström K. Comparison of one-step and two-step meta-analysis models using individual patient data. Biom J. 2010; 52: 271-287. doi: 10.1002/bimj.200900143 PMID: 20349448
29. Harrell, Frank E. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer Science & Business Media; 2001.
30. Kaplan EL, Couser R, Huwe BB. Significance of quantitative salivary cultures for group A and nongroup A (beta)-hemolytic streptococci in patients with pharyngitis and in their family contacts. Pediatrics. 1979; 64: 904-912. PMID: 390488
31. Diehr P, Wood RW, Bushyhead J, Krueger L, Wolcott B, Tompkins RK. Prediction of pneumonia in outpatients with acute cough-a statistical approach. J Chronic Dis. 1984; 37: 215-25. PMID: 6699126
32. Hopstaken RM, Muris JW, Knottnerus JA, Kester AD, Rinkens PE, Dinant GJ. Contributions of symptoms, signs, erythrocyte sedimentation rate, and C-reactive protein to a diagnosis of pneumonia in acute lower respiratory tract infection. Br J Gen Pr. 2003; 53: 358-64.
33. Melbye H, Straume B, Aasebø U, Dale K. Diagnosis of pneumonia in adults in general practice. Relative importance of typical symptoms and abnormal chest signs evaluated against a radiographic reference standard. Scand J Prim Health Care. 1992; 10: 226-233. doi: 10.3109/02813439209014066 PMID: 1410955
34. Singal BM, Hedges JR, Radack KL. Decision rules and clinical prediction of pneumonia: evaluation of low-yield criteria. Ann Emerg Med. 1989; 18: 13-20. PMID: 2642673
35. Flanders SA, Stein J, Shochat G, Sellers K, Holland M, Maselli J, et al. Performance of a bedside Creactive protein test in the diagnosis of community-acquired pneumonia in adults with acute cough. Am J Med. 2004; 116: 529-535. PMID: 15063814
36. Holm A, Nexoe J, Bistrup LA, Pedersen SS, Obel N, Nielsen LP, et al. Aetiology and prediction of pneumonia in lower respiratory tract infection in primary care. Br J Gen Pract. 2007; 57: 547-554. PMID: 17727747
37. Rainer TH, Chan CP, Leung MF, Leung W, Ip M, Lee N, et al. Diagnostic utility of CRP to neopterin ratio in patients with acute respiratory tract infections. J Infect. 2009; 58: 123-30. doi: 10.1016/j.jinf.2008.11. 007 PMID: 19073345
38. Steurer J, Held U, Spaar A, Bausch B, Zoller M, Hunziker R, et al. A decision aid to rule out pneumonia and reduce unnecessary prescriptions of antibiotics in primary care patients with cough and fever. BMC Med. 2011; 9: 56. doi: 10.1186/1741-7015-9-56 PMID: 21569472
39. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009; 339: b2700. doi: 10.1136/bmj.b2700 PMID: 19622552
40. de Groot JAH, Dendukuri N, Janssen KJM, Reitsma JB, Bossuyt PMM, Moons KGM. Adjusting for Differential-verification Bias in Diagnostic-accuracy Studies: A Bayesian Approach. Epidemiol March 2011. 2011; 22: 234-241. doi: 10.1097/EDE.0b013e318207fc5c
41. Melbye H, Straume B. The spectrum of patients strongly influences the usefulness of diagnostic tests for pneumonia. Scand J Prim Health Care. 1993; 11: 241-6. PMID: 8146507
42. Steyerberg EW, Borsboom GJJM, van Houwelingen HC, Eijkemans MJC, Habbema JDF. Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med. 2004; 23: 2567-2586. doi: 10.1002/sim.1844 PMID: 15287085
43. Macfarlane J, Holmes W, Gard P, Macfarlane R, Rose D, Weston V, et al. Prospective study of the incidence, aetiology and outcome of adult lower respiratory tract illness in the community. Thorax. 2001; 56: 109-114. PMID: 11209098