Clinical prediction model to aid emergency doctors managing febrile children at risk of serious bacterial infections: Diagnostic study

BMJ (Online)

Volumn 346, Issue 7905, 2013, Pages

  Nijman, Ruud G ^a   Vergouwe, Yvonne ^b   Thompson, Matthew ^c   Veen, Mirjam Van ^a   Van Meurs, Alfred H J ^d   Van Der Lei, Johan ^b   Steyerberg, Ewout W ^b   Moll, Henriette A ^a   Oostenbrink, Rianne ^a  

^a SOPHIA CHILDREN S HOSPITAL   (Netherlands)

^b ERASMUS MEDICAL CENTER   (Netherlands)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d JULIANA CHILDREN S HOSPITAL   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

C REACTIVE PROTEIN;

ADOLESCENT; ARTICLE; BACTERIAL INFECTION; BACTERIAL PNEUMONIA; BODY TEMPERATURE MEASUREMENT; CLINICAL PREDICTION MODEL; CLINICAL TRIAL; DISEASE DURATION; EMERGENCY CARE; EMERGENCY PHYSICIAN; FEVER; HUMAN; INFANT; MAJOR CLINICAL STUDY; MANAGED CARE; MATHEMATICAL MODEL; MULTIVARIATE LOGISTIC REGRESSION ANALYSIS; NETHERLANDS; OBSERVATIONAL STUDY; OXYGEN SATURATION; PRIORITY JOURNAL; PROSPECTIVE STUDY; RISK ASSESSMENT; TACHYCARDIA; TACHYPNEA; UNITED KINGDOM; VALIDATION STUDY;

ADOLESCENT; BACTERIAL INFECTIONS; C-REACTIVE PROTEIN; CHILD; CHILD, PRESCHOOL; EMERGENCIES; EMERGENCY SERVICE, HOSPITAL; FEMALE; FEVER; HUMANS; INFANT; MALE; MODELS, STATISTICAL; PROGNOSIS; PROSPECTIVE STUDIES; RISK ASSESSMENT; RISK FACTORS; SEVERITY OF ILLNESS INDEX;

EID: 84877616348     PISSN: None     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.f1706     Document Type: Article

References (73)

1. Kuppermann N, Fleisher GR, Jaffe DM. Predictors of occult pneumococcal bacteremia in young febrile children. Ann Emerg Med 1998;31:679-87. (Pubitemid 28252622)
2. Nelson DS, Walsh K, Fleisher GR. Spectrum and frequency of pediatric illness presenting to a general community hospital emergency department. Pediatrics 1992;90:5-10.
3. Slater M, Krug SE. Evaluation of the infant with fever without source: an evidence based approach. Emerg Med Clin North Am 1999;17:97-126, viii-ix. (Pubitemid 29147009)
4. Neuman MI, Monuteaux MC, Scully KJ, Bachur RG. Prediction of pneumonia in a pediatric emergency department. Pediatrics 2011;128:246-53.
5. Bleeker SE, Derksen-Lubsen G, Grobbee DE, Donders AR, Moons KG, Moll HA. Validating and updating a prediction rule for serious bacterial infection in patients with fever without source. Acta Paediatr 2007;96:100-4.
6. Nigrovic LE, Kuppermann N, Macias CG, Cannavino CR, Moro-Sutherland DM, Schremmer RD, et al. Clinical prediction rule for identifying children with cerebrospinal fluid pleocytosis at very low risk of bacterial meningitis. JAMA 2007;297:52-60. (Pubitemid 46041726)
7. Oostenbrink R, Moons KG, Donders AR, Grobbee DE, Moll HA. Prediction of bacterial meningitis in children with meningeal signs: reduction of lumbar punctures. Acta Paediatr 2001;90:611-7. (Pubitemid 32595862)
8. Leroy S, Marc E, Adamsbaum C, Gendrel D, Breart G, Chalumeau M. Prediction of vesicoureteral reflux after a first febrile urinary tract infection in children: validation of a clinical decision rule. Arch Dis Child 2006;91:241-4. (Pubitemid 43325503)
9. Maguire JL, Kulik DM, Laupacis A, Kuppermann N, Uleryk EM, Parkin PC. Clinical prediction rules for children: a systematic review. Pediatrics 2011;128:e666-77.
10. Thompson M, Van den Bruel A, Verbakel J, Lakhanpaul M, Haj-Hassan T, Stevens R, et al. Systematic review and validation of prediction rules for identifying children with serious infections in emergency departments and urgent-access primary care. Health Technol Assess 2012;16:1-100.
11. Craig JC, Williams GJ, Jones M, Codarini M, Macaskill P, Hayen A, et al. The accuracy of clinical symptoms and signs for the diagnosis of serious bacterial infection in young febrile children: prospective cohort study of 15 781 febrile illnesses. BMJ 2010;340:c1594.
12. Van den Bruel A, Thompson MJ, Haj-Hassan T, Stevens R, Moll H, Lakhanpaul M, et al. Diagnostic value of laboratory tests in identifying serious infections in febrile children: systematic review. BMJ 2011;342:d3082.
13. Sanders S, Barnett A, Correa-Velez I, Coulthard M, Doust J. Systematic review of the diagnostic accuracy of C-reactive protein to detect bacterial infection in nonhospitalized infants and children with fever. J Pediatr 2008;153:570-4.
14. Yo CH, Hsieh PS, Lee SH, Wu JY, Chang SS, Tasi KC, et al. Comparison of the test characteristics of procalcitonin to c-reactive protein and leukocytosis for the detection of serious bacterial infections in children presenting with fever without source: a systematic review and meta-analysis. Ann Emerg Med 2012;60:591-600.
15. Dahler-Eriksen BS, Lassen JF, Petersen PH, Lund ED, Lauritzen T, Brandslund I. Evaluation of a near-patient test for C-reactive protein used in daily routine in primary healthcare by use of difference plots. Clin Chem 1997;43:2064-75. (Pubitemid 27497804)
16. Galetto-Lacour A, Zamora SA, Gervaix A. Bedside procalcitonin and C-reactive protein tests in children with fever without localizing signs of infection seen in a referral center. Pediatrics 2003;112:1054-60. (Pubitemid 37339556)
17. Steyerberg EW. Clinical prediciton models: a practical approach to development, validation, an updating. Statistics for Biology and Health. Springer, 2009.
18. Roukema J, Steyerberg EW, van der Lei J, Moll HA. Randomized trial of a clinical decision support system: impact on the management of children with fever without apparent source. J Am Med Inform Assoc 2008;15:107-13. (Pubitemid 350216482)
19. Van Veen M, Steyerberg EW, Lettinga L, Ruige M, van Meurs AH, van der Lei J, et al. Safety of the Manchester Triage System to identify less urgent patients in paediatric emergency care: a prospective observational study. Arch Dis Child 2011;96:513-8.
20. Thompson M, Coad N, Harnden A, Mayon-White R, Perera R, Mant D. How well do vital signs identify children with serious infections in paediatric emergency care? Arch Dis Child 2009;94:888-93.
21. Roukema J, Los RK, Bleeker SE, van Ginneken AM, van der Lei J, Moll HA. Paper versus computer: feasibility of an electronic medical record in general pediatrics. Pediatrics 2006;117:15-21. (Pubitemid 46050514)
22. Bleeker SE, Moons KG, Derksen-Lubsen G, Grobbee DE, Moll HA. Predicting serious bacterial infection in young children with fever without apparent source. Acta Paediatr 2001;90:1226-32. (Pubitemid 33144982)
23. Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM. A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol 2009;62:797-806.
24. Van den Bruel A, Aertgeerts B, Bruyninckx R, Aerts M, Buntinx F. Signs and symptoms for diagnosis of serious infections in children: a prospective study in primary care. Br J Gen Pract 2007;57:538-46. (Pubitemid 47039500)
25. Joffe A, McCormick M, De Angelis C. Which children with febrile seizures need lumbar puncture? A decision analysis approach. Am J Dis Child 1983;137:1153-6. (Pubitemid 14208443)
26. Taylor JA, Del Beccaro M, Done S, Winters W. Establishing clinically relevant standards for tachypnea in febrile children younger than 2 years. Arch Pediatr Adolesc Med 1995;149:283-7.
27. McCarthy PL, Sharpe MR, Spiesel SZ, Dolan TF, Forsyth BW, De Witt TG, et al. Observation scales to identify serious illness in febrile children. Pediatrics 1982;70:802-9. (Pubitemid 12004270)
28. Berger RM, Berger MY, van Steensel-Moll HA, Dzoljic-Danilovic G, Derksen-Lubsen G. A predictive model to estimate the risk of serious bacterial infections in febrile infants. Eur J Pediatr 1996;155:468-73. (Pubitemid 26170118)
29. Hsiao AL, Chen L, Baker MD. Incidence and predictors of serious bacterial infections among 57-to 180-day-old infants. Pediatrics 2006;117:1695-701. (Pubitemid 46071399)
30. Trautner BW, Caviness AC, Gerlacher GR, Demmler G, Macias CG. Prospective evaluation of the risk of serious bacterial infection in children who present to the emergency department with hyperpyrexia (temperature of 106 degrees F or higher). Pediatrics 2006;118:34-40. (Pubitemid 46071144)
31. Andreola B, Bressan S, Callegaro S, Liverani A, Plebani M, Da Dalt L. Procalcitonin and C-reactive protein as diagnostic markers of severe bacterial infections in febrile infants and children in the emergency department. Pediatr Infect Dis J 2007;26:672-7. (Pubitemid 47424634)
32. Teele DW, Pelton SI, Grant MJ, Herskowitz J, Rosen DJ, Allen CE, et al. Bacteremia in febrile children under 2 years of age: results of cultures of blood of 600 consecutive febrile children seen in a "walk-in clinic". J Pediatr 1975;87:227-30.
33. Offringa M, Derksen-Lubsen G, Bossuyt PM, Lubsen J. Seizure recurrence after a first febrile seizure: a multivariate approach. Dev Med Child Neurol 1992;34:15-24.
34. Mahabee-Gittens EM, Grupp-Phelan J, Brody AS, Donnelly LF, Bracey SE, Duma EM, et al. Identifying children with pneumonia in the emergency department. Clin Pediatr (Phila) 2005;44:427-35. (Pubitemid 40868906)
35. Wells LC, Smith JC, Weston VC, Collier J, Rutter N. The child with a non-blanching rash: how likely is meningococcal disease? Arch Dis Child 2001;85:218-22. (Pubitemid 32822382)
36. Waskerwitz S, Berkelhamer JE. Outpatient bacteremia: clinical findings in children under two years with initial temperatures of 39.5 degrees C or higher. J Pediatr 1981;99:231-3. (Pubitemid 11046490)
37. Haddon RA, Barnett PL, Grimwood K, Hogg GG. Bacteraemia in febrile children presenting to a paediatric emergency department. Med J Aust 1999;170:475-8. (Pubitemid 29224966)
38. Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D, European Research Network on Recognising Serious Infection. Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet 2010;375:834-45.
39. Laupacis A, Sekar N, Stiell IG. Clinical prediction rules. A review and suggested modifications of methodological standards. JAMA 1997;277:488-94. (Pubitemid 27074334)
40. Turner NM. Advanced paediatric life support (APLS). 2nd ed. Reed business, 2006.
41. Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating. Springer, 2009.
42. R: a language and environment for statistical computing In: Team RdC, ed. R Foundation for Statistical Computing, 2006.
43. World Health Organization. The management of acute respiratory infections in children. Practical guidelines for outpatient care. WHO, 1995.
44. Mintegi S, Benito J, Sanchez J, Azkunaga B, Iturralde I, Garcia S. Predictors of occult bacteremia in young febrile children in the era of heptavalent pneumococcal conjugated vaccine. Eur J Emerg Med 2009;16:199-205.
45. Bressan S, Berlese P, Mion T, Masiero S, Cavallaro A, Da Dalt L. Bacteremia in feverish children presenting to the emergency department: a retrospective study and literature review. Acta Paediatr 2012;101:271-7.
46. Van Calster B, Vergouwe Y, Looman CW, Van Belle V, Timmerman D, Steyerberg EW. Assessing the discriminative ability of risk models for more than two outcome categories. Eur J Epidemiol 2012;27:761-70.
47. Oostenbrink R, Thompson M, Steyerberg EW; ERNIE members. Barriers to translating diagnostic research in febrile children to clinical practice: a systematic review. Arch Dis Child 2012;97:667-72.
48. Rutman MS, Bachur R, Harper MB. Radiographic pneumonia in young, highly febrile children with leukocytosis before and after universal conjugate pneumococcal vaccination. Pediatr Emerg Care 2009;25:1-7.
49. Shah S, Mathews B, Neuman MI, Bachur R. Detection of occult pneumonia in a pediatric emergency department. Pediatr Emerg Care 2010;26:615-21.
50. Murphy CG, van de Pol AC, Harper MB, Bachur RG. Clinical predictors of occult pneumonia in the febrile child. Acad Emerg Med 2007;14:243-9.
51. Mintegi S, Benito J, Pijoan JI, Maranon R, Penalba A, Gonzalez A, et al. Occult pneumonia in infants with high fever without source: a prospective multicenter study. Pediatr Emerg Care 2010;26:470-4.
52. Nijman RG, Thompson M, van Veen M, Perera R, Moll HA, Oostenbrink R. Derivation and validation of age and temperature specific reference values and centile charts to predict lower respiratory tract infection in children with fever: prospective observational study. BMJ 2012;345:e4224.
53. Huppler AR, Eickhoff JC, Wald ER. Performance of low-risk criteria in the evaluation of young infants with fever: review of the literature. Pediatrics 2010;125:228-33.
54. Bressan S, Gomez B, Mintegi S, Dalt LD, Blazquez D, Olaciregui I, et al. Diagnostic performance of the "lab-score" in predicting severe and invasive bacterial infections in well-appearing young febrile infants. Pediatr Infect Dis J 2012;31:1239-44.
55. Galetto-Lacour A, Zamora SA, Andreola B, Bressan S, Lacroix L, Da Dalt L, et al. Validation of a laboratory risk index score for the identification of severe bacterial infection in children with fever without source. Arch Dis Child 2010;95:968-73.
56. Lacour AG, Zamora SA, Gervaix A. A score identifying serious bacterial infections in children with fever without source. Pediatr Infect Dis J 2008;27:654-6.
57. Pulliam PN, Attia MW, Cronan KM. C-reactive protein in febrile children 1 to 36 months of age with clinically undetectable serious bacterial infection. Pediatrics 2001;108:1275-9. (Pubitemid 33121468)
58. Thayyil S, Shenoy M, Hamaluba M, Gupta A, Frater J, Verber IG. Is procalcitonin useful in early diagnosis of serious bacterial infections in children? Acta Paediatr 2005;94:155-8. (Pubitemid 40343688)
59. Carrol ED, Newland P, Riordan FA, Thomson AP, Curtis N, Hart CA. Procalcitonin as a diagnostic marker of meningococcal disease in children presenting with fever and a rash. Arch Dis Child 2002;86:282-5. (Pubitemid 34289631)
60. Hsiao AL, Baker MD. Fever in the new millennium: a review of recent studies of markers of serious bacterial infection in febrile children. Curr Opin Pediatr 2005;17:56-61.
61. Gomez B, Bressan S, Mintegi S, Da Dalt L, Blazquez D, Olaciregui I, et al. Diagnostic value of procalcitonin in well-appearing young febrile infants. Pediatrics 2012;130:815-22.
62. Steyerberg EW, Eijkemans MJ, Harrell FE Jr, Habbema JD. Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets. Stat Med 2000;19:1059-79. (Pubitemid 30238915)
63. Vergouwe Y, Steyerberg EW, Eijkemans MJ, Habbema JD. Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol 2005;58:475-83. (Pubitemid 40544569)
64. Edmonds ZV, Mower WR, Lovato LM, Lomeli R. The reliability of vital sign measurements. Ann Emerg Med 2002;39:233-7. (Pubitemid 34219635)
65. Steyerberg EW, van Veen M. Imputation is beneficial for handling missing data in predictive models. J Clin Epidemiol 2007;60:979. (Pubitemid 47208539)
66. Vergouwe Y, Moons KG, Steyerberg EW. External validity of risk models: use of benchmark values to disentangle a case-mix effect from incorrect coefficients. Am J Epidemiol 2010;172:971-80.
67. Thompson MJ, Ninis N, Perera R, Mayon-White R, Phillips C, Bailey L, et al. Clinical recognition of meningococcal disease in children and adolescents. Lancet 2006;367:397-403. (Pubitemid 43184259)
68. Curtis S, Stobart K, Vandermeer B, Simel DL, Klassen T. Clinical features suggestive of meningitis in children: a systematic review of prospective data. Pediatrics 2010;126:952-60.
69. Almond SC, Summerton N. Diagnosis in general practice. Test of time. BMJ 2009;338:b1878.
70. Mallett S, Halligan S, Thompson M, Collins GS, Altman DG. Interpreting diagnostic accuracy studies for patient care. BMJ 2012;345:e3999.
71. Rudensky B, Sirota G, Erlichman M, Yinnon AM, Schlesinger Y. Neutrophil CD64 expression as a diagnostic marker of bacterial infection in febrile children presenting to a hospital emergency department. Pediatr Emerg Care 2008;24:745-8.
72. Reilly BM, Evans AT. Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med 2006;144:201-9. (Pubitemid 46780691)
73. Wallace E, Smith SM, Perera-Salazar R, Vaucher P, McCowan C, Collins G, et al. Framework for the impact analysis and implementation of Clinical Prediction Rules (CPRs). BMC Med Inform Decis Mak 2011;11:62.