Scalable Joint Models for Reliable Uncertainty-Aware Event Prediction

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 40, Issue 8, 2018, Pages 1948-1963

  Soleimani, Hossein ^a   Hensman, James ^b   Saria, Suchi ^a  

^a Johns Hopkins University   (United States)

^b LANCASTER UNIVERSITY   (United Kingdom)

Author keywords

joint modeling; missing data; scalable Gaussian processes; survival analysis; time series; Uncertainty aware prediction

Indexed keywords

DATA STRUCTURES; DETECTORS; FORECASTING; GAUSSIAN DISTRIBUTION; RELIABILITY; RELIABILITY ANALYSIS; TIME SERIES; TIME SERIES ANALYSIS; UNCERTAINTY ANALYSIS;

COMPUTATIONAL MODEL; GAUSSIAN PROCESSES; JOINT MODELING; MISSING DATA; PREDICTIVE MODELS; SURVIVAL ANALYSIS; UNCERTAINTY;

GAUSSIAN NOISE (ELECTRONIC);

EID: 85028517618     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2017.2742504     Document Type: Article

References (67)

1. G. Verbeke and G. Molenberghs, Linear Mixed Models for Longitudinal Data. Berlin, Germany: Springer, 2009.
2. E. Rivers, et al., "Early goal-directed therapy in the treatment of severe sepsis and septic shock," New England J. Med., vol. 345, no. 19, pp. 1368-1377, 2001.
3. R. M. Schein, N. Hazday, M. Pena, B. H. Ruben, and C. L. Sprung, "Clinical antecedents to in-hospital cardiopulmonary arrest," Chest, vol. 98, no. 6, pp. 1388-1392, 1990.
4. A. F. Smith and J. Wood, "Can some in-hospital cardio-respiratory arrests be prevented? A prospective survey," Resuscitation, vol. 37, no. 3, pp. 133-137, 1998.
5. A. Kumar, et al., "Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock," Critical Care Med., vol. 34, no. 6, pp. 1589-1596, 2006.
6. T. Pelkonen, et al., "Gorilla: A fast, scalable, in-memory time series database," Proc. VLDB Endowment, vol. 8, no. 12, pp. 1816-1827, 2015.
7. J. Kalbfleisch and R. Prentice, The Statistical Analysis of Failure Time Data. Hoboken, NJ, USA: Wiley, 2011.
8. J. C. van. Houwelingen and H. Putter, Dynamic Prediction in Clinical Survival Analysis. Boca Raton, FL, USA: CRC Press, 2012.
9. D. Rizopoulos, Joint Models for Longitudinal and Time-to-Event Data: With Applications in R. Boca Raton, FL, USA: CRC Press, 2012.
10. D. Rizopoulos, "Dynamic predictions and prospective accuracy in joint models for longitudinal and time-to-event data," Biometrics, vol. 67, no. 3, pp. 819-829, Sep. 2011.
11. D. Rizopoulos, "JM : An R package for the joint modelling of longitudinal and time-to-event data," J. Statist. Softw., vol. 35, no. 9, pp. 1-33, 2010.
12. C. Proust-Lima, M. Séne, J. M. Taylor, and H. Jacqmin-Gadda, "Joint latent class models for longitudinal and time-to-event data: A review," Statist. Methods Med. Res., vol. 23, no. 1, pp. 74-90, 2014.
13. C. Proust-Lima, J. F. Dartigues, and H. Jacqmin-Gadda, "Joint modeling of repeated multivariate cognitive measures and competing risks of dementia and death: A latent process and latent class approach," Statist. Med., vol. 35, no. 3, pp. 382-398, 2016.
14. D. Rizopoulos, L. A. Hatfield, B. P. Carlin, and J. J. M. Takkenberg, "Combining dynamic predictions from joint models for longitudinal and time-to-event data using Bayesian model averaging," J. Amer. Statist. Assoc., vol. 109, no. 508, pp. 1385-1397, 2014.
15. J. Futoma, M. Sendak, C. B. Cameron, and K. Heller, "Scalable joint modeling of longitudinal and point process data for disease trajectory prediction and improving management of chronic kidney disease," in Proc. Conf. Uncertainty Artif. Intell., 2016, pp. 222-231.
16. A. Tsiatis and M. Davidian, "Joint modeling of longitudinal and time-to-event data: An overview," Statistica Sinica, vol. 14, pp. 809-834, 2004.
17. M. Sweeting and S. Thompson, "Joint modelling of longitudinal and time-to-event data with application to predicting abdominal aortic aneurysm growth and rupture," Biometrical J., vol. 53, pp. 750-763, 2011.
18. K. E. Henry, D. N. Hager, P. J. Pronovost, and S. Saria, "A targeted real-time early warning score (TREWScore) for septic shock," Sci. Transl. Med., vol. 7, no. 299, 2015, Art. no. 299ra122.
19. M. Ghassemi, et al., "A multivariate timeseries modeling approach to severity of illness assessment and forecasting in ICU with sparse, heterogeneous clinical data," in Proc. AAAI Conf. Artif. Intell., 2015, pp. 446-453.
20. M. Wu, M. Ghassemi, M. Feng, L. A. Celi, P. Szolovits, and F. Doshi- Velez, "Understanding vasopressor intervention and weaning: Risk prediction in a public heterogeneous clinical time series database," J. Amer. Med. Informat. Assoc., vol. 24, pp. 488-495, 2017.
21. C. K. Chow, "An optimum character recognition system using decision functions," IRE Trans. Electron. Comput., vol. EC-6, no. 4, pp. 247-254, Dec. 1957.
22. M. Golfarelli, D. Maio, and D. Malton, "On the error-reject tradeoff in biometric verification systems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 786-796, Jul. 1997.
23. P. L. Bartlett and M. H. Wegkamp, "Classification with a reject option using a hinge loss," J. Mach. Learn. Res., vol. 9, pp. 1823- 1840, 2008.
24. N. Parrish, H. S. Anderson, M. R. Gupta, and D. Y. Hsiao, "Classifying with confidence from incomplete information," J. Mach. Learn. Res., vol. 14, no. 1, pp. 3561-3589, 2013.
25. M. Sangnier, J. Gauthier, and A. Rakotomamonjy, "Early and reliable event detection using proximity space representation," in Proc. Int. Conf. Mach. Learn., 2016, pp. 2310-2319.
26. M. Hoai and F. De La Torre, "Max-margin early event detectors," Int. J. Comput. Vis., vol. 107, no. 2, pp. 191-202, 2014.
27. P. Billingsley, Probability and Measure. Hoboken, NJ, USA: Wiley, 2008.
28. H. C. Van Houwelingen, "Dynamic prediction by landmarking in event history analysis," Scandinavian J. Statist., vol. 34, no. 1, pp. 70-85, 2007.
29. A. G. Journel and C. J. Huijbregts, Mining Geostatistics. Cambridge, MA, USA: Academic Press, 1978.
30. M. Seeger, Y.-W. Teh, and M. Jordan, "Semiparametric latent factor models," Tech. Rep. EPFL-REPORT-161465, 2005.
31. M. A. - Alvarez and N. D. Lawrence, "Computationally efficient convolved multiple output Gaussian processes," J. Mach. Learn. Res., vol. 12, pp. 1459-1500, 2009.
32. D. B. Rubin, "Inference and missing data," Biometrika, vol. 63, no. 3, pp. 581-592, 1976.
33. P. Schulam and S. Saria, "Integrative analysis using coupled latent variable models for individualizing prognoses," J. Mach. Learn. Res., vol. 17, no. 234, pp. 1-35, 2016.
34. C. E. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. Cambridge, MA, USA: MIT Press, 2006.
35. P. Jylänki, J. Vanhatalo, and A. Vehtari, "Robust Gaussian process regression with a student-t likelihood," J. Mach. Learn. Res., vol. 12, pp. 3227-3257, 2011.
36. H. Joensuu, et al., "Risk of recurrence of gastrointestinal stromal tumour after surgery: An analysis of pooled population-based cohorts," Lancet Oncology, vol. 13, no. 3, pp. 265-274, 2012.
37. A. D. Saul, J. Hensman, A. Vehtari, and N. D. Lawrence, "Chained Gaussian processes," in Proc. Int. Conf. Artif. Intell. Statist., 2016, pp. 1-23.
38. T. Fernández, N. Rivera, and Y. W. Teh, "Gaussian processes for survival analysis," in Proc. Int. Conf. Neural Inf. Process. Syst., pp. 5021-5029, 2016.
39. R. Ranganath, A. Perotte, N. Elhadad, and D. Blei, "Deep survival analysis," in Proc. Mach. Learn. Healthcare, 2016, pp. 1-13.
40. R. Ranganath, A. Perotte, N. Elhadad, and D. Blei, "Deep exponential families," in Proc. Int. Conf. Artif. Intell. Statist., 2015, pp. 762-771.
41. M. K. Titsias, "Variational model selection for sparse gaussian process regression," in Proc. Int. Conf. Artif. Intell. Statist., 2009, pp. 1-20.
42. J. Hensman, N. Fusi, and N. D. Lawrence, "Gaussian processes for big data," in Proc. Conf. Uncertainty Artif. Intell., 2013, pp. 282-290.
43. J. Hensman and A. Matthews, "Scalable variational gaussian process classification," in Proc. Int. Conf. Artif. Intell. Statist., 2015, pp. 1-9.
44. A. G. de G. Matthews, J. Hensman, R. E. Turner, and Z. Ghahramani, "On sparse variational methods and the Kullback-Leibler divergence between stochastic processes," in Proc. Int. Conf. Artif. Intell. Statist., 2016, pp. 231-239.
45. M. Osborne, D. Duvenaud, R. Garnett, C. E. Rasmussen, S. J. Roberts, and Z. Ghahramani, "Active learning of model evidence using Bayesian quadrature," in Proc. Int. Conf. Neural Inf. Process. Syst., 2012, pp. 46-54.
46. M. Lázaro-Gredilla and A. Figueiras-Vidal, "Inter-domain gaussian processes for sparse inference using inducing features," in Proc. 22nd Int. Conf. Neural Inf. Process. Syst., 2009, pp. 1087-1095.
47. J. Hensman, N. Durrande, and A. Solin, "Variational fourier features for gaussian processes," arXiv preprint arXiv:1611.06740, 2016.
48. D. P. Kingma and M. Welling, "Auto-encoding variational bayes," in Proc. Int. Conf. Learn. Representations, Dec. 2014.
49. R. Byrd, P. Lu, J. Nocedal, and C. Zhu, "A limited memory algorithm for bound constrained optimization," SIAM J. Sci. Comput., vol. 16, no. 5, pp. 1190-1208, 1995.
50. H. V. Poor, An Introduction to Signal Detection and Estimation. Berlin, Germany: Springer, 2013.
51. P. Schulam and S. Saria, "A framework for individualizing predictions of disease trajectories by exploiting multi-resolution structure," in Proc. Int. Conf. Neural Inf. Process. Syst., 2015, pp. 748-756.
52. C. Enders, Applied Missing Data Analysis. New York, NY, USA: Guilford Press, 2010.
53. R. J. Little and D. B. Rubin, Statistical Analysis with Missing Data. Hoboken, NJ, USA: Wiley, 2014.
54. P. D. Allison, Missing Data. Thousand Oaks, CA, USA: Sage Publications, 2001.
55. R. Young and D. R. Johnson, "Handling missing values in longitudinal panel data with multiple imputation," J. Marriage Family, vol. 77, pp. 277-294, 2015.
56. I. Stanculescu, C. K. Williams, and Y. Freer, "Autoregressive hidden Markov models for the early detection of neonatal sepsis," IEEE J. Biomed. Health Informat., vol. 18, no. 5, pp. 1560-1570, Sep. 2014.
57. Z. Liu and M. Hauskrecht, "Learning adaptive forecasting models from irregularly sampled multivariate clinical data," in Proc. AAAI Conf. Artif. Intell., 2016, pp. 1273-1279.
58. A. M. Alaa, J. Yoon, S. Hu, and M. van der Schaar, "Personalized risk scoring for critical care patients using mixtures of Gaussian process experts," in Proc. Int. Conf. Mach. Learn. Workshop Comput. Frameworks Personalization, 2016.
59. T. A. Lasko, J. C. Denny, and M. A. Levy, "Computational phenotype discovery using unsupervised feature learning over noisy, sparse, and irregular clinical data," PLoS One, vol. 8, no. 6, pp. 1- 13, Jun. 2013.
60. J. A. Quinn, C. K. Williams, and N. McIntosh, "Factorial switching linear dynamical systems applied to physiological condition monitoring," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 9, pp. 1537-1551, Sep. 2009.
61. Z. C. Lipton, D. C. Kale, and R. Wetzel, "Directly modeling missing data in sequences with RNNs: Improved classification of clinical time series," in Proc. Mach. Learn. Healthcare, 2016, pp. 1-17.
62. A. Gunawardana, C. Meek, and P. Xu, "A model for temporal dependencies in event streams," in Proc. Int. Conf. Neural Inf. Process. Syst., 2011, pp. 1962-1970.
63. S. C.-X. Li and B. M. Marlin, "A scalable end-to-end gaussian process adapter for irregularly sampled time series classification," in Proc. Int. Conf. Neural Inf. Process. Syst., 2016, pp. 1804-1812.
64. A. L. Goldberger, et al., "PhysioBank, PhysioToolkit, and Physio- Net: Components of a new research resource for complex physiologic signals," Circulation, vol. 101, no. 23, pp. 215-220, 2000.
65. R. H. Byrd, P. Lu, J. Nocedal, and C. Zhu, "A limited memory algorithm for bound constrained optimization," SIAM J. Sci. Comput., vol. 16, no. 5, pp. 1190-1208, 1995.
66. M. Abadi, et al., "TensorFlow: Large-scale machine learning on heterogeneous distributed systems," arXiv preprint arXiv:1603.04467, 2016.
67. J. Hensman, et al., "GPflow," 2016. [Online]. Available: https:// github.com/GPflow/GPflow