Sieve estimation of constant and time-varying coefficients in nonlinear ordinary differential equation models by considering both numerical error and measurement error

Annals of Statistics

Volumn 38, Issue 4, 2010, Pages 2351-2387

  Xue, Hongqi ^a   Miao, Hongyu ^a   Wu, Hulin ^a  

^a UNIVERSITY OF ROCHESTER SCHOOL OF MEDICINE AND DENTISTRY   (United States)

Author keywords

Nonlinear least squares; Ordinary differential equation; Runge kutta algorithm; Sieve approach; Spline smoothing; Time varying parameter

Indexed keywords

EID: 77955160687     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/09-AOS784     Document Type: Article

References (93)

1. ADAMS, B. M. (2005). Non-parametric parameter estimation and clinical data fitting with a model of HIV infection. Ph. D. thesis, North Carolina State Univ. MR2623319
2. ANDERSON, R. M. and MAY, R. M. (1991). Infectious Diseases of Humans: Dynamics and Control. Oxford Univ. Press, Oxford.
3. AUDOLY, S., BELLU, G., D'ANGIO, L., SACCOMANI, M. P. and COBELLI, C. (2001). Global identifiability of nonlinear models of biological systems. IEEE Trans. Biomed. Eng. 48 55-65.
4. BABENKO, V. F., KOFANOV, V. A. and PICHUGOV, S. A. (1996). Multivariate inequalities of Kolmogorov type and their applications. In Multivariate Approximation and Splines (G. Nuraberger, J. W. Schmidt and G. Walz, eds.) 1-12. Birkhauser, Basel. MR1484990
5. BARD, Y. (1974). Nonlinear Parameter Estimation. Academic Press, New York. MR0326870
6. BELLMAN, R. and ÅSTRÖM, K. J. (1970). On structural identifiability. Math. Biosci. 7 329-339.
7. BENSON, M. (1979). Parameter fitting in dynamic models. Ecol. Mod. 6 97-115.
8. BICKEL, P. J., KLAASSEN, C. A. J., RITOV, Y. and WELLNER, J. A. (1993). Efficient and Adaptive Estimation for Semiparametric Models. Johns Hopkins Univ. Press, Baltimore. MR1245941
9. BROOKMEYER, R. and GAIL, M. H. (1994). AIDS Epidemiology: A Quantitative Approach. Monographs in Epidemiology and Biostatistics 23. Oxford Univ. Press, New York.
10. BRUNEL, N. (2008). Parameter estimation of ODE's via nonparametric estimators. Electron. J. Statist. 2 1242-1267. MR2471285
11. BURNHAM, K. P. and ANDERSON, D. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociol. Methods Res. 33 261. MR2086350
12. CHAPPEL, M. J. and GODFREY, K. R. (1992). Structural identifiability of the parameters of a nonlinear batch reactor model. Math. Biosci. 108 245-251. MR1154720
13. CHEN, J. and WU, H. (2008). Efficient local estimation for time-varying coefficients in deterministic dynamic models with applications to HIV-1 dynamics. J. Amer. Statist. Assoc. 103 369-384. MR2420240
14. CHEN, T., HE, H. L. and CHURCH, G. M. (1999). Modeling gene expression with differential equations. Pac. Symp. Biocomput. 29-40.
15. COBELLI, C., LEPSCHY, A. and JACUR, R. (1979). Identifiability of compartmental systems and related structural proerties. Math. Biosci. 44 1-18.
16. DALEY, D. J. and GANI, J. (1999). Epidemic Modeling. Cambridge Univ. Press, Cambridge.
17. DE BOOR, C. (1978). A Practical Guide to Splines. Springer, New York. MR0507062
18. DELGADO, M. A. (1992). Semiparametric generalized least squares in the multivariate nonlinear regression model. Econometric Theory 8 203-222. MR1179510
19. DONNET, S. and SAMSON, A. (2007). Estimation of parameters in incomplete data models defined by dynamical systems. J. Statist. Plann. Inference 137 2815-2831. MR2323793
20. ENGLEZOS, P. and KALOGERAKIS, N. (2001). Applied Parameter Estimation for Chemical Engineers. Dekker, New York.
21. GRENANDERV, U. (1981). Abstract Inference. Wiley, New York. MR0599175
22. HAIRER, E., NøRSETT, S. P. and WANNER, G. (1993). Solving Ordinary Differential Equations I: Nonstiff Problems, 2nd ed. Springer, Berlin. MR1227985
23. HE, X., FUNG, W. K. and ZHU, Z. Y. (2002). Estimation in a semiparametric model for longitudinal data with unspecified dependence structure. Biometrika 89 579-590. MR1929164
24. HECKMAN, N. E. and RAMSAY, J. O. (2000). Penalized regression with model-based penalties. Canad. J. Statist. 28 241-258. MR1792049
25. HO, D. D., NEUMANN, A. U., PERELSON, A. S. ET AL. (1995). Rapid turnover of plasma virions and CD4 lymphocytes in HIV-1 infection. Nature 373 123-126.
26. HUANG, J. (1996). Efficient estimation for the proportinal hazards model with interval censoring. Ann. Statist. 24 540-568. MR1394975
27. HUANG, J. (1999). Efficient estimation of the partly linear additive Cox model. Ann. Statist. 27 1536-1563. MR1742499
28. HUANG, J. and ROSSINI, A. J. (1997). Sieve estimation for the proportional-odds failure-time regression model with interval censoring. J. Amer. Statist. Assoc. 92 960-967. MR1482126
29. HUANG, J. Z. (2003). Local asymptotics for polynomial spline regression. Ann. Statist. 31 1600-1635. MR2012827
30. HUANG, J. Z., ZHANG, L. and ZHOU, L. (2007). Efficient estimation in marginal partially linear models for longitudinal/clustered data using plines. Scand. J. Statist. 34 451-477. MR2368793
31. HUANG, Y., LIU, D. and WU, H. (2006). Hierarchical Bayesian methods for estimation of parameters in a longitudinal HIV dynamic system. Biometrics 62 413-423. MR2227489
32. HUANG, Y., ROSENKRANZ, S. L. and WU, H. (2003). Modeling HIV dynamics and antiviral response with consideration of time-varying drug exposures, adherence and phenotypic sensitivity. Math. Biosci. 184 165-186
33. HUBER, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. In Proc. Fifth Berkeley Symp. Math. Statist. Probab. 221-233. Univ. California Press, Berkeley. MR0216620
34. JANSSON, B. and REVESZ, L. (1975). Analysis of the growth of tumor cell populations. Math. Biosci. 19 131-154.
35. JEFFREY, A. M. and XIA, X. (2005). Identifiability of HIV/AIDS model. In Deterministic and Stochastic Models of AIDS Epidemics and HIV Infections with Intervention (W. Y. Tan and H. Wu, eds.) 255-286. World Scientific, Singapore.
36. JENNERICH, R. I. (1969). Asymptotic properties of non-linear least squares estimators. Ann. Math. Statist. 40 633-643. MR0238419
37. JOLLIFFE, I. T. (1972). Discarding variables in a principal component analyssis. I: Artificial data. J. Roy. Statist. Soc. Ser. C Appl. Statist. 21 160-172. MR0311034
38. JOSHI, M., SEIDEL-MORGENSTERN, A. and KREMLING, A. (2006). Exploiting the boostrap method for quantifying parameter confidence intervals in dynamic systems. Metabolic Engineering 8 447-455.
39. KOLCHIN, E. (1973). Differential Algebra and Algebraic Groups. Academic Press, New York. MR0568864
40. KUTTA, W. (1901). Beitrag zur näherungsweisen itegration totaler differentialgleichungen. Zeitschr. Math. Phys. 46 435-453.
41. LI, L., BROWN, M. B., LEE, K. H. and GUPTA, S. (2002). Estimation and inference for a splineenhanced pupulation pharmacokinetic model. Biometrics 58 601-611. MR1933534
42. LI, Z., OSBORNE, M. R. and PRAVAN, T. (2005). Parameter estimation of ordinary differential equations. IMA J. Numer. Anal. 25 264-285. MR2126204
43. LIANG, H. and WU, H. (2008). Parameter estimation for differential equation models using a framework of measurement error in regression models. J. Amer. Statist. Assoc. 103 1570-1583. MR2504205
44. LJUNG, L. and GLAD, T. (1994). On global identifiability for arbitrary model parametrizations. Automatica 30 265-276. MR1261705
45. MA, S. and KOSOROK, M. R. (2005). Robust semiparametric M-estimation and the weighted bootstrap. J. Multivariate Anal. 96 190-217. MR2202406
46. MALINVAUD, E. (1970). The consistancy of nonlinear regressions. Ann. Math. Statist. 41 956-969. MR0261754
47. MATTHEIJ, R. and MOLENAAR, J. (2002). Ordinary Differential Equations in Theory and Practice. SIAM, Philadelphia. MR1946758
48. MIAO, H., DYKES, C., DEMETER, L. M., CAVENAUGH, J., PARK, S. Y., PERELSON, A. S. and WU, H. (2008). Modeling and estimation of kinetic parameters and replicative fitness of HIV-1 from flow-cytometry-based growth competition experiments. Bull. Math. Biol. 70 1749-1771. MR2430325
49. MICHELSON, S. and LEITH, J. T. (1997). Tumor heterogeneity and growth control. In Tumor Heterogeneity and Growth Control (J. A. Adam and N. Bellomo, eds.) 295-326. Birkhäuser, Boston.
50. MOLES, C. G., BANGA, J. R. and KELLER, K. (2004). Solving nonconvex climate control problems: Pitfalls and algorithm performances. Appl. Soft. Comput. 5 35-44.
51. NOWAK, M. A. and MAY, R. M. (2000). Virus Dynamics: Mathematical Principles of Immunology and Virology. Oxford Univ. Press, Oxford. MR2009143
52. OLLIVIER, F. (1990). Le problème de l'identifiabilité globale: étude thé orique, méthodes effectives et bornes de complexité. Ph. D. thesis, école Polytechnique, Paris, France.
53. PAKES, A. and POLLARD, D. (1989). Simulation and the asymptotics of optimization estimators. Econometrica 57 1027-1057. MR1014540
54. PERELSON, A. S., ESSUNGER, P., CAO, Y., VESANEN, M., HURLEY, A., SAKSELA, K., MARKOWITZ, M. and HO, D. D. (1997). Decay characteristics of HIV-1-infected compartments during combination therapy. Nature 387 188-191
55. PERELSON, A. S. and NELSON, P. W. (1999). Mathematical analysis of HIV-1 dynamics in vivo. SIAM Rev. 41 3-44. MR1669741
56. PERELSON, A. S., NEUMANN, A. U., MARKOWITZ, M., LEONARD, J. M. and HO, D. D. (1996). HIV-1 dynamics in vivo: Virion clearance rate, infected cell life-span, and viral generation time. Science 271 1582-1586.
57. POHJANPALO, H. (1978). System identifiability based on the power series expansion of the solution. Math. Biosci. 41 21-33. MR0507373
58. POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York. MR0762984
59. POLLARD, D. (1985). New ways to prove central limit theorems. Econometric Theory 1 295-314.
60. POLLARD, D. (1990). Empirical Processes Theory and Applications. IMS, Hayward, CA. MR1089429
61. POYTON, A. A., VARZIRI, M. S., MCAULEY, K. B., MCLELLEN, P. J. and RAMSAY, J. O. (2006). Parameter estimation in continuous-time dynamic models using principal differential analysis. Computers and Chemical Engineering 30 698-708.
62. PUTTER, H., HEISTERKAMP, S. H., LANGE, J. M. and DE WOLF, F. (2002). A Bayesian approach to parameter estimation in HIV dynamical models. Stat. Med. 21 2199-2214.
63. QUAISER, T. and MÖNNIGMANN, M. (2009). Systematic identifiability testing for unambiguous mechanistic modeling-application to JAK-STAT, MAP kinase, and NF-κB signaling pathway models. BMC Sys. Bio. 3 50.
64. RAMSAY, J. O. (1996). Principal Differential Analysis: Data Reduction by Differential Operators. J. Roy. Statist. Soc. Ser. B 58 495-508. MR1394362
65. RAMSAY, J. O., HOOKER, G., CAMPBELL, D. and CAO, J. (2007). Parameter estimation for differential equations: A generalized smoothing approach (with discussion). J. R. Stat. Soc. Ser. B Stat. Methodol. 69 741-796. MR2368570
66. RITT, J. F. (1950). Differential Algebra. Amer. Math. Soc., Providence, RI. MR0035763
67. RODRIGUEZ-FERNANDEZ, M., EGEA, J. A. and BANGA, J. R. (2006). Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems. BMC Bioinformatics 7 1-18.
68. RUNGE, C. (1895). Ueber die numerische Auflösung von Differentialgleichungen. Math. Ann. 46 167-178. MR1510879
69. SCHICK, A. (1986). On asymptotically efficient estimation in semiparametric models. Ann. Statist. 14 1139-1151. MR0856811
70. SCHUMAKER, L. L. (1981). Spline Functions. Wiley, New York. MR0606200
71. SHEN, X. (1997). On methods of sieves and penalization. Ann. Statist. 25 2555-2591. MR1604416
72. SHEN, X. and WONG, W. H. (1994). Convergence rate of sieve estimates. Ann. Statist. 22 580-615. MR1292531
73. STONE, C. J. (1982). Optimal global rates of convergence for nonparametric regression. Ann. Statist. 10 1040-1053. MR0673642
74. STONE, C. J. (1985). Additive regression and other nonparametric models. Ann. Statist. 13 689-705. MR0790566
75. STORN, R. and PRICE, K. (1997). Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11 341-359. MR1479553
76. SWARTZ, J. and BREMERMANN, H. (1975). Discussion of parameter estimation in biological modeling: Algorithms for estimation and evaluation of the estimates. J. Math. Biol. 1 241-275.
77. TAN, W. Y. and WU, H. (2005). Deterministic and Stochastic Models of AIDS Epidemics and HIV Infections With Intervention. World Scientific, Singapore. MR2169300
78. THOMASETH, K., ALEXANDRA, K. W., BERNHARD, L. ET AL. (1996). Integrated mathematical model to assess β-cell activity during the oral glucose test. Amer. J. Phisiol. 270 E522-E531.
79. VAJDA, S., RABITZ, H., WALTER, E. and LECOURTIER, Y. (1989). Qualitative and quantitative identifiability analysis of nonlinear chemical kinetiv-models. Chem. Eng. Commun. 83 191-219.
80. VAN DER VAART, A. W. and WELLNER, J. A. (1996). Weak Convergence and Empirical Processes. Springer, New York. MR1385671
81. VAN DOMSELAAR, B. and HEMKER, P. W. (1975). Nonlinear parameter estimation in initial value problmes. Report NW18/75, Math. Centrum, Amsterdam.
82. VARAH, J. M. (1982). A spline least squares method for numerical parameter estimation in differential equations. SIAM J. Sci. Comput. 3 28-46. MR0651865
83. VARZIRI, M. S., POYTON, A. A., MCAULEY, K. B., MCLELLEN, P. J. and RAMSAY, J. O. (2008). Selecting optimal weighting factors in iPDA for parameter estimation in continuous-time dynamic models. Comp. Chem. Eng. 32 3011-3022.
84. WALTER, E. (1987). Identifiability of Parameteric Models. Pergamon Press, Oxford.
85. WEI, X., GHOSH, S. K., TAYLOR, M. E. ET AL. (1995). Viral dynamics in human immunodeficiency virus type 1 infection. Nature 373 117-122.
86. WELLNER, J. A. and ZHANG, Y. (2007). Two likelihood-based semiparametric estimation methods for panel count data with covariates. Ann. Statist. 35 2106-2142. MR2363965
87. WU, C. F. (1981). Asymptotic theory of nonlinear least squares estiamtion. Ann. Statist. 9 501-513. MR0615427
88. WU, H. (2005). Statistical methods for HIV dynamic studies in AIDS clinical trials. Stat. Methods Med. Res. 14 1-22. MR2135921
89. WU, H., HUANG, Y., ACOSTA, E. P. ET AL. (2005). Modeling long-term HIV dynamics and antiretroviral response: Effects of drug potency, pharmacokinetics, adherence, and drug resistance. JAIDS 39 272-283.
90. WU, H., ZHU, H., MIAO, H. and PERELSON, A. S. (2008). Identifiability and statistical estimation of dynamic parameters in HIV/AIDS dynamic models. Bull. Math. Biol. 70 785-799. MR2393024
91. XIA, X. (2003). Estimation of HIV/AIDS parameters. Automatica J. IFAC 39 1983-1988. MR2142834
92. XIA, X. and MOOG, C. H. (2003). Identifiability of nonlinear systems with applications to HIV/AIDS models. IEEE Trans. Automat. Control 48 330-336. MR1957979
93. XUE, H., LAM, K. F. and LI, G. (2004). Sieve maximum likelihood estimator for semiparametric regression models with current status data. J. Amer. Statist. Assoc. 99 346-356. MR2062821