High-dimensional ODEs coupled with mixed-effects modeling techniques for dynamic gene regulatory network identification

Journal of the American Statistical Association

Volumn 106, Issue 496, 2011, Pages 1242-1258

  Lu, Tao ^a   Liang, Hua ^a   Li, Hongzhe ^b   Wu, Hulin ^a  

^a UNIVERSITY OF ROCHESTER SCHOOL OF MEDICINE AND DENTISTRY   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Differential equations; Network graph; Nonparametric; Nonparametric mixed effects; Saccharomyces cerevisiae; Smoothly clipped absolute deviation; Stochastic approximation EM; Time course microarray data; Two stage smoothing based method; Yeast cell cycles

Indexed keywords

EID: 84862970480     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2011.ap10194     Document Type: Article

References (74)

1. An, L. T. H., and Tao, P. D. (1997), "Solving a Class of Linearly Constrained Indefinite Quadratic Problems by DC Algorithms," Journal of Global Optimization, 11, 253-285. [1246]
2. Arnone, M. I., and Davidson, E. H. (1997), "The Hardwiring of Development: Organization and Function of Genomic Regulatory Systems," Development, 124, 1851-1864. [1243]
3. Bansal, M., Della Gatta, G., and di Bernardo, D. (2006), "Inference of Gene Regulatory Networks and Compound Mode of Action From Time Course Gene Expression Profiles," Bioinformatics, 22, 815-822. [1246]
4. Bertsekas, D. P. (1999), Nonlinear Programming (2nd ed.), Belmount, MA: Athena Scientific. [1255]
5. Bornholdt, S. (2008), "Boolean Network Models of Cellular Regulation: Prospects and Limitations," Journal of the Royal Society Interface, 5 (Suppl 1), S85-S94. [1242]
6. Breiman, L. (1996), "Heuristics of Instability and Stabilization in Model Selection," The Annals of Statistics, 24, 2350-2383. [1246]
7. Brumback, B. A., and Rice, J. A. (1998), "Smoothing Spline Models for the Analysis of Nested and Crossed Samples of Curves" (with discussion), Journal of the American Statistical Association, 93, 961-994. [1244]
8. Carthew, R. W., and Sontheimer, E. J. (2009), "Origins and Mechanisms of miRNAs and siRNAs," Cell, 136, 642-655.[1242]
9. Chen, J., and Wu, H. (2008a), "Efficient Local Estimation for Time-Varying Coefficients in Deterministic Dynamic ModelsWith Applications to HIV-1 Dynamics," Journal of the American Statistical Association, 103, 369-384. [1244,1245]
10. Chen, J., and Wu, H. (2008b), "Estimation of Time-Varying Parameters in Deterministic Dynamic Models," Statistica Sinica, 18, 987-1006. [1244,1245]
11. Chi, Y. Y., Ibrahim, J. G., Bissahoyo, A., and Threadgill, D. W. (2007), "Bayesian Hierarchical Modleing for Time Course Microarray Experiments," Biometrics, 63, 496-504. [1242]
12. DeJong, H. (2002), "Modeling and Simulation of Genetic Regulatory Systems: A Literature Review," Journal of Computational Biology, 9, 67-103. [1243, 1248]
13. Delyon, B., Lavielle, M., and Moulines, E. (1999), "Convergence of a Stochastic Approximation Version of the EM Algorithm," The Annals of Statistics, 27, 94-128. [1244,1247]
14. D'Haeseleer, P., Wen, X., Fuhrman, S., and Somogyi, R. (1999), "Linear Modeling of mRNA Expression Levels During CNS Development and Injury," Pacific Symposium on Biocomputing, 4, 41-52. [1246]
15. Donnet, S., and Samson, A. (2007), "Estimation of Parameters in Incomplete Data Models Defined by Dynamical Systems," Journal of Statistical Planning and Inference, 137, 2815-2831. [1244,1247]
16. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal of the American Statistical Association, 96, 1348-1360. [1244-1246]
17. Frank, I., and Friedman, J. (1993), "A Statistical View of Some Chemometrics Regression Tools" (with discussion), Technometrics, 35, 109-148. [1246]
18. Friedman, N., Linial, M., Nachman, I., and Peer, D. (2000), "Using Bayesian Networks to Analyze Expression Data," Journal of Computational Biology, 7, 601-620. [1242,1248]
19. Gene Ontology Consortium (2000), "Gene Ontology: Tool for the Unification of Biology," Nature Genetics, 25, 25-29. [1247,1248]
20. Gu, C. (2002), Smoothing Spline ANOVA Models, New York: Springer-Verlag. [1244]
21. Gu, C., and Ma, P. (2005), "Optimal Smoothing in Nonparametric Mixed-Effect Models," The Annals of Statistics, 33, 1357-1379. [1244]
22. Hartemink, A., Gifford, D., Jaakkola, T., and Young, R. (2001), "Using Graphical Models and Genomic Expression Data to Statistically Validate Models of Genetic Regulatory Networks," Pacific Symposium on Biocomputing, 6, 422-433. [1242]
23. Heard, N. A., Holmes, C. C., and Stephens, D. A. (2006), "A Quantitative Study of Gene Regulation Involved in The Immune Response of Anopheline Mosquitoes: An Application of Bayesian Hierarchical Clustering of Curves," Journal of the American Statistical Association, 101, 18-29. [1242]
24. Hecker, M., Lambeck, S., Toepfer, S., van Someren, E., and Guthke, R. (2009), "Gene Regulatory Network Inference: Data Integration in Dynamic Models-a Review," Biosystems, 96, 86-103. [1242]
25. Heckerman, D. (1996), "A Tutorial on Learning With Bayesian Networks," Technical Report MSR-TR-95-06, Microsoft Research. [1242]
26. Hirose, O., Yoshida, R., Imoto, S., Yamaguchi, R., Higuchi, T., Charnock- Jones, D. S., Print, C., andMiyano, S. (2008), "Statistical Inference of TranscriptionalModule- Based Gene Networks From Time Course Gene Expression Profiles by Using State Space Models," Bioinformatics, 24, 932-942.[1243]
27. Holter, N. S., Maritan, A., Cieplak, M., Fedoroff, N. V., and Banavar, J. R. (2001), "Dynamic Modeling of Gene Expression Data," Proceedings of the National Academy of Sciences of the United States of America, 98, 1693-1698. [1243,1248]
28. Hong, F., and Li, H. (2006), "Functional Hierarchical Models for Identifying Genes With Different Time-Course Expression Profiles," Biometrics, 62, 534-544. [1242]
29. Imoto, S., Sunyong, K., Goto, T., Aburatani, S., Tashiro, K., Kuhara, S., and Miyano, S. (2003), "Bayesian Network and Nonparametric Heteroscedastic Regression for Nonlinear Modeling of Genetic Network," Journal of Bioinformatics and Computational Biology, 6, 231-252. [1243]
30. James, G. M., and Sugar, C. A. (2003), "Clustering for Sparsely Sampled Functional Data," Journal of the American Statistical Association, 98, 397-408. [1242,1244]
31. Kauffman, S. A. (1969), "Metabolic Stability and Epigenesis in Randomly Constructed Genetic Nets," Journal of Theoretical Biology, 22, 437-467. [1242]
32. Kim, Y., Choi, H., and Oh, H.-S. (2008), "Smoothly Clipped Absolute Deviation on High Dimensions," Journal of the American Statistical Association, 103, 1665-1673. [1244-1246,1255,1256]
33. Kojima, K., Yamaguchi, R., Imoto, S., Yamauchi, M., Nagasaki, M., Yoshida, R., Shimamura, T., Ueno, K., Higuchi, T., Gotoh, N., andMiyano, S. (2009), "A State Space Representation of VAR Models With Sparse Learning for Dynamic Gene Networks," Genome Informatics, 22, 56-68. [1243]
34. Kuhn, E., and Lavielle, M. (2005), "Coupling a Stochastic Approximation Version of EM With a MCMC Procedure," ESAIM: Probability and Statistics, 8, 115-131. [1244,1247]
35. Lee, T. I., Rinaldi, N. J., Robert, F., Odom, D. T., Bar-Joseph, Z., Gerber, G. K., Hannett, N. M., Harbison, C. T., Thompson, C. M., Simon, I., Zeitlinger, J., Jennings, E. G., Murray, H. L., Gordon, D. B., Ren, B., Wyrick, J. J., Tagne, J.-B., Volkert, T. L., Fraenkel, E., Gifford, D. K., and Young, R. A. (2002), "Transcriptional Regulatory Networks in Saccharomyces Cerevisiae," Science, 298, 799-804. [1252]
36. Liang, H., and Wu, H. (2008), "Parameter Estimation for Differential Equation Models Using a Framework of Measurement Error in Regression Models," Journal of the American Statistical Association, 103, 1570-1583. [1244-1246,1254,1256]
37. Liu, X. L., and Yang, M. C. K. (2009), "Identifying Temporally Differentially Expressed Genes Through Functional Principal Components Analysis," Biostatistics, 10, 667-679. [1242]
38. Luan, Y., and Li, H. (2004), "Model-Based Methods for Identifying Periodically Expressed Genes Based on Time Course Microarray Gene Expression Data," Bioinformatics, 20, 332-339. [1242-1244]
39. Ma, P., and Zhong, W. (2008), "Penalized Clustering of Large-Scale Functional Data With Multiple Covariates," Journal of the American Statistical Association, 103, 625-636. [1242-1244,1248]
40. Ma, P., Castillo-Davis, C. I., Zhong, W., and Liu, J. S. (2006), "A Data-Driven Clustering Method for Time Course Gene Expression Data," Nucleic Acids Research, 34, 1261-1269. [1242-1244,1248]
41. Meinshausen, N., and Bühlmann, P. (2006), "High-Dimensional Graphs and Variable Selection With the Lasso," The Annals of Statistics, 34, 1436-1462. [1246]
42. Müller, H., Chiou, J. M., and Leng, X. (2008), "Inferring Gene Experssion Dynamics via Functional Regression Analysis," BMC Bioinformatics, 9, 60. [1242]
43. Needham, C. J., Bradford, J. R., Bulpitt, A. J., and Westhead, D. R. (2007), "A Primer on Learning in Bayesian Networks for Computational Biology," PLoS Computational Biology, 3, e129. [1243]
44. Orlando, D. A., Lin, C. Y., Bernard, A., Wang, J. Y., Socolar, J. E. S., Iversen, E. S., Hartemink, A. J., and Haase, S. B. (2008), "Global Control of Cell- Cycle Transcription by Coupled CDK and Network Oscillators," Nature, 453, 944-947. [1252]
45. Ramsay, J. O., Hooker, G., Campbell, D., and Cao, J. (2007), "Parameter Estimation for Differential Equations: A Generalized Smoothing Approach" (with discussion), Journal of the Royal Statistical Society, Ser. B, 69, 741-796. [1254]
46. Rosset, S., and Zhu, J. (2007), "Piecewise Linear Regularized Solution Paths," The Annals of Statistics, 35, 1012-1030. [1246]
47. Sakamoto, E., and Iba, H. (2001), "Inferring a Systems of Differential Equations for a Gene Regulatory Network by Using Genetic Programming," in Proceedings of the IEEE Congress on Evolutionary Computation, IEEE Press, pp. 720-726. [1243]
48. Samson, A., Lavielle, M., and Mentré, F. (2006), "Extension of the SAEM Algorithm to Left-Censored Data in Nonlinear Mixed-Effects Model: Application to HIV Dynamics Model," Computational Statistics & Data Analysis, 51, 1562-1574. [1244,1247]
49. Shimamura, T., Imoto, S., Yamaguchi, R., Fujita, A., Nagasaki, M., and Miyano, S. (2009), "Recursive Regularization for Inferring Gene Networks From Time-Course Gene Expression Profiles," BMC Systems Biology, 3, 41-54. [1243]
50. Simon, I., Barnett, J., Hannett, N., Harbison, C. T., Rinaldi, N. J., Volkert, T. L., Wyrick, J. J., Zeitlinger, J., Gifford, D. K., Jaakkola, T. S., and Young, R. A. (2001), "Serial Regulation of Transcriptional Regulators in the Yeast Cell Cycle," Cell, 106, 697-708. [1252]
51. Sokal, R., and Rohlf, F. (1995), Biometry: The Principles and Practice of Statistics in Biological Research (3rd ed.), New York: Freeman. [1247]
52. Spellman, P. T., Sherlock, G., Zhang, M. Q., Iyer, V. R., Anders, K., Eisen, M. B., Brown, P. O., Botstein, D., and Futcher, B. (1998), "Comprehensive Identification of Cell Cycle-Regulated Genes of the Yeast Saccharomyces Cerevisiae by Microarray Hybridization," Molecular Biology of the Cell, 9, 3273-3297. [1248]
53. Spieth, C., Hassis, N., and Streichert, F. (2006), "Comparing Mathematical Models on the Problem of Network Inference," in Proceedings of 8th Annual Conference on Genetic and Evolutionary Computation, New York: ACM Press, pp. 279-285. [1243]
54. Steuer, R., Kurths, J., Daub, C. O., Weise, J., and Selbig, J. (2002), "TheMutual Information: Detecting and Evaluating Dependencies Between Variables," Bioinformatics, 18, S231-S240. [1242]
55. Storey, J. D., Xiao, W., Leek, J. T., Tompkins, R. G., and Davis, R. W. (2005), "Significance Analysis of Time Course Microarray Experiments," Proceedings of the National Academy of Sciences of the United States of America, 102, 12837-12842. [1242]
56. Stuart, J. M., Segal, E., Koller, D., and Kim, S. K. (2003), "A Gene- Coexpression Network for Global Discovery of Conserved Genetic Modules," Science, 302, 249-255. [1242]
57. Tai, Y., and Speed, T. (2009), "On Gene Ranking Using Replicated Microarray Time Course Data," Biometrics, 65, 40-51. [1242]
58. Thomas, R. (1973), "Boolean Formalization of Genetic Control Circuits," Journal of Theoretical Biology, 42, 563-585. [1242]
59. Tibshirani, R. J. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Ser. B, 58, 267-288. [1246]
60. Varah, J. M. (1982), "A Spline Least Squares Method for Numerical Parameter Estimation in Differential Equations," SIAM Journal on Scientific and Statistical Computing, 3, 28-46. [1244]
61. Voit, E. O. (2000), Computational Analysis of Biochemical Systems: A Practical Guide for Biochemists and Molecular Biologists, Cambridge: Cambridge University Press. [1243]
62. Wang, Y. (1998), "Mixed Effects Smoothing Spline Analysis of Variance," Journal of the Royal Statistical Society, Ser. B, 60, 159-174. [1244]
63. Weaver, D. C., Workman, C. T., and Stormo, G. D. (1999), "Modeling Regulatory Networks With Weight Matrices," Pacific Symposium on Biocomputing, 4, 112-123. [1243]
64. Werhli, A. V., and Husmeier, D. (2007), "Reconstructing Gene Regulatory Networks With Bayesian Networks by Combining Expression Data With Multiple Sources of Prior Knowledge," Statistical Applications in Genetics and Molecular Biology, 6, Article 15. [1243,1248]
65. Wessels, L. F., van Someren, E. P., and Reinders, M. J. (2001), "A Comparison of Genetic Network Models," Pacific Symposium on Biocomputing, 6, 508-519. [1246]
66. Wu, H., and Zhang, J. T. (2002), "Local Polynomial Mixed-Effects Models for Longitudinal Data," Journal of the American Statistical Association, 97, 883-897. [1244]
67. Wu, H., and Zhang, J. T. (2006), Nonparametric Regression Methods for Longitudinal Data Analysis. Wiley Series in Probability and Statistics, Hoboken, NJ: Wiley. [1244,1245,1255]
68. Xue, H., Miao, H., and Wu, H. (2010), "Sieve Estimation of Constant and Time- Varying Coefficients in Nonlinear Ordinary Differential Equation Models by Considering Both Numerical Error and Measurement Error," The Annals of Statistics, 38, 2351-2387. [1254]
69. Yao, F., Müller, H. G., and Wang, J. L. (2005), "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, 100, 577-590. [1242,1248]
70. Yeung, M. K. S., Tegner, J., and Collins, J. J. (2002), "Reverse Engineering Gene Networks Using Singular Value Decomposition and Robust Regression," Proceedings of the National Academy of Sciences of the United States of America, 99, 6163-6168. [1243,1248]
71. Yuan, M., and Kendziorski, C. (2006), "Hidden Markov Models for Microarray Time Course Data in Multiple Biological Conditions," Journal of the American Statistical Association, 101, 1323-1332. [1242]
72. Zhao, P., and Yu, B. (2006), "On Model Selection Consistency of Lasso," Journal of Machine Learning Research, 7, 2541-2563. [1255]
73. Zou, H. (2006), "The Adaptive LASSO and Its Oracle Properties," Journal of the American Statistical Association, 101, 1418-1429. [1246]
74. Zou, M., and Conzen, S. D. (2005), "A New Dynamic Bayesian Network (DBN) Approach for Identifying Gene Regulatory Networks From Time Course Microarray Data," Bioinformatics, 21, 71-79. [1243]