A sparse structured shrinkage estimator for nonparametric varying-coefficient model with an application in genomics

Journal of Computational and Graphical Statistics

Volumn 21, Issue 1, 2012, Pages 110-133

  John Daye, Z ^a   Xie, Jichun ^a   Li, Hongzhe ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

High dimensional data; Model selection; Motif analysis; Nonparametric regression; Sparsity; Structured covariates

Indexed keywords

EID: 84859876027     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2011.10102     Document Type: Article

References (48)

1. Bach, F. R. (2008), "Consistency of the Group Lasso and Multiple Kernel Learning," Journal of Machine Learning Research, 9, 1179-1225. [117]
2. Bickel, P. J., Ritov, Y., and Tsybakov, A. (2009), "Simultaneous Analysis of Lasso and Dantzig Selector," The Annals of Statistics, 37, 1705-1732. [118]
3. Bussemaker, H. J., Li, H., and Siggia, E. D. (2001), "Regulatory Element Detection Using Correlation With Expression," Nature Genetics, 27, 167-171. [124,126,130]
4. Cai, Z.W., Fan, J. Q., and Li, R. Z. (2000), "Efficient Estimation and Inferences for Varying-Coefficient Models," Journal of the Royal Statistical Society, Ser. B, 95, 888-902. [111]
5. Carroll, R. J., Fan, J., Gijbels, I., and Wand, M. P. (1997), "Generalized Partially Linear Single-Index Models," Journal of the American Statistical Association, 92, 477-489. [130]
6. Chen, Z., and Chen, J. (2009), "Tournament Screening cum EBIC for Feature Selection With High Dimensional Feature Spaces," Science in China, Ser. A: Mathematics, 52, 1327-1341. [126]
7. Conlon, E. M., Liu, X. S., Lieb, J. D., and Liu, J. S. (2003), "Integrating Regulatory Motif Discovery and Genome-Wide Expression Analysis," Proceedings of the National Academy of Science of the USA, 100, 3339-3344. [124,126,130]
8. Daye, Z. J., and Jeng, X. J. (2008), "Shrinkage and Model Selection With Correlated Variables via Weighted Fusion," Computational Statistics and Data Analysis, 53, 1284-1298. [130]
9. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," The Annals of Statistics, 32, 407-499. [111]
10. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal of the American Statistical Association, 96, 1348-1360. [130]
11. Fan, J., and Lv, J. (2008), "Sure Independence Screening for Ultra-High Dimensional Feature Space," Journal of the Royal Statistical Society, Ser. B, 70, 849-911. [126]
12. Fan, J., and Zhang, W. (2008), "Statistical Methods With Varying Coefficient Models," Statistics and Its Interface, 1, 179-195. [111]
13. Friedman, J., Hastie, T., Hoefling, H., and Tibshirani, R. (2007), "Pathwise Coordinate Optimization," The Annals of Applied Statistics, 1, 302-332. [111]
14. Friedman, J., Hastie, T., and Tibshirani, R. (2010), "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, 33 (1), 1-22. [113]
15. Hamada, M., and Wu, C. (1992), "Analysis of Designed ExperimentsWith Complex Aliasing," Journal of Quality Technology, 24, 130-137. [130]
16. Hastie, T., and Tibshirani, R. (1990), Generalized Additive Models, Boca Raton, FL: Chapman & Hall/CRC. [130]
17. Hastie, T., and Tibshirani, R. (1993), "Varying-Coefficient Models," Journal of the Royal Statistical Society, Ser. B, 55, 757-796. [111]
18. Hebiri, M., and van de Geer, S. (2010), The Smooth-Lasso and Other ℓ1 + ℓ2-Penalized Methods, unpublished manuscript, available at arXiv:1003.4885v1. [118]
19. Hoover, D. R., Rice, J.A., Wu, C. O., and Yang, L. (1998), "Nonparametric Smoothing Estimates of Time-Varying Coefficient Models With Longitudinal Data," Biometrika, 85, 809-822. [111]
20. Huang, J., Horowitz, J. L., and Wei, F. (2010), "Variable Selection in Nonparametric Additive Models," The Annals of Statistics, 38, 2282-2313. [112,113]
21. Huang, J. Z., Wu, C. O., and Zhou, L. (2004), "Polynomial Spline Estimation and Inference for Varying Coefficient Models With Longitudinal Data," Statistica Sinica, 14, 763-788. [119]
22. Kechris, K., van Zwet, E., Bickel, P., and Eisen, M. B. (2004), "Detecting DNA Regulatory Motifs by Incorporating Positional Trends in Information Content," Genome Biology, 5, R50. [125]
23. Land, S., and Friedman, J. (1996), "Variable Fusion: A New Method of Adaptive Signal Regression," technical report, Dept. of Statistics, Stanford University. [111,113]
24. Li, C., and Li, H. (2008), "Network-Constrained Regularization and Variable Selection for Analysis of Genomic Data," Bioinformatics, 24, 1175-1182. [111]
25. Li, C., and Li, H. (2010), "Variable Selection and Regression Analysis for Graph-Structured Covariates With an Application to Genomics," The Annals of Applied Statistics, 4, 1498-1516. [112]
26. Li, F., and Zhang, N. R. (2010), "Bayesian Variable Selection in Structured High-Dimensional Covariate Spaces With Applications in Genomics," Journal of the American Statistical Association, 105, 1202-1214. [125, 127,130,131]
27. Meier, L., van de Geer, S., and Bühlmann, P. (2009), "High-Dimensional Additive Modeling," The Annals of Statistics, 37, 3779-3821. [112,113]
28. Meinshausen, N., and Buhlmann, P. (2006), "High Dimensional Graphs and Variable Selection With the Lasso," The Annals of Statistics, 34, 1436-1462. [111]
29. Mirny, L., and Gelfand, M. (2002), "Structural Analysis of Conserved Base Pairs in Protein-DNA Complexes," Nucleic Acids Research, 30, 1704-1711. [125]
30. Moses, A., Chiang, D., Kellis, M., Lander, E., and Eisen, M. (2003), "Position Specific Variation in the Rate of Evolution in Transcription Factor Binding Sites," BMC Evolutionary Biology, 3, 19. [125]
31. Nocedal, J., and Wright, S. (1999), Numerical Optimization, New York: Springer. [115]
32. Ravikumar, P., Lafferty, J., Liu, H., and Wasserman, L. (2009), "Sparse Additive Models," Journal of the Royal Statistical Society, Ser. B, 71, 1009-1030. [112,113]
33. Rosset, S., and Zhu, J. (2007), "Piecewise Linear Regularized Solution," The Annals of Statistics, 35, 1012-1030. [111]
34. Ruppert, D. (2002), "Selecting the Number of Knots for Penalized Splines," Journal of Computational and Graphical Statistics, 11, 735-757. [116]
35. Spellman, P. T., Sherlock, G., Zhang, M. Q., Iyer, V. R., Anders, K., Eisen, M. B., Brown, P. O., Botstein, D., and Futcher, B. (1998), "Comprehensive Identification of Cell Cycle-Regulated Genes of the Yeast Saccharomyces Cerevisiae by Microarray Hybridization," Molecular Biology of the Cell, 9, 3273-3297. [125]
36. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Ser. B, 58, 267-288. [111,113]
37. Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., and Knight, K. (2005), "Sparsity and Smoothness via the Fused Lasso," Journal of the Royal Statistical Society, Ser. B, 67, 91-108. [111,113]
38. Tseng, P. (1988), "Coordinate Ascent for Maximizing Nondifferentiable Concave Functions," Technical Report LIDS-P 1840, Massachusetts Institute of Technology, Laboratory for Information and Decision Systems. [111,113]
39. Tseng, P. (2001), "Convergence of Block Coordinate Descent Method for Nondifferentiable Maximation," Journal of Optimization Theory and Applications, 109, 474-494. [111,113]
40. Wang, H., and Xia, Y. (2009), "Shrinkage Estimation of the Varying Coefficient Model," Journal of the American Statistical Association, 104, 747-757. [112]
41. Wang, L., Chen, G., and Li, H. (2007), "Group SCAD Regression Analysis for Microarray Time Course Gene Expression Data," Bioinformatics, 23, 1486-1544. [111]
42. Wang, L., Li, H., and Huang, J. (2008), "Variable Selection in Nonparametric Varying-Coefficient Models for Analysis of Repeated Measurements," Journal of the Royal Statistical Society, Ser. B, 103, 1556-1569. [111, 112,125,130]
43. Witten, D. M., and Tibshirani, R. (2009), "Covariance-Regularized Regression and Classification for High- Dimensional Problems," Journal of the Royal Statistical Society, Ser. B, 71, 615-636. [113]
44. Yu, Y., and Ruppert, D. (2002), "Penalized Spline Estimation for Partially Linear Single-Index Models," Journal of the American Statistical Association, 97, 1042-1054. [116]
45. Yuan, M., and Lin, Y. (2006), "Model Selection and Estimation in Regression With Grouped Variables," Journal of the Royal Statistical Society, Ser. B, 68, 49-67. [111,114,130]
46. Zhang, N. R., Wildermuth, M. C., and Speed, T. P. (2007), "Transcription Factor Binding Site Prediction With Multivariate Gene Expression Data," The Annals of Applied Statistics, 2, 332-365. [124]
47. Zhao, P., and Yu, B. (2006), "On Model Selection Consistency of Lasso," Journal of Machine Learning Research, 7, 2541-2567. [111,117]
48. Zhong, W., Zeng, P., Ma, P., Liu, J. S., and Zhu, Y. (2005), "RSIR: Regularized Sliced Inverse Regression for Motif Discovery," Bioinformatics, 21, 4169-4175. [124]