Sparse estimation in functional linear regression

Journal of Multivariate Analysis

Volumn 105, Issue 1, 2012, Pages 1-17

  Lee, Eun Ryung ^a   Park, Byeong U ^a  

^a Seoul National University   (South Korea)

Author keywords

Adaptive LASSO; Functional data analysis; Functional principal component analysis; Karhunen Lo ve expansion; MCP; Oracle properties; Penalized least squares regression; Primary; SCAD; Secondary; Sparsity

Indexed keywords

EID: 80053443716     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2011.08.005     Document Type: Article

References (29)

1. Bosq D. Linear Processes in Function Spaces: Theory and Applications. Lectures Notes in Statistics 2000, vol. 149. Springer, Berlin.
2. Cai T., Hall P. Prediction in functional linear regression. Annals of Statistics 2006, 34:2159-2179.
3. Cardot H., Ferraty F., Sarda P. Functional linear model. Statistics and Probability Letters 1999, 45:11-22.
4. Cardot H., Ferraty F., Sarda P. Spline estimators for the functional linear model. Statistica Sinica 2003, 13:571-591.
5. Cardot H., Johannes J. Thresholding projection estimators in functional linear models. Journal of Multivariate Analysis 2010, 101:395-408.
6. Fan J., Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of American Statistical Association 2001, 96:1348-1360.
7. Geyer C.J. On the asymptotics of constrained M-estimation. Annals of Statistics 1994, 22:1993-2010.
8. Hall P., Horowitz J.L. Methodology and convergence rates for functional linear regression. Annals of Statistics 2007, 35:70-91.
9. Hall P., Lee Y.K., Park B.U. A method for projecting functional data onto a low-dimensional space. Journal of Computational and Graphical Statistics 2007, 16:799-812.
10. Hall P., Yang Y.-J. Ordering and selecting components in multivariate or functional data linear prediction. Journal of the Royal Statistical Society: Series B 2010, 72:93-110.
11. James G.M. Generalized linear models with functional predictors. Journal of the Royal Statistical Society: Series B 2002, 64:411-432.
12. James G.M., Silverman B.W. Functional adaptive model estimation. Journal of American Statistical Association 2005, 100:565-576.
13. James G.M., Wang J., Zhu J. Functional linear regression that's interpretable. Annals of Statistics 2009, 37:2083-2108.
14. Knight K., Fu W. Asymptotics for lasso-type estimators. Annals of Statistics 2000, 28:1356-1378.
15. Lv J., Fan Y. A unified approach to model selection and sparse recovery using regularized least squares. Annals of Statistics 2009, 37:3498-3528.
16. Müller H.-G., Stadtmüller U. Generalized functional linear models. Annals of Statistics 2005, 33:774-805.
17. H.S. Noh, Variable selection in sparse nonparametric models, Ph.D. Dissertation, Seoul National University, 2009.
18. Noh H.S., Park B.U. Sparse varying coefficient models for longitudinal data. Statistica Sinica 2010, 20:1183-1202.
19. Ramsay J.O., Silverman B.W. Functional Data Analysis 1997, Springer, New York.
20. Shao J. An asymptotic theory for linear model selection. Statistica Sinica 1997, 7:221-264.
21. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B 1996, 58:267-288.
22. Wang H., Leng C. Unified LASSO estimation by least squares approximation. Journal of American Statistical Association 2007, 102:1039-1048.
23. Wang H., Li B., Leng C. Shrinkage tuning parameter selection with a diverging number of parameters. Journal of the Royal Statistical Society: Series B 2009, 71:671-683.
24. Wang H., Li R., Tsai C.-L. Tuning parameter selectors for the smoothly clipped absolute deviation method. Biometrika 2007, 94:553-568.
25. Yang Y. Can the strengths of AIC and BIC be shared?: a conflict between model identification and regression estimation. Biometrika 2005, 92:937-950.
26. Yuan M., Cai T.T. A reproducing kernel Hilbert space approach to functional linear regression. Annals of Statistics 2010, 38:3412-3444.
27. Zhang C.-H. Nearly unbiased variable selection under minimax concavity penalty. Annals of Statistics 2010, 38:894-942.
28. Zou H. The adaptive lasso and its oracle properties. Journal of American Statistical Association 2006, 101:1418-1429.
29. Zou H., Li R. One-step sparse estimates in nonconcave penalized likelihood models (with discussion). Annals of Statistics 2008, 36:1509-1566.