A general framework for functional regression modelling

Statistical Modelling

Volumn 17, Issue 1-2, 2017, Pages 1-35

  Greven, Sonja ^a   Scheipl, Fabian ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

functional additive mixed model; Functional data; functional principal components; GAMLSS; gradient boosting; penalized splines

Indexed keywords

EID: 85014673804     PISSN: 1471082X     EISSN: 14770342     Source Type: Journal    
DOI: 10.1177/1471082X16681317     Document Type: Article

References (115)

1. Brockhaus S, Fuest A, Mayr A, Greven S, (2015a) Functional regression models for location, scale and shape with application to stock returns. In Friedl H, Wagner H, eds. Proceedings of the 30th International Workshop on Statistical Modelling, vol. 1, Linz, July 6–10, 2015, pages 117–22.
2. Brockhaus S, Fuest A, Mayr A, Greven S, (2016a) Signal regression models for loca- tion, scale and shape with an application to stock returns. arXiv preprint arXiv:1605. 04281.
3. Brockhaus S, Melcher M, Leisch F, Greven S, (2016b) Boosting flexible functional regre- ssion models with a high number of functional historical effects. Statistics and Computing. Available at http://link.springer.com/article/10.1007/s11222-016-9662-1. (accessed on 17 November 2016).
4. Brockhaus S, Rügamer D, (2016) FDboost: Boosting functional regression models. R package version 0.2-0. Available at http://CRAN.R-project.org/package=FDboost. (accessed on 17 November 2016).
5. Brockhaus S, Scheipl F, Hothorn T, Greven S, (2015b) The functional linear array model. Statistical Modelling, 15, 279–300.
6. Bühlmann P, Hothorn T, (2007) Boosting algo- rithms: Regularization, prediction and model fitting. Statistical Science, 22, 477–505.
7. Cardot H, Ferraty F, Sarda P, (1999) Functional linear model. Statistics & Probability Letters, 45, 11–22.
8. Cederbaum J, Pouplier M, Hoole P, Greven S, (2016) Functional linear mixed models for irregularly or sparsely sampled data. Statistical Modelling, 16, 67–88.
9. Currie ID, Durban M, Eilers PH, (2006) Gene- ralized linear array models with applications to multidimensional smoothing. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68, 259–80.
10. De Boor C, (1978) A Practical Guide to Splines. New York: Springer.
11. Di C-Z, Crainiceanu CM, Caffo BS, Punjabi NM, (2009) Multilevel functional principal component analysis. The Annals of Applied Statistics, 3, 458–88.
12. Dryden IL, (2014) Shape and object data analysis. Biometrical Journal, 56, 758–60.
13. Eilers P, Marx B, (1996) Flexible smoothing with B-splines and penalties. Statistical Sciences, 11, 89–121.
14. Eilers PH, Marx BD, (2003) Multivariate calibration with temperature interaction using two-dimensional penalized signal regression. Chemometrics and intelligent laboratory systems, 66, 159–74.
15. Eilers PHC, Marx BD, (2002) Generalized linear additive smooth structures. Journal of Computational and Graphical Statistics, 11, 758–83.
16. Ettinger B, Perotto S, Sangalli LM, (2016) Spatial regression models over two-dimensional manifolds. Biometrika, 103, 71–88.
17. Febrero-Bande M, Oviedo de la Fuente M, (2012) Statistical computing in functional data analysis: The R package fda.usc. Journal of Statistical Software, 51, 1–28. Available at http://www.jstatsoft.org/v51/i04/ (accessed on 17 November 2016).
18. Fenske N, Kneib T, Hothorn T, (2011) Identifying risk factors for severe childhood malnutrition by boosting additive quantile regression. Journal of the American Statistical Association, 106, 494–510.
19. Ferraty F, Vieu P, (2006) Nonparametric Functional Data Analysis: Theory and Practice. New York: Springer.
20. Fuchs K, Scheipl F, Greven S, (2015) Penalized scalar-on-functions regression with interaction term. Computational Statistics & Data Analysis, 81, 38–51.
21. Gasparrini A, Armstrong B, Kenward MG, (2010) Distributed lag non-linear models. Statistics in Medicine, 29, 2224–34.
22. Gertheiss J, Goldsmith J, Crainiceanu C, Greven S, (2013a) Longitudinal scalar-on- functions regression with application to tractography data. Biostatistics, 14, 447–61.
23. Gertheiss J, Maity A, Staicu A-M, (2013b) Variable selection in generalized functional linear models. Stat, 2, 86–101.
24. Gervini D, (2015) Warped functional regression. Biometrika, 102, 1–14.
25. Goldsmith J, Bobb J, Crainiceanu CM, Caffo B, Reich D, (2012) Penalized functional regression. Journal of Computational and Graphical Statistics, 20, 830–51.
26. Goldsmith J, Greven S, Crainiceanu CM, (2013) Corrected confidence bands for functional data using principal components. Biometrics, 69, 41–51.
27. Goldsmith J, Huang L, Crainiceanu CM, (2014) Smooth scalar-on-image regression via spatial Bayesian variable selection. Journal of Computational and Graphical Statistics, 23, 46–64.
28. Goldsmith J, Wand MP, Crainiceanu CM, (2011) Functional regression via variational Bayes. Electronic Journal of Statistics, 5, 572–602.
29. Goldsmith J, Zipunnikov V, Schrack J, (2015) Generalized multilevel function-on-scalar regression and principal component analysis. Biometrics, 71, 344–53.
30. Greven S, Crainiceanu CM, Caffo BS, Reich D, (2010) Longitudinal functional principal component analysis. Electronic Journal of Statistics, 4, 1022–54.
31. Greven S, Crainiceanu CM, Küchenhoff H, Peters A, (2008) Restricted likelihood ratio testing for zero variance components in linear mixed models. Journal of Computational and Graphical Statistics, 17, 870–91.
32. Hadjipantelis PZ, Aston JA, Müller H-G, Evans JP, (2015) Unifying amplitude and phase analysis: A compositional data approach to functional multivariate mixed- effects modeling of mandarin Chinese. Journal of the American Statistical Association, 110, 545–59.
33. Hall P, Hooker G, (2016) Truncated linear models for functional data. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 78, 637–53. Available at http://onlinelibrary.wiley.com/doi/10.1111/ rssb.12125/abstract
34. Hastie T, Mallows R, (1993) Discussion of ‘A statistical view of some chemometrics reg- ression tools,’ by I. E. Frank and J. H. Friedman. Technometrics, 35, 140–43.
35. Hastie T, Tibshirani R, (1993) Varying-coefficient models. Journal of the Royal Statistical Society. Series B, 55, 757–96.
36. Hastie TJ, Tibshirani RJ, Friedman JH, (2011) The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer.
37. Herrick R, (2015) WFMM. The University of Texas M.D. Anderson Cancer Center, version 3.0 edition. Available at https://biostatistics.mdanderson.org/SoftwareDownload/SingleSoftware.aspx?Software_Id=70 (accessed on 16 December 2016)
38. Hofner B, Hothorn T, Kneib T, Schmid M, (2012) A framework for unbiased model selection based on boosting. Journal of Computational and Graphical Statistics, 20, 956–71.
39. Hofner B, Mayr A, Fenske N, Schmid M, (2016) gamboostLSS: Boosting Methods for GAMLSS Models.R package version 1.3-0. Available at http://CRAN.R-project.org/package=gamboostLSS (accessed on 29 October 2016).
40. Horváth L, Kokoszka P, (2012) Inference for Functional Data with Applications. New York: Springer Science & Business Media.
41. Hothorn T, Buehlmann P, Kneib T, Schmid M, Hofner B, (2016) mboost: Model-Based Boosting. R package version 2.6-0. Available at http://CRAN.R-project.org/package=mboost (accessed on 22 November 2016).
42. Hothorn T, Kneib T, Bühlmann P, (2014) Conditional transformation models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76, 3–27.
43. Huang L, Scheipl F, Goldsmith J, Gellar J, Harezlak J, McLean MW, Swihart B, Xiao L, Crainiceanu C, Reiss P, (2016) refund: Regression with Functional Data. R package version 0.1-15. Available at https://CRAN.R-project.org/package=refund. (accessed on 22 November 2016).
44. Ivanescu AE, Staicu A-M, Scheipl F, Greven S, (2015) Penalized function-on-function regression. Computational Statistics, 30, 539–68.
45. James GM, Hastie TJ, Sugar CA, (2000) Principal component models for sparse functional data. Biometrika, 87, 587–602.
46. James GM, Silverman BW, (2005) Functional adaptive model estimation. Journal of the American Statistical Association, 100, 565–76.
47. Karhunen K, (1947) Über Lineare Methoden in der Wahrscheinlichkeitsrechnung. Annales Academiae Scientiarum Fennicae, 37, 1–79.
48. Kneib T, Hothorn T, Tutz G, (2009) Variable selection and model choice in geoadditive regression models. Biometrics, 65, 626–34.
49. Koenker R, (2005) Quantile Regression. Cambridge: Cambridge University Press.
50. Lang S, Brezger A, (2004) Bayesian P-splines. Journal of Computational and Graphical Statistics, 13, 183–212.
51. Loève M, (1945) Fonctions aléatoires de second ordre. Comptes Rendus Académie des Sciences, 220, 469.
52. Malfait N, Ramsay JO, (2003) The historical functional linear model. Canadian Journal of Statistics, 31, 115–28.
53. Marra G, Wood SN, (2012) Coverage proper- ties of confidence intervals for generalized additive model components. Scandinavian Journal of Statistics, 39, 53–74.
54. Marron JS, Alonso AM, (2014) Overview of object oriented data analysis. Biometrical Journal, 56, 732–53.
55. Marron JS, Ramsay JO, Sangalli LM, Srivastava A, (2014) Statistics of time warpings and phase variations. Electronic Journal of Statistics, 8, 1697–702.
56. Marx BD, Eilers PH, (1999) Generalized linear regression on sampled signals and curves: A P-spline approach. Technometrics, 41, 1–13.
57. Marx BD, Eilers PH, (2005) Multidimensional penalized signal regression. Technometrics, 47, 13–22.
58. Mayr A, Fenske N, Hofner B, Kneib T, Schmid M, (2012) Generalized additive models for location, scale and shape for high dimensional data—A flexible approach based on boosting. Journal of the Royal Statistical Society: Series C (Applied Statistics), 61, 403–27.
59. McLean MW, Hooker G, Ruppert D, (2015) Restricted likelihood ratio tests for linearity in scalar-on-function regression. Statistics and Computing, 25, 997–1008.
60. McLean MW, Hooker G, Staicu A-M, Scheipl F, Ruppert D, (2014) Functional generalized additive models. Journal of Computational and Graphical Statistics, 23, 249–69.
61. Meinshausen N, Bühlmann P, (2010) Stability selection. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 72, 417–73.
62. Mercer J, (1909) Functions of positive and negative type, and their connection with the theory of integral equations. Philosophical Transactions of the Royal Society of London. Series A, 209, 415–46.
63. Meyer MJ, Coull BA, Versace F, Cinciripini P, Morris JS, (2015) Bayesian function-on- function regression for multilevel functional data. Biometrics, 71, 563–74.
64. Morris JS, (2015) Functional regression. Annual Review of Statistics and its Applications, 2, 321–59.
65. Morris JS, Arroyo C, Coull BA, Ryan LM, Herrick R, Gortmaker SL, (2006) Using wavelet-based functional mixed models to characterize population heterogeneity in accelerometer profiles: A case study. Journal of the American Statistical Association, 101, 1352–64.
66. Morris JS, Baladandayuthapani V, Herrick RC, Sanna P, Gutstein H, (2011) Automated analysis of quantitative image data using isomorphic functional mixed models, with application to proteomics data. The Annals of Applied Statistics, 5, 894–923.
67. Morris JS, Carroll RJ, (2006) Wavelet-based functional mixed models. Journal of the Royal Statistical Society, Series B, 68, 179–99.
68. Müller H-G, Stadtmüller U, (2005) Genera- lized functional linear models. Annals of Statistics, 33, 774–805.
69. Obermeier V, Scheipl F, Heumann C, Wassermann J, Küchenhoff H, (2015) Flexible dis- tributed lags for modelling earthquake data. Journal of the Royal Statistical Society: Series C (Applied Statistics), 64, 395–412.
70. O'Sullivan F, (1986) A statistical perspective on ill-posed inverse problems. Statistical Science, 1, 502–18.
71. Peng J, Paul D, (2012) A geometric approach to maximum likelihood estimation of the functional principal components from sparse longitudinal data. Journal of Compu- tational and Graphical Statistics, 18, 995–1015.
72. Plummer M, (2016) rjags: Bayesian Graphical Models Using MCMC. R package version 4-6. Available at https://CRAN.R-project.org/package=rjags. (accessed on 23 November 2016).
73. Ramsay JO, Dalzell C, (1991) Some tools for functional data analysis. Journal of the Royal Statistical Society. Series B (Methodological), 33, 539–72.
74. Ramsay J, Graves S, Hooker G, (2009) Functional data analysis with R and MATLAB. New York: Springer.
75. Ramsay JO, Silverman BW, (2005) Functional Data Analysis. New York: Springer.
76. Ramsay JO, Wickham H, Graves S, Hooker G, (2014) fda: Functional Data Analysis. R package version 2.4-4. Available at http://CRAN.R-project.org/package=fda. (accessed on 23 November 2016).
77. Reimherr M, Nicolae D, (2016) Estimating variance components in functional linear models with applications to genetic heritability. Journal of the American Statis- tical Association, 111, 407–22.
78. Reiss PT, Ogden RT, (2007) Functional principal component regression and functional partial least squares. Journal of the American Statistical Association, 102, 984–96.
79. Reiss PT, Goldsmith J, Shang HL, Ogden RT, (2016) Methods for scalar-on-function regression. International Statistical Review. Available at http://onlinelibrary.wiley.com/doi/10.1111/insr.12163/full
80. Reiss PT, Huang L, Mennes M, (2010) Fast function-on-scalar regression with penalized basis expansions. The International Journal of Biostatistics, 6, 1557–4679.
81. Reiss PT, Miller DL, Wu P-S, Hua W-Y, (2015) Penalized nonparametric scalar-on-function regression via principal coordinates. Technical Report. Available at http://works.bepress.com/phil_reiss/42/ (accessed on 23 November 2016).
82. Reiss PT, Ogden RT, (2007) Functional prin- cipal component regression and functional partial least squares. Journal of the American Statistical Association, 102, 984–96.
83. Rigby RA, Stasinopoulos DM, (2005) Generalized additive models for location, scale and shape. Journal of the Royal Statistical Society: Series C (Applied Statistics), 54, 507–54.
84. Ruppert D, Wand MP, Carroll RJ, (2003) Semiparametric Regression. Cambridge: Cambridge University Press.
85. Scheipl F, Gertheiss J, Greven S, (2016) Generalized functional additive mixed models. Electronic Journal of Statistics, 10, 1455–92.
86. Scheipl F, Greven S, (2016) Identifiability in penalized function-on-function regression models. Electronic Journal of Statistics, 10, 495–526.
87. Scheipl F, Greven S, Küchenhoff H, (2008) Size and power of tests for a zero random effect variance or polynomial regression in additive and linear mixed models. Computational Statistics & Data Analysis, 52, 3283–99.
88. Scheipl F, Staicu A-M, Greven S, (2015) Functional additive mixed models. Journal of Computational and Graphical Statistics, 24, 477–501.
89. Schmid M, Hothorn T, (2008) Boosting additive models using component-wise P-splines. Computational Statistics & Data Analysis, 53, 298–311.
90. Shah RD, Samworth RJ, (2013) Variable selection with error control: another look at stability selection. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 75, 55–80.
91. Shi JQ, Cheng Y, (2014) GPFDA: Apply Gaussian Process in Functional data analysis. R package version 2.2. Available at https://CRAN.R-project.org/package=GPFDA (accessed on 23 November 2016).
92. Shi JQ, Choi T, (2011) Gaussian Process Regression Analysis for Functional Data. Boca Raton, FL: CRC Press.
93. Shi JQ, Wang B, Murray-Smith R, Titterington M, (2007) Gaussian process functional regression modeling for batch data. Biometrics, 63, 714–23.
94. Shou H, Zipunnikov V, Crainiceanu CM, Greven S, (2015) Structured functional principal component analysis. Biometrics, 71, 247–57.
95. Staicu A-M, Li Y, Crainiceanu CM, Ruppert D, (2014) Likelihood ratio tests for dependent data with applications to longitudinal and functional data analysis. Scandinavian Journal of Statistics, 41, 932–49.
96. Staniswalis J, Lee J, (1998) Nonparametric regression analysis of longitudinal data. Journal of the American Statistical Association, 93, 1403–04.
97. Swihart BJ, Goldsmith J, Crainiceanu CM, (2014) Restricted likelihood ratio tests for functional effects in the functional linear model. Technometrics, 56, 483–93.
98. Usset J, Staicu A-M, Maity A, (2016) Interaction models for functional regression. Computational Statistics & Data Analysis, 94, 317–30.
99. Van der Linde A, (2009) Bayesian functional principal components analysis for binary and count data. Advances in Statistical Analysis, 93, 307–33.
100. Wand M, Ormerod J, (2008) On semiparametric regression with O'Sullivan penalized splines. Australian & New Zealand Journal of Statistics, 50, 179–98.
101. Wang B, Shi JQ, (2014) Generalized Gaussian process regression model for non-Gaussian functional data. Journal of the American Statistical Association, 109, 1123–33.
102. Wang H, Marron J, (2007) Object-oriented data analysis: Sets of trees. The Annals of Statistics, 35, 1849–73.
103. Wang J-L, Chiou J-M, Mueller H-G, (2016) Review of functional data analysis. Annual Review of Statistics and Its Application, 3, 257–95.
104. Wood SN, (2006a) Generalized Additive Models: An Introduction with R. Boca Raton, FL: CRC Press.
105. Wood SN, (2006b) Low-rank scale-invariant tensor product smooths for generalized additive mixed models. Biometrics, 62, 1025–36.
106. Wood SN, (2011) Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. Journal of the Royal Statistical Society: Series B, 73, 3–36.
107. Wood SN, (2013) A simple test for random effects in regression models. Biometrika, 100, 1005–10.
108. Wood SN, (2016a) Just another Gibbs additive modeller: Interfacing JAGS and mgcv. arXiv preprint arXiv:1602.02539. Available at https://arxiv.org/abs/1602.02539 (accessed on 23 November 2016).
109. Wood SN, (2016b) mgcv: Mixed GAM Computation Vehicle with GCV/AIC/REML Smoothness Estimation. R package version 1.8-12. Available at http://CRAN.R-project.org/package=mgcv (accessed on 23 November 2016).
110. Wood SN, Li Z, Shaddick G, Augustin NH, (2016a) Generalized additive models for gigadata: Modelling the UK black smoke network daily data. Journal of the Ameri- can Statistical Association. Available at http://amstat.tandfonline.com/doi/abs/10.1080/01621459.2016.1195744
111. Wood SN, Pya N, Säfken B, (2016b) Smoothing parameter and model selection for general smooth models. Journal of the American Statistical Association. Available at http://arxiv.org/abs/1511.03864 (accessed on 23 November 2016).
112. Yao F, Müller H, Wang J, (2005a) Functional data analysis for sparse longitudinal data. Journal of the American Statistical Association, 100, 577–90.
113. Yao F, Müller H, Wang J, (2005b) Functional linear regression analysis for longitudinal data. The Annals of Statistics, 33, 2873–903.
114. Zipunnikov V, Caffo B, Yousem DM, Davatzikos C, Schwartz BS, Crainiceanu C, (2011) Multilevel functional principal component analysis for high-dimensional data. Journal of Computational and Graphical Statistics, 20, 852–73.
115. Zipunnikov V, Greven S, Shou H, Caffo B, Reich DS, Crainiceanu C, (2014) Longitudinal high-dimensional principal components analysis with application to diffusion tensor imaging of multiple sclerosis. The Annals of Applied Statistics, 8, 2175–202.