Shrinkage, pretest and absolute penalty estimators in partially linear models

Australian and New Zealand Journal of Statistics

Volumn 49, Issue 4, 2007, Pages 435-454

  Ahmed, S Ejaz ^a   Doksum, Kjell A ^a,b   Hossain, S ^a   You, Jinhong ^a,c  

^a UNIVERSITY OF WINDSOR   (Canada)

^b University of Wisconsin   (United States)

^c University of North Carolina at Chapel Hill   (United States)

Author keywords

Asymptotic risk; Hard thresholding; Kernel smoothing; Regression model; Semiparametric least squares; Simulation; Smooth thresholding

Indexed keywords

EID: 37249000767     PISSN: 13691473     EISSN: 1467842X     Source Type: Journal    
DOI: 10.1111/j.1467-842X.2007.00493.x     Document Type: Article

References (45)

1. Ahmed, S.E. (2001). Shrinkage estimation of regression coefficients from censored data with multiple observations. Empirical Bayes and Likelihood Inference. In Lecture Notes in Statistics, 148. eds S.E. Ahmed, N. Reid, pp. 103 120. New York : Springer-Verlag.
2. Ahmed, S.E., Hussein, A.A. & Sen, P.K. (2006). Positive-part shrinkage M-estimation in linear models. J. Nonparametr. Statist. 18, 401 415.
3. Ahmed, S.E. & Saleh, A.K.M.D.E. (1999). Estimation of regression coefficients in an exponential regression model with censored observations. J. Japan Statist. Soc. 29, 55 64.
4. Bancroft, T.A. (1944). On biases in estimation due to the use of preliminary tests of significances. Ann. Math. Statist. 15, 190 204.
5. Bickel, P.J. (1984). Parametric robustness: small biases can be worthwhile. Ann. Statist. 12, 864 879.
6. Bowman, A.W. & Azzalini A. (1997). Applied Smoothing Techniques for Data Analysis: The Kernel Approach with S-Plus Illustrations. Oxford : Oxford University Press.
7. Bunea, F. (2004). Consistent covariate selection and post model selection inference in semiparametric regression. Ann. Statist. 32, 898 927.
8. Burman, P. & Chaudhuri, P. (1992). A Hybrid Approach to Parametric and Nonparametric Regression, Technical Report No. 243, Division of Statistics, University of California-Davis, Davis, CA, USA.
9. Burnham, K.P. & Anderson, D.R. (2002). Model selection and multimodel inference, New York : Springer-Verlag.
10. Chen, H. (1988). Convergence rates for parametric components in a partially linear model. Ann. Statist. 16, 136 147.
11. Chen, H. & Shiau, J. (1994). Data-driven efficient estimation for a partially linear model. Ann. Statist. 22, 211 237.
12. Chen, S. & Donoho, D.L. (1994). On Basis Pursuit. Technical Report, Department of Statistics, Stanford University.
13. Chen, S., Donoho, D.L. & Saunders, M.A. (1999). Atomic Decomposition by Basis Pursuit. SIAM J. Sci. Comput. 20, 33 61.
14. Claeskens, G. & Hjort, N. (2003). The focused information criterion, J. Amer. Statist. Assoc. 98, 900 916.
15. Cui, X., Huang, J.T.G., Qiu, J., Blades, N.J. & Churchill, G.A. (2005). Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics 6, 59 75.
16. Donald, G. & Newey, K. (1994). Series estimation of semilinear models. J. Multivariate Anal. 50, 30 40.
17. Donoho, D.L. & Johnstone, I.M. (1998). Minimax estimation via wavelet shrinkage. Ann. Statist. 26, 879 921.
18. Engle, R.F., Granger, W.J., Rice, J. & Weiss, A. (1986). Semiparametric estimates of the relation between weather and electricity sales. J. Amer. Statist. Assoc. 80, 310 319.
19. Eubank, R.L., Hart, J.D. & Speckman, P. (1990). Trigonometric series regression estimators with an application to partially linear models. J. Multivariate Anal. 32, 70 83.
20. Fan, J., Härdle, W. & Mammen, E. (1998). Direct estimation of low-dimensional components in additive models. Ann. Statist. 26, 943 971.
21. Gao, J.T. (1995a). Asymptotic theory for partially linear models. Comm. Statist. Theory Methods, A 24, 1985 2009.
22. Gao, J.T. (1995b). The laws of the iterated logarithm of some estimates in partially linear models. Statist. Probab. Lett. 25, 153 162.
23. Gao, J.T. (1997). Adaptive parametric test in a semiparametric regression model. Comm. Statist. Theory Methods, A 26, 787 800.
24. Hamilton, A. & Truong, K. (1997). Local linear estimation in partially linear models. J. Multivariate Anal. 60, 1 19.
25. Härdle, W., Liang, H. & Gao, J. (2000). Partially linear models. Heidelberg : Physica-Verlag.
26. Heckman, N. (1986). Spline smoothing in a partially linear model. J. R. Statist. Soc. Ser. B 48, 244 248.
27. Hoeting, J.A., Madigan, D., Rafferty, A.E. & Volinsky, C.T. (1999). Bayesian model averaging: A tutorial. Statist. Sci. 14, 382 401.
28. Hoeting, J.A., Rafferty, A.E. & Madigan, D. (2002). Bayesian variable and transformation selection in linear regression averaging: A tutorial. J. Comput. Graph. Statist. 11, 485 507.
29. Ihaka, R. & Gentleman, R. (1996). R: A language for data analysis and graphics. J. Comput. Graph. Statist. 5, 299 314.
30. Judge, G.G. & Mittelhammaer, R.C. (2004). A semiparametric basis for combining estimation problem under quadratic loss. J. Amer. Statist. Assoc. 99, 479 487.
31. Liang, H. & Härdle, W. (1999). Large sample theory of the estimation of the error distribution for a semiparametric model. Comm. Statist. Theory Methods, A 28, 2025 2037.
32. Liang, H., Wong, S., Robins, J.M. & Carroll, R.J. (2004). Estimation in partially linear models with missing covariates. J. Amer. Statist. Assoc. 99, 357 367.
33. Rice, J. (1986). Convergence rates for partially splined models. Statist. Probab. Lett. 4, 203 208.
34. Robinson, P. (1988). Root-N-consistent semiparametric regression. Econometrica 56, 931 954.
35. Schick, A. (1994). Estimation of the autocorrelation coefficient in the presence of a regression trend. Statist. Probab. Lett. 21, 371 380.
36. Schick, A. (1996). Efficient estimation in a semiparametric additive regression model with autoregressive errors. Stochastic Process. Appl. 61, 339 361.
37. Schick, A. (1998). An adaptive estimator of the autocorrelation coefficient in regression models with autoregressive errors. J. Time Ser. Anal. 19, 575 589.
38. Scolve, S.L., Morris, C. & Radhakrishnan, R. (1972). Optimality of preliminary test estimation for the multinormal mean. Ann. Math. Statist. 43, 1481 1490.
39. Shi, J. & Lau, T.S. (2000). Empirical likelihood for partially linear models. J. Multivariate Anal. 72, 132 149.
40. Shi, P. & Li, G. (1995). A note of the convergence rates of M-estimates for partially linear model. Statistics 26, 27 47.
41. Speckman, P. (1988). Kernel smoothing in partial linear models. J. R. Statist. Soc. Ser. B 50, 413 437.
42. 2-test. Ann. Math. Statist. 27, 616 623.
43. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. J. R. Statist. Soc. Ser. B 58, 267 288.
44. Wang, Q., Linton, O. & Härdle, W. (2004). Semiparametric regression analysis with missing response at random. J. Amer. Statist. Assoc. 99, 334 345.
45. Xue, H., Lam, K.F. & Gouying, L. (2004). Sieve maximum likelihood estimator for semiparametric regression models with current status data. J. Amer. Statist. Assoc. 99, 346 356.