Shrinkage estimation for nearly singular designs

Econometric Theory

Volumn 24, Issue 2, 2008, Pages 323-337

  Knight, Keith ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 39649107585     PISSN: 02664666     EISSN: 14694360     Source Type: Journal    
DOI: 10.1017/S0266466608080146     Document Type: Article

References (26)

1. Barnabani, M. (2002) Wald-Based Approach with Singular Information Matrix. Working paper 2002/ 13, Department of Statistics, University of Florence.
2. Caner, M. (2004) Nearly Singular Design in GMM and Generalized Empirical Likelihood Estimators. Working paper, Department of Economics, University of Pittsburgh.
3. Caner, M. (2006) Lasso Type GMM. Estimator. Working paper, Department of Economics, University of Pittsburgh.
4. Chernozhukov, V. (2005) Extremal quantile regression. Annals of Statistics 33, 806-839.
5. Chernozhukov, V. & H. Hong (2004) Likelihood estimation and inference in a class of nonregular econometric models. Econometrica 72, 1445-1480.
6. Fan, J. & R. Li (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96, 1348-1360.
7. Frank, I.E. &. J.H. Friedman (1993) A statistical view of some chemometrics regression tools (with discussion). Technometries 35, 109-148.
8. Fu, W.J. (1998) Penalized regressions: The bridge versus the lasso. Journal of Computational and Graphical Statistics 7, 397-416.
9. Gabaix, X. & R. Ibragimov (2006) Log(rank - 1/2): A Simple Way to Improve the OLS Estimation of Tail Exponents. Working paper, Harvard Institute of Economic Research.
10. Geyer, C.J. (1994) On the asymptotics of constrained M-estimation. Annals of Statistics 22, 1993-2010.
11. Geyer, C.J. (1996) On the Asymptotics of Convex Stochastic Optimization. Technical report, Department of Statistics, University of Minnesota.
12. Hoerd, A.E. & R.W. Kennard (1970) Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12, 55-67.
13. Knight, K. (1999) Epi-convergence in Distribution and Stochastic Equi-semicontinuity. Unpublished manuscript, Department of Statistics, University of Toronto.
14. Knight, K. & W. Fu (2000) Asymptotics for lasso-type estimators. Annals of Statistics 28, 1356-1378.
15. Leeb, H. & B. Pötscher (2006) Performance limits for estimators of the risk or distribution of shrinkage-type estimators, and some general lower risk-bound results. Econometric Theory 22, 69-97.
16. Lorber, A., L.E. Wanger, & B.R. Kowalski (1987) A theoretical foundation for the PLS algorithm. Journal of Chemometrics 1, 19-31.
17. Pflug, G.C. (1995) Asymptotic stochastic programs. Mathematics of Operations Research 20, 769-789.
18. Phillips, P.C.B. (2001) Regression with Slowly Varying Regressors. Cowles Foundation Discussion paper 1310, Yale University.
19. Radchenko, P. (2004) Reweighting the Lasso. Unpublished manuscript, Department of Statistics, University of Chicago.
20. Rotnitzky, A., D.R. Cox, M. Bottai, & J. Robins (2000) Likelihood-based inference with singular information matrix. Bernoulli 6, 243-284.
21. Srivastava, M.S. (1971) On fixed width confidence bounds for regression parameters. Annals of Mathematical Statistics 42, 1403-1411.
22. Stock, J.H., J.H. Wright, & M. Yogo (2002) A survey of weak instruments and weak identification in generalized method of moments. Journal of Business & Economic Statistics 20, 518-529.
23. Stone, M. & R.J. Brooks (1990) Continuum regression: Cross-validated sequentially constructed prediction embracing ordinary least squares, partial least squares and principal components regression (with discussion). Journal of the Royal Statistical Society, Series B 52, 237-269; corrigendum (1992) 54, 906-907.
24. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 58, 267-288.
25. van der Vaart, A.W. & J.A. Wellner (1996) Weak Convergence and Empirical Processes with Applications to Statistics. Springer.
26. Wold, H. (1984) PLS regression. In N.L. Johnson & S. Kotz (eds.), Encyclopedia of Statistical Sciences, vol. 6, pp. 581-591. Wiley.