A review on dimension reduction

International Statistical Review

Volumn 81, Issue 1, 2013, Pages 134-150

  Ma, Yanyuan ^a   Zhu, Liping ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b SHANGHAI UNIVERSITY OF FINANCE AND ECONOMICS   (China)

Author keywords

Dimension reduction; Double robustness; Efficiency bound; Estimating equation; Linearity condition; Sliced inverse regression; Sufficient dimension reduction

Indexed keywords

EID: 84875651600     PISSN: 03067734     EISSN: 17515823     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2012.00182.x     Document Type: Article

References (84)

1. Adragni, K. & Cook, R.D. (2009). Sufficient dimension reduction and prediction in regressions. Philos. Trans. R. Soc., A, 367, 4385-4405.
2. Aragon, Y. (1997). A Gauss implementation of multivariate sliced inverse regression. Comput. Statist., 12, 355-372.
3. Bickel, P.J., Klaassen, C.A.J., Ritov, Y. & Wellner, J.A. (1993). Efficient and Adaptive Estimation for Semiparametric Models . Baltimore : The Johns Hopkins University Press.
4. Box, G.E.P. & Cox, D.R. (1964). An analysis of transformations (with discussion). J. R. Stat. Soc. Ser. B, 26, 211-252.
5. Bura, E. & Cook, R.D. (2001). Extending sliced inverse regression: the weighted Chi-squared test. J. Amer. Statist. Assoc., 96, 996-1003.
6. Bura, E. & Yang, J. (2011). Dimension estimation in sufficient dimension reduction: a unifying approach. J. Multivariate Anal., 102, 130-142.
7. Candes, E. & Tao, T. (2007). The Dantzig selector: statistical estimation when p is much larger than n (with discussion). Ann. Statist., 35, 2313-2404.
8. Chen, C.H. & Li, K.C. (1998). Can SIR be as popular as multiple linear regression? Statist. Sinica, 8, 289-316.
9. Cook, R.D. (1994). On the interpretation of regression plots. J. Amer. Statist. Assoc., 89, 177-189.
10. Cook, R.D. (1998). Regression Graphics: Ideas for Studying Regressions through Graphics . New York : Wiley.
11. Cook, R.D. (2004). Testing predictor contributions in sufficient dimension reduction. Ann. Statist., 32, 1062-1092.
12. Cook, R.D. & Forzani, L. (2008). Principal fitted components for dimension reduction in regression. Statist. Sci., 23, 485-501.
13. Cook, R.D. & Lee, H. (1999). Dimension reduction in binary response regression. J. Amer. Statist. Assoc., 94, 1187-1200.
14. Cook, R.D. & Li, B. (2002). Dimension reduction for conditional mean in regression. Ann. Statist., 30, 455-474.
15. Cook, R.D. & Li, B. (2004). Determining the dimension of iterative Hessian transformation. Ann. Statist., 32, 2501-2531.
16. Cook, R.D., Li, B. & Chiaromonte, F. (2007). Dimension reduction in regression without matrix inversion. Biometrika, 94, 569-584.
17. Cook, R.D., Li, B. & Chiaromonte, F. (2010). Envelope models for parsimonious and efficient multivariate liner regression. Statist. Sinica, 20, 927-1010.
18. Cook, R.D. & Nachtsheim, C.J. (1994). Reweighting to achieve elliptically contoured covariates in regression. J. Amer. Statist. Assoc., 89, 592-599.
19. Cook, R.D. & Ni, L. (2005). Sufficient dimension reduction via inverse regression: a minimum discrepancy approach. J. Amer. Statist. Assoc., 100, 410-428.
20. Cook, R.D. & Weisberg, S. (1991). Discussion of "Sliced inverse regression for dimension reduction". J. Amer. Statist. Assoc., 86, 28-33.
21. Cook, R.D. & Setodji, C.M. (2003). A model-free test for reduced rank in multivariate regression. J. Amer. Statist. Assoc., 98, 340-351.
22. Cook, R. D. & Yin, X. (2001). Dimension reduction and visualization in discriminant analysis (with discussion). Aust. N. Z. J. Stat., 43, 147-199.
23. Dong, Y. & Li, B. (2010). Dimension reduction for non-elliptically distributed predictors: second-order moments. Biometrika, 97, 279-294.
24. Eaton, M.L. (1986). A characterization of spherical distributions. J. Multivariate Anal., 34, 439-446.
25. Efron, B., Hastie, T., Johnstone, I. & Tibshirani, R. (2004). Least Angle Regression. Ann. Statist., 32, 407-499.
26. Fan, J. & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc., 96, 1348-1360.
27. Fan, J. & Lv, J. (2008). Sure independence screening for ultrahigh dimensional feature space (with discussion). J. R. Stat. Soc. Ser. B, 70, 849-911.
28. Fan, J., Yao, Q. & Tong, H. (1996). Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems. Biometrika, 83, 189-196.
29. Fung, W.K., He, X., Liu, L. & Shi, P. (2002). Dimension reduction based on canonical correlation. Statist. Sinica, 12, 1093-1113.
30. Hall, P. & Li, K.C. (1993). On almost linearity of low dimensional projection from high dimensional data. Ann. Statist., 21, 867-889.
31. Hampel, F.R. (1968). Contributions to the Theory of Robust Estimation. Thesis, University of California, Berkeley.
32. Henmi, M. & Eguchi, S. (2004). A paradox concerning nuisance parameters and projected estimating functions. Biometrika, 91, 929-941.
33. Hernández, A. & Velilla, S. (2005). Dimension reduction in nonparametric kernel discriminant analysis. J. Comput. Graph. Statist., 14, 847-866.
34. Hsing, T. (1999). Nearest neighbor inverse regression. Ann. Statist., 27, 697-731.
35. Ichimura, H. (1993). Semiparametric least squares (SLS) and weighted SLS estimation of single-index models. J. Econometrics, 58, 71-120.
36. Li, B. & Dong, Y. (2009). Dimension reduction for non-elliptically distributed predictors. Ann. Statist., 37, 1272-1298.
37. Li, B. & Wang, S. (2007). On directional regression for dimension reduction. J. Amer. Statist. Assoc., 102, 997-1008.
38. Li, B., Wen, S.Q. & Zhu, L.X. (2008). On a projective resampling method for dimension reduction with multivariate responses. J. Amer. Statist. Assoc., 103, 1177-1186.
39. Li, B., Zha, H. & Chiaromonte, F. (2005). Contour regression: a general approach to dimension reduction. Ann. Statist., 33, 1580-1616.
40. Li, G., Zhu, L.P. & Zhu, L.X. (2010). Confidence region for the direction in semi-parametric regressions. J. Multivariate Anal., 101, 1364-1377.
41. Li, L.X., Cook, R.D. & Tsai, C.L. (2007). Partial inverse regression. Biometrika, 94, 615-625.
42. Li, K.C. (1991). Sliced inverse regression for dimension reduction. J. Amer. Statist. Assoc., 86, 316-327.
43. Li, K.C. (1992). On principal Hessian directions for data visualization and dimension reduction: another application of Stein's lemma. J. Amer. Statist. Assoc., 87, 1025-1039.
44. Li, K.C., Aragon, Y., Shedden, K. & Agnan, C.T. (2003). Dimension reduction for multivariate response data. J. Amer. Statist. Assoc., 98, 99-109.
45. Li, K.C. & Duan, N. (1991). Regression analysis under link violation. Ann. Statist., 17, 1009-1052.
46. Luo, R., Wang, H. & Tsai, C.L. (2009). Contour projected dimension reduction. Ann. Statist., 37, 3743-3778.
47. Ma, Y. & Genton, M.G. (2010). Explicit semiparametric estimators for generalized linear latent variable models. J. R. Stat. Soc. Ser. B, 72, 475-495.
48. Ma, Y. & Zhu, L. (2012a). A semiparametric approach to dimension reduction. J. Amer. Statist. Assoc., 107(497), 168-179.
49. Ma, Y. & Zhu, L. (2012b). Efficient estimation in sufficient dimension reduction, Ann. Statist ., http://www.stat.tamu.edu/ma/papers/mz5.pdf.
50. Ma, Y. & Zhu, L. (2012c). Efficiency loss caused by linearity condition in dimension reduction, Biometrika, http://www.stat.tamu.edu/ma/papers/mz4.pdf.
51. Naik, P. & Tsai, C.L. (2000). Partial least squares estimator for single-index models. J. R. Stat. Soc. Ser. B, 62, 763-771.
52. Prendergast, L.A. (2005). Influence functions for sliced inverse regression. Scand. J. Statist., 32, 385-404.
53. Prendergast, L.A. (2007). Implications of influence function analysis for sliced inverse regression and sliced average variance estimation. Biometrika, 94, 585-601.
54. Saracco, J. (2005). Asymptotics for pooled marginal slicing estimator based on SIR approach. J. Multivariate Anal., 96, 117-135.
55. Schott, J.R. (1994). Determining the dimensionality in sliced inverse regression. J. Amer. Statist. Assoc., 89, 141-148.
56. Setodji, C.M. & Cook, R.D. (2004). K -means inverse regression. Technometrics, 46, 421-429.
57. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. Ser. B, 58, 267-288.
58. Tsiatis, A.A. (2006). Semiparametric Theory and Missing Data . New York : Springer.
59. Velilla, S. (1998). Assessing the number of linear components in a general regression problem. J. Amer. Statist. Assoc., 93, 1088-1098.
60. Wang, H. & Xia, Y. (2008). Sliced regression for dimension reduction. J. Amer. Statist. Assoc., 103, 811-821.
61. Xia, Y. (2007). A constructive approach to the estimation of dimension reduction directions. Ann. Statist., 35, 2654-2690.
62. Xia, Y., Tong, H., Li, W.K. & Zhu, L.X. (2002). An adaptive estimation of dimension reduction space (with discussion). J. R. Stat. Soc. Ser. B, 64, 363-410.
63. Ye, Z. & Weiss, R.E. (2003). Using the bootstrap to select one of a new class of dimension reduction methods. J. Amer. Statist. Assoc., 98, 968-979.
64. Yin, X. (2010). Sufficient dimension reduction in regression. In The Analysis of High-dimensional Data, Eds. T.T. Cai & X. Shen, Chapter 9. New Jersey : World Scientific.
65. Yin, X. & Bura, E. (2006). Moment based dimension reduction for multivariate response regression. J. Statist. Plann. Inference, 136, 3675-3688.
66. Yin, X. & Cook, R.D. (2002). Dimension reduction for the conditional kth moment in regression. J. R. Stat. Soc. Ser. B, 64, 159-175.
67. Yin, X. & Cook, R.D. (2005). Direction estimation in single-index regressions. Biometrika, 92, 371-384.
68. Yin, X., Li, B. & Cook, R.D. (2008). Successive direction extraction for estimating the central subspace in a multiple-index regression. J. Multivar. Anal., 99, 1733-1757.
69. Zeng, P. (2008). Determining the dimension of the central subspace and central mean subspace. Biometrika, 95, 469-479.
70. Zeng, P. & Zhu, Y. (2010). An integral transform method for estimating the central mean and central subspaces. J. Multivariate Anal., 101, 271-290.
71. Zhu, L.P., Li, L., Li, R. & Zhu, L.X. (2011). Model-free feature screening for ultrahigh dimensional data. J. Amer. Statist. Assoc., 106(496), 1464-1475.
72. Zhu, L.P., Wang, T., Zhu, L.X. & Férre, L. (2010a). Sufficient dimension reduction through discretization-expectation estimation. Biometrika, 97, 295-304.
73. Zhu, L.P., Yin, X. & Zhu, L.X. (2010b). Dimension reduction for correlated data: an alternating inverse regression. J. Comput. Graph. Statist., 19, 887-899.
74. Zhu, L.P., Yu, Z. & Zhu, L.X. (2010c) A sparse eigen-decomposition estimation in semi-parametric regression. Comput. Statist. Data Anal., 54, 976-986.
75. Zhu, L.P. & Zhu, L.X. (2007). On kernel method for sliced average variance estimation. J. Multivariate Anal., 98, 970-991.
76. Zhu, L.P. & Zhu, L.X. (2009a). Dimension-reduction for conditional variance in regressions. Statist. Sinica, 19, 869-883.
77. Zhu, L.P. & Zhu, L.X. (2009b). On distribution-weighted partial least squares with diverging number of highly correlated predictors. J. R. Stat. Soc. Ser. B, 71, 525-548.
78. Zhu, L.P., Zhu, L.X. & Feng, Z. (2010d). Dimension reduction in regressions through cumulative slicing estimation. J. Amer. Statist. Assoc., 105, 1455-1466.
79. Zhu, L.P., Zhu, L.X. & Wen, S.Q. (2010e). On dimension reduction in regressions with multivariate responses. Statist. Sinica, 20, 1291-1307.
80. Zhu, L.X. & Fang, K.T. (1996). Asymptotics for the kernel estimates of sliced inverse regression. Ann. Statist., 24, 1053-1067.
81. Zhu, L.X., Miao, B. & Peng, H. (2006). On sliced inverse regression with high-dimensional covariates. J. Amer. Statist. Assoc., 101, 630-643.
82. Zhu, L.X., Ohtaki, M. & Li, Y.X. (2007). On hybrid methods of inverse regression based algorithms. Comput. Statist. Data Anal., 51, 2621-2635.
83. Zhu, Y. & Zeng, P. (2006). Fourier methods for estimating the central subspace and the central mean subspace in regression. J. Amer. Statist. Assoc., 101, 1638-1651.
84. Zou, H. (2006). The adaptive Lasso and its oracle properties. J. Amer. Statist. Assoc., 101, 1418-1429.