Sparse non-Gaussian component analysis

IEEE Transactions on Information Theory

Volumn 56, Issue 6, 2010, Pages 3033-3047

  Diederichs, Elmar ^a   Juditsky, Anatoli ^b   Spokoiny, Vladimir ^c   Schütte, Christof ^a  

^a FREIE UNIVERSITÄT BERLIN   (Germany)

^b UNIV GRENOBLE ALPES   (France)

^c HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Convex projection; Model reduction; Principle component analysis (PCA); Reduction of dimensionality; Sparsity structural adaptation; Variable selection

Indexed keywords

CLUSTERING ALGORITHMS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); ITERATIVE METHODS;

CONVEX PROJECTIONS; MODEL REDUCTION; PRINCIPLE COMPONENT ANALYSIS; REDUCTION OF DIMENSIONALITY; STRUCTURAL ADAPTATION; VARIABLE SELECTION;

PRINCIPAL COMPONENT ANALYSIS;

EID: 77957593739     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2010.2046229     Document Type: Article

References (30)

1. F. J. Anscombe and W. J. Glynn, "Distribution of Kurtosis statistic for normal statistics," Biometrika, vol.70, no.1, pp. 227-234, 1983.
2. E. Bura and R. D. Cook, "Estimating the structural dimension of regressions via parametric inverse regression," J. Roy. Statist. Soc. Ser. B, vol.63, no. (393-410), 2001.
3. M. Svensen, C. M. Bishop, and C. K. I.Wiliams, "Gtm: The generative topographic mapping," Neural Computat., vol.10, no.1, pp. 215-234,1998.
4. R. D. Cook, "Principal hessian directions revisited," J. Amer. Statist. Assoc., vol.93, pp. 85-100, 1998.
5. T. M. Cover and J. A. Thomas, Elements of Information Theory, ser. Telecommun. Hoboken, NJ: Wiley, 1991.
6. P. Diaconis and D. Friedman, "Asymptotics of graphical projection pursuit," Ann. Statist., vol.12, no.3, pp. 793-815, 1984.
7. N. E. Goljandina, V. V. Nekrutkin, and A. A. Zhigljavsky, Analysis of Time Series Structure: SSA and Related Technique. Boca Raton, FL: Chapman & Hall, 2001.
8. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, ser. Statistics. New York: Springer, 2001.
9. M. Hristache, A. Juditsky, J. Polzehl, and V. Spokoiny, "Structure adaptive approach for dimension reduction," Ann. Statist., vol.29, no.6, pp. 1537-1566, 2001.
10. P. J. Huber, "Projection pursuit," Ann. Statist., vol.13, pp. 435-475, 1985.
11. A. Hyvärinen, Survey on Independent Component Analysis, 2nd ed. New York: Neural Computing Surveys, 1999, pp. 94-128.
12. F. John, Extremum Problems With Inequalities as Subsidiary Conditions. Boston, MA: Birkhäuser, 1985, Volume Reprinted in: J. Fritz, Collected Papers Vol. 2, pp. 543-560.
13. I. T. Jolliffe, Principal Component Analysis, ser. Springer Ser. Statist., 2nd ed. New York: Springer, 2002.
14. H. C. Thode Jr., Testing for Normality. New York: Marcel-Dekker, 2002.
15. K. C. Li, "Sliced inverse regression for dimension reduction," J. Amer. Statist. Ass., vol.86, pp. 316-342, 1991.
16. K. C. Li, "On principal Hessian directions for data visualisation and dimension reduction: Another application of stein's lemma," Ann. Statist., vol.87, pp. 1025-1039, 1992.
17. M. Mizuta, J. E. Gentle, W. Härdle, and Y. Mori, Eds., Dimension Reduction Methods 2004, pp. 566-589, ch. 6, vol.Handbook of Computational Statistics.
18. Yu. E. Nesterov, "Rounding of convex sets and efficient gradient methods for linear programming problems," Discussion Paper 2004-4, CORE, Catholic Univ. Louvain. Louvain-la-Neuve, Belgium, 2004.
19. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol.290, pp. 2323-2326, 2000.
20. J. P. Royston, "An extension of Shapiro andWilks' w test for normality to large samples," Appl. Statist., vol.31, pp. 115-124, 1982.
21. J. P. Royston, "The w test for normality," Appl. Statist., vol.21, pp. 176-180, 1982.
22. S. S. Shapiro and M. B. Wilk, "An analysis of variance test for normality," Biometrika, vol.52, pp. 591-611, 1965.
23. V. Spokoiny, A penalized Exponential Risk Bound in Parametric Estimation [Online]. Available: http://arxiv.org/abs/0903.1721 2009,WIAS-preprint.
24. V. Spokoiny, G. Blanchard, M. Sugiyama, M. Kawanabe, and K.-R. Müller, "In search of non-Gaussian components of a high-dimensional distribution," J. Mach. Learn. Res., vol.7, pp. 247-282, 2006.
25. M. A. Stephens, R. B. D'Agostino and M. A. Stephens, Eds., "Tests Based on Goodness of Fit," in Goodness of Fit Techniques. New York: Marcel-Dekker, 1986.
26. A. van der Vaart and J. A. Wellner, Weak Convergence and Empirical Processes, ser. Statistics. New York: Springer, 1996.
27. L. Wasserman, All of Nonparametric Statistics, ser. Springer Texts in Statistcs. New York: Springer, 2006.
28. S.Wold, S. Hellberg, M. Sjostrom, and H.Wold, "PLS model building: Theory and applications," PLS Modeling With Latent Variables in Two or More Dimensions, 1987.
29. Y. Xia, H. Tong, W. K. Li, and L.-X. Zhu, "An adaptive estimation of dimension reduction space," J. Royal Statist. Soc., Ser. B, vol.64, no.3, pp. 363-388, 2001.
30. J. H. Zar, Biostatistical Analysis, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1999.