Sparse logistic principal components analysis for binary data

Annals of Applied Statistics

Volumn 4, Issue 3, 2010, Pages 1579-1601

  Lee, Seokho ^a   Huang, Jianhua Z ^b   Hu, Jianhua ^c  

^a HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c UNIVERSITY OF TEXAS MD ANDERSON CANCER CENTER   (United States)

Author keywords

Binary data; Dimension reduction; LASSO; MM algorithm; PCA; Regularization; Sparsity

Indexed keywords

EID: 80051959023     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/10-AOAS327     Document Type: Article

References (27)

1. Böhning, D. (1999). The lower bound method in probit regression. Comput. Statist. Data Anal. 30 13-17.
2. Brookes, A. J. (1999). Review: The essence of SNPs. Gene 234 177-186.
3. Collins, M., Dasgupta, S. and Schapire, R. E. (2002). A generalization of principal component analysis to the exponential family. In Advanced in Neural Information Processing System (T. G. Dietterich, S. Becker and Z. Ghahramani, eds.) 14 617-642. MIT Press, Cambridge, MA.
4. de Leeuw, J. (2006). Principal component analysis of binary data by iterated singular value decomposition. Comput. Statist. Data Anal. 50 21-39.
5. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39 1-38.
6. Ewens, W. J. and Spielman, R. S. (1995). The transmission/disequilibrium test: History, subdivision, and admixture. The American Journal of Human Genetics 57 455-464.
7. Golub, G. and van Loan, C. F. (1996). Matrix Computations, 3rd ed. Johns Hopkins Univ. Press, Baltimore, MD.
8. Hao, K., Li, C., Rosenow, C. and Wong, W. H. (2004). Detect and adjust for population stratification in population-based association study using genomic control markers: An application of Affymetrix Genechip® Human Mapping 10K array. European Journal of Human Genetics 12 1001-1006.
9. Hotelling, H. (1933). Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology 24 417-441.
10. Hunter, D. R. and Lange, K. (2004). A tutorial on MM algorithms. Amer. Statist. 58 30-37.
11. Hunter, D. R. and Li, R. (2005). Variable selection using MM algorithms. Ann. Statist. 33 1617-1642.
12. Jaakkola, T. S. and Jordan, M. I. (2000). Bayesian parameter estimation via variational methods. Statist. Comput. 10 25-37.
13. Jolliffe, I. T. (2002). Principal Component Analysis, 2nd ed. Springer, New York.
14. Jolliffe, I. T., Trendafilov, M. and Uddine, M. (2003). A modified principal component technique based on the LASSO. J. Comput. Graph. Statist. 12 531-547.
15. Kwok, P. Y., Deng, Q., Zakeri, H., Taylor, S. L. and Nickerson, D. A. (1996). Increasing the information content of STS-based genome maps: Identifying polymorphisms in mapped STSs. Genomics 31 123-126.
16. Lange, K., Hunter, D. R. and Yang, I. (2000). Optimization transfer using surrogate objective functions (with discussion). J. Comput. Graph. Statist. 9 1-20.
17. Lee, S., Huang, J. Z. and Hu, J. (2010). The MM algorithm for sparse logistic PCA using the tight bound: A supplementary note to "Sparse logistic principal components analysis for binary data". DOI: 10.1214/10-AOAS327SUPP.
18. Liang, Y. and Kelemen, A. (2008). Statistical advances and challenges for analyzing correlated high dimensional SNP data in genomic study for complex diseases. Stat. Surv. 2 43-60.
19. Pearson, K. (1901). On lines and planes of closest fit to systems of points in space. The London, Edinburgh and Dublin Pholosophical Magazine and Journal of Science, Sixth Series 2 559-572.
20. Risch, N., Burchard, E., Ziv, E. and Tang, H. (2002). Categorization of humans in biomedical research: Genes, race and disease. Genome Biology 3 comment 2007.1-2007.12.
21. Schein, A. I., Saul, L. K. and Ungar, L. H. (2003). A generalized linear model for principal component analysis of binary data. In Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics (C. M. Bishop and B. J. Frey, eds.) 14-21. Key West, FL.
22. Serre, D., Montpetit, A., Paré, G., Engert, J. G., Yusuf, S., Keavney, B., Hudson, K. J. and Anand, S. (2008). Correction of population stratification in large multi-ethnic association studies. PLoS ONE 2 e1382.
23. Shen, H. and Huang, J. Z. (2008). Sparse principal component analysis via regularized low rank matrix approximation. J. Multivariate Anal. 99 1015-1034.
24. The International HapMap Consortium (2005). A haplotype map of the human genome. Nature 437 1299-1320.
25. Tibshirani, R. J. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267-288.
26. Zou, H., Hastie, T. J. and Tibshirani, R. J. (2006). Sparse principal component analysis. J. Comput. Graph. Statist. 15 265-286.
27. Zou, H., Hastie, T. J. and Tibshirani, R. J. (2007). On the "Degrees of Freedom" of the LASSO. Ann. Statist. 35 2173-2192.