Sparse machine learning methods for understanding large text corpora

Proceedings of the 2011 Conference on Intelligent Data Understanding, CIDU 2011

Volumn , Issue , 2011, Pages 159-173

  El Ghaoui, Laurent ^a   Li, Guan Cheng ^a   Duong, Viet An ^b   Pham, Vu ^c   Srivastava, Ashok ^d   Bhaduri, Kanishka ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b ECOLE DES MINES D ALÈS   (France)

^c UNIVERSITY OF NATURAL SCIENCES   (Viet Nam)

^d NASA HEADQUARTERS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COSTS; CONTRIBUTING FACTOR; HIGH DIMENSIONAL DATA; MACHINE LEARNING METHODS; PRINCIPAL COMPONENTS; SPARSE GRAPHICAL MODELS; TEXT SUMMARIZATION; UNSUPERVISED ANALYSIS;

INFORMATION RETRIEVAL SYSTEMS; NASA; SAFETY ENGINEERING; TEXT PROCESSING;

LEARNING SYSTEMS;

EID: 84893279977     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (48)

1. M. A. U. Abedin, V. Ng, and L. Khan. Cause identification from aviation safety incident reports via weakly supervised semantic lexicon construction. J. Artif. Int. Res., 38: 569-631, May 2010.
2. A. Agovic and A. Banerjee. Gaussian process topic models. In Proceedings of the Twenty-Sixth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-10), pages 10-19, Corvallis, Oregon, 2010.
3. M. S. Ahmed and L. Khan. SISC: A Text Classification Approach Using Semi Supervised Subspace Clustering. In Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, ICDMW '09, pages 1-6, 2009.
4. D. Blei and J. McAuliffe. Supervised topic models. In J. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems 20, pages 121-128. MIT Press, Cambridge, MA, 2008.
5. 1 minimization. Annals of Statistics, 37: 2145-2177, 2009.
6. X. Dai, J. Jia, L. El Ghaoui, and B. Yu. SBA-term: Sparse bilingual association for terms. In Fifth IEEE International Conference on Semantic Computing, Palo Alto, CA, USA, 2011.
7. D. Das and A. F. T. Martins. A survey on automatic text summarization, 2007.
8. A. d'Aspremont, F. Bach, and L. El Ghaoui. Optimal solutions for sparse principal component analysis. Journal of Machine Learning Research, 9: 1269-1294, 2008.
9. B. Ding, D. Lo, J. Han, and S.-C. Khoo. Efficient Mining of Closed Repetitive Gapped Subsequences from a Sequence Database. In Proceedings of the 2009 IEEE International Conference on Data Engineering, pages 1024-1035, 2009.
10. B. Ding, B. Zhao, C. X. Lin, J. Han, and C. Zhai. Topcells: Keyword-based search of top-k aggregated documents in text cube. Data Engineering, International Conference on, pages 381-384, 2010.
11. A. Dobra, C. Hans, B. Jones, J. R. Nevins, G. Yao, and M. West. Sparse graphical models for exploring gene expression data. Journal of Multivariate Analysis, 90(1): 196-212, 2004. Special Issue on Multivariate Methods in Genomic Data Analysis.
12. D. Donoho. Compressed sensing. IEEE Transactions on Information Theory, 52(4): 1289-1306, 2006.
13. J. Eisenstein, A. Ahmed, and E. P. Xing. parse additive generative models of text. In International Conference on Machine Learning (ICML), 2011.
14. L. El Ghaoui, V. Viallon, and T. Rabbani. Safe feature elimination for the LASSO. Journal of Machine Learning Research, 2011. Submitted, April 2011.
15. M. Elad and M. Aharon. Image denoising via sparse and redundant representations over learned dictionaries. IEEE Transactions on Image Processing, 15(12): 3736-3745, 2006.
16. J. Friedman, T. Hastie, H. Höfling, and R. Tibshirani. Pathwise coordinate optimization. Annals of Applied Statistics, 1(2): 302-332, 2007.
17. J. Friedman, T. Hastie, and R. Tibshirani. Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3): 432, 2008.
18. B. Gawalt, J. Jia, L. Miratrix, L. El Ghaoui, B. Yu, and S. Clavier. Discovering word associations in news media via feature selection and sparse classification. In Proc. 11th ACM SIGMM International Conference on Multimedia Information Retrieval, 2010.
19. J. Goldstein, V. Mittal, J. Carbonell, and M. Kantrowitz. Multi-document summarization by sentence extraction. In NAACL-ANLP 2000 Workshop on Automatic summarization, pages 40-48, 2000.
20. L. Hennig. Topic-based multi-document summarization with probabilistic latent semantic analysis. In Recent Advances in Natural Language Processing (RANLP), 2009.
21. T. Joachims. Learning to Classify Text Using Support Vector Machines - Methods, Theory, and Algorithms. Kluwer/Springer, 2002.
22. J. E. Jonsson and W. R. Ricks. Cognitive models of pilot categorization and prioritization of flight-deck information. Technical report, 1995.
23. M. Journée, Y. Nesterov, P. Richtárik, and R. Sepulchre. Generalized power method for sparse principal component analysis. arXiv: 0811.4724, 2008.
24. M. Kolar, A. Parikh, and E. Xing. On Sparse Nonparametric Conditional Covariance Selection. International Conference on Machine Learning, 2010.
25. C. X. Lin, B. Ding, J. Han, F. Zhu, and B. Zhao. Text Cube: Computing IR Measures for Multidimensional Text Database Analysis. IEEE International Conference on Data Mining, pages 905-910, 2008.
26. Z. Lu, R. Monteiro, and M. Yuan. Convex optimization methods for dimension reduction and coefficient estimation in multivariate linear regression. Mathematical Programming, 9(1): 1-32, 2010.
27. L. Mackey. Deflation methods for sparse PCA. Advances in Neural Information Processing Systems, 21: 1017-1024, 2009.
28. J. Mairal, G. Sapiro, and M. Elad. Learning multiscale sparse representations for image and video restoration. SIAM Multiscale Modeling and Simulation, 7(1): 214-241, 2008.
29. N. Meinshausen and B. Yu. Lasso-type recovery of sparse representations for high-dimensional data. Annals of Statistics, 37(1): 246-270, 2008.
30. L. Miratrix, J. Jia, B. Gawalt, B. Yu, and L. El Ghaoui. Summarizing large-scale, multiple-document news data: sparse methods and human validation. submitted to JASA.
31. B. Moghaddam, Y. Weiss, and S. Avidan. Fast Pixel/Part Selection with Sparse Eigenvectors. Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1-8, 2007.
32. B. L. Monroe, M. P. Colaresi, and K. M. Quinn. Fightin' words: Lexical feature selection and evaluation for identifying the content of political conflict. Political Analysis, 16(4): 372-403, 2008.
33. Y. Nesterov. Efficiency of coordinate descent methods on huge-scale optimization problems. CORE Discussion Papers, 2010.
34. O. Banerjee, L. El Ghaoui, and A. d'Aspremont. Model selection through sparse maximum likelihood estimation for multivariate gaussian or binary data. Journal of Machine Learning Research, 9: 485-516, March 2008.
35. N. C. Oza, J. P. Castle, and J. Stutz. Classification of Aeronautics System Health and Safety Documents. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 39(6): 670-680, 2009.
36. I. Persing and V. Ng. Semi-supervised cause identification from aviation safety reports. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2, pages 843-851, 2009.
37. F. Schilder and R. Kondadadi. Fastsum: fast and accurate query-based multi-document summarization. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers, HLT-Short '08, pages 205-208, Stroudsburg, PA, USA, 2008. Association for Computational Linguistics.
38. H. Shan, A. Banerjee, and N. C. Oza. Discriminative Mixed-Membership Models. In Proceedings of the 2009 Ninth IEEE International Conference on Data Mining, pages 466-475, Washington, DC, USA, 2009.
39. H. Shen and J. Z. Huang. Sparse principal component analysis via regularized low rank matrix approximation. J. Multivar. Anal., 99: 1015-1034, July 2008.
40. J. Songsiri and L. Vandenberghe. Topology selection in graphical models of autoregressive processes. Journal of Machine Learning Research, 2010.
41. R. Tibshirani. Regression shrinkage and selection via the LASSO. Journal of the Royal statistical society, series B, 58(1): 267-288, 1996.
42. J. A. Tropp. Just relax: Convex programming methods for identifying sparse signals. IEEE Trans. Inform. Theory, 51(3): 1030-1051, Mar. 2006.
43. C. Woolam and L. Khan. Multi-concept Document Classification Using a Perceptron-Like Algorithm. In Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01, pages 570-574, 2008.
44. C. Woolam and L. Khan. Multi-label large margin hierarchical perceptron. IJDMMM, 1(1): 5-22, 2008.
45. M. Yuan and Y. Lin. Model selection and estimation in the Gaussian graphical model. Biometrika, 94(1): 19, 2007.
46. D. Zhang, C. Zhai, J. Han, A. Srivastava, and N. Oza. Topic modeling for OLAP on multidimensional text databases: topic cube and its applications. Stat. Anal. Data Min., 2: 378-395, December 2009.
47. Y. Zhang, A. d'Aspremont, and L. El Ghaoui. Sparse PCA: Convex relaxations, algorithms and applications. In M. Anjos and J. Lasserre, editors, Handbook on Semidefinite, Cone and Polynomial Optimization: Theory, Algorithms, Software and Applications. Springer, 2011. To appear.
48. H. Zou, T. Hastie, and R. Tibshirani. Sparse Principal Component Analysis. Journal of Computational & Graphical Statistics, 15(2): 265-286, 2006.