Making the most of bag of words: Sentence regularization with alternating direction method of multipliers

31st International Conference on Machine Learning, ICML 2014

Volumn 2, Issue , 2014, Pages 997-1005

  Yogatama, Dani ^a   Smith, Noah A ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; TEXT PROCESSING;

ALTERNATING DIRECTION METHOD OF MULTIPLIERS; ALTERNATING DIRECTIONS METHOD OF MULTIPLIERS; BAG OF WORDS; HIGH-DIMENSIONAL LEARNING; OVERLAPPING GROUPS; PREDICTION TASKS; TEXT CATEGORIZATION; TRAINING DATA;

LEARNING SYSTEMS;

EID: 84919913907     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Bach, Francis, Jenatton, Rodolphe, Mairal, Julien, and Obozinski, Guillaume. Convex Optimization with Sparsity-Inducing Norms. The MIT Press, 2011.
2. Bergstra, James, Bardenet, Remi, Bengio, Yoshua, and Kegl, Balazs. Algorithms for hyper-parameter optimization. In Proc. of NIPS, 2011.
3. Blitzer, John, Dredze, Mark, and Pereira, Fernando. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In Proc. of ACL, 2007.
4. Boyd, Stephen, Parikh, Neal, Chu, Eric, Peleato, Boija, and Eckstein, Jonathan. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning, 3(1): 1-122, 2010.
5. Chen, Xi, Lin, Qihang, Kim, Seyoung, Carbonell, Jaime G., and Xing, Eric P. Smoothing proximal gradient method for general structured sparse learning. In Proc. of UAI, 2011.
6. Cortes, Corinna and Vapnik, Vladimir. Support-vector networks. Machine Learning, 20(3):273-297, 1995.
7. Duchi, John and Singer, Yoram. Efficient online and batch learning using forward backward splitting. Journal of Machine Learning Research, 10:2899-2934, 2009.
8. Forman, George. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3:1289-1305, 2003.
9. Friedman, Jerome, Hastie, Trevor, and Tibshiran, Robert. A note on the group lasso and a sparse group lasso. Technical report, Stanford University, 2010.
10. Goldstein, Tom and Osher, Stanley. The split bregman method for 11-regularized problems. SIAM Journal on Imaging Sciences, 2 (2):323-343, 2009.
11. Hestenes, Magnus R. Multiplier and gradient methods. Journal of Optimization Theory and Applications, 4:303-320, 1969.
12. Hoerl, Arthur E. and Kennard, Robert W. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1): 55-67, 1970.
13. Jacob, Laurent, Obozinski, Guillaume, and Vert, Jean-Philippe. Group lasso with overlap and graph lasso. In Proc. Of lCML, 2009.
14. Jenatton, Rodolphe, Audibert, Jean-Yves, and Bach, Francis. Structured variable selection with sparsity-inducing norms. Journal of Machine Learning Research, 12:2777-2824, 2011.
15. Kim, Seyoung and Xing, Eric P. Feature selection via block- regularized regression. In Proc. Of UAI, 2008.
16. Kogan, Shimon, Levin, Dimitry, Routledge, Bryan R., Sagi, Jacob S., and Smith, Noah A. Predicting risk from financial reports with regression. In Proc. of HLT-NAACL, 2009.
17. Martins, Andre F. T., Smith, Noah A., Aguiar, Pedro M. Q., and Figueiredo, Mario A. T. Online learning of structured predictors with multiple kernels. In Proc. of AISTATS, 2011a.
18. Martins, Andre F. T., Smith, Noah A., Aguiar, Pedro M. Q., and Figueiredo, Mario A. T. Structured sparsity in structured prediction. In Proc. Of EMNLP, 2011b.
19. Moreau, J. J. Fonctions convexes duales et points proximaux dans un espace hilbertien. CR Acad. Sci. Paris Ser. A Math, 255: 2897-2899, 1963.
20. Pang, Bo and Lee, Lilian. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proc. of ACL, 2004.
21. Pang, Bo and Lee, Lilian. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1-2): 1-135, 2008.
22. Powell, M. J. D. A method for nonlinear constraints in minimization problems. In Fletcher, R. (ed.), Optimization, pp. 283-298. Academic Press, 1969.
23. Qin, Zhiwei (Tony) and Goldfarb, Donald. Structured sparsity via alternating direction methods. Journal of Machine Learning Research, 13:1435-1468, 2012.
24. Radev, Dragomir R., Muthukrishnan, Pradeep, and Qazvinian, Vahed. The ACL anthology network corpus. In Proc. of ACL Workshop on Natural Language Processing and Information Retrieval for Digital Libraries, 2009.
25. Reynar, Jeffrey C. and Ratnaparkhi, Adwait. A maximum entropy approach to identifying sentence boundaries. In Proc. of the Fifth Conference on Applied Natural Language Processing, 1997.
26. Socher, Richard, Perelygin, Alex, Wu, Jean, Chuang, Jason, Manning, Chris, Ng, Andrew, and Potts, Chris. Recursive deep models for semantic compositionality over a sentiment tree- bank. In Proc. ofEMNLP, 2013.
27. Tackstrom, Oscar and McDonald, Ryan. Discovering fine-grained sentiment with latent variable structured prediction models. In Proc. Of ECIR, 2011.
28. Thomas, Matt, Pang, Bo, and Lee, Lilian. Get out the vote: Determining support or opposition from congressional floor-debate transcripts. In Proc. Of EMNLP, 2006.
29. Tibshirani, Robert. Regression shrinkage and selection via the lasso. Journal of Royal Statistical Society B, 58(1):267-288, 1996.
30. Wu, Tong Tong, Chen, Yi Fang, Hastie, Trevor, Sobel, Eric, and Lange, Kenneth. Genome-wide association analysis by lasso penalized logistic regression. Bioinformatics, 25(6):714-721, 2009.
31. Yano, Tae, Smith, Noah A., and Wilkerson, John D. Textual predictors of bill survival in congressional committees. In Proc. of NAACL, 2012.
32. Yessenalina, Ainur, Yue, Yisong, and Cardie, Claire. Multi-level structured models for document sentiment classification. In Proc. Of EMNLP, 2010.
33. Yogatama, Dani, Heilman, Michael, O'Connor, Brendan, Dyer, Chris, Routledge, Bryan R., and Smith, Noah A. Predicting a scientific communitys response to an article. In Proc. of EMNLP, 2011.
34. Yuan, Lei, Liu, Jun, and Ye, Jieping. Efficient methods for overlapping group lasso. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(9):2104-2116, 2013.
35. Yuan, Ming and Lin, Yi. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society, Series B, 68(1):49-67, 2006.
36. Zaidan, Omar F. and Eisner, Jason. Modeling annotators: A generative approach to learning from annotator rationales. In Proc. of EMNLP, 2008.
37. Zou, Hui and Hastie, Trevor. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society, Series B, 67:301-320, 2005.