L1AND L2REGULARIZATION FOR MULTICLASS HINGE LOSS MODELS

Machine Learning in Speech and Language Processing, MLSLP 2011

Volumn , Issue , 2011, Pages 1-5

  Moore, Robert C ^a   DeNero, John ^a  

^a GOOGLE INC   (United States)

Author keywords

hinge loss; Regularization; sparsity; support vector machines; SVMs

Indexed keywords

LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

EXPERIMENTAL EVIDENCE; HINGE LOSS; LINEAR MODELING; LOSS FUNCTIONS; LOSS MODEL; REGULARISATION; SPARSE MODELS; SPARSITY; SUPPORT VECTORS MACHINE; SVM;

SUPPORT VECTOR MACHINES;

EID: 85087831031     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Galen Andrew and Jianfeng Gao, 2007. Scalable training of L1-regularized log linear models. In Proceedings of the 24th International Conference on Machine Learning, June 20-24, Corvallis, Oregon, USA, 33-40.
2. Koby Crammer and Yoram Singer. 2001. On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2:265-292.
3. Thorsten Joachims. 2006. Training linear SVMs in linear time. In KDD '06, Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 20-23, Philadelpha, Pennsylvania, USA, 217-216.
4. Thorsten Joachims, Thomas Finley, and Chun-Nam John Yu. 2009. Cutting-plane training of structural SVMs. Journal of Machine Learning, 77(1):27-59.
5. Percy Liang, Hal Daumé III, and Dan Klein. 2008. Structure compilation: trading structure for features. In Proceedings of the 24th International Conference on Machine Learning, July 5-9, Helsinki, Finland, 592-599.
6. Mitchell P. Marcus, Beatrice Santorini, and Mary A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2):313-330.
7. Andrew McCallum. 2002. MALLET: A machine learning for language toolkit. http://mallet.cs.umass.edu.
8. Jorge Nocedal and Stephen J. Wright. 1999. Numerical Optimization. Springer.
9. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, July 7-12, Sapporo, Japan, 160-167.
10. Libin Shen, Giorgio Satta, and Aravind K. Joshi. 2007. Guided learning for bidirectional sequence classification. in Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, June 23-30, Prague, Czech Republic, 760-767.
11. Kristina Toutanova, Dan Klein, Christopher D. Manning, and Yoram Singer. 2003. Feature-rich part-ofspeech tagging with a cyclic dependency network. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, May 27-June 1, Edmonton, Alberta, Canada, 173-180.