Minibatch and parallelization for online large margin structured learning

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 370-379

  Zhao, Kai ^a   Huang, Liang ^a,b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

E-LEARNING; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; PARALLEL PROCESSING SYSTEMS;

ARCHITECTURE-BASED; BATCH LEARNING; FAST CONVERGENCE; LARGE MARGINS; LEARNING METHODS; ONLINE LEARNING; ONLINE LEARNING ALGORITHMS; PARALLELIZATIONS; SIMPLE++; STRUCTURED LEARNING;

LEARNING ALGORITHMS;

EID: 84905674636     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. David Chiang. 2012. Hope and fear for discriminative training of statistical translation models. J. Machine Learning Research (JMLR), 13:1159-1187.
2. C.-T. Chu, S.-K. Kim, Y.-A. Lin, Y.-Y. Yu, G. Bradski, A. Ng, and K. Olukotun. 2007. Map-reduce for machine learning on multicore. In Advances in Neural Information Processing Systems 19.
3. Michael Collins and Brian Roark. 2004. Incremental parsing with the perceptron algorithm. In Proceedings of ACL.
4. Michael Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of EMNLP.
5. Koby Crammer and Yoram Singer. 2003. Ultraconservative online algorithms for multiclass problems. J. Mach. Learn. Res., 3:951-991, March.
6. Jenny Rose Finkel, Alex Kleeman, and Christopher D. Manning. 2008. Efficient, feature-based, conditional random field parsing. In Proceedings of ACL.
7. Kevin Gimpel, Dipanjan Das, and Noah Smith. 2010. Distributed asynchronous online learning for natural language processing. In Proceedings of CoNLL.
8. Clifford Hildreth. 1957. A quadratic programming procedure. Naval Research Logistics Quarterly, 4(1):79-85.
9. Liang Huang and Kenji Sagae. 2010. Dynamic programming for linear-time incremental parsing. In Proceedings of ACL 2010.
10. Liang Huang, Suphan Fayong, and Yang Guo. 2012. Structured perceptron with inexact search. In Proceedings of NAACL.
11. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of ICML.
12. Percy Liang and Dan Klein. 2009. Online em for unsupervised models. In Proceedings of NAACL.
13. Ryan McDonald and Fernando Pereira. 2006. Online learning of approximate dependency parsing algorithms. In Proceedings of EACL.
14. Ryan McDonald, Koby Crammer, and Fernando Pereira. 2005. Online large-margin training of dependency parsers. In Proceedings of the 43rd ACL.
15. Ryan McDonald, Keith Hall, and Gideon Mann. 2010. Distributed training strategies for the structured perceptron. In Proceedings of NAACL, June.
16. Shai Shalev-Shwartz, Yoram Singer, and Nathan Srebro. 2007. Pegasos: Primal estimated sub-gradient solver for svm. In Proceedings of ICML.
17. M. Zinkevich, A. J. Smola, and J. Langford. 2009. Slow learners are fast. In Advances in Neural Information Processing Systems 22.