Improved natural language learning via variance-regularization support vector machines

CoNLL 2010 - Fourteenth Conference on Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2010, Pages 172-181

  Bergsma, Shane ^a   Lin, Dekang ^b   Schuurmans, Dale ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING RATES; LEXICAL DISAMBIGUATION; NATURAL LANGUAGE LEARNING; QUADRATIC FUNCTION; TRAINING EXAMPLE;

SUPPORT VECTOR MACHINES;

EID: 84862273336     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (47)

1. Mikhail Belkin, Partha Niyogi, and Vikas Sindhwani. 2006. Manifold regularization: A geometric frame work for learning from labeled and unlabeled exam ples. JMLR, 7:2399-2434.
2. Shane Bergsma, Dekang Lin, and Randy Goebel. 2008. Distributional identification of non-referential pronouns. In ACL-08: HLT.
3. Shane Bergsma, Dekang Lin, and Randy Goebel. 2009. Web-scale N-gram models for lexical disam biguation. In IJCAI.
4. John Blitzer, Mark Dredze, and Fernando Pereira. 2007. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classi fication. In ACL.
5. Avrim Blum and Tom Mitchell. 1998. Combining labeled and unlabeled data with co-training. In COLT.
6. Thorsten Brants and Alex Franz. 2006. The Google Web 1T 5-gram Corpus Version 1.1. LDC2006T13.
7. Martin Chodorow, Joel R. Tetreault, and Na-Rae Han. 2007. Detection of grammatical errors involving prepositions. In ACL-SIGSEM Workshop on Prepo sitions.
8. Kenneth Church, Ted Hart, and Jianfeng Gao. 2007. Compressing trigram language models with Golomb coding. In EMNLP-CoNLL.
9. David Cohn, Les Atlas, and Richard Ladner. 1994. Improving generalization with active learning. Mach. Learn., 15(2):201-221.
10. Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Mach. Learn., 20(3):273-297.
11. CPLEX. 2005. IBM ILOG CPLEX 9.1. www.ilog.com/products/cplex/.
12. Koby Crammer and Yoram Singer. 2001. On the algorithmic implementation of multiclass kernel-based vector machines. JMLR, 2:265-292.
13. Koby Crammer and Yoram Singer. 2003. Ultracon-servative online algorithms for multiclass problems. JMLR, 3:951-991.
14. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. 2006. Online passive-aggressive algorithms. JMLR, 7:551-585.
15. Hal III Daumé. 2007. Frustratingly easy domain adaptation. In ACL.
16. Mark Dredze, Koby Crammer, and Fernando Pereira. 2008. Confidence-weighted linear classification. In ICML.
17. Richard O. Duda and Peter E. Hart. 1973. Pattern Classification and Scene Analysis. John Wiley & Sons.
18. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLIN-EAR: A library for large linear classification. JMLR, 9:1871-1874.
19. Andrew R. Golding and Dan Roth. 1999. A Winnow-based approach to context-sensitive spelling correction. Mach. Learn., 34(1-3):107-130.
20. Sariel Har-Peled, Dan Roth, and Dav Zimak. 2003. Constraint classification for multiclass classification and ranking. In NIPS.
21. Graeme Hirst and Alexander Budanitsky. 2005. Correcting real-word spelling errors by restoring lexical cohesion. Nat. Lang. Eng., 11(1):87-111.
22. Chih-Wei Hsu and Chih-Jen Lin. 2002. A comparison of methods for multiclass support vector machines. IEEE Trans. Neur. Networks, 13(2):415-425.
23. Thorsten Joachims, Thomas Finley, and Chun-Nam John Yu. 2009. Cutting-plane training of structural SVMs. Mach. Learn., 77(1):27-59.
24. Thorsten Joachims. 2002. Optimizing search engines using clickthrough data. In KDD.
25. Thorsten Joachims. 2006. Training linear SVMs in linear time. In KDD.
26. Terry Koo, Xavier Carreras, and Michael Collins. 2008. Simple semi-supervised dependency parsing. In ACL-08: HLT.
27. Irene Kotsia, Stefanos Zafeiriou, and Ioannis Pitas. 2009. Novel multiclass classifiers based on the min imization of the within-class variance. IEEE Trans. Neur. Networks, 20(1):14-34.
28. Mirella Lapata and Frank Keller. 2005. Web-based models for natural language processing. ACM Trans. Speech and Language Processing, 2(1):1-31.
29. David McClosky, Eugene Charniak, and Mark Johnson. 2006. Effective self-training for parsing. In HLT-NAACL.
30. Scott Miller, Jethran Guinness, and Alex Zamanian. 2004. Name tagging with word clusters and discriminative training. In HLT-NAACL.
31. Andrew Y. Ng and Michael I. Jordan. 2002. Discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. In NIPS.
32. Vincent NG. 2009. Graph-cut-based anaphoricity determination for coreference resolution. In NAACL-HLT.
33. Franz J. Och and Hermann Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In ACL.
34. Daisuke Okanohara and Jun'ichi Tsujii. 2007. A discriminative language model with pseudo-negative samples. In ACL.
35. Chris D. Paice and Gareth D. Husk. 1987. Towards the automatic recognition of anaphoric features in English text: the impersonal pronoun "it". Computer Speech and Language, 2:109-132.
36. Rajat Raina, Andrew Y. NG, and Daphne Koller. 2006. Constructing informative priors using transfer learning. In ICML.
37. Ryan Rifkin and Aldebaro Klautau. 2004. In defense of one-vs-all classification. JMLR, 5:101-141.
38. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: training log-linear models on unlabeled data. In ACL.
39. Anastasios Tefas, Constantine Kotropoulos, and Ioan-nis Pitas. 2001. Using support vector machines to enhance the performance of elastic graph matching for frontal face authentication. IEEE Trans. Pattern Anal. Machine Intell., 23:735-746.
40. Joel R. Tetreault and Martin Chodorow. 2008. The ups and downs of preposition error detection in ESL writing. In COLING.
41. Simon Tong and Daphne Koller. 2002. Support vector machine active learning with applications to text classification. JMLR, 2:45-66.
42. Ioannis Tsochantaridis, Thorsten Joachims, Thomas Hofmann, and Yasemin Altun. 2005. Large margin methods for structured and interdependent output variables. JMLR, 6:1453-1484.
43. Vladimir N. Vapnik. 1998. Statistical Learning Theory. John Wiley & Sons.
44. Qin Iris Wang, Colin Cherry, Dan Lizotte, and Dale Schuurmans. 2006. Improved large margin dependency parsing via local constraints and Laplacian regularization. In CoNLL.
45. Jason Weston and Chris Watkins. 1998. Multi-class support vector machines. Technical Report CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London.
46. David Yarowsky. 1995. Unsupervised word sense disambiguation rivaling supervised methods. In ACL.
47. Omar Zaidan, Jason Eisner, and Christine Piatko. 2007. Using "annotator rationales" to improve machine learning for text categorization. In NAACL-HLT.