Unsupervised spectral learning of WCFG as low-rank matrix completion

EMNLP 2013 - 2013 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2013, Pages 624-635

  Bailly, Raphaël ^a   Carreras, Xavier ^a   Luque, Franco M ^b   Quattoni, Ariadna ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b UNIVERSIDAD NACIONAL DE CÓRDOBA   (Argentina)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXT FREE GRAMMARS; MATRIX ALGEBRA; NATURAL LANGUAGE PROCESSING SYSTEMS;

HANKEL MATRIX; LOW-RANK MATRIX COMPLETIONS; RECURSIONS; SPECTRAL LEARNING; SPECTRAL METHODS;

HANKEL FUNCTIONS;

EID: 84926285760     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Pieter Adriaans, Marten Trautwein, and Marco Vervoort. 2000. Towards high speed grammar induction on large text corpora. In SOFSEM 2000: Theory and Practice of Informatics, pages 173-186. Springer.
2. Raphaël Bailly, Franois Denis, and Liva Ralaivola. 2009. Grammatical inference as a principal component analysis problem. In Léon Bottou and Michael Littman, editors, Proceedings of the 26th International Conference on Machine Learning, pages 33-40, Montreal, June. Omnipress.
3. Raphaël Bailly, Amaury Habrard, and François Denis. 2010. A spectral approach for probabilistic grammatical inference on trees. In Proceedings of the 21st International Conference Algorithmic Learning Theory, Lecture Notes in Computer Science, pages 74-88. Springer.
4. Raphaël Bailly, Xavier Carreras, and Ariadna Quattoni. 2013. Unsupervised spectral learning of finite-state transducers. In Advances in Neural Information Processing Systems 26.
5. James K. Baker. 1979. Trainable grammars for speech recognition. In D. H. Klatt and J. J. Wolf, editors, Speech Communication Papers for the 97th Meeting of the Acoustical Society of America, pages 547-550.
6. Borja Balle, Ariadna Quattoni, and Xavier Carreras. 2011. A spectral learning algorithm for finite state transducers. In Proceedings of ECML PKDD, pages 156-171.
7. Borja Balle, Ariadna Quattoni, and Xavier Carreras. 2012. Local loss optimization in operator models: A new insight into spectral learning. In John Langford and Joelle Pineau, editors, Proceedings of the 29th International Conference on Machine Learning (ICML-2012), ICML '12, pages 1879-1886, New York, NY, USA, July. Omnipress.
8. Amir Beck and Marc Teboulle. 2009. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Img. Sci., 2(1):183-202, March.
9. Stanley F Chen. 1995. Bayesian grammar induction for language modeling. In Proceedings of the 33rd annual meeting on Association for Computational Linguistics, pages 228-235. Association for Computational Linguistics.
10. Alexander Clark. 2001. Unsupervised induction of stochastic context-free grammars using distributional clustering. In Proceedings of the 2001 workshop on Computational Natural Language Learning-Volume 7, page 13. Association for Computational Linguistics.
11. Alexander Clark. 2007. Learning deterministic context free grammars: The omphalos competition. Machine Learning, 66(1):93-110.
12. Shay B. Cohen, David M. Blei, and Noah A. Smith. 2010. Variational inference for adaptor grammars. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 564-572, Los Angeles, California, June. Association for Computational Linguistics.
13. Shay B. Cohen, Karl Stratos, Michael Collins, Dean P. Foster, and Lyle Ungar. 2012. Spectral learning of latent-variable pcfgs. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 223-231, Jeju Island, Korea, July. Association for Computational Linguistics.
14. Shay B. Cohen, Karl Stratos, Michael Collins, Dean P. Foster, and Lyle Ungar. 2013. Experiments with spectral learning of latent-variable pcfgs. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 148-157, Atlanta, Georgia, June. Association for Computational Linguistics.
15. Matthew Gormley and Jason Eisner. 2013. Nonconvex global optimization for latent-variable models. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL), Sofia, Bulgaria, August. 11 pages.
16. Daniel Hsu, Sham M. Kakade, and Tong Zhang. 2009. A spectral algorithm for learning hidden markov models. In Proceedings of the Annual Conference on Computational Learning Theory (COLT).
17. Daniel Hsu, Sham Kakade, and Percy Liang. 2012. Identifiability and unmixing of latent parse trees. In P. Bartlett, F.C.N. Pereira, C.J.C. Burges, L. Bottou, and K.Q. Weinberger, editors, Advances in Neural Information Processing Systems 25, pages 1520-1528.
18. Dan Klein and Christopher D Manning. 2002. A generative constituent-context model for improved grammar induction. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pages 128-135. Association for Computational Linguistics.
19. Kenichi Kurihara and Taisuke Sato. 2006. Variational bayesian grammar induction for natural language. In Grammatical Inference: Algorithms and Applications, pages 84-96. Springer.
20. Karim Lari and Steve J Young. 1990. The estimation of stochastic context-free grammars using the inside-outside algorithm. Computer speech & language, 4(1):35-56.
21. Percy Liang, Slav Petrov, Michael I Jordan, and Dan Klein. 2007. The infinite PCFG using hierarchical dirichlet processes. In EMNLP-CoNLL, pages 688-697.
22. Franco M. Luque, Ariadna Quattoni, Borja Balle, and Xavier Carreras. 2012. Spectral learning for non-deterministic dependency parsing. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 409-419, Avignon, France, April. Association for Computational Linguistics.
23. Fernando Pereira and Yves Schabes. 1992. Inside-outside reestimation from partially bracketed corpora. In Proceedings of the 30th Annual Meeting of the Association for Computational Linguistics, pages 128-135, Newark, Delaware, USA, June. Association for Computational Linguistics.
24. Slav Petrov, Dipanjan Das, and Ryan McDonald. 2012. A universal part-of-speech tagset. In Proceedings of LREC, May.
25. Kewei Tu and Vasant Honavar. 2008. Unsupervised learning of probabilistic context-free grammar using iterative biclustering. In Grammatical Inference: Algorithms and Applications, pages 224-237. Springer.
26. Menno Van Zaanen. 2000. Abl: Alignment-based learning. In Proceedings of the 18th conference on Computational linguistics-Volume 2, pages 961-967. Association for Computational Linguistics.