Efficient parallel CKY parsing on GPUs

IWPT 2011 - Proceedings of the 12th International Conference on Parsing Technologies

Volumn , Issue , 2011, Pages 175-185

  Yi, Youngmin ^a   Lai, Chao Yue ^b   Petrov, Slav ^c   Keutzer, Kurt ^b  

^a University of Seoul   (South Korea)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXT FREE GRAMMARS; DYNAMIC PROGRAMMING; GRAPHICS PROCESSING UNIT; NATURAL LANGUAGE PROCESSING SYSTEMS; SYNTACTICS;

DATA PARALLELISM; FINE GRAINED; INTEGRAL PART; LOW LATENCY; NATURAL LANGUAGE APPLICATIONS; PROBABILISTIC CONTEXT FREE GRAMMARS; REAL- TIME; STATE OF THE ART; SYNTACTIC PARSING; TIME USE;

PROGRAM PROCESSORS;

EID: 85080793869     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. K. Asanovic, R. Bodik, B. Catanzaro, J. Gebis, P. Husbands, K. Keutzer, D. Patterson, W. Plishker, J. Shalf, S. Williams, and K. Yelick. 2006. The landscape of parallel computing research: A view from berkeley. Technical report, Electrical Engineering and Computing Sciences, University of California at Berkeley.
2. J. Bordim, Y. Ito, and K. Nakano. 2002. Accelerating the CKY parsing using FPGAs. In ICHPC’02.
3. X. Carreras, M. Collins, and T. Koo. 2008. TAG, dynamic programming, and the perceptron for efficient, feature-rich parsing. In CoNLL’08.
4. E. Charniak and M. Johnson. 2005. Coarse-to-Fine N-Best Parsing and MaxEnt Discriminative Reranking. In ACL’05.
5. E. Charniak. 2000. A maximum–entropy–inspired parser. In NAACL’00.
6. J. Cocke and J. T. Schwartz. 1970. Programming languages and their compilers: Preliminary notes. Technical report, Courant Institute of Mathematical Sciences, New York University.
7. M. Collins. 1999. Head-Driven Statistical Models for Natural Language Parsing. Ph.D. thesis, University of Pennsylvania, Philadelphia, PA, USA.
8. A. Dunlop, N. Bodenstab, and B. Roark. 2011. Efficient matrix-encoded grammars and low latency parallelization strategies for CYK. In IWPT’11.
9. J. Finkel, A. Kleeman, and C. D. Manning. 2008. Efficient, feature-based, conditional random field parsing. In ACL/HLT’08.
10. E. P. Giachin and C. Rullent. 1989. A parallel parser for spoken natural language. In IJCAL’89.
11. J. Goodman. 1997. Global thresholding and multiple-pass parsing. In EMNLP’97.
12. L. Huang and D. Chiang. 2005. Better k-best parsing. In IWPT’05.
13. T. Kasami. 1965. An efficient recognition and syntax-analysis algorithm for context-free languages. Scientific Report AFCRL-65-758, Air Force Cambridge Research Lab.
14. David B. Kirk and Wen-mei W. Hwu. 2010. Programming Massively Parallel Processors: A Hands-on Approach. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1st edition.
15. D. Klein and C. Manning. 2003. A* parsing: Fast exact viterbi parse selection. In NAACL’03.
16. E. Lindholm, J. Nickolls, S. Oberman, and J. Montrym. 2008. Nvidia tesla: A unified graphics and computing architecture. IEEE Micro, 28(2):39–55.
17. A. G. Manousopoulou, G. Manis, P. Tsanakas, and G. Papakonstantinou. 1997. Automatic generation of portable parallel natural language parsers. In Proceedings of the 9th conference on Tools with Artificial Intelligence.
18. M. Marcus, B. Santorini, and M. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. In Computational Linguistics.
19. J. Nickolls, I. Buck, M. Garland, and K. Skadron. 2008. Scalable parallel programming with CUDA. ACM Queue, 6(2):40–53.
20. T. Ninomiya, K. Torisawa, K. Taura, and J. Tsujii. 1997. A parallel cky parsing algorithm on large–scale distributed–memory parallel machines. In PA-CLING’97.
21. NVIDIA. 2009. Fermi: NVIDIA’s next generation CUDA compute architecture. http://www.nvidia.com/content/PDF/fermi_white_papers/NVIDIA_Fermi_Compute_ Architecture_Whitepaper.pdf.
22. A. Pauls and D. Klein. 2009. Hierarchical search for parsing. In NAACL-HLT’09.
23. S. Petrov and D. Klein. 2007a. Discriminative log-linear grammars with latent variables. In NIPS’07.
24. S. Petrov and D. Klein. 2007b. Improved inference for unlexicalized parsing. In NAACL’07.
25. S. Petrov, L. Barrett, R. Thibaux, and D. Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In ACL’06.
26. E. Pontelli, G. Gupta, J. Wiebe, and D. Farwell. 1998. Natural language processing: A case study. In AAAI ’98.
27. M. P. van Lohuizen. 1999. Parallel processing of natural language parsers. In ParCo’99, pages 17–20.
28. D.H. Younger. 1967. Recognition and parsing of context-free languages in time n3. Information and Control, 10.