A linguistically inspired statistical model for chinese punctuation generation

ACM Transactions on Asian Language Information Processing

Volumn 9, Issue 2, 2010, Pages

  Guo, Yuqing ^a   Wang, Haifeng ^a,b   Genabith, Josef Van ^c  

^a Toshiba China Co Ltd   (China)

^b BAIDU INC   (China)

^c DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Chinese punctuation marks; Maximum entropy model; Sentence realization

Indexed keywords

CHINESE NATIONAL STANDARD; DATA INPUT; F-SCORE; HUMAN PERFORMANCE; LANGUAGE MODEL; MAXENT MODELS; MAXIMUM ENTROPY MODELS; NATURAL LANGUAGE PROCESSING; PENN CHINESE TREEBANK; PUNCTUATION MARKS; STATISTICAL MODELS; STRING MATCHING; SYNTACTIC PROPERTIES;

COMPUTATIONAL LINGUISTICS; ENTROPY; ERROR ANALYSIS; FEATURE EXTRACTION; NATURAL LANGUAGE PROCESSING SYSTEMS;

RESTORATION;

EID: 77953784659     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1781134.1781136     Document Type: Article

References (28)

1. BATISTA, F., CASEIRO, D., MAMEDE, N., AND TRANCOSO, I., 2008. Recovering capitalization and punctuation marks for automatic speech recognition: Case study for Portuguese broadcast news. Speech Comm. 50, 10, 847-862.
2. BEEFERMAN, D., BERGER, A., AND LAFFERTY, J., 1998. Cyberpunc: A lightweight punctuation annotation system for speech. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal (ICASSP'98). 689-692.
3. BIKEL, D. M., 2004. On the parameter space of generative lexicalized statistical parsing models. Ph.D. thesis. Department of Computer & Information Science, University of Pennsylvania.
4. BRISCOE, T., 1994. Parsing (with) punctuation etc. Tech. rep., Rank Xerox Research Centre, Grenoble, France.
5. CAHILL, A. AND VAN GENABITH, J., 2006. Robust PCFG-based generation using automatically acquired LFG approximations. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (ACL'06). 1033-1040.
6. CHRISTENSEN, H., GOTOH, Y., AND RENALS, S., 2001. Punctuation annotation using statistical prosody models. In Proceedings of the ISCA Workshop on Prosody in Speech Recognition and Understanding (ISCA'01). 35-40.
7. CHURCH, K. W. AND HANKS, P., 1990. Word association norms, mutual information, and lexicography. Comput. Linguist. 16, 1, 183-213.
8. DORAN, C., 2000. Punctuation in a lexicalized grammar. In Proceedings of the 5th International Workshop on Tree Adjoining Grammar and Related Formalisms (TAG'00).
9. FANO, R. M., 1961. Transmission of Information: A Statistical Theory of Information. MIT Press, Cambridge, MA.
10. GUO, Y., VAN GENABITH, J., AND WANG, H., 2007. Treebank-based acquisition of LFG resources for Chinese. In Proceedings of the Conference on Lexical Functional Grammar (LFG'07). 214-232.
11. GUO, Y., VAN GENABITH, J., AND WANG, H., 2008. Dependency-based n-gram models for general purpose sentence realization. In Proceedings of the 22nd International Conference on Computational Linguistics (ICCL'08). 297-304.
12. KAPLAN, R. M. AND BRESNAN, J., 1982. Lexical functional grammar: A formal system for grammatical representation. In The Mental Representation of Grammatical Relations. MIT Press, Cambridge, MA, 173-282.
13. LANGKILDE, I., 2002. An empirical verification of coverage and correctness for a general-purpose sentence generator. In Proceedings of the 2nd International Conference on Natural Language Generation (INLG'02). 17-24.
14. LI, X., ZONG, C., AND HU, R., 2005. A hierarchical parsing approach with punctuation processing for long Chinese sentences. In Proceedings of the 2nd International Joint Conference on Natural Language Processing (IJNLP'05). 7-12.
15. LIN, D., 1998. Extracting collocations from text corpora. In Proceedings of the 1st Workshop on Computational Terminology (WCT'98), 57.
16. MANNING, C. D. AND SCHUTZE, H., 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.
17. NUNBERG, G., 1990. The Linguistics of Punctuation. CSLI Publications, Stanford, CA.
18. RATNAPARKHI, A., 1996. A maximum entropy model for part-of-speech tagging. In Proceedings of the Empirical Methods in Natural Language Processing (EMNLP'96). 133-142.
19. RATNAPARKHI, A., 1997. A simple introduction to maximum entropy models for natural language processing. Tech. rep., University of Pennsylvania.
20. REED, C. AND LONG, D., 1997. Generating punctuation in written arguments. Tech. rep., University College, London.
21. REYNAR, J. C. AND RATNAPARKHI, A., 1997. A maximum entropy approach to identifying sentence boundaries. In Proceedings of the 5th Conference on Applied Natural Language Processing (ANLP'97). 16-19.
22. SAY, B. AND AKMAN, V., 1996. Information-based aspects of punctuation. In Proceedings of the Association for Computational Linguistics Workshop on Punctuation (ACLWP'96). 49-56.
23. SEBASTIANI, F., 2002. Machine learning in automated text categorization. ACM Comput. Surv. 34, 1, 1-47.
24. TOUTANOVA, K. AND MANNING, C. D., 2000. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP-VLC'00). 63-70.
25. TSENG, H., CHANG, P., ANDREW, G., JURAFSKY, D., AND MANNING, C., 2005. A conditional random field word segmenter. In Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing (WCLP'05). 168-171.
26. WHITE, M., 1995. Presenting punctuation. In Proceedings of the 5th European Workshop on Natural Language Generation (EWNLG'95). 107-125.
27. WHITE, M. AND RAJKUMAR, R., 2008. A more precise analysis of punctuation for broad-coverage surface realization with CCG. In Proceedings of the Workshop on Grammar Engineering Across Frameworks (COLING'08). 17-24.
28. XUE, N. AND PALMER, M., 2005. Automatic semantic role labeling for Chinese verbs. In Proceedings of the 9th International Joint Conferences on Artificial Intelligence (IJCAI'05). 1160-1165.