Mining Pinyin-to-Character Conversion Rules From Large-Scale Corpus: A Rough Set Approach

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 2, 2004, Pages 834-844

  Xiaolong, Wang ^a,b   Qingcai, Chen ^a   Yeung, Daniel S ^b  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Data generalization; Data mining; Pinyin to character conversion; Rough set

Indexed keywords

DATA MINING; INFORMATION RETRIEVAL; INTERPOLATION; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; ROUGH SET THEORY;

DATA GENERALIZATION; PINYIN-TO-CHARACTER CONVERSION; ROUGH SET;

CHARACTER RECOGNITION;

EID: 1842587892     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.817101     Document Type: Article

References (25)

1. Z. Chen and K.-F. Lee, "A new statistical approach to Chinese Pinyin input," in ACL-2000, Hong Kong, 2000, pp. 241-247.
2. G. Jianfeng, J. Goodman, M. Li, and K.-F. Lee, "Toward a unified approach to statistical language modeling for Chinese," ACM Trans. Asian Lang. Infonn. Process., vol. 1, no. 1, pp. 3-33, 2002.
3. X. Wang, D. Yeung, and X. Wang, "Chinese intelligent input method," in Proc. Int. Conf. Artificial Intelligence. Las Vegas, NV, 2000, pp. 1203-1208.
4. M. Siu and M. Ostendorf, "Variable n-grams and extensions for conversational speech language modeling, "IEEE Trans. Speech Audio Processing, vol. 8, pp. 63-75, Jan. 2000.
5. R. Kuhn and R. de Mori, "A cache based natural language model for speech recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 570-583, 1999.
6. J. Goodman, "A bit of progress in language modeling," Comput. Speech Lang., vol. 15, pp. 403-434, 2001.
7. H. Ney, U. Essen, and R. Kneser, "On structuring probabilistic dependences in stochastic language modeling," Comput. Speech Lang., vol. 8, pp. 1-38, 1994.
8. R. Rosenfeld, "A maximum entropy approach to adaptive statistical language modeling," Comput. Speech Lang., vol. 10, pp. 187-228, 1996.
9. B. Roark, "Probabilistic top-down parsing and language modeling," Computat. Linguist., vol. 27, no. 2, pp. 249-276, 2001.
10. C. Chelba and F. Jelinek, "Structured language modeling," Comput. Speech Lang., vol. 14, no. 4, pp. 283-332, 2001.
11. P. F. Brown, V. J. Della Pietra, P. V. deSouza, J. C. Lai, and R. L. Mercer, "Class-based n-gram models of natural language," Computat. Linguist., vol. 8, pp. 467-479, 1992.
12. T. R. Niesler and P. C. Woodland, "Variable-length category n-gram language models," Comput. Speech Lang., vol. 13, pp. 99-124, 1999.
13. E. Brill, "Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging," Computat. Linguist., vol. 21, no. 4, pp. 543-565, 2001.
14. Z. Pawlak, "Rough sets," Int. J. Comput. Inform. Sci., vol. 11, pp. 341-356, 1982.
15. _, "Rough set theory and its applications to data analysis," Cybern. Syst., vol. 29, pp. 661-668, 1998.
16. I. Duntsch and G. Gediga, "Uncertainty measures of rough set prediction," Artif. Intell., vol. 106, pp. 109-137, 1998.
17. Y. Yang, "An evaluation of statistical approaches to text categorization," Inform. Retrieval, vol. 1-2, no. 1, pp. 69-90, 1999.
18. J. He, A. H. Tan, and C. L. Tan, "A comparative study on chinese text categorization methods," in PRICA 2000 Workshop on Text and Web Mining, Melbourne, Australia, 2000, pp. 24-35.
19. J. W. Guan, D. Bell, and A. Bell, "Rough computational methods for information systems," Artif. Intell., vol. 105, pp. 77-103, 1998.
20. X. Wang and F.Fu Guohong et al., "Models and algorithms of chinese word segmentation," in Proc. Int. Confer. Artificial Intelligence (ICAI'2000), Las Vegas, NV, 2000, pp. 1279-1284.
21. X. Hu and N. Cercone, "Mining knowledge rules from databases: a rough set approach," in Proce. 12th Int. Conf. Data Engineering (ICDE'96), New Orleans, LA, 1996, pp. 96-105.
22. S. F. Chen and J. T. Goodman, "An empirical study of smoothing techniques for language modeling," Comput. Speech Lang., vol. 13, pp. 359-394, 1999.
23. Q.-D. Wang, X.-J. Wang, and X.-P. Wang, "Variable precision rough set model based dataset partition and association rule," in Proce. IEEE Int. Conf. Machine Learning and Cybernetics, vol. 4, 2002, pp. 2175-2179.
24. K. M. Ali and M. J. Pazzani, "Error reduction through learning multiple descriptions," Mach. Learn., vol. 23, no. 3, pp. 173-202, 1996.
25. Z. GuoDong and L. KimTeng, "Interpolation of n-grams and mutual-information based trigger pair language models for mandarin speech recognition," Comput. Speech Lang., vol. 13, pp. 125-141, 1998.