Compression techniques for Chinese text

Software - Practice and Experience

Volumn 28, Issue 12, 1998, Pages 1299-1314

  Vines, Phil ^a   Zobel, Justin ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Chinese text; Compression; PPM (partial predictive matching); Text compression

Indexed keywords

PARTIAL-PREDICTIVE MATCHING (PPM) COMPRESSION TECHNIQUES;

CHARACTER RECOGNITION; CHARACTER SETS; DATA REDUCTION; DATA STRUCTURES; INTERNET;

DATA COMPRESSION;

EID: 0032183785     PISSN: 00380644     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1097-024X(1998100)28:12<1299::AID-SPE203>3.0.CO;2-E     Document Type: Article

References (27)

1. T. C. Bell, J. G. Cleary and I. H. Witten, Text Compression, Prentice-Hall, Englewood Cliffs, NJ, 1990.
2. J. N. Chang, J. S. Chang and M. H. Chen, 'Using word-segmentation model for compression of Chinese text', Computer Processing of Chinese and Orientai Languages, 9 (1), 17-30 (1995).
3. Zhonghua Bookstore, Kang Xi Zidian, seventh edition, 1989 (in Chinese).
4. I. H. Witten, R. M. Neal and J. G. Cleary, 'Arithmetic coding for data compression', Communications of the ACM, 30 (6), 520-541 (1987).
5. G. H. Ong and S. Y. Huang, 'Compression of Chinese text files using a multiple four-bit coding scheme', in T. S. Ng, C. S. Yeo and S. P. Yeo (eds.), Communications on the move ICCS/ISITA, Singapore, 1992, pp. 1062-1066.
6. T. A. Welch, 'A technique for high performance data compression', IEEE Computer, 17, 8-20 (1984).
7. K. T. Lua, 'Compression of Chinese text', International Conference on Chinese Computing '94 (ICCC94), Singapore, June 1994, pp. 367-375.
8. J. Ziv and A. Lempel, 'A universal algorithm for sequential data compression', IEEE Transactions on Information Theory, IT-23 (3), 337-343 (1977).
9. H.-Y. Gu, 'A new Chinese compression scheme combining dictionary coding and adaptive alphabet-character grouping', Computer Processing of Chinese and Oriental Languages, 10 (3), 321-335 (1997).
10. J. G. Cleary and I. H. Witten, 'Data compression using adaptive coding and partial string matching', IEEE Transactions on Communications, COM-32, 396-402 (1984).
11. J. G. Cleary, W. Teahan and I. H. Witten, 'Unbounded length contexts for PPM', in J. A. Storer and M. Cohn (eds.), Proc. IEEE Data Compression Conference, Snowbird, UT, 1995, pp. 52-61.
12. L. Y. Tseng and T. H. Huang, 'A predictive coding method for Chinese text file', Journal of Computers, 2 (3), 18-23 (1990).
13. H. K. Chang and S. H. Chen, 'Extended predictive data coding scheme for Chinese text files', Computer Processing of Chinese and Oriental Languages, 7 (2), 257-271 (1993).
14. H.-Y, Gu, 'Large-alphabet Chinese text compression using adaptive Markov model and arithmetic coder', Computer Processing of Chinese and Oriental Languages, 9 (2), 111-124 (1995).
15. M. K. Tsay, C. H. Kuo, R. H. Ju and M. K. Chou, 'Modelling for Chinese text file compression', International Conference on Industrial Applications of Computing, Alexandria, Egypt, 1992, pp. 205-208.
16. C. E. Shannon, 'Prediction and entropy of printed English', Bell Systems Technical Journal, 30, 55 (1951).
17. V. B. H. Nguyen, P. Vines and R. Wilkinson, 'A comparison of morpheme and word based document retrieval for Asian languages', in R. R. Wagner and H. Thoma (eds.), International Conference on Database and Expert System Applications - DEXA 96, Zurich, Switzerland, 1996, pp. 24-33, Springer.
18. D. E. Knuth, 'Dynamic Huffman coding', Journal of Algorithms, 6, 163-180 (1985).
19. J. S. Vitter, 'Algorithm 673: Dynamic Huffman coding', ACM Transactions on Mathematical Software, 15 (2), 158-167 (1989).
20. S. Bunton, 'Semantically motivated improvements for PPM variants', Computer Journal, 40 (2/3), 76-93 (1997).
21. A. Moffat, J. Zobel and N. Sharman, 'Text compression for dynamic document databases', IEEE Transactions on Knowledge and Data Engineering, 9 (2), 302-313 (1997).
22. D. Harman, 'Overview of the second text retrieval conference (TREC-2)', Information Processing & Management, 31 (3), 271-289 (1995).
23. T. C. Bell, I. H. Witten and J. G. Cleary, 'Modeling for text compression', Computing Surveys, 21 (4), 557-592 (1989).
24. A. Moffat, 'Implementing the PPM data compression scheme', IEEE Transactions on Communications, 38 (11), 1917-1921 (1990).
25. R. N. Williams, Adaptive Data Compression, Kluwer Academic, Norwell, MA, 1991.
26. I. H. Witten and T. C. Bell, 'The zero frequency problem: Estimating the probabilities of novel events in adaptive text compression', IEEE Transactions on Information Theory, 37 (4), 1085-1094 (1991).
27. P. M. Fenwick, 'A new data structure for cumulative probability tables', Software - Practice and Experience, 24 (3), 327-336 (1994). (Errata published in 24 (7): 677, July 1994).