A fast, highly reliable data compression chip and algorithm for storage systems

IBM Journal of Research and Development

Volumn 40, Issue 6, 1996, Pages 603-612

  Cheng, J M ^{a,b,c,d,e,f,g,h}   Duyanovich, L M ^b   Craft, D J ^b  

^a IBM   (United States)

^b CYU ^*

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e Macrodata Inc

^f Teledyne Systems

^g IBM ALMADEN RESEARCH CENTER   (United States)

^h IBM RESEARCH ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER HARDWARE; COST EFFECTIVENESS; DATA STORAGE EQUIPMENT; INFORMATION RETRIEVAL SYSTEMS; MICROPROCESSOR CHIPS; PERFORMANCE; SEMICONDUCTOR DEVICE MANUFACTURE;

COMPRESSION ALGORITHM; DATA COMPRESSION CHIP; SILICON TECHNOLOGY;

DATA COMPRESSION;

EID: 0030284515     PISSN: 00188646     EISSN: None     Source Type: Journal    
DOI: 10.1147/rd.406.0603     Document Type: Article

References (33)

1. Mayank Patel, Neil MacLean, and Glen G. Langdon, Jr., "An Economical Hardware-Oriented High-Speed Data Compression Scheme," Research Report RJ-9170, IBM Research Laboratory, San Jose, CA, January 11, 1993.
2. Glen G. Langdon, Joe-Ming Cheng, Ronald B. Arps, and Patrick E. Mantey, "Hardware-Optimized Compression and the Skew Coder LSI Chip," described the BAC chip (completed in 1982) and the research efforts on three applications: file, binary image, and gray-scale compression, 1983-1984; Research Report RJ-8611, IBM Research Laboratory, San Jose, CA, February 6, 1992.
3. David A. Huffman, "A Method for the Construction of Minimum Redundancy Codes," Proc. IRE 40, 1098-1101 (1952).
4. J. J. Rissanen, "Generalized Kraft Inequality and Arithmetic Coding," IBM J. Res. Develop. 20, No. 3, 198-203 (1976).
5. Richard C. Pasco, "Source Coding Algorithm for Fast Data Compression," Ph.D. thesis, Department of Electrical Engineering, Stanford University, Stanford, CA, 1976.
6. Glen G. Langdon, Jr., "An Introduction to Arithmetic Coding," IBM J. Res. Develop. 28, No. 2, 135-149 (March 1984).
7. Robert G. Gallager, "Variations on a Theme by Huffman," IEEE Trans. Info. Theory IT-24, No. 6, 668-674 (November 1978).
8. Richard W. Hamming, Coding and Information Theory, ISBN 0-13-139139-9, Prentice-Hall, Inc., Englewood Cliffs, NJ, 1980.
9. J. Rissanen and G. G. Langdon, Jr., "Arithmetic Coding," IBM J. Res. Develop. 23, No. 2, 149-162 (March 1979).
10. Jorma Rissanen and Glen G. Langdon, "Universal Modeling and Coding," IEEE Trans. Info. Theory IT-27, No. 1, 12-23 (January 1981).
11. Ian H. Witten, Radford M. Neal, and John G. Cleary, "Arithmetic Coding for Data Compression," Commun. ACM 30, No. 6, 520-540 (June 1987).
12. Joe-Ming Cheng and Glen G. Langdon, "Image Compression with QM-AYA Adaptive Binary Arithmetic Coder," SPIE Proc. 1771 (Application of Digital Image Processing XV), 413-423 (1992).
13. N. Abramson, Information Theory and Coding, McGraw-Hill Book Co., Inc., New York, 1963, pp. 61-62.
14. R. Morris, "Counting Large Numbers of Events in Small Registers," Commun. ACM 21, 840-842 (1978).
15. Philippe Flajolet, "Approximate Counting: A Detailed Analysis," BIT 25, 113-134 (1985).
16. Daniel R. Helman, Glen G. Langdon, N. Martin, and Stephen Todd, "Statistics Collection for Compression Coding with Randomizing Feature," IBM Tech. Disclosure Bull. 24, 4917 (1982).
17. Glen G. Langdon and Jorma Rissanen, "Compression of Black-White Images with Arithmetic Coding," IEEE Trans. Commun. COM-29, 858-867 (June 1981).
18. W. B. Pennebaker, J. L. Mitchell, G. G. Langdon, Jr., and R. B. Arps, "An Overview of the Basic Principles of the Q-Coder Adaptive Binary Arithmetic Coder," IBM J. Res. Develop. 32, No. 6, 717-726 (November 1988). W. B. Pennebaker and J. L. Mitchell, "Probability Estimation for the Q-Coder," IBM J. Res. Develop. 32, No. 6, 737-752 (November 1988).
19. W. B. Pennebaker, J. L. Mitchell, G. G. Langdon, Jr., and R. B. Arps, "An Overview of the Basic Principles of the Q-Coder Adaptive Binary Arithmetic Coder," IBM J. Res. Develop. 32, No. 6, 717-726 (November 1988). W. B. Pennebaker and J. L. Mitchell, "Probability Estimation for the Q-Coder," IBM J. Res. Develop. 32, No. 6, 737-752 (November 1988).
20. R. B. Arps, T. K. Truong, D. J. Lu, R. C. Pascoe, and T. D. Friedman, "A Multi-Purpose VLSI Chip for Adaptive Data Compression of Bilevel Images," IBM J. Res. Develop. 32, No. 6, 775-795 (November 1988).
21. Joe-Ming Cheng and Glen G. Langdon, "Modified Metropolis Annealing Algorithm for QM-AYA Arithmetic Coder Design Optimization," SPIE Proc. 2028 (Application of Digital Image Processing), 2-12 (1993).
22. Jacob Ziv and Abraham Lempel, "A Universal Algorithm for Sequential Data Compression," IEEE Trans. Info. Theory IT-23, No. 3, 337-343 (May 1977).
23. Jacob Ziv and Abraham Lempel, "Compression of Individual Sequences via Variable-Rate Coding," IEEE Trans. Info. Theory IT-24, No. 5, 530-536 (September 1978).
24. Rory D. Jackson and Willi K. Rackl (both from the IBM Poughkeepsie Laboratory), "Data Expansion Apparatus," essentially described the LZ1; patent filed on June 30, 1976; U.S. Patent 4,054,951, October 18, 1977.
25. Victor S. Miller and Mark N. Wegman, "Variation on a Theme by Ziv and Lempel," Research Report RC-10630, IBM Thomas J. Watson Research Center, Yorktown Heights, NY, July 31, 1984.
26. Thomas H. Cormen, Charles E. Leiserson, and Ronald L. Rivest, "String Matching," Introduction to Algorithms, McGraw-Hill Book Co., Inc., New York, 1990, Ch. 34.
27. Thomas H. Cormen, Charles E. Leiserson, and Ronald L. Rivest, "Radix Sort," Introduction to Algorithms, McGraw-Hill Book Co., Inc., New York, 1990, Ch. 9.
28. Joe-Ming Cheng and Yancy L. Cheng, "A Method and Means for Character String Pattern Matching for Compression and the Like Using Minimal Cycle per Character," U.S. Patent 5,525,982, June 11, 1996.
29. Joe-Ming Cheng, Ehud D. Karnin, David J. Craft, and Larry J. Garibay, "Effective 286 LZ1/JR Compression Coding Format for Hardware and Software and the Fast Attack Option," SA9-94-061, IBM filed U.S. patent application, 1995.
30. Glen G. Langdon, "Further Development in Lossless Gray-Scale Image Compression," presented at the IBM Conference on Pattern Recognition and Image Processing, Session C1, IBM Thomas J. Watson Research Center, November 14, 1984; also known as the "SUNSET algorithm," reprinted as IBM Research Report RJ-6426, September 1988.
31. Glen G. Langdon, "Further Development in Lossless Gray-Scale Image Compression," presented at the IBM Conference on Pattern Recognition and Image Processing, Session C1, IBM Thomas J. Watson Research Center, November 14, 1984; also known as the "SUNSET algorithm," reprinted as IBM Research Report RJ-6426, September 1988.
32. J. G. Cleary and I. H. Witten, "Data Compression Using Adaptive Coding and Partial String Matching," IEEE Trans. Commun. COM-32, No. 4, 396-402 (April 1984).
33. Ted Lattrell, "40 MB/sec Throughput IBM Compression Chip and Macro Announcement," EE Times, front page, August 16, 1993.