A scalable high-bandwidth architecture for lossless compression on FPGAS

Proceedings - 2015 IEEE 23rd Annual International Symposium on Field-Programmable Custom Computing Machines, FCCM 2015

Volumn , Issue , 2015, Pages 52-59

  Fowers, Jeremy ^a   Kim, Joo Young ^a   Burger, Doug ^a   Hauck, Scott ^a,b  

^a MICROSOFT RESEARCH   (United States)

^b University of Washington   (United States)

Author keywords

Data compression; FPGA; Hardware accelerator; High throughput; Huffman encoding; LZ77; Xpress

Indexed keywords

COMMERCE; COMPUTATION THEORY; DATA COMPRESSION; ENCODING (SYMBOLS); FIELD PROGRAMMABLE GATE ARRAYS (FPGA); PIPELINE PROCESSING SYSTEMS; PIPELINES; SIGNAL ENCODING;

HARDWARE ACCELERATORS; HIGH THROUGHPUT; HUFFMAN ENCODING; LZ77; XPRESS;

BANDWIDTH COMPRESSION;

EID: 84943396793     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FCCM.2015.46     Document Type: Conference Paper

References (20)

1. J. Ziv and A. Lempel, "A universal algorithm for sequential data compression, " IEEE Transactions on Information Theory, vol. 23, no. 3, pp. 337-343, 1977.
2. D. A. Huffman, "A method for the construction of minimumredundancy codes, " Proceedings of the IRE, vol. 40, no. 9, pp. 1098-1101, 1952.
3. P. Deutsch. (1996) Rfc 1951 deflate compressed data format specification version 1. 3. [Online]. Available: https://tools. ietf. org/html/rfc1951
4. P. Deutsch. (1996) Gzip file format specification version 4. 3. [Online]. Available: http://tools. ietf. org/html/rfc1952
5. P. Deutsch and J.-L. Gailly. (1996) Zlib compressed data format specification version 3. 3. [Online]. Available: http://tools. ietf. org/html/rfc1950
6. Microsoft. (2014) Ms-xca: Xpress compression algorithm. [Online]. Available: http://msdn. microsoft. com/enus/ library/hh554002. aspx
7. I. Pavlov. (2013) Lzma sdk. [Online]. Available: http://www. 7-zip. org/sdk. html
8. W.-J. Huang, N. Saxena, and E. J. McCluskey, "A reliable lz data compressor on reconfigurable coprocessors, " in Symposium on Field-Programmable Custom Computing Machines. IEEE, 2000, pp. 249-258.
9. S.-A. Hwang and C.-W. Wu, "Unified vlsi systolic array design for lz data compression, " Very Large Scale Integration (VLSI) Systems, IEEE Transactions on, vol. 9, no. 4, pp. 489-499, 2001.
10. S. Rigler, W. Bishop, and A. Kennings, "Fpga-based lossless data compression using huffman and lz77 algorithms, " in Electrical and Computer Engineering, 2007. CCECE 2007. Canadian Conference on. IEEE, 2007, pp. 1235-1238.
11. A. Martin, D. Jamsek, and K. Agarwal, "Fpga-based application acceleration: Case study with gzip compression/ decompression streaming engine, " in Special Session 7C, International Conference on Computer-Aided Design. IEEE, 2013.
12. M. S. Abdelfattah, A. Hagiescu, and D. Singh, "Gzip on a chip: High performance lossless data compression on fpgas using opencl, " in International Workshop on OpenCL. ACM, 2014.
13. B. Sukhwani, B. Abali, B. Brezzo, and A. Sameh, "Highthroughput, lossless data compression on fpgas, " in Symposium on Field-Programmable Custom Computing Machines. IEEE, 2011, pp. 113-116.
14. AHA378. (2015). [Online]. Available: http://www. aha. com/data-compression/
15. C. E. LaForest and J. G. Steffan, "Efficient multi-ported memories for fpgas, " in International Symposium on Field Programmable Gate Arrays. ACM, 2010, pp. 41-50.
16. M. Powell. (2001) The canterbury corpus. [Online]. Available: http://corpus. canterbury. ac. nz/descriptions/
17. S. Deorowicz. (2014) Silesia compression corpus. [Online]. Available: http://sun. aei. polsl. pl/ sdeor/index. php?page=silesia
18. M. Mahoney. (2014) Large text compression benchmark. [Online]. Available: http://mattmahoney. net/dc/text. html
19. J.-Y. Kim, S. Hauck, and D. Burger, "A scalable multiengine xpress9 compressor with asynchronous data transfer, " in Symposium on Field-Programmable Custom Computing Machines. IEEE, 2014, pp. 161-164.
20. A. Putnam et al. , "A reconfigurable fabric for accelerating large-scale datacenter services, " in 41st Annual International Symposium on Computer Architecture (ISCA), 2014.