Improving I/O forwarding throughput with data compression

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2011, Pages 438-445

  Welton, Benjamin ^a   Kimpe, Dries ^b   Cope, Jason ^a   Patrick, Christina M ^c   Iskra, Kamil ^a   Ross, Robert ^a  

^a ARGONNE NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

I O Forwarding; Scientific Data Compression

Indexed keywords

CPU RESOURCES; DATA SETS; HIGH-PERFORMANCE COMPUTING CLUSTERS; I/O PERFORMANCE; NETWORK BANDWIDTH; NETWORK SPEED; NETWORK TRAFFIC; SCIENTIFIC DATA COMPRESSION;

BANDWIDTH; BANDWIDTH COMPRESSION; CLUSTER COMPUTING; COMPUTER SOFTWARE SELECTION AND EVALUATION;

DATA COMPRESSION;

EID: 80955123442     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2011.80     Document Type: Conference Paper

References (35)

1. D. A. Lelewer and D. S. Hirschberg, "Data compression,"ACM Comput. Surv., vol. 19, no. 3, pp. 261-296, 1987.
2. D. Le Gall, "MPEG: A video compression standard for multimedia applications," Commun. ACM, vol. 34, no. 4, pp. 46-58, 1991. (Pubitemid 21701250)
3. H. Man, A. Docef, and F. Kossentini, "Performance analysis of the JPEG 2000 image coding standard," Multimedia Tools Appl., vol. 26, no. 1, pp. 27-57, 2005. (Pubitemid 41201704)
4. X. Chen, W. Wang, and G. Wei, "Impact of HTTP compression on web response time in asymmetrical wireless network,"in NSWCTC '09: Proceedings of the International Conference on Networks Security, Wireless Communications and Trusted Computing, 2009, pp. 679-682.
5. J. C. Mogul, F. Douglis, A. Feldmann, and B. Krishnamurthy, "Potential benefits of delta encoding and data compression for HTTP," in SIGCOMM '97: Proceedings of the ACM SIGCOMM '97 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, 1997, pp. 181-194.
6. W. Dong, X. Chen, S. Xu, W. Wang, and G. Wei, "Proxy-based object packaging and compression: A web acceleration scheme for UMTS," in WiCOM'09: Proceedings of the 5th International Conference on Wireless Communications, Networking and Mobile Computing, 2009, pp. 4965-4969.
7. K. J. Ma and R. Bartos, "Analysis of transport optimization techniques," in ICWS '06: Proceedings of the IEEE International Conference on Web Services, 2006, pp. 611-620.
8. A. B. King, Website Optimization. O'Reilly, 2008.
9. R. L. R. Mattson and S. Ghosh, "HTTP-MPLEX: An enhanced hypertext transfer protocol and its performance evaluation,"J. Netw. Comput. Appl., vol. 32, no. 4, pp. 925-939, 2009.
10. S. Deshpande and W. Zeng, "Scalable streaming of JPEG2000 images using hypertext transfer protocol," in MULTIMEDIA '01: Proceedings of the ninth ACM international conference on Multimedia, 2001, pp. 372-381.
11. R. Kothiyal, V. Tarasov, P. Sehgal, and E. Zadok, "Energy and performance evaluation of lossless file data compression on server systems," in SYSTOR '09: Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference, 2009, pp. 1-12.
12. A. R. Alameldeen and D. A. Wood, "Adaptive cache compression for high-performance processors," in ISCA '04: Proceedings of the 31st Annual International Symposium on Computer Architecture, 2004, p. 212.
13. R. Canal, A. González, and J. E. Smith, "Very low power pipelines using significance compression," in MICRO 33: Proceedings of the 33rd annual ACM/IEEE International Symposium on Microarchitecture, 2000, pp. 181-190.
14. K. C. Barr and K. Asanović, "Energy-aware lossless data compression," ACM Trans. Comput. Syst., vol. 24, no. 3, pp. 250-291, 2006.
15. R. Das, A. Mishra, C. Nicopoulos, D. Park, V. Narayanan, R. Iyer, M. Yousif, and C. Das, "Performance and power optimization through data compression in network-on-chip architectures," in IEEE 14th International Symposium on High Performance Computer Architecture, 2008., 2008, pp. 215-225.
16. Y. Chen, A. Ganapathi, and R. Katz, "To compress or not to compress - compute vs. IO tradeoffs for MapReduce energy efficiency," in Proceedings of the First ACM SIGCOMM Workshop on Green Networking. ACM, 2010, pp. 23-28.
17. B. Nicolae, "High throughput data compression for cloud storage,"Data Management in Grid and Peer-to-Peer Systems, pp. 1-12, 2011.
18. S. Plimpton, "Fast parallel algorithms for short-range molecular dynamics," J Comp Phys, no. 117, pp. 1-19, 1995.
19. LAMMPS documentation: dump command. [Online]. Available: http://lammps.sandia.gov/doc/dump.html
20. "Hierarchical data format 5," http://www.hdfgroup.org/ HDF5/.
21. A. Collette. (2009) LZF compression filter for HDF5. [Online]. Available: http://h5py.alfven.org/lzf/
22. btrfs wiki. [Online]. Available: https://btrfs.wiki.kernel.org/
23. M. Larabel. (2010, August) Using disk compression with Btrfs to enhance performance. [Online]. Available: http://www.phoronix.com/scan.php?page= article&item= btrfs-compress-2635
24. The Hadoop distributed file system. [Online]. Available: http://hadoop.apache.org/hdfs/
25. Using LZO compression. [Online]. Available: http://wiki. apache.org/hadoop/UsingLzoCompression
26. K. Ohta, D. Kimpe, J. Cope, K. Iskra, R. Ross, and Y. Ishikawa, "Optimization techniques at the I/O forwarding layer," in IEEE International Conference on Cluster Computing, 2010.
27. N. Ali, P. Carns, K. Iskra, D. Kimpe, S. Lang, R. Latham, R. Ross, L. Ward, and P. Sadayappan, "Scalable I/O forwarding framework for high-performance computing systems," in IEEE International Conference on Cluster Computing, 2009.
28. J. Cope, K. Iskra, D. Kimpe, and R. Ross, "Bridging HPC and Grid file I/O with IOFSL," in Para 2010: State of the Art in Scientific and Parallel Computing, 2010.
29. LZO real-time data compression library. [Online]. Available: http://www.oberhumer.com/opensource/lzo/
30. bzip2. [Online]. Available: http://www.bzip2.org/
31. zlib. [Online]. Available: http://www.zlib.net/
32. P. Deutsch. (1996, May) DEFLATE compressed data format specification version 1.3. [Online]. Available: http: //tools.ietf.org/html/rfc1951
33. European Nucleotide Archive. [Online]. Available: http: //www.ebi.ac.uk/
34. CORE.2 global air-sea flux dataset. [Online]. Available: http://dss.ucar.edu/datasets/ds260.2/
35. NCEP FNL operational model global tropospheric analyses. [Online]. Available: http://dss.ucar.edu/datasets/ds083.2/