Enhancing data migration performance via parallel data compression

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002

Volumn , Issue , 2002, Pages 444-451

  Lee, Jonghyun ^a   Winslett, M ^a   Ma, Xiaosong ^a   Yu, Shengke ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84966559314     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2002.1015528     Document Type: Conference Paper

References (19)

1. A. Apostolico and S. Lonardi. Compression of biological sequences by greedy off-line textual substitution. In Proc. Data Compression Conference, Snowbird, 2000.
2. BBFTP home page. http://ccweb.in2p3.fr/bbftp/.
3. V. Engelson, D. Fritzson, and P. Fritzson. Lossless compression of high-volume numerical data for simulations. In Proc. Data Compression Conference, Snowbird, 2000.
4. Personal communication with Mike Folk, head of the HDF project at NCSA.
5. I. Foster, D. Kohr, Jr., R. Krishnaiyer, and J. Mogill. Remote I/O: Fast access to distant storage. In Proc. IOPADS, San Jose, 1997.
6. File Transfer Protocol (FTP) Specification. RFC 959.
7. NCSA HDF home page. http://hdf.ncsa.uiuc.edu.
8. P. Howard and J. Vitter. Parallel lossless image compression using Huffman and arithmetic coding. In Proc. Data Compression Conference, Snowbird, 1992.
9. HTTP/1.0 Specification. RFC 1945.
10. J. Lee, M. Winslett, X. Ma, and S. Yu. Tuning high-performance scientific codes: The use of performance models to control resource usage during data migration and I/O. In Proc. Int'l Conf. on Supercomputing, Sorrento, 2001.
11. J. Mogul, F. Douglis, A. Feldmann, and B. Krishnamurthy. Potential benefits of delta encoding and data compression for HTTP. In Proc. of Conf. on Applications, Technologies, Architectures, and Protocols for Computer Communication, Cannes, 1997.
12. MPEG home page. http://www.cselt.it/mpeg.
13. H. Nielsen, J. Gettys, A. Baird-Smith, E. Prud'hommeaux, H. Lie, and C. Lilley. Network performance effect of HTTP/1.1, CSS1, and PNG. In Proc. Conf. on Applications, Technologies, Architectures, and Protocols for Computer Communication, Cannes, 1997.
14. J. No, S.-S. Park, J. Carretero, A. Choudhary, and P. Chen. Design and implementation of a parallel I/O runtime system for irregular applications. In Proc. IPPS, Orlando, 1998.
15. K. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-directed collective I/O in Panda. In Proc. Supercomputing, San Diego, 1995.
16. K. Seamons and M. Winslett. A data management approach for handling large compressed arrays in hight performance computing. In Proc. Symp. on Frontiers of Massively Parallel Computation, McLean, 1995.
17. Universal source encoding for scientific data. http://www.mrc.unm.edu/Uses/index.html.
18. R. Thakur, W. Gropp, and E. Lusk. Data sieving and collective I/O in ROMIO. In Proc. Symp. on Frontiers of Massively Parallel Computation, Annapolis, 1999.
19. J. Tilton, D. Han, and M. Manohar. Compression experiments with AVHRR data. In Proc. Data Compression Conference, Snowbird, 1991.