Lightweight I/O for scientific applications

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2006, Pages

  Oldfield, Ron A ^a   Ward, Lee ^a   Riesen, Rolf ^a   Maccabe, Arthur B ^b   Widener, Patrick ^b   Kordenbrock, Todd ^c  

^a SANDIA NATIONAL LABORATORIES   (United States)

^b University of New Mexico   (United States)

^c HEWLETT PACKARD COMPANY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATIONS.; CLUSTER COMPUTING; CORE SETS; GENERATION SYSTEMS; INTERNATIONAL CONFERENCES; MASSIVELY PARALLEL PROCESSING; PARALLEL FILE SYSTEMS; SCIENTIFIC APPLICATIONS; STANDARD INTERFACES;

CHLORINE COMPOUNDS; STANDARDS;

PARALLEL PROCESSING SYSTEMS;

EID: 46049092568     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2006.311853     Document Type: Conference Paper

References (34)

1. M. Accetta, R. Baron, D. Golub, R. Rashid, A. Tevanian, and M. Young. Mach: A new kernel foundation for UNIX development. In Proceedings of the 1986 Summer USENIX Conference, pages 93-112, 1986.
2. A. Acharya, M. Uysal, and J. Saltz. Active disks: Programming model, algorithms and evaluation. In H. Jin, T. Cortes, and R. Buyya, editors, High Performance Mass Storage and Parallel I/O: Technologies and Applications, chapter 34, pages 499-512. IEEE Computer Society Press and Wiley, New York, NY, 2001.
3. B. N. Bershad, C. Chambers, S. Eggers, C. Maeda, D. McNamee, P. Pardyak, S. Savage, and E. G. Sirer. SPIN: An extensible microkernel for application-specific operating system services. ACM Operating Systems Review, 29(1):74-77, Jan. 1995.
4. R. Brightwell, W. Camp, B. Cole, E. DeBenedictis, R. Leland, J. Tomkins, and A. B. Maccabe. Architectural specification for massively parallel computers: an experience and measurement-based approach. Concurrency and Computation: Practice and Experience, 17(10):1271-1316, Mar. 2005.
5. R. Brightwell, R. Riesen, K. Underwood, T. Hudson, P. Bridges, and A. B. Maccabe. A performance comparison of linux and a lightweight kernel. In Proceedings of the IEEE International Conference on Cluster Computing (Cluster 2003), pages 251-258, Hong Kong, Dec. 2003. IEEE Computer Society Press.
6. W. J. Camp and J. L. Tomkins. The red storm computer architecture and its implementation. In The Conference on High-Speed Computing: LANL/LLNL/SNL, Salishan Lodge, Glenedon Beach, Oregon, Apr. 2003.
7. P. H. Cams, W B. Ligon III, R. B. Ross, and R. Thakur. PVFS: A parallel file system for linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317-327, Atlanta, GA, Oct. 2000. USENIX Association.
8. Lustre: A scalable, high-performance file system. Cluster File Systems Inc. white paper, version 1.0, Nov. 2002. http://www.lustre.org/docs/whitepaper. pdf.
9. K. Coloma, A. Choudhary, W. keng Liao, L. Ward, E. Russell, and N. Pundit. Scalable high-level caching for parallel I/O. In Proceedings of the International Parallel and Distributed Processing Symposium, page 96b, Santa Fe, NM, Apr. 2004. Los Alamitos, CA, USA : IEEE Comput. Soc, 2004.
10. J. M. del Rosario, R. Bordawekar, and A. Choudhary. Improved parallel I/O via a two-phase run-time access strategy. In Proceedings of the IPPS '93 Workshop on Input/Output in Parallel Computer Systems, pages 56-70, Newport Beach, CA, 1993. Also published in Computer Architecture News 21(5), December 1993, pages 31-38.
11. G. A. Gibson, D. F. Nagle, K. Amiri, F. W. Chang, E. M. Feinberg, H. Gobioff, C. Lee, B. Ozceri, E. Riedel, D. Rochberg, and J. Zelenka. File server scaling with network-attached secure disks. Performance Evaluation Review, 25(1):272-84, 1997.
12. G. A. Gibson, D. P. Nagle, K. Amiri, F. W. Chang, E. Feinberg, H. G. C. Lee, B. Ozceri, E. Riedel, and D. Rochberg. A case for network-attached secure disks. Technical Report CMU-CS-96-142, Carnegie-Mellon University, June 1996.
13. H. Gobioff. Security for a High Performance Commodity Storage Subsystem. PhD thesis, Carnegie Mellon University, July 1999. CMU Technical Report CMU-CS-99-160.
14. D. S. Greenberg, R. Brightwell, L. A. Fisk, A. B. Maccabe, and R. Riesen. A system software architecture for high-end computing. In Proceedings of SC97: High Performance Networking and Computing, pages 1-15, San Jose, California, Nov. 1997. ACM Press.
15. J. S. Heidemann and G. J. Popek. File-system development with stackable layers. ACM Transactions on Computer Systems, 12(1):58-89, Feb. 1994.
16. J. L. Hennessy and D. A. Patterson. Computer architecture (2nd ed.): a quantitative approach. Morgan Kaufmann Publishers Inc., 1996.
17. D. Kotz. Disk-directed I/O for MIMD multiprocessors. In H. Jin, T. Cortes, and R. Buyya, editors, High Performance Mass Storage and Parallel I/O: Technologies and Applications, chapter 35, pages 513-535. IEEE Computer Society Press and John Wiley & Sons, 2001.
18. O. Krieger and M. Stumm. HFS: A performance-oriented flexible file system based on building-block compositions. ACM Transactions on Computer Systems, 15(3):286-321, Aug. 1997.
19. R. Latham, N. Miller, R. Ross, and P. Cams. A next-generation parallel file system for linux clusters. Linux-World, 2(1), Jan. 2004.
20. H. M. Levy. Capability-Based Computer Sys-tems. Digital Press, 1984. Available online at http://www.cs.washington.edu/homes/levy/capabook/.
21. A. B. Maccabe and S. R. Wheat. Message passing in PUMA. Technical Report SAND-93-0935C, Sandia National Labs, 1993.
22. R. A. Oldfield, A. B. Maccabe, S. Arunagiri, T. Kordenbrock, R. Riesen, L. Ward, and P. Widener. Lightweight I/O for scientific applications. Technical Report SAND2006-3057, Sandia National Laboratories, Albuquerque, NM, May 2006.
23. R. A. Oldfield, P. Widener, A. B. Maccabe, L. Ward, and T. Kordenbrock. Efficient data-movement for lightweight I/O. In Proceedings of the 2006 International Workshop on High Performance I/O Techniques and Deployment of Very Large Scale I/O Systems, Barcelona, Spain, Sept. 2006. To appear.
24. R. A. Oldfield, D. E. Womble, and C. C. Ober. Efficient parallel I/O in seismic imaging. The International Journal of High Performance Computing Applications, 12(3):333-344, Fall 1998.
25. Object-based storage architecture: Defining a new generation of storage systems built on distributed, intelligent storage devices. Panasas Inc. white paper, version 1.0, Oct. 2003. http://www.panasas.com/docs/.
26. R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. In H. Jin, T. Cortes, and R. Buyya, editors, High Performance Mass Storage and Parallel I/O: Technologies and Applications, chapter 16, pages 224-244. IEEE Computer Society Press and Wiley, New York, NY, 2001.
27. F. Petrini and K. Davis. Tutorial: Achieving Usability and Efficiency in Large-Scale Parallel Computing Systems, Aug. 31, 2004. Euro-Par 2004, Pisa, Italy.
28. P. D. Team. Parallel Virtual File System, Version 2, Sept. 2003. http://www.pvfs.org/pvfs2/pvfs2-guide.html.
29. T. B. Team. An overview of the BlueGene/L supercomputer. In Proceedings of SC2002: High Performance Networking and Computing, Baltimore, MD, Nov. 2002.
30. R. Thakur, W. Gropp, and E. Lusk. Optimizing noncontiguous accesses in MPI-IO. Parallel Computing, 28(1):83-105, Jan. 2002.
31. R. O. Weber. SCSI object-based storage device commands (OSD). Technical Report ISO/EC 14776, incits Technical Committee T10, July 2004. Revision 10.
32. S. R. Wheat, A. B. Maccabe, R. Riesen, D. W. van Dresser, and T. M. Stallcup. PUMA: An operating system for massively parallel systems. In Proceedings of the Twenty-Seventh Annual Hawaii International Conference on System Sciences, pages II:56-65, Wailea, HI, 1994. IEEE Computer Society Press.
33. D. Womble, D. Greenberg, S. Wheat, and R. Riesen. Beyond core: Making parallel computer I/O practical. In Proceedings of the 1993 DAGS/PC Symposium, pages 56-63, Hanover, NH, June 1993. Dartmouth Institute for Advanced Graduate Studies.
34. E. Zadok, I. Badulescu, and A. Shender. Extending file systems using stackable templates. In Proceedings of the 1999 USENIX Technical Conference, pages 57-70. USENIX Association, June 1999.