Dynamic active storage for high performance I/O

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2012, Pages 379-388

  Chen, Chao ^a   Chen, Yong ^a  

^a Texas Tech University   (United States)

Author keywords

active storage; data intensive computing; dynamic active storage; high end computing; parallel file systems; parallel I O

Indexed keywords

ACTIVE STORAGE; DATA-INTENSIVE COMPUTING; HIGH END COMPUTING; PARALLEL FILE SYSTEM; PARALLEL I/O;

ARCHITECTURE; BANDWIDTH; FILE ORGANIZATION;

DIGITAL STORAGE;

EID: 84871178404     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2012.22     Document Type: Conference Paper

References (32)

1. A. Acharya and J. Saltz. Active Disks : Programming Model , Algorithms and Evaluation. In Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, 1998.
2. J. F. O. Callaghan and M. D. M. The Extraction of Drainage Networks from Digital Elevation Data. Computer Vision, Graphics and Image Processing, 8:323-344, 1984.
3. S. Chiu, W.-k. Liao, and A. Choudhary. Design and Evaluation of Distributed Smart Disk Architecture for I/O-Intensive Workloads. In Proceedings of International Conference on Computational Science, 2003.
4. G. Chockler and D. Malkhi. Active Disk Paxos with infinitely many processes. In Proceedings of the 21st ACM Symposium on Principles of Distributed Computing, 2002.
5. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51:107-113, Jan. 2008.
6. T. El-Ghazawi and L. Smith. UPC: Unified Parallel C. In Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, SC '06, 2006.
7. E. J. Felix, K. Fox, K. Regimbal, and J. Nieplocha. Active Storage Processing in a Parallel File System. In 6th LCI International Conference on Linux Clusters: The HPC Revolution, Chapel Hill, North Carolina, 2005.
8. M. Franklin, R. Chamberlain, M. Henrichs, B. Shands, and J. White. An Architecture for Fast Processing of Large Unstructured Data Sets. In Proceedings of the IEEE International Conference on Computer Design, 2004.
9. W. Jiang and G. Agrawal. Ex-mate: Data intensive computing with large reduction objects and its application to graph. In 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pages 475-484, 2011.
10. W. Jiang, V. Ravi, and G. Agrawal. A map-reduce system with an alternate api for multi-core environments. In 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid), pages 84-93, may 2010.
11. K. Keeton, D. A. Patterson, and J. M. Hellerstein. A Case for Intelligent Disks ( IDISKs ). SIGMOD Record, 27(3):42-52, 1998.
12. H. Lim, V. Kapoor, C. Wighe, and D. Du, H.-C. Active Disk File System: a Distributed, Scalable File System. In 18th IEEE Symposium on Mass Storage Systems and Technologies (MSS '01.), pages 101-116, San Diego, CA, USA, 2001. IEEE Computer Society.
13. X. Ma and A. L. N. Reddy. MVSS : Multi-View Storage System. In 21st International Conference on Distributed Computing Systems, pages 31-38, Mesa, AZ , USA, 2001.
14. X. Ma and A. N. Reddy. MVSS : An Active Storage Architecture. IEEE Transactions on Parallel and Distributed Systems, 14(10):993-1005, 2003.
15. J. Nieplocha, R. J. Harrison, and R. J. Littlefield. Global arrays: a Portable "Shared-memory" Programming Model for Distributed Memory Computers. In SC'94, pages 340-349, 1994.
16. J. Piernas and J. Nieplocha. Efficient Management of Complex Striped Files in Active Storage. In Proceedings of the 14th international Euro-Par conference on Parallel Processing, 2008.
17. J. Piernas, J. Nieplocha, and E. J. Felix. Evaluation of Active Storage Strategies for the Lustre Parallel File System. In Proceedings of the 2007 ACM/IEEE conference on Supercomputing, 2007.
18. L. Qin and D. Feng. Active Storage Framework for Object-based Storage Device. In 20th International Conference on Advanced Information Networking and Applications, pages 97-101, 2006.
19. B. Rich and D. Thain. DataLab: Transactional Data-Parallel Computing on an Active Storage Cloud*. In IEEE/ACM High Performance Distributed Computing, 2008.
20. E. Riedel, G. Gibson, and C. Faloutsos. Active Storage For Large-Scale Data Mining and Multimedia. In In Proceedings of the 24rd International Conference on Very Large Data Bases(VLDB '98 ), New York, NY, USA, 1998.
21. E. Riedel, G. A. Gibson, and D. Nagle. Active Disks for Large-Scale Data Processing. IEEE Computer, 2001.
22. M. Sivathanu, A. Arpaci-Dusseau, and R. Arpaci-Dusseau. Evolving RPC for Active Storage. In Proceedings of the 10th international conference on Architectural support for programming languages and operating systems, volume 37, New York, NY, USA, 2002. ACM.
23. M. Sivathanu, V. Prabhakaran, F. I. Popovici, T. E. Denehy, A. C. Arpaci-Dusseau, and R. H. Arpaci- Dusseau. Semantically-Smart Disk Systems. In FAST, 2003.
24. C. W. Smullen, S. Rohinton, S. Gurumurthi, P. Ranganathan, and M. Uysal. Active Storage Revisited : The Case for Power and Performance Benefits for Unstructured Data Processing Applications. Proceedings of the 5th conference on Computing frontiers, 2008.
25. S. W. Son, S. Lang, P. Carns, R. Ross, and R. Thakur. Enabling Active Storage on Parallel I / O Software Stacks. In 26th IEEE Symposium on Mass Storage Systems and Technologies (MSST), 2010.
26. D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the condor experience. Concurrency - Practice and Experience, 17(2-4):323-356, 2005.
27. L. Toma, R. Wickremesinghe, L. Arge, J. S. Chase, and J. S. Vitter. Flow computation on massive grids. In Proceedings of the 9th ACM international symposium on Advances in geographic information systems, 2001.
28. M. Uysal, A. Acharya, and J. Saltz. Evaluation of Active Disks for Decision Support Databases. In Proceedings of 6th International Symposium on High-performance Computer Architecture, pages 337-348, 2000.
29. E. L. W. D. Gropp and R. Thakur. Using MPI-2. MIT Press, 1999.
30. R. Wickremesinghe, J. S. Chase, and J. S. Vitter. Distributed Computing with Load-Managed Active Storage. In Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing(HPDC-11), 2002.
31. Y. Xie, D. Fengt, and D. D. E. Long. Design and Evaluation of Oasis : An Active Storage Framework based on TIO OSD Standard. In 27th IEEE Symposium on Mass Storage Systems and Technologies (MSST), 2011.
32. Y. Zhang and D. Feng. An Active Storage System for High Performance Computing. 22nd International Conference on Advanced Information Networking and Applications (aina 2008), pages 644-651, 2008.