A new paradigm: Data-aware scheduling in grid computing

Future Generation Computer Systems

Volumn 25, Issue 4, 2009, Pages 406-413

  Kosar, Tevfik ^a   Balman, Mehmet ^a  

^a Louisiana State University   (United States)

Author keywords

Data placement; Data aware scheduling; Data intensive applications; Grid computing; Stork

Indexed keywords

APPLICATIONS; DISTRIBUTED COMPUTER SYSTEMS; GRID COMPUTING; INTERCONNECTION NETWORKS; MANAGEMENT INFORMATION SYSTEMS; SCHEDULING;

CASE STUDIES; DATA MANAGEMENT PROBLEMS; DATA PLACEMENT; DATA-AWARE SCHEDULING; DATA-INTENSIVE APPLICATIONS; DISTRIBUTED APPLICATIONS; DISTRIBUTED COMPUTING ENVIRONMENTS; STORK; TRADITIONAL SYSTEMS;

DATA HANDLING;

EID: 58149234817     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.09.006     Document Type: Article

References (31)

1. B. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, S. Tuecke, Secure, efficient data transport and replica management for high-performance data-intensive computing, in: Proceedings of IEEE Mass Storage Conference, San Diego, CA, April 2001
2. C. Baru, R. Moore, A. Rajasekar, M. Wan, The SDSC storage resource Broker, in: Proceedings of CASCON, Toronto, Canada, 1998
3. Beck M., Moore T., Plank J., and Swany M. Logistical networking. In: Hariri S., Lee C., and Raghavendra C. (Eds). Active Middleware Services (2000), Kluwer Academic Publishers
4. J. Bent, V. Venkataramani, N. LeRoy, A. Roy, J. Stanley, A.C. Arpaci-Dusseau, R.H. Arpaci-Dusseau, M. Livny, Flexibility, manageability, and performance in a Grid storage appliance, in: Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing, 2002
5. J. Bent, D. Thain, A. Arpaci-Dusseau, R. Arpaci-Dusseau, Explicit control in a batch-aware distributed file system, in: Proceedings of the First USENIX/ACM Conference on Networked Systems Design and Implementation, March 2004
6. J. Bent, Data-driven batch scheduling, Ph.D. Dissertation, University of Wisconsin-Madison, 2005
7. E. Ceyhan, T. Kosar, Large scale data management in sensor networking applications, in: Proceedings of Secure Cyberspace Workshop, Shreveport, LA, November 2007
8. A. Chervenak, R. Schuler, C. Kesselman, S. Koranda, B. Moe, Wide area data replication for scientific collaborations, in: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, November 2005
9. E. Ceyhan, G. Allen, C. White, T. Kosar, A grid-enabled workflow system for reservoir uncertainty analysis, in: Proceedings of Challenges of Large Applications in Distributed Environments (CLADE 2008) Workshop, Madeira, Portugal, June 2007
10. Flynn M.J. Basic issues in microprocessor architecture. J. Syst. Archit. 45 12-13 (1999) 939-948
11. Hennessy J.L., and Jouppi N.P. Computer technology and architecture: An evolving interaction. Computer 24 9 (1991) 18-29
12. Hey T., and Trefethen A. The Data Deluge: An e-Science Perspective, in Grid Computing - Making the Global Infrastructure a Reality (2003), Wiley and Sons pp. 809-824 (Chapter 36)
13. S. Koranda, M. Moe, Lightweight data replicator. http://www.ligo.caltech.edu/docs/G/G030623-00/G030623-00.pdf
14. T. Kosar, M. Livny, Stork: Making data placement a first class citizen in the grid, in: Proceedings of 24th IEEE International Conference on Distributed Computing Systems, ICDCS 2004, Tokyo, Japan, March 2004
15. T. Kosar, S. Son, G. Kola, M. Livny, Data placement in widely distributed environments, in: L. Grandinetti, (Ed.), Grid Computing: The New Frontier of High Performance Computing, 14, Elsevier Press, 2005
16. T. Kosar, A new paradigm in data intensive computing: Stork and the data-aware schedulers, in: Proceedings of Challenges of Large Applications in Distributed Environments (CLADE 2006) Workshop, Paris, France, June 2006
17. T. Kosar, PetaShare: A distributed data archival, analysis and visualization cyberinfrastructure for data-intensive collaborative research. http://www.petashare.org
18. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, B. Zhao, Oceanstore: An architecture for global-scale persistent storage, in: Proceedings of the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2000, November 2000
19. R.K. Madduri, C.S. Hood, W.E. Allcock, Reliable file transfer in grid environments, in: Proceedings of 27th Annual IEEE Conference on Local Computer Networks, November 2002
20. Y. Morita, H. Sato, Y. Watase, O. Tatebe, S. Sekiguchi, S. Matsuoka, N. Soda, A. Dell'Acqua, Building a high performance parallel le system using Grid Datafarm and ROOT I/O, in: Proceedings of the 2003 Computing in High Energy and Nuclear Physics, CHEP03, La Jolla, CA, March 2003
21. R. Raman, M. Livny, M. Solomon, Matchmaking: Distributed resource management for high throughput computing, in: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing, HPDC7, Chicago, IL, July 1998
22. R.M. Ramanathan, Extending the words most popular processor architecture - New innovations that improve the performance and energy efficiency of Intel architecture, 2006. http://download.intel.com/technology/architecture
23. Ranganathan K., and Foster I. Decoupling computation and data scheduling in distributed data-intensive applications. HPDC '02: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing HPDC-11 20002. HPDC'02 (2002), IEEE Computer Society, Washington, DC, USA 352
24. Ranganathan K., and Foster I. Computation scheduling and data replication algorithms for data grids. Grid Resource Management: State of the Art and Future Trends (2004) 359-373
25. A. Shoshani, A. Sim, J. Gu, Storage resource managers: Middleware components for grid storage, in: Nineteenth IEEE Symposium on Mass Storage Systems, 2002
26. Stokes J.M. Inside the Machine - An Illustrated Introduction to Microprocessors and Computer Architecture (December 2003), No Starch Press 320 pp
27. Sun Microsystems. Ultra Sparc III Cu - User Manual, 2005. http://www.sun.com/processors/manuals/USIIIv2.pdf
28. Sun Microsystems. Ultra Sparc III Cu Processor - Overview, 2005. http://www.sun.com/processors/whitepapers/USIIICuoverview.pdf
29. I. Suslu, T. Kosar, Balancing the use of remote i/o versus staging in distributed environments, in: Proceedings of the 9th International Conference on Enterprise Information Systems Doctoral Symposium, DCEIS 2007, New Orleans, LA, September 2008
30. I. Suslu, F. Turkmen, M. Balman, T. Kosar, Choosing between remote i/o versus staging in large scale distributed applications, in: Proceedings of ISCA 21st Int. Conference on Parallel and Distributed Computing and Applications, PDCCS 2008, New Orleans, LA, September 2008
31. Tummala S., and Kosar T. Data management challenges in coastal applications. J. Coastal Res. Special Issue No. 50 (2007) 1188-1193