JAWS: Job-aware workload scheduling for the exploration of turbulence simulations

2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010

Volumn , Issue , 2010, Pages

  Wang, Xiaodan ^a   Perlman, Eric ^a   Burns, Randal ^a   Malik, Tanu ^b   Budavári, Tamas ^a   Meneveau, Charles ^a   Szalay, Alexander ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH SCHEDULERS; CACHING DECISIONS; DATA DEPENDENCIES; DATA SETS; DATA SHARING; DATA-DRIVEN; DATABASE CLUSTERS; MULTIPLE QUERIES; OVERLAPPING DATA; PERFORMANCE BOTTLENECKS; RESPONSE TIME; SCIENTIFIC DATABASE; SUB-QUERIES; TURBULENCE SIMULATION; WORK-FLOWS;

FEATURE EXTRACTION; QUERY LANGUAGES; SCHEDULING; THROUGHPUT; TURBULENCE;

SCHEDULING ALGORITHMS;

EID: 78650849510     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2010.31     Document Type: Conference Paper

References (25)

1. X. Wang, R. Burns, and T. Malik, "LifeRaft: Data-Driven, Batch Processing for the Exploration of Scientific Databases, "in CIDR, 2009.
2. Y. Li, E. Perlman, M. Wan, Y. Yang, C. Meneveau, R. Burns, S. Chen, A. Szalay, and G. Eyink, "A Public Turbulence Database Cluster and Applications to Study Lagrangian Evolution of Velocity Increments in Turbulence, "Journal of Turbulence, vol. 9, no. 31, pp. 1-29, 2008.
3. J. Gray and A. Szalay, "Where the Rubber Meets the Sky: Bridging the Gap Between Databases and Science, "IEEE Data Engineering Bulletin, vol. 27, no. 4, pp. 3-11, 2004.
4. A. Szalay, G. Bell, J. Vandenberg, A. Wonders, R. Burns, D. Fay, and J. Heasley, "GrayWulf: Scalable Clustered Architecture for Data Intensive Computing, "in HICSS, 2009.
5. J. N. Heasley, M. Nieto-Santisteban, A. Szalay, and A. Thakar, "The Pan-STARRS Object Data Manager Database, " Bulletin of the American Astronomical Society, vol. 38, no. 1, p. 124, 2007.
6. M. Abdelguerfi, V. Mahadevan, N. Challier, and M. Flanagin, "A High Performance System for Viewing, Querying, and Retrieval of Geospatial Data Distributed Across a Beowulf Cluster, "in HPCCS, 2004.
7. The JHU Turbulence Database Cluster. [Online]. Available: http://turbulence.pha.jhu.edu.
8. A. Szalay, J. Gray, A. Thakar, P. Kuntz, T. Malik, J. Raddick, C. Stoughton, and J. Vandenberg, "The SDSS SkyServer - Public Access to the Sloan Digital Sky Server Data, "in SIGMOD, 2002.
9. E. Otoo, D. Rotem, and A. Romosan, "Optimal File-Bundle Caching Algorithms for Data-Grids, "in SC, 2004.
10. E. J. O'Neil, P. E. O'Neil, and G. Weikum, "The LRU-K Page Replacement Algorithm for Database Disk Buffering, " in SIGMOD, 1993.
11. J. Myllymaki and M. Livny, "Relational Joins for Data on Tertiary Storage, "in ICDE, 1997.
12. S. Sarawagi, "Query Processing in Tertiary Memory Databases, "in VLDB, 1995.
13. J.-B. Yu and D. J. DeWitt, "Query Pre-Execution and Batching in Paradise: A Two-Pronged Approach to the Efficient Processing of Queries on Tape-Resident Raster Images, "in SSDBM, 1997.
14. H. Andrade, T. Kurc, A. Sussman, and J. Saltz, "Efficient Execution of Multiple Query Workloads in Data Analysis Applications, "in SC, 2001.
15. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters, "in OSDI, 2004.
16. H. C. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker, "Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters, "in SIGMOD, 2007.
17. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins, "Pig Latin: A Not-So-Foreign Language for Data Processing, "in SIGMOD, 2008.
18. P. Agrawal, D. Kifer, and C. Olston, "Scheduling Shared Scans of Large Data Files, "in VLDB, 2008.
19. W. O'Mullane, N. Li, M. Nieto-Santisteban, A. Szalay, and A. Thakar, "Batch is Back: CasJobs, Serving Multi-TB Data on the Web, "in ICWS, 2005.
20. The Sloan Digital Sky Survey. [Online]. Available: http://www.sdss.org.
21. S. B. Needleman and C. D. Wunsch, "A General Method Applicable to the Search for Similarities in the Amino Acid Sequence of Two Proteins, "Journal of Molecular Biology, vol. 48, no. 3, pp. 443-453, 1970.
22. P. Shenoy and H. Vin, "Cello: A Disk Scheduling Framework for Next Generation Operating Systems, "in SIGMETRICS, 1997.
23. T. Johnson and D. Shasha, "2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm, "in VLDB, 1994.
24. R. Karedla, J. S. Love, and B. G. Wherry, "Caching Strategies to Improve Disk System Performance, "Computer, vol. 27, no. 3, pp. 38- 46, 1994.
25. K. D. Squires and J. K. Eaton, "Preferential Concentration of Particles by Turbulence, "Physics of Fluids, vol. 3, no. 5, pp. 1169-1178, 1991.