Executing multiple pipelined data analysis operations in the grid

Proceedings of the International Conference on Supercomputing

Volumn 2002-November, Issue , 2002, Pages

  Spencer, Matthew ^a   Ferreira, Renato ^a   Beynon, Michael ^b   Kurc, Tahsin ^a   Catalyurek, Umit ^a   Sussman, Alan ^b   Saltz, Joel ^a  

^a OHIO STATE UNIVERSITY   (United States)

^b University of Maryland ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA FLOW ANALYSIS; DATA TRANSFER; INFORMATION ANALYSIS; SCHEDULING; SCHEDULING ALGORITHMS;

COARSE GRAINS; DATA-SOURCE; DATAFLOW; GRID RESOURCE; SCHEDULING PROBLEM; VISUALIZATION APPLICATION;

DATA HANDLING;

EID: 31144436184     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2002.10015     Document Type: Conference Paper

References (41)

1. D. Abramson, M. Cope, and R. McKenzie. Modeling photochemical pollution using parallel and distributed computing platforms. In Proceedings of PARLE-94, pages 478-489, 1994.
2. B. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke. Secure, efficient data transport and replica management for high-performance data-intensive computing. In Proceedings of IEEE Mass Storage Conference, April 2001.
3. J. Basney, M. Livny, and P. Mazzanti. Harnessing the capacity of computational grids for high-energy physics. In Conference on Computing in High Energy and Nuclear Physics, 2000.
4. F. Berman and R. Wolski. The AppLeS project: A status report. In Proceedings of the 8th NEC Research Symposium, Berlin, Germany, May 1997.
5. M. Beynon. Supporting Data Intensive Applications in a Heterogeneous Environment. PhD thesis, University of Maryland, 2001.
6. M. Beynon, C. Chang, U. Catalyurek, T. Kurc, A. Sussman, H. Andrade, R. Ferreira, and J. Saltz. Processing large-scale multidimensional data in parallel and distributed environments. Parallel Computing, 2002. To appear in special issue on Data Intensive Computing.
7. M. Beynon, T. Kurc, A. Sussman, and J. Saltz. Design of a framework for data-intensive wide-area applications. In Proceedings of the 9th Heterogeneous Computing Workshop (HCW2000), pages 116-130. IEEE Computer Society Press, May 2000.
8. M. D. Beynon, T. Kurc, U. Catalyurek, C. Chang, A. Sussman, and J. Saltz. Distributed processing of very large datasets with DataCutter. Parallel Computing, 27(11):1457-1478, Oct. 2001.
9. M. D. Beynon, T. Kurc, U. Catalyurek, A. Sussman, and J. Saltz. A component-based implementation of isosurface rendering for visualizing large datasets. Technical Report CS-TR-4249 and UMIACS-TR-2001-34, University of Maryland, Department of Computer Science and UMIACS, May 2001.
10. M. D. Beynon, T. Kurc, U. Catalyurek, A. Sussman, and J. Saltz. Efficient manipulation of large datasets on heterogeneous storage systems. In Proceedings of the 11th Heterogeneous Computing Workshop (HCW2002). IEEE Computer Society Press, April 2002.
11. T. D. Braun, H. J. Siegel, N. Beck, L. L. Bölöni, M. Maheswaran, A. I. Reuther, J. P. Robertson, M. D. Theys, B. Yao, D. Hensgen, and R. F. Freund. A comparison study of static mapping heuristics for a class of meta- tasks on heterogeneous computing systems. Journal of Parallel and Distributed Computing, 61:810-837, 2001.
12. R. Buyya, D. Abramson, and J. Giddy. An economy driven resource management architecture for global computational power grids. In Proceedings of PDPTA 2000, June 2000.
13. Common Component Architecture Forum. http://www.cca-forum.org.
14. C. Chang, T. Kurc, A. Sussman, and J. Saltz. Optimizing retrieval and processing of multi-dimensional scientific datasets. In Proceedings of the Third Merged IPPS/SPDP (14th International Parallel Processing Symposium & 11th Symposium on Parallel and Distributed Processing). IEEE Computer Society Press, May 2000.
15. K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman. Grid information services for distributed resource sharing, 2001.
16. M. M. Eshaghian and Y. C. Wu. Mapping heterogeneous task graphs ontp heterogeneous system graphs. In Proceedings of the 6th Heterogeneous Computing Workshop, pages 147-160, Geneva, Switzerland, April 1997. IEEE Computer Society Press.
17. A. Gallant and G. Tauchen. SNP: A program for nonparametric time series analysis. Technical report, Duke Economics Working Paper No:95-26, Duke University, 1997.
18. Global Grid Forum. http://www.gridforum.org.
19. The Globus Project. http://www.globus.org.
20. C. Isert and K. Schwan. ACDS: Adapting computational data streams for high performance. In 14th International Parallel & Distributed Processing Symposium (IPDPS 2000), pages 641-646, Cancun, Mexico, May 2000. IEEE Computer Society Press.
21. M. Iverson and F. Ozguner. Dynamic, competitive scheduling of multiple dags in a distributed heterogeneous environment. In Proceedings of the 7th Heterogeneous Computing Workshop, Orlando, FL, March 1998. IEEE Computer Society Press.
22. T. Kurc, C. Aykanat, and B. Ozguc. Object-space parallel polygon rendering on hypercubes. Computers & Graphics, 22(4):487-503, 1998.
23. Y.-K. Kwok and I. Ahmad. Static scheduling algorithms for allocating directed task graphs. ACM Computing Surveys, 31(4):406-471, Dec. 1999.
24. W. Lorensen and H. Cline. Marching cubes: a high resolution 3d surface reconstruction algorithm. Computer Graphics, 21(4):163-169, 1987.
25. M. Maheswaran and H. J. Siegel. A dynamic matching and scheduling algorithm for heterogeneous computing systems. In Proceedings of the 7th Heterogeneous Computing Workshop, Orlando, FL, March 1998. IEEE Computer Society Press.
26. A. Majumdar. Parallel performance study of monte carlo photon transport code on shared-, distributed-, and distributed-shared-memory architectures. In Proceedings of the 14th Parallel and Distributed Processing Symposium (IPDPS'00), pages 93-99, 2000.
27. R. Oldfield and D. Kotz. Armada: A parallel file system for computational. In Proceedings of CCGrid2001: IEEE International Symposium on Cluster Computing and the Grid, Brisbane, Australia, May 2001. IEEE Computer Society Press.
28. B. Plale and K. Schwan. dQUOB: Managing large data flows using dynamic embedded queries. In IEEE International High Performance Distributed Computing (HPDC), August 2000.
29. J. Plank, R. Wolski, J. Brevik, and T. Bryan. G-Commerce: The study and building of computational economies for the computational grid. In Workshop on Clusters and ComputationalGrids for Scientific Computing, 2000.
30. A. Rogers, M. C. Carlisle, J. H. Reppy, and L. Hendren. Supporting dynamic data structures on distributed-memory machines. ACM Transactions on Programming Languages and Systems, 17(2):233-263, Mar. 1995.
31. V. Sarkar. Determining average program execution times and their variance. In Proceedings of the ACM SIGPLAN '89 Conference on Programming Language Design and Implementation, pages 298-312. ACM Press, June 1989.
32. S. Sciutto. AIRES users guide and reference manual, version 2.0.0. Technical Report GAP-99-020, Auger Project, 1999.
33. J. Stiles, T. Bartol, E. Salpeter, and M. Salpeter. Monte Carlo simulation of neuromuscular transmitter release using MCell, a general simulator of cellular physiological processes. Computational Neuroscience, pages 279-284, 1998.
34. A. Takefusa. Bricks: A performance evaluation system for scheduling algorithms on the grids. In JSPS Workshop on Applied Information Technology for Science (JWAITS 2001), 2001.
35. A. Takefusa, H. Casanova, S. Matsuoka, and F. Berman. A study of deadline scheduling for client-server systems on the computational grid. In Proceedings of 10th IEEE International Symposium on High Performance Distributed Computing (HPDC-10), pages 406-415, 2001.
36. H. Topcuoglu, S. Hariri, and M.-Y. Wu. Task scheduling algorithms for heterogeneous processors. In Proceedings of the 8th Heterogeneous Computing Workshop, pages 3-14, San Juan, Puerto Rico, April 1999. IEEE Computer Society Press.
37. S. Vazhkudai, S. Tuecke, and I. Foster. Replica selection in the globus data grid, 2001.
38. J. B. Weissman and X. Zhao. Run-time support for scheduling parallel applications in heterogeneous nows. In Proceedings of the 6th High Performance Distributed Computing Conference, August 1997.
39. R. Wolski, N. Spring, and J. Hayes. The network weather service: A distributed resource performance forecasting service for metacomputing. Journal of Future Generation Computing Systems, 15(5-6):757-768, 1999.
40. S. Yang, D. Gannon, S. Srinivas, and F. Bodin. High Performance Fortran interface to the Parallel C++. In Proceedings of the Scalable High Performance Computing Conference (SHPCC-94), pages 301-308. IEEE Computer Society Press, May 1994.
41. T. Zhao and V. Karamcheti. Expressing and enforcing distributed storage sharing agreements. In Proceedings of SC2000, 2000.