Exploiting functional decomposition for efficient parallel processing of multiple data analysis queries

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2003

Volumn , Issue , 2003, Pages

  Andrade, Henrique ^a   Kurc, Tahsin ^b   Sussman, Alan ^a   Saltz, Joel ^b  

^a University of Maryland ^*  (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED PARAMETER NETWORKS; INFORMATION ANALYSIS;

COMPUTATION REUSE; FUNCTIONAL DECOMPOSITION; INTERMEDIATE RESULTS; PARALLEL PROCESSING; PERFORMANCE BENEFITS; PERFORMANCE EFFECT; QUERY EXECUTION; SATELLITE DATA;

DATA HANDLING;

EID: 84947260150     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2003.1213184     Document Type: Conference Paper

References (24)

1. K. Amiri, D. Petrou, G. R. Ganger, and G. A. Gibson. Dynamic function placement for data-intensive cluster computing. In Proceedings of the 2000 USENIX Symposium on Internet Technologies and Systems, San Diego, CA, 2000.
2. H. Andrade, T. Kurc, A. Sussman, E. Borovikov, and J. Saltz. On cache replacement policies for servicing mixed data intensive query workloads. In Proceedings of the 2nd Workshop on Caching, Coherence, and Consistency, held in conjunction with the 16th ACM International Conference on Supercomputing, New York, NY, June 2002.
3. H. Andrade, T. Kurc, A. Sussman, and J. Saltz. Efficient execution of multiple workloads in data analysis applications. In Proceedings of the 2001 ACM/IEEE Supercomputing Conference, Denver, CO, November 2001.
4. H. Andrade, T. Kurc, A. Sussman, and J. Saltz. Exploiting functional decomposition for efficient parallel processing of multiple data analysis queries. Technical Report CS-TR-4404 and UMIACS-TR-2002-84, University of Maryland, October 2002.
5. H. Andrade, T. Kurc, A. Sussman, and J. Saltz. Scheduling multiple data visualization query workloads on a shared memory machine. In Proceedings of the 2002 IEEE International Parallel and Distributed Processing Symposium, Fort Lauderdale, FL, April 2002. Also available as University of Maryland Technical Report CS-TR-4290 and UMIACS-TR-2001-68.
6. M. D. Beynon, C. Chang, U. Catalyurek, T. Kurc, A. Sussman, H. Andrade, R. Ferreira, and J. Saltz. Processing largescale multidimensional data in parallel and distributed environments. Parallel Computing, 28(5):827-859, May 2002. Special issue on Data Intensive Computing.
7. M. D. Beynon, R. Ferreira, T. Kurc, A. Sussman, and J. Saltz. DataCutter: Middleware for filtering very large scientific datasets on archival storage systems. In Proceedings of the Eighth Goddard Conference on Mass Storage Systems and Technologies/17th IEEE Symposium on Mass Storage Systems, pages 119-133, College Park, MD, March 2000.
8. E. Borovikov, A. Sussman, and L. Davis. An efficient system for multi-perspective imaging and volumetric shape analysis. In Proceedings of the 2001 Workshop on Parallel and Distributed Computing in Imaging Processing, Video Processing, and Multimedia, San Francisco, CA, 2001.
9. S. Chaudhuri, R. Krishnamurthy, S. Potamianos, and K. Shim. Optimizing queries with materialized views. In Proceedings of the 11th International Conference on Data Engineering, pages 190-200, Los Alamitos, CA, 1995. IEEE Computer Society Press.
10. H. Fallah-Adl, J. Jájá, S. Liang, J. Townshend, and Y. J. Kaufman. Fast algorithms for removing atmospheric effects from satellite images. IEEE Computational Science & Engineering, 3(2):66-77, Summer 1996.
11. G. Graefe. Query evaluation techniques for large databases. ACM Computing Surveys, 25(2), 1993.
12. High Performance Fortran Forum. High performance fortran-language specification-version 2. 0. Technical report, Rice University, January 1997. available at http://www. netlib. org/hpf.
13. S. Kalluri, Z. Zhang, J. JáJá, D. Bader, N. E. Saleous, E. Vermote, and J. R. G. Townshend. A hierarchical data archiving and processing system to generate custom tailored products from AVHRR data. In 1999 IEEE International Geoscience and Remote Sensing Symposium, pages 2374-2376, 1999.
14. M. H. Kang, H. G. Dietz, and B. K. Bhargava. Multiplequery optimization at algorithm-level. Data and Knowledge Engineering, 14(1):57-75, 1994.
15. T. Kurc, U. Catalyurek, C. Chang, A. Sussman, and J. Saltz. Visualization of very large datasets with the Active Data Repository. IEEE Computer Graphics and Applications, 21(4):22-33, July/August 2001. Also available as University of Maryland Technical Report CS-TR-4208 and UMIACSTR-2001-04.
16. D. A. Menascé and V. A. F. Almeida. Scaling for E-Business. Prentice Hall PTR, 2000.
17. National Oceanic and Atmospheric Administration. NOAA Polar Orbiter User's Guide-November 1998 Revision. compiled and edited by Katherine B. Kidwell. Available at http://www2. ncdc. noaa. gov/docs/podug/cover. htm.
18. R. Oldfield and D. Kotz. Armada: A parallel I/O framework for computational grids. Future Generation Computing Systems, 18(4):501-523, March 2002.
19. B. Plale and K. Schwan. dQUOB:Managing large data flows using dynamic embedded queries. In Proceedings of the Ninth IEEE International Symposium on High Performance Distributed Computing (HPDC-9), Pittsburgh, PA, August 2000.
20. D. P. Roy. Investigation of the maximum normalized difference vegetation index (NDVI) and the maximum surface temperature (. ) AVHRR compositing procedures for the extraction of NDVIan d . over forest. International Journal of Remote Sensing, 18(11):2383-2401, 1997.
21. D. P. Roy, L. Giglio, J. D. Kendall, and C. Justice. Multitemporal active-fire based burn scar detection algorithm. International Journal of Remote Sensing, 20(5):1031-1038, 1999.
22. T. K. Sellis. Multiple-query optimization. ACM Transactions on Database Systems, 13(1):23-52, 1988.
23. P. M. Teillet, N. E. Saleous, M. C. Hansen, J. C. Eidenshink, C. Justice, and J. R. G. Townshend. An evaluation of the global 1-km AVHRR land dataset. International Journal of Remote Sensing, 21(10):1987-2021, 2000.
24. Z. Zhang, J. JáJá, D. Bader, S. Kalluri, H. Song, N. E. Saleous, E. Vermote, and J. R. G. Townshend. Kronos: A Java-based software system for the processing and retrieval of large scale AVHRR data sets. Technical Report EECETR-99-006, University of New Mexico, November 1999.