Exploiting common subexpressions for cloud query processing

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2012, Pages 1337-1348

  Silva, Yasin N ^a   Larson, Paul Ake ^b   Zhou, Jingren ^c  

^a ARIZONA STATE UNIVERSITY WEST   (United States)

^b MICROSOFT RESEARCH   (United States)

^c MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVENTIONAL OPTIMIZATION; ESTIMATED COSTS; EXPERIMENTAL ANALYSIS; INTERMEDIATE RESULTS; LARGE CLUSTERS; MICROSOFT; OPTIMAL PLAN; OPTIMIZERS; SCRIPTING LANGUAGES; SUB-EXPRESSIONS; TRADE OFF;

METADATA; OPTIMIZATION;

COST BENEFIT ANALYSIS;

EID: 84864252206     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2012.106     Document Type: Conference Paper

References (20)

1. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The google file system," in SOSP '03: Proceedings of the 19th ACM symposium on Operating systems principles. New York, NY, USA: ACM, 2003, pp. 29-43.
2. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters," in OSDI'04: Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation. Berkeley, CA, USA: USENIX Association, 2004, pp. 10-10.
3. -, "Mapreduce: a flexible data processing tool," Commun. ACM, vol. 53, no. 1, pp. 72-77, 2010.
4. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber, "Bigtable: A distributed storage system for structured data," ACM Trans. Comput. Syst., vol. 26, no. 2, pp. 1-26, 2008.
5. Apache, "Hadoop," http://hadoop.apache.org/.
6. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: distributed data-parallel programs from sequential building blocks," in EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007. New York, NY, USA: ACM, 2007, pp. 59-72.
7. R. Chaiken, B. Jenkins, P.-A. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou, "Scope: easy and efficient parallel processing of massive data sets," Proc. VLDB Endow., vol. 1, no. 2, pp. 1265-1276, 2008.
8. J. Zhou, P.-A. Larson, and R. Chaiken, "Incorporating partitioning and parallel plans into the scope optimizer," in ICDE '07: Proceedings of 26th IEEE International Conference on Data Engineering, 2010, 2010, pp. 1060-1071.
9. G. Graefe, "The cascades framework for query optimization," IEEE Data Engineering Bulletin, vol. 18, no. 3, pp. 19-29, 1995.
10. J. Zhou, P.-A. Larson, J.-C. Freytag, and W. Lehner, "Efficient exploitation of similar subexpressions for query processing," in SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 2007, pp. 533-544.
11. S. Finkelstein, "Common expression analysis in database applications," in SIGMOD '82: Proceedings of the 1982 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 1982, pp. 235-245.
12. S. N. Subramanian and S. Venkataraman, "Cost-based optimization of decision support queries using transient-views," in SIGMOD '98: Proceedings of the 1998 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 1998, pp. 319-330.
13. J. Park and A. Segev, "Using common subexpressions to optimize multiple queries," in ICDE '88: Proceedings of the 4th International Conference on Data Engineering. Washington, DC, USA: IEEE Computer Society, 1988, pp. 311-319.
14. P. Roy, S. Seshadri, S. Sudarshan, and S. Bhobe, "Efficient and extensible algorithms for multi query optimization," in SIGMOD '00: Proceedings of the 2000 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 2000, pp. 249-260.
15. T. K. Sellis, "Multiple-query optimization," ACM Trans. Database Syst., vol. 13, no. 1, pp. 23-52, 1988.
16. T. Sellis and S. Ghosh, "On the multiple-query optimization problem," IEEE Trans. on Knowl. and Data Eng., vol. 2, no. 2, pp. 262-266, 1990.
17. H. Mistry, P. Roy, S. Sudarshan, and K. Ramamritham, "Materialized view selection and maintenance using multi-query optimization," in SIGMOD '01: Proceedings of the 2001 ACM SIGMOD international conference on Management of data. New York, NY, USA: ACM, 2001, pp. 307-318.
18. W. Lehner, R. Cochrane, H. Pirahesh, and M. Zaharioudakis, "fast refresh using mass query optimization," in Proceedings of the 17th International Conference on Data Engineering. Washington, DC, USA: IEEE Computer Society, 2001, pp. 391-398.
19. G. Graefe and W. J. McKenna, "The volcano optimizer generator: Extensibility and efficient search," in Proceedings of the Ninth International Conference on Data Engineering. Washington, DC, USA: IEEE Computer Society, 1993, pp. 209-218.
20. L. Chen, C. Olston, and R. Ramakrishnan, "Parallel evaluation of composite aggregate queries," in Proceedings of the 2008 IEEE 24th International Conference on Data Engineering. Washington, DC, USA: IEEE Computer Society, 2008, pp. 218-227.