Online aggregation for large MapReduce jobs

Proceedings of the VLDB Endowment

Volumn 4, Issue 11, 2011, Pages 1135-1145

  Pansare, Niketan ^a   Borkar, Vinayak ^b   Jermaine, Chris ^a   Condie, Tyson ^c  

^a RICE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c YAHOO INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA HANDLING; QUERY PROCESSING;

AGGREGATION QUERIES; CLOUD-COMPUTING; CONFIDENCE BOUNDS; LARGE-SCALE DATA PROCESSING; LARGE-SCALES; MAP-REDUCE; ON-LINE FASHION; ONLINE AGGREGATIONS; QUERY RESULTS; SYSTEM PROCESS;

MAPREDUCE;

EID: 84863769684     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/3402707.3402748     Document Type: Conference Paper

References (18)

1. R. Avnur, J. Hellerstein, B. Lo, C. Olston, B. Raman, V. Raman, T. Roth, and K. Wylie. Control: continuous output and navigation technology with refinement on-line. In SIGMOD conference, pages 567-569, 1998.
2. V. R. Borkar, M. J. Carey, R. Grover, N. Onose, and R. Vernica. Hyracks: A flexible and extensible foundation for data-intensive computing. In ICDE, pages 1151-1162, 2011.
3. D. Borthakur. The Hadoop Distributed File System: Architecture and Design, 2007.
4. G. Casella and E. George. Explaining the gibbs sampler. The American Statistician, 46:167-174, 1992.
5. T. Condie, N. Conway, P. Alvaro, J. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. In NSDI Conference, pages 21-21, 2010.
6. D. Cox. Renewal Theory. Methuen and Co, New York, 1970.
7. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI '04, pages 137-150, December 2004.
8. P. B. Gibbons and Y. Matias. New sampling-based summary statistics for improving approximate query answers. SIGMOD Rec., 27:331-342, June 1998.
9. P. Haas and J. Hellerstein. Ripple joins for online aggregation. In SIGMOD Conference, pages 287-298, 1999.
10. J. Hellerstein, P. Haas, and H. Wang. Online aggregation. In SIGMOD Conference, pages 171-182, 1997.
11. C. Jermaine, S. Arumugam, A. Pol, and A. Dobra. Scalable approximate query processing with the dbo engine. In SIGMOD Conference, pages 725-736, 2007.
12. E. L. Lehmann and G. Casella. Theory of Point Estimation. Springer, second edition, 1998.
13. A. O'Hagan and J. J. Forster. Bayesian Inference. Arnold, second edition, 2004.
14. F. Olken and D. Rotem. Maintenance of materialized views of sampling queries. In Proceedings of the Eighth International Conference on Data Engineering, 1992.
15. C. Robert and G. Casella. Monte Carlo Statistical Methods. Springer, second edition, 2004.
16. C. S̈arndal, B. Swensson, and J. Wretman. Model Assisted Survey Sampling. Springer, New York, 1992.
17. S. Wu, S. Jiang, B. C. Ooi, and K.-L. Tan. Distributed online aggregations. Proc. VLDB Endow., 2:443-454, August 2009.
18. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In EuroSys, pages 265-278, 2010.