Extending map-reduce for efficient predicate-based sampling

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2012, Pages 486-497

  Grover, Raman ^a   Carey, Michael J ^a  

^a Irvine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CURRENT LOADS; EXECUTION MODEL; EXPERIMENTAL PERFORMANCE STUDY; EXPLORATORY DATA ANALYSIS; FACEBOOK; INPUT SIZE; MAP-REDUCE; MASSIVE DATA; MULTI-USER; RESOURCE CONSUMPTION;

INDUSTRIAL ENGINEERING;

ENGINEERING;

EID: 84864210199     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2012.104     Document Type: Conference Paper

References (17)

1. G. Antoshenkov. Random sampling from pseudo- ranked B+ trees. In Proc. VLDB 2002, pp. 375-382
2. V. Ayyalasomayajula. HERDER: A Heterogeneous Engine for Running Data-Intensive Experiments and Reports. M.S Thesis. University of California-Irvine, 2011
3. S. Babu. Towards automatic optimization of mapreduce programs. In Proc. SoCC 2010 pp. 137-142.
4. S. Chaudhuri, R. Motwani, and V. Narasayya. On random sampling over joins. In Proc. SIGMOD 1999, pp. 263274.
5. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Proc. OSDI 2004, pp. 137-150.
6. Hadoop. http://hadoop.apache.org.
7. Hive Website. http://hadoop.apache.org/hive
8. https://issues.apache.org/jira/browse/HIVE-2004
9. F. Olken. Random Sampling from Databases. PhD thesis, University of California Berkeley, 1993
10. F. Olken and D. Rotem. Simple Random Sampling from Relational Databases. In Proc. VLDB 1986, pp. 160-169.
11. D. E. Knuth. The Art of Computer Programming, Vol 3: Sorting and Searching. Addison-Wesley, Reading, MA, 1973.
12. R. J. Lipton, J. F. Naughton, D. A. Schneider, and S. Seshadri. Efficient sampling strategies for relational database operations. Theoretical Computer Science 1993: pp. 195-226.
13. C. Olston, B. Reed et.al. PigLatin: A not-so-foreign language for data processing. In Proc. SIGMOD 2008, pp 1099-1110.
14. F. Olken and D. Rotem. Sampling from B+ trees. In Proc VLDB 1989, pp. 269-277.
15. A. Thusoo, Z. Shao et al. Data warehousing and analytics infrastructure at Facebook. In Proc. SIGMOD 2010, pp. 1013-1020.
16. TPC-H Benchmark Specification http://www.tpc.org
17. M. Zaharia, D. Borthakur et al. Job Scheduling for Multi-User MapReduce Clusters. UC Berkeley Technical Report UCB/EECS-2009.