Very fast estimation for result and accuracy of big data analytics: The EARL system

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2013, Pages 1296-1299

  Laptev, Nikolay ^a   Zeng, Kai ^a   Zaniolo, Carlo ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY ESTIMATION; ANALYTICAL APPLICATIONS; APPROXIMATE RESULTS; ARBITRARY FUNCTIONS; DATA DISTRIBUTION; FAST ESTIMATION; MASSIVE DATA SETS; RESOURCE CONSTRAINT;

ESTIMATION; SAMPLING;

RESPONSE TIME (COMPUTER SYSTEMS);

EID: 84881335978     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2013.6544928     Document Type: Conference Paper

References (19)

1. Earl release website: http://yellowstone.cs.ucla.edu/wis/.
2. D.J. Newman A. Asuncion. UCI machine learning repository, 2007.
3. Tyson Condie, Neil Conway, Peter Alvaro, Joseph M. Hellerstein, Khaled Elmeleegy, and Russell Sears. Mapreduce online. Technical Report UCB/EECS-2009-136, EECS Department, University of California, Berkeley, Oct 2009.
4. B Efron. Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7(1):1-26, 1979.
5. Bradley Efron. Better bootstrap confidence intervals. Journal of the American Statistical Association, 82(397):171-185, 1987.
6. Raman Grover and Michael Carey. Extending map-reduce for efficient predicate-based sampling. ICDE '12, 2012.
7. Trevor Hastie, Robert Tibshirani, and Jerome Friedman. The Elements of Statistical Learning, Second Edition: Data Mining, Inference, and Prediction. Springer Series in Statistics. Springer, 2nd ed. 2009. corr. 3rd printing 5th printing. edition, February 2009.
8. Herodotos Herodotou, Harold Lim, Gang Luo, Nedyalko Borisov, Liang Dong, Fatma Bilgen Cetin, and Shivnath Babu. Starfish: A self-tuning system for big data analytics. In CIDR, pages 261-272, 2011.
9. Nikolay Laptev, Kai Zeng, and Carlo Zaniolo. Early accurate results for advanced analytics on mapreduce. PVLDB, 5(10):1028-1039, 2012.
10. Sayan Mukherjee, Pablo Tamayo, Simon Rogers, Ryan M. Rifkin, Anna Engle, Colin Campbell, Todd R. Golub, and Jill P. Mesirov. Estimating dataset size requirements for classifying dna microarray data. Journal of Computational Biology, pages 119-142, 2003.
11. Frank Olken and Doron Rotem. Random sampling from database files: A survey. In SSDBM, pages 92-111, 1990.
12. Christopher Olston, Benjamin Reed, Utkarsh Srivastava, Ravi Kumar, and Andrew Tomkins. Pig latin: a not-so-foreign language for data processing. SIGMOD, pages 1099-1110, New York, NY, USA, 2008. ACM.
13. Niketan Pansare, Vinayak R. Borkar, Chris Jermaine, and Tyson Condie. Online aggregation for large mapreduce jobs. PVLDB, 4(11):1135-1145, 2011.
14. Rob Pike, Sean Dorward, Robert Griesemer, Sean Quinlan, and Google Inc. Interpreting the data: Parallel analysis with sawzall. In Scientific Programming Journal, Special Issue on Grids and Worldwide Computing Programming Models and Infrastructure, pages 227-298.
15. David N. Reshef, Yakir A. Reshef, Hilary K. Finucane, Sharon R. Grossman, Gilean McVean, Peter J. Turnbaugh, Eric S. Lander, Michael Mitzenmacher, and Pardis C. Sabeti. Detecting novel associations in large data sets. Science, 334(6062):1518-1524, 2011.
16. Jun Shao and D. Tu. The jackknife and bootstrap. Springer Verlag, 1995.
17. Alun Thomas. Bootstrapping, jackknifing and cross validation. reusing your data. 2000.
18. Ashish Thusoo, Joydeep Sen Sarma, Namit Jain, Zheng Shao, Prasad Chakka, Suresh Anthony, Hao Liu, Pete Wyckoff, and Raghotham Murthy. Hive- a warehousing solution over a map-reduce framework. In VLDB, pages 1626-1629, 2009.
19. V N Vapnik and A Y Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and Its Applications, 16(2):264-280, 1971.