Early accurate results for advanced analytics on mapreduce

Proceedings of the VLDB Endowment

Volumn 5, Issue 10, 2012, Pages 1028-1039

  Laptev, Nikolay ^a   Zeng, Kai ^a   Zaniolo, Carlo ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL APPLICATIONS; APPROXIMATE RESULTS; ARBITRARY FUNCTIONS; DEGREE OF ACCURACY; INCREMENTAL COMPUTATION; MAPREDUCE FRAMEWORKS; MASSIVE DATA SETS; RESOURCE CONSTRAINT;

BIG DATA;

EID: 84873118945     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2336664.2336675     Document Type: Article

References (31)

1. Earl release website: http://yellowstone.cs.ucla.edu/wis/
2. Hadoop: Open-source implementation of mapreduce: http://hadoop.apache.org.
3. V. Borkar, M. Carey, R. Grover, N. Onose, and R. Vernica. Hyracks: A exible and extensible foundation for data-intensive computing. In ICDE, pages 1151 -1162, 2011.
4. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Effcient iterative data processing on large clusters. In VLDB, pages 285-296, 2010.
5. S. Chaudhuri, G. Das, and U. Srivastava. Effective use of block-level sampling in statistics estimation. In SIGMOD, pages 287-298, 2004.
6. B. Chen, P. Haas, and P. Scheuermann. A new two-phase sampling based algorithm for discovering association rules. In SIGKDD, pages 462-468, 2002.
7. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. Technical Report UCB/EECS-2009-136, EECS Department, University of California, Berkeley, 2009.
8. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, J. Gerth, J. Talbot, K. Elmeleegy, and R. Sears. Online aggregation and continuous query support in mapreduce. In SIGMOD, pages 1115-1118, 2010.
9. R. Davidson and J. G. MacKinnon. Bootstrap tests: How many bootstraps? Working Papers 1036, Queen's University, Department of Economics, 2001.
10. A. Doucet, M. Briers, and S. Sncal. Effcient block sampling strategies for sequential monte carlo methods. Journal of Computational and Graphical Statistics, 15(3):693-711, 2006.
11. B. Efron. Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7(1):1-26, 1979.
12. B. Efron. Better bootstrap conffdence intervals. Journal of the American Statistical Association, 82(397):171-185, 1987.
13. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google ffle system. In SOSP, pages 29-43, 2003.
14. R. Grover and M. Carey. Extending map-reduce for effcient predicate-based sampling. In ICDE, 2012.
15. J. M. Hellerstein, P. J. Haas, and H. J. Wang. Online aggregation. In SIGMOD, pages 171-182, 1997.
16. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F. B. Cetin, and S. Babu. Starffsh: A self-tuning system for big data analytics. In CIDR, pages 261-272, 2011.
17. S. Lahiri. Resampling methods for dependent data. Springer series in statistics. Springer-Verlag, 2003.
18. S. M. S. Lee and P. Y. Lai. Double block bootstrap conffdence intervals for dependent data. Biometrika, 96(2):427-443, 2009.
19. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. J. Shenoy. A platform for scalable one-pass analytics using mapreduce. In SIGMOD, pages 985-996, 2011.
20. F. Olken and D. Rotem. Random sampling from database ffles: A survey. In SSDBM, pages 92-111, 1990.
21. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: a not-so-foreign language for data processing. In SIGMOD, pages 1099-1110, 2008.
22. N. Pansare, V. R. Borkar, C. Jermaine, and T. Condie. Online aggregation for large mapreduce jobs. PVLDB, 4(11):1135-1145, 2011.
23. R. Pike, S. Dorward, R. Griesemer, and S. Quinlan. Interpreting the data: Parallel analysis with sawzall. Sci. Program., 13(4):277-298, 2005.
24. A. Pol and C. Jermaine. Relational conffdence bounds are easy with the bootstrap. In SIGMOD, pages 587-598, 2005.
25. D. N. Politis and H. White. Automatic block-length selection for the dependent bootstrap. Econometric Reviews, 28(4):372-375, 2009.
26. B. Schroeder and G. A. Gibson. Disk failures in the real world: what does an mttf of 1,000,000 hours mean to you? In USENIX FAST, pages 1-12, 2007.
27. J. Shao and D. Tu. The jackknife and bootstrap. Springer series in statistics. Springer Verlag, 1995.
28. S. E. Syrjala. A bootstrap approach to making sample-size calculations for resource surveys. In SSC, pages 53-60, 2001.
29. A. Thomas. Bootstrapping, jackkniffng and cross validation, reusing your data. Utah University Lecture, 2000.
30. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy. Hivea warehousing solution over a map-reduce framework. In VLDB, pages 1626-1629, 2009.
31. W. Zhao, H. Ma, and Q. He. Parallel k-means clustering based on mapreduce. In CloudCom, pages 674-679, 2009.