Cumulon: Optimizing statistical data analysis in the cloud

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2013, Pages 1-12

  Huang, Botong ^a   Babu, Shivnath ^a   Yang, Jun ^a  

^a DUKE UNIVERSITY   (United States)

Author keywords

Cloud; Data parallelism; Linear algebra; Statistical computing

Indexed keywords

COST-BASED OPTIMIZATION; DATA PARALLELISM; DEPLOYMENT PLANS; EXECUTION MODEL; MAP-REDUCE; SEARCH TECHNIQUE; STATISTICAL COMPUTING; STATISTICAL DATA ANALYSIS;

CLOUDS; LINEAR ALGEBRA; STATISTICAL METHODS;

OPTIMIZATION;

EID: 84880526880     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2463676.2465273     Document Type: Conference Paper

References (25)

1. V. R. Borkar, Y. Bu, M. J. Carey, J. Rosen, N. Polyzotis, T. Condie, M. Weimer, and R. Ramakrishnan. Declarative systems for large-scale machine learning. IEEE Data Engineering Bulletin, 35(2):24-32, 2012.
2. P. G. Brown. Overview of SciDB: Large scale array storage, processing and analysis. SIGMOD 2010.
3. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient iterative data processing on large clusters. PVLDB, 3(1):285-296, 2010.
4. J. B. Buck, N. Watkins, J. LeFevre, K. Ioannidou, C. Maltzahn, N. Polyzotis, and S. A. Brandt. SciHadoop: Array-based query processing in Hadoop. Supercomputing 2011.
5. J. Cohen, B. Dolan, M. Dunlap, J. M. Hellerstein, and C. Welton. MAD skills: New analysis practices for big data. VLDB 2009.
6. S. Das, Y. Sismanis, K. S. Beyer, R. Gemulla2, P. J. Haas, and J. McPherson. Ricardo: Integrating R and Hadoop. SIGMOD 2010.
7. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. OSDI 2004.
8. A. Ghoting, R. Krishnamurthy, E. Pednault, B. Reinwald, V. Sindhwani, S. Tatikonda, Y. Tian, and S. Vaithyanathan. SystemML: Declarative machine learning on MapReduce. ICDE 2011.
9. S. Guha. Computing Environment for the Statistical Analysis of Large and Complex Data. PhD thesis, Purdue University, 2010.
10. J. M. Hellerstein, C. Re, F. Schoppmann, Z. D. Wang, E. Fratkin, A. Gorajek, K. S. Ng, C. Welton, X. Feng, K. Li, and A. Kumar. The MADlib analytics library or MAD skills, the SQL. PVLDB, 5(12):1700-1711, 2012.
11. H. Herodotou and S. Babu. Profiling, what-if analysis, and cost-based optimization of MapReduce programs. PVLDB Endowment, 4(11):1111-1122, 2011.
12. H. Herodotou, F. Dong, and S. Babu. No one (cluster) size fits all: Automatic cluster sizing for data-intensive analytics. SoCC 2011.
13. T. Hofmann. Probabilistic latent semantic indexing. SIGIR 1999.
14. K. Kambatla, A. Pathak, and H. Pucha. Towards optimizing hadoop provisioning for the cloud. HotCloud 2009.
15. U. Kang, C. E. Tsourakakis, and C. Faloutsos. PEGASUS: A peta-scale graph mining system. ICDM 2009.
16. J. Li, X. Ma, S. B. Yoginath, G. Kora, and N. F. Samatova. Transparent runtime parallelization of the R scripting language. J. Parallel & Distributed Computing, 71(2):157-168, 2011.
17. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: A not-so-foreign language for data processing. SIGMOD 2008.
18. V. Rokhlin, A. Szlam, and M. Tygert. A randomized algorithm for principal component analysis. SIAM J. Matrix Analysis & Applications, 31(3), 2009.
19. S. Seo, E. J. Yoon, J.-H. Kim, S. Jin, J.-S. Kim, and S. Maeng. HAMA: An efficient matrix computation with the MapReduce framework. CloudCom 2010.
20. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyck-off, and R. Murthy. Hive - a warehousing solution over a map-reduce framework. PVLDB, 2(2):1626-1629, 2009.
21. S. Toledo. A survey of out-of-core algorithms in numerical linear algebra. In DIMACS Series In Discrete Mathematics And Theoretical Computer Science: External Memory Algorithms, pages 161-179. 1999.
22. L. G. Valiant. A bridging model for parallel computation. CACM, 33(8), 1990.
23. A. Verma, L. Cherkasova, and R. H. Campbell. ARIA: automatic resource inference and allocation for mapreduce environments. ICAC 2011.
24. Y. Zhang, H. Herodotou, and J. Yang. RIOT: I/O-efficient numerical computing without SQL. CIDR 2009.
25. Z. Zhang, L. Cherkasova, A. Verma, and B. T. Loo. Meeting service level objectives of Pig programs. In 2012 Intl. Workshop on Cloud Computing Platforms.