Shark: Fast data analysis using coarse-grained distributed memory

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2012, Pages 689-692

  Engle, Cliff ^a   Lupher, Antonio ^a   Xin, Reynold ^a   Zaharia, Matei ^a   Franklin, Michael J ^a   Shenker, Scott ^a   Stoica, Ion ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

data warehouse; databases; machine learning; resilient distributed dataset; shark; spark

Indexed keywords

COARSE-GRAINED; DATA MANIPULATIONS; DATA SETS; DISTRIBUTED MEMORY; DISTRIBUTED SHARED MEMORY; FAULT-TOLERANT; LARGE DATASETS; LEARNING PROGRAMS; MAP-REDUCE; RESEARCH DATA; SHARK; UNIFIED SYSTEM;

COMPUTER SOFTWARE; DATA WAREHOUSES; DATABASE SYSTEMS; ELECTRIC SPARKS; QUERY PROCESSING;

LEARNING SYSTEMS;

EID: 84862681431     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2213836.2213934     Document Type: Conference Paper

References (4)

1. G. Ananthanarayanan, A. Ghodsi, S. Shenker, and I. Stoica. Disk-locality in datacenter computing considered irrelevant. In HotOS '11, 2011.
2. A. Pavlo, E. Paulson, A. Rasin, D. Abadi, D. DeWitt, S. Madden, and M. Stonebraker. A comparison of approaches to large-scale data analysis. In Proceedings of the 35th SIGMOD international conference on Management of data, pages 165-178. ACM, 2009.
3. A. Thusoo, J. Sarma, N. Jain, Z. Shao, P. Chakka, N. Zhang, S. Antony, H. Liu, and R. Murthy. Hive-a petabyte scale data warehouse using hadoop. In Data Engineering (ICDE), 2010 IEEE 26th International Conference on, pages 996-1005. IEEE, 2010.
4. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In NSDI 2012.