Rex: Recursive, deltabased datacentric computation

Proceedings of the VLDB Endowment

Volumn 5, Issue 11, 2012, Pages 1280-1291

  Mihaylov, Svilen R ^a   Ives, Zachary G ^a   Guha, Sudipto ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS;

CONVERGENCE CRITERION; DATA ANALYSIS ALGORITHMS; DATA RELATIONSHIPS; ITERATIVE ALGORITHM; ITERATIVE COMPUTATION; NETWORK ENVIRONMENTS; PROGRAMMING MODELS; USER DEFINED FUNCTIONS;

ITERATIVE METHODS;

EID: 84873171138     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2350229.2350246     Document Type: Article

References (27)

1. A. Abouzeid, K. Bajda-Pawlikowski, D. J. Abadi, A. Rasin, and A. Silberschatz. HadoopDB: An architectural hybrid of MapReduce and DBMS technologies for analytical workloads. PVLDB, 2(1):922-933, 2009.
2. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquin. Incoop: Mapreduce for incremental computations. SOCC, pages 7:1-7:14, 2011.
3. V. Borkar, M. Carey, R. Grover, N. Onose, and R. Vernica. Hyracks: A flexible and extensible foundation for data-intensive computing. ICDE, pages 1151-1162, 2011.
4. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient iterative data processing on large clusters. In VLDB, pages 285-296, 2010.
5. S. Chaudhuri and K. Shim. Including group-by in query optimization. In VLDB, pages 354-366, 1994.
6. J. Chen, D. DeWitt, F. Tian, and Y. Wang. NiagaraCQ: A scalable continuous query system for Internet databases. In SIGMOD, pages 379-390, 2000.
7. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. In NSDI, pages 313-328, 2010.
8. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI, pages 137-150, 2004.
9. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: a runtime for iterative mapreduce. In HPDC, pages 810-818, 2010.
10. G. Graefe and W. J. McKenna. The Volcano optimizer generator: Extensibility and efficient search. In ICDE, pages 209-218, 1993.
11. J. Gray. Why do computers stop and what can be done about it? Technical Report 85.7, Tandem, 1985.
12. A. Gupta, I. S. Mumick, and V. S. Subrahmanian. Maintaining views incrementally. In SIGMOD, pages 157-166, 1993.
13. J. M. Hellerstein and M. Stonebraker. Predicate migration: Optimizing queries with expensive predicates. In SIGMOD, pages 267-276, 1993.
14. W. Hong and M. Stonebraker. Optimization of parallel query execution plans in XPRS. Distributed and Parallel Databases, 1(1):9-32, 1993.
15. R. Huebsch, J. M. Hellerstein, N. Lanham, B. T. Loo, S. Shenker, and I. Stoica. Quering the Internet with PIER. In VLDB, pages 321-332, 2003.
16. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In EuroSys, pages 59-72, 2007.
17. M. Liu, N. E. Taylor, W. Zhou, Z. G. Ives, and B. T. Loo. Recursive computation of regions and connectivity in networks. In ICDE, pages 1108-1119, 2009.
18. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, and C. Guestrin. Graphlab: A distributed framework for machine learning in the cloud. CoRR, abs/1107.0922, 2011.
19. L. F. Mackert and G. M. Lohman. R* optimizer validation and performance evaluation for distributed queries. In VLDB, pages 149-159, 1986.
20. G. Malewicz, M. H. Austern, A. J. C. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: a system for large-scale graph processing. In SIGMOD, pages 135-146, 2010.
21. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: a not-so-foreign language for data processing. In SIGMOD, pages 1099-1110, 2008.
22. N. E. Taylor and Z. G. Ives. Reliable storage and querying for collaborative data sharing systems. In ICDE, pages 40-51, 2010.
23. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, N. Zhang, S. Anthony, H. Liu, and R. Murthy. Hive -a petabyte scale data warehouse using Hadoop. In ICDE, pages 996-1005, 2010.
24. P. A. Tucker and D. Maier. Exploiting punctuation semantics in data streams. In ICDE, pages 555-568, 2002.
25. T. White. Hadoop: The Definitive Guide, chapter 14. O'Reilly, 2009.
26. Y. Yu, M. Isard, D. Fetterly, M. Budiu, Ú. Erlingsson, P. K. Gunda, and J. Currey. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In OSDI, pages 1-14, 2008.
27. M. Zaharia, M. Chodhury, M. J. Franklin, S. Shenker, and I. Stoica. Spark: Cluster computing with working sets. In HotCloud 10, pages 10-10, 2010.