Differential dataflow

CIDR 2013 - 6th Biennial Conference on Innovative Data Systems Research

Volumn , Issue , 2013, Pages

  McSherry, Frank ^a   Murray, Derek G ^a   Isaacs, Rebecca ^a   Isard, Michael ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA FLOW ANALYSIS; ITERATIVE METHODS;

COMPLEX TASK; COMPUTATIONAL MODEL; DATA PARALLEL; DATA TRANSFORMATION; INCREMENTAL COMPUTATION; PROTOTYPE SYSTEM; SOCIAL GRAPHS; STRONGLY CONNECTED COMPONENT;

METADATA;

EID: 85084014248     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. U. A. Acar. Self-adjusting computation. PhD thesis, Carnegie Mellon University, 2005.
2. U. A. Acar, G. Blelloch, R. Ley-Wild, K. Tangwongsan, and D. Turkoglu. Traceable data types for self-adjusting computation. In ACM PLDI, 2010.
3. Y. Ahmad, O. Kennedy, C. Koch, and M. Nikolic. DBToaster: Higher-order delta processing for dynamic, frequently fresh views. In 38th VLDB, Aug. 2012.
4. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquini. Incoop: MapReduce for incremental computations. In 2nd ACM SOCC, Oct. 2011.
5. #. In 22nd OOPSLA, Oct. 2007.
6. J. A. Blakeley, P.-Å. Larson, and F. W. Tompa. Efficiently updating materialized views. In 1986 ACM SigMod, 1986.
7. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient iterative data processing on large clusters. In 36th VLDB, Sept. 2010.
8. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. MapReduce Online. In 7th USENIX NSDI, 2010.
9. N. Conway, W. R. Marczak, P. Alvaro, J. M. Hellerstein, and D. Maier. Logic and lattices for distributed programming. In 3rd ACM SOCC, 2012.
10. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In 6th USENIX OSDI, 2004.
11. C. Demetrescu, I. Finocchi, and A. Ribichini. Reactive imperative programming with dataflow constraints. In 26th OOPSLA, 2011.
12. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: a runtime for iterative MapReduce. In 19th ACM HPDC, June 2010.
13. S. Ewen, K. Tzoumas, M. Kaufmann, and V. Markl. Spinning fast iterative data flows. In 38th VLDB, 2012.
14. P. K. Gunda, L. Ravindranath, C. A. Thekkath, Y. Yu, and L. Zhuang. Nectar: automatic management of data and computation in datacenters. In 9th USENIX OSDI, Oct. 2010.
15. A. Gupta, I. S. Mumick, and V. S. Subrahmanian. Maintaining views incrementally. In 1993 ACM SigMod, 1993.
16. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed data-parallel programs from sequential building blocks. In EuroSys, Mar. 2007.
17. G. Malewicz, M. H. Austern, A. J. C. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: a system for large-scale graph processing. In 2010 ACM SigMod, June 2010.
18. D. Michie. “Memo” functions and machine learning. Nature, (218):19–22, Apr. 1968.
19. S. R. Mihaylov, Z. G. Ives, and S. Guha. REX: recursive, delta-based data-centric computation. In 38th VLDB, 2012.
20. D. G. Murray, M. Schwarzkopf, C. Smowton, S. Smith, A. Madhavapeddy, and S. Hand. CIEL: a universal execution engine for distributed data-flow computing. In 8th USENIX NSDI, Mar. 2011.
21. M. Najork. The scalable hyperlink store. In 20th ACM Conference on Hypertext and Hypermedia, 2009.
22. M. Najork, D. Fetterly, A. Halverson, K. Kenthapadi, and S. Gollapudi. Of hammers and nails: An empirical comparison of three paradigms for processing large graphs. In 5th ACM WSDM, Feb. 2012.
23. V. Nigam, L. Jia, B. T. Loo, and A. Scedrov. Maintaining distributed logic programs incrementally. In 13th ACM PPDP, July 2011.
24. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P. K. Gunda, and J. Currey. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In 8th USENIX OSDI, Dec. 2008.
25. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. Franklin, S. Shenker, and I. Stoica. Resilient Distributed Datasets: A fault-tolerant abstraction for in-memory cluster computing. In 9th USENIX NSDI, Apr. 2012.
26. M. Zaharia, T. Das, H. Li, S. Shenker, and I. Stoica. Discretized streams: An efficient and fault-tolerant model for stream processing on large clusters. In 4th USENIX HotCloud, 2012.
27. Y. Zhang, Q. Gao, L. Gao, and C. Wang. iMapReduce: A distributed computing framework for iterative computation. In 1st International Workshop on Data Intensive Computing in the Clouds, May 2011.
28. Y. Zhang, Q. Gao, L. Gao, and C. Wang. PrIter: A distributed framework for prioritized iterative computations. In 2nd ACM SOCC, Oct. 2011.