Incremental stream processing using Computational Conflict-free Replicated Data Types

Proceedings of the 3rd International Workshop on Cloud Data and Platforms, CloudDP 2013 - Co-located with ACM 13th EuroSys

Volumn , Issue , 2013, Pages 31-36

  Navalho, David ^a   Duarte, Sérgio ^a   Preguiça, Nuno ^a   Shapiro, Marc ^b  

^a UNIVERSIDADE NOVA DE LISBOA   (Portugal)

^b UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

Distributed processing; Incremental computation; Real time; Stream processing

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS;

CONSISTENT STATE; DISTRIBUTED PROCESSING; INCREMENTAL COMPUTATION; REAL TIME; REPLICATED OBJECTS; STATE OF THE ART; STREAM PROCESSING; STREAM PROCESSING SYSTEMS;

C (PROGRAMMING LANGUAGE);

EID: 84879520704     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2460756.2460762     Document Type: Conference Paper

References (21)

1. Storm -. http://storm-project.net (accessed Jan. 2013).
2. I. F. Akyildiz,W. Su, Y. Sankarasubramaniam, and E. Cayirci. A survey on sensor networks. Communications Magazine, IEEE, 40(8):102-114, November 2002.
3. P. Bahl and V. N. Padmanabhan. Radar: An in-building rfbased user location and tracking system. In Proc. INFOCOM, pages 775-784, 2000.
4. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquin. Incoop: Mapreduce for incremental computations. In Proc. SOCC '11, pages 7:1-7:14, 2011.
5. A. Brito, A. Martin, T. Knauth, S. Creutz, D. Becker, S. Weigert, and C. Fetzer. Scalable and Low-Latency Data Processing with StreamMapReduce. In Proc. CloudCom 2011, pages 48 -58, Los Alamitos, CA, USA, 2011. IEEE.
6. M. Cha, F. Benevenuto, H. Haddadi, and P. K. Gummadi. The world of connections and information flow in twitter. IEEE TSMC, Part A, 42(4):991-998, 2012.
7. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, and S. B. Zdonik. Scalable distributed stream processing. In CIDR, 2003.
8. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. In Proc. 7th USENIX conference on Networked systems design and implementation, NSDI'10, pages 21-21, 2010.
9. J. Cranshaw, R. Schwartz, J. I. Hong, and N. M. Sadeh. The livehoods project: Utilizing social media to understand the dynamics of a city. In Proc. Sixth International Conference on Weblogs and Social Media, 2012.
10. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. In Proc. 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6, OSDI'04, pages 10-10, 2004.
11. J. Eriksson, L. Girod, B. Hull, R. Newton, S. Madden, and H. Balakrishnan. The Pothole Patrol: Using a Mobile Sensor Network for Road Surface Monitoring. In MobiSys '08, 2008.
12. B. Hull, V. Bychkovsky, Y. Zhang, K. Chen, M. Goraczko, A. K. Miu, E. Shih, H. Balakrishnan, and S. Madden. CarTel: A Distributed Mobile Sensor Computing System. In 4th ACM SenSys, November 2006.
13. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In Proc. 2nd EuroSys European Conference on Computer Systems, EuroSys '07, pages 59-72, 2007.
14. Mohan, Prashanth and Padmanabhan, Venkata and Ramjee, Ramachandran. Nericell: Rich Monitoring of Road and Traffic Conditions using Mobile Smartphones. In Proc. of ACM SenSys 2008, November 2008.
15. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari. S4: Distributed stream computing platform. In Proc. ICDMW '10, ICDMW '10, pages 170-177, 2010.
16. D. Peng and F. Dabek. Large-scale incremental processing using distributed transactions and notifications. In Proc. 9th USENIX conference on Operating systems design and implementation, OSDI'10, pages 1-15, 2010.
17. Y. Saito and M. Shapiro. Optimistic replication. ACM Computing Surveys, 37(1):42-81, 2005. ISSN 0360-0300.
18. M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. Convergent and commutative replicated data types. Bulletin of the European Association for Theoretical Computer Science (EATCS), (104):67-88, June 2011.
19. M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. Conflict-free replicated data types. In X. Défago, F. Petit, and V. Villain, editors, Proc. 13th International Symposium on Stabilization, Safety, and Security of Distributed Systems (SSS), volume 6976 of Lecture Notes on Computer Science, pages 386-400, Oct. 2011.
20. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P. K. Gunda, and J. Currey. Dryadlinq: a system for generalpurpose distributed data-parallel computing using a high-level language. In Proc. 8th USENIX conference on Operating systems design and implementation, OSDI'08, pages 1-14, 2008.
21. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. Mc-Cauley, M. J. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In Proc. NSDI'12, pages 2-2, 2012.