Elastic scaling of a high-throughput content-based publish/subscribe engine

Proceedings - International Conference on Distributed Computing Systems

Volumn , Issue , 2014, Pages 567-576

  Barazzutti, Raphael ^a   Heinze, Thomas ^b   Martin, Andre ^c   Onica, Emanuel ^a   Felber, Pascal ^a   Fetzer, Christof ^c   Jerzak, Zbigniew ^b   Pasin, Marcelo ^a   Riviere, Etienne ^a  

^a UNIVERSITY OF NEUCHÂTEL   (Switzerland)

^b SAP RESEARCH   (Germany)

^c DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COST EFFECTIVENESS; CRYPTOGRAPHY;

CLOUD ENVIRONMENTS; COMPUTATIONAL COSTS; CONTENT BASED FILTERING; CONTENT-BASED PUBLISH; DESIGN AND EVALUATIONS; DISTRIBUTED APPLICATIONS; END TO END LATENCIES; FILTERING OPERATIONS;

INFRASTRUCTURE AS A SERVICE (IAAS);

EID: 84907766496     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2014.64     Document Type: Conference Paper

References (31)

1. http://aws.amazon.com/sns/.
2. https://cwiki.apache.org/ZOOKEEPER/hedwig.html.
3. http://aws.amazon.com/autoscaling/.
4. M. Altinel and M. J. Franklin. Efficient filtering of xml documents for selective dissemination of information. In VLDB, 2000.
5. Michael Armbrust, Armando Fox, Rean Griffith, Anthony D. Joseph, Randy Katz, Andy Konwinski, Gunho Lee, David Patterson, Ariel Rabkin, Ion Stoica, and Matei Zaharia. A view of cloud computing. Communications of the ACM, 53(4):50-58, April 2010.
6. R. Barazzutti, P. Felber, C. Fetzer, E. Onica, M. Pasin, J.-F. Pineau, E. Rivìere, and S. Weigert. StreamHub: A massively parallel architecture for high-performance contentbased publish/subscribe. In DEBS, 2013.
7. R. Barazzutti, P. Felber, H. Mercier, E. Onica, and E. Rivìere. Thrifty privacy: Efficient support for privacy-preserving publish/subscribe. In DEBS, 2012.
8. A. Brito, A. Martin, T. Knauth, S. Creutz, D. Becker de Brum, S. Weigert, and C. Fetzer. Scalable and low-latency data processing with StreamMapReduce. In CloudCom, 2011.
9. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf. Design and evaluation of a wide-area event notification service. ACM TCS, 2001.
10. C.-Y. Chan, P. Felber, M. Garofalakis, and R. Rastogi. Efficient filtering of XML documents with XPath expressions. VLDB Journal, 11, 2002.
11. Sunoh Choi, Gabriel Ghinita, and Elisa Bertino. A privacyenhancing content-based publish/subscribe system using scalar product preserving transformations. In DEXA, 2010.
12. E.G. Coffman Jr, M.R. Garey, and D.S. Johnson. Approximation algorithms for bin packing: A survey. In Approximation algorithms for NP-hard problems, pages 46-93. PWS Publishing Co., 1996.
13. Patrick T. Eugster, Pascal Felber, Rachid Guerraoui, and Anne-Marie Kermarrec. The many faces of publish/subscribe. ACM Comput. Surv., 35(2):114-131, 2003.
14. Wenjing Fang, Beihong Jin, Biao Zhang, Yuwei Yang, and Ziyuan Qin. Design and evaluation of a pub/sub service in the cloud. In CSC, 2011.
15. Raul Castro Fernandez, Matteo Migliavacca, Evangelia Kalyvianaki, and Peter Pietzuch. Integrating scale out and fault tolerance in stream processing using operator state management. In SIGMOD, 2013.
16. Anshul Gandhi, Mor Harchol-Balter, Ram Raghunathan, and Michael A. Kozuch. Autoscale: Dynamic, robust capacity management for multi-tier data centers. ACM Trans. Comput. Syst., 30(4):14:1-14:26, 2012.
17. Vincenzo Gulisano, Ricardo Jimenez-Peris, Marta Patino-Martinez, Claudio Soriente, and Patrick Valduriez. Streamcloud: An elastic and scalable data streaming system. IEEE TPDS, 23(12), 2012.
18. Joe Hoffert, Douglas C. Schmidt, and Aniruddha Gokhale. Adapting distributed real-time and embedded pub/sub middleware for cloud computing environments. In Middleware, 2010.
19. Patrick Hunt, Mahadev Konar, Flavio P. Junqueira, and Benjamin Reed. Zookeeper: wait-free coordination for internetscale systems. In USENIX ATC, 2010.
20. Atsushi Ishii and Toyotaro Suzumura. Elastic stream computing with clouds. In IEEE Cloud, 2011.
21. Jay Kreps, Neha Narkhede, and Jun Rao. Kafka: a distributed messaging system for log processing. In NetDB, 2011.
22. Ming Li, Fan Ye, Minkyong Kim, Han Chen, and Hui Lei. A scalable and elastic publish/subscribe service. In IPDPS, 2011.
23. Paul Marshall, Kate Keahey, and Tim Freeman. Elastic site: Using clouds to elastically extend site resources. In Ccgrid, 2010.
24. Silvano Martello and Paolo Toth. Knapsack problems: algorithms and computer implementations. John Wiley & Sons, Inc., 1990.
25. A. Martin, C. Fetzer, and A. Brito. Active replication at (almost) no cost. In Srds, 2011.
26. A. Martin, T. Knauth, S. Creutz, D. Becker de Brum, S. Weigert, A. Brito, and C. Fetzer. Low-overhead fault tolerance for high-throughput data processing systems. In Icdcs, 2011.
27. Peter Mell and Timothy Grance. The NIST definition of cloud computing. NIST special publication, 800(145):7, 2011.
28. Scott Schneider, Henrique Andrade, Bugra Gedik, Alain Biem, and Kun-Lung Wu. Elastic scaling of data parallel operators in stream processing. In Ipdps, 2009.
29. Juraj Somorovsky, Mario Heiderich, Meiko Jensen, Jorg Schwenk, Nils Gruschka, and Luigi Lo Iacono. All your clouds are belong to us: security analysis of cloud management interfaces. In CCSW, 2011.
30. Nam-Luc Tran, Sabri Skhiri, and Esteban Zimanyi. Eqs: An elastic and scalable message queue for the cloud. In Cloudcom, 2011.
31. Kun-Lung Wu, Kirsten W. Hildrum, Wei Fan, Philip S. Yu, Charu C. Aggarwal, David A. George, Bugra Gedik, Eric Bouillet, Xiaohui Gu, Gang Luo, and Haixun Wang. Challenges and experience in prototyping a multi-modal stream analytic and monitoring application on System S. In VLDB