Stormy: An elastic and highly available streaming service in the cloud

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages 55-60

  Loesing, Simon ^a   Hentschel, Martin ^a   Kraska, Tim ^b   Kossmann, Donald ^a  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARCHITECTURAL PROPERTIES; CONTINUOUS DATA; COST EFFICIENCY; DATA AGGREGATION; DATA STREAMING; FAULT-TOLERANT; PRIMARY DESIGN; REAL-TIME DATA; RESOURCE UTILIZATIONS; SCALABLE STORAGE SYSTEMS; STORAGE SYSTEMS; STREAM PROCESSING; STREAMING SERVICE; TECHNIQUES USED; TO A VERY LARGE;

DATA PROCESSING; DATA REDUCTION; DISTRIBUTED PARAMETER CONTROL SYSTEMS; ELECTRIC GENERATORS;

STORMS;

EID: 84864131193     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2320765.2320789     Document Type: Conference Paper

References (27)

1. D. J. Abadi, Y. Ahmad, M. Balazinska, M. Cherniack, J.-H. Hwang, W. Lindner, A. S. Maskey, E. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik. The design of the Borealis stream processing engine. In CIDR '05, pages 277-289, 2005.
2. Apache Zookeeper. http://zookeeper.apache.org/.
3. A. Arasu, M. Cherniack, E. Galvez, D. Maier, A. S. Maskey, E. Ryvkina, M. Stonebraker, and R. Tibbetts. Linear Road: A stream data management benchmark. In VLDB '04, pages 480-491, 2004.
4. H. Balakrishnan, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Looking up data in P2P systems. CACM, 46:43-48, February 2003.
5. M. Balazinska, H. Balakrishnan, S. R. Madden, and M. Stonebraker. Fault-tolerance in the Borealis distributed stream processing system. ACM Transactions on Database Systems, 33:1-44, March 2008.
6. M. Burrows. The Chubby lock service for loosely-coupled distributed systems. In OSDI '06, pages 335-350, 2006.
7. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. R. Madden, F. Reiss, and M. A. Shah. TelegraphCQ: Continuous dataow processing. In SIGMOD '03, page 668, 2003.
8. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, and S. Zdonik. Scalable distributed stream processing. In CIDR '03, pages 257-268, 2003.
9. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI '04, pages 137-150, 2004.
10. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In SOSP '07, pages 205-220, 2007. (Pubitemid 351429377)
11. M. Grinev, M. Grineva, M. Hentschel, and D. Kossmann. Analytics for the real-time web. PVLDB, 4(12):1391-1394, September 2011.
12. V. Gulisano, R. Jimenez-Peris, M. Patino-Martinez, and P. Valduriez. StreamCloud: A large scale data streaming system. In ICDCS '10, pages 126-137, 2010.
13. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed data-parallel programs from sequential building blocks. In EuroSys '07, pages 59-72, 2007. (Pubitemid 47281575)
14. D. Karger, E. Lehman, T. Leighton, R. Panigrahy, M. Levine, and D. Lewin. Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the World Wide Web. In STOC '97, pages 654-663, 1997.
15. D. Kossmann, T. Kraska, S. Loesing, S. Merkli, R. Mittal, and F. Pfaffhauser. Cloudy: A modular cloud storage system. PVLDB, 3:1533-1536, September 2010.
16. A. Lakshman and P. Malik. Cassandra: A decentralized structured storage system. SIGOPS Operating Systems Review, 44:35-40, 2010.
17. L. Lamport. The part-time parliament. ACM Transactions on Computer Systems, 16:133-169, May 1998. (Pubitemid 128482394)
18. N. Marz. A Storm is coming. http://engineering.twitter.com/2011/08/storm- is-coming-more-details-and-plans.html, August 2011.
19. F. McSherry, R. Isaacs, M. Isard, and D. G. Murray. Naiad: The animating spirit of rivers and streams. In SOSP '11, 2011.
20. Microsoft SQL Server StreamInsight. http://www.microsoft.com/sqlserver/ en/us/solutions-technologies/business-intelligence/complex-event-processing. aspx.
21. MXQuery: A lightweight, full-featured XQuery engine. http://mxquery.org/.
22. D. Peng and F. Dabek. Large-scale incremental processing using distributed transactions and notifications. In OSDI '10, pages 251-264, 2010.
23. M. Shah, J. Hellerstein, S. Chandrasekaran, and M. Franklin. Flux: An adaptive partitioning operator for continuous query systems. In ICDE '03, pages 25-36, 2003.
24. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for internet applications. In SIGCOMM '01, pages 149-160, 2001. (Pubitemid 32981961)
25. StreamBase Systems, Inc. http://www.streambase.com/.
26. N. Tatbul, U. Çetintemel, and S. Zdonik. Staying FIT: efficient load shedding techniques for distributed stream processing. In VLDB '07, pages 159-170, 2007.
27. Y. Xing, S. Zdonik, and J.-H. Hwang. Dynamic load distribution in the Borealis stream processor. In ICDE '05, pages 791-802, 2005. (Pubitemid 41731202)