Storm @Twitter

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2014, Pages 147-156

  Toshniwal, Ankit ^a   Taneja, Siddarth ^a   Shukla, Amit ^a   Ramasamy, Karthik ^a   Patel, Jignesh M ^b   Kulkarni, Sanjeev ^a   Jackson, Jason ^a   Gade, Krishna ^a   Fu, Maosong ^a   Donham, Jake ^a   Bhagat, Nikunj ^a   Mittal, Sailesh ^a   Ryaboy, Dmitriy ^a  

^a TWITTER INC   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA PROCESSING; FAULT TOLERANCE; SOCIAL NETWORKING (ONLINE);

EMPIRICAL EVALUATIONS; FAULT-TOLERANT; MACHINE FAILURE; REAL TIME; STREAM DATA PROCESSING;

STORMS;

EID: 84904335699     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2588555.2595641     Document Type: Conference Paper

References (25)

1. Arvind Arasu, Brian Babcock, Shivnath Babu, Mayur Datar, Keith Ito, Rajeev Motwani, Itaru Nishizawa, Utkarsh Srivastava, Dilys Thomas, Rohit Varma, Jennifer Widom: STREAM: The Stanford Stream Data Manager. IEEE Data Eng. Bull. 26(1): 19-26 (2003)
2. Hari Balakrishnan, Magdalena Balazinska, Donald Carney, Ugur Çetintemel, Mitch Cherniack, Christian Convey, Eduardo F. Galvez, Jon Salz, Michael Stonebraker, Nesime Tatbul, Richard Tibbetts, Stanley B. Zdonik: Retrospective on Aurora. VLDB J. 13(4): 370-383 (2004)
3. Minos N. Garofalakis, Johannes Gehrke: Querying and Mining Data Streams: You Only Get One Look. VLDB 2002
4. Daniel J. Abadi, Yanif Ahmad, Magdalena Balazinska, Ugur Çetintemel, Mitch Cherniack, Jeong-Hyon Hwang, Wolfgang Lindner, Anurag Maskey, Alex Rasin, Esther Ryvkina, Nesime Tatbul, Ying Xing, Stanley B. Zdonik: The Design of the Borealis Stream Processing Engine. CIDR 2005: 277-289
5. S4 Distributed stream computing platform. http://incubator.apache.org/s4/
6. Tyler Akidau, Alex Balikov, Kaya Bekiroglu, Slava Chernyak, Josh Haberman, Reuven Lax, Sam McVeety, Daniel Mills, Paul Nordstrom, Sam Whittle: MillWheel: Fault-Tolerant Stream Processing at Internet Scale. PVLDB 6(11): 1033-1044 (2013)
7. Apache Samza. http://samza.incubator.apache.org
8. Spark Streaming. http://spark.incubator.apache.org/docs/latest/ streamingprogramming-guide.html
9. Mohamed H. Ali, Badrish Chandramouli, Jonathan Goldstein, Roman Schindlauer: The extensibility framework in Microsoft StreamInsight. ICDE 2011: 1242-1253
10. Sankar Subramanian, Srikanth Bellamkonda, Hua-Gang Li, Vince Liang, Lei Sheng, Wayne Smith, James Terry, Tsae- Feng Yu, Andrew Witkowski: Continuous Queries in Oracle. VLDB 2007: 1173-1184
11. IBM Infosphere Streams. http://www-03.ibm.com/software/products/en/ infosphere-streams/
12. Namit Jain, Shailendra Mishra, Anand Srinivasan, Johannes Gehrke, Jennifer Widom, Hari Balakrishnan, Ugur Çetintemel, Mitch Cherniack, Richard Tibbetts, Stanley B. Zdonik: Towards a streaming SQL standard. PVLDB 1(2): 1379-1390 (2008)
13. Jay Kreps, Neha Narkhede, and Jun Rao. Kafka: a distributed messaging system for log processing. SIGMOD Workshop on Networking Meets Databases, 2011.
14. Kestrel: A simple, distributed message queue system. http://robey.github. com/kestrel
15. Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, and Ion Stoica. 2011. Mesos: a platform for fine-grained resource sharing in the data center. In NSDI, 2011.
16. Goetz Graefe: Encapsulation of Parallelism in the Volcano Query Processing System. SIGMOD Conference 1990: 102-111
17. Apache Zookeeper. http://zookeeper.apache.org/
18. Summingbird. https://github.com/Twitter/summingbird
19. Rajagopal Ananthanarayanan, Venkatesh Basker, Sumit Das, Ashish Gupta, Haifeng Jiang, Tianhao Qiu, Alexey Reznichenko, Deomid Ryabkov, Manpreet Singh, Shivakumar Venkataraman: Photon: fault-tolerant and scalable joining of continuous data streams. SIGMOD Conference 2013: 577-588
20. Nathan Marz: (Storm) Tutorial. https://github.com/nathanmarz/storm/wiki/ Tutorial
21. Storm, Stream Data Processing: http://hortonworks.com/labs/storm/
22. Apache Storm: http://hortonworks.com/hadoop/storm/
23. Vinod Kumar Vavilapalli, Arun C. Murthy, Chris Douglas, Sharad Agarwal, Mahadev Konar, Robert Evans, Thomas Graves, Jason Lowe, Hitesh Shah, Siddharth Seth, Bikas Saha, Carlo Curino, Owen O'Malley, Sanjay Radia, Benjamin Reed, Eric Baldeschwieler: Apache Hadoop YARN: yet another resource negotiator. SoCC 2013: 5
24. Nathan Marz: Trident API Overview. https://github.com/nathanmarz/storm/ wiki/Trident-APIOverview
25. ZeroMQ: http://zeromq.org/