Photon: Fault-tolerant and scalable joining of continuous data streams

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2013, Pages 577-588

  Ananthanarayanan, Rajagopal ^a   Basker, Venkatesh ^a   Das, Sumit ^a   Gupta, Ashish ^a   Jiang, Haifeng ^a   Qiu, Tianhao ^a   Reznichenko, Alexey ^a   Ryabkov, Deomid ^a   Singh, Manpreet ^a   Venkataraman, Shivakumar ^a  

^a GOOGLE INC   (United States)

Author keywords

Continuous Streams; Fault tolerance; Paxos; Stream joining

Indexed keywords

ADVERTISING SYSTEMS; CONTINUOUS STREAMS; DEPLOYMENT PROCESS; GEOGRAPHICALLY DISTRIBUTED SYSTEMS; MANUAL INTERVENTION; PAXOS; WEB SEARCH QUERIES; WEB-BASED ENTERPRISE;

DATA COMMUNICATION SYSTEMS; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS; JOINING; SEMANTICS; WEBSITES;

PHOTONS;

EID: 84880518659     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2463676.2465272     Document Type: Conference Paper

References (26)

1. D. J. Abadi et al. "The Design of the Borealis Stream Processing Engine,". Proc. of CIDR 2005, pp. 277-289.
2. J. Baker et al. "Megastore: Providing scalable, highly available storage for interactive devices,". Proc. of CIDR 2011, pp. 223-234.
3. S. Blanas et al. "A comparison of join algorithms for log processing in Mapreduce,". Proc. of SIGMOD 2010, pp. 975-986.
4. T. D. Chandra, R. Griesemer, and J. Redstone. "Paxos made live: an engineering perspective,". Proc. of ACM PODC 2007, pp. 398-407.
5. S. Chandrasekaran and M. J. Franklin. "Streaming queries over streaming data,". Proc. of VLDB 2002, pp. 203-214.
6. F. Chang et al. "Bigtable: A Distributed Storage System for Structured Data,". ACM TOCS 2008, 26.2, pp.4:1-4:26.
7. E. F. Codd. "A Relational Model of Data for Large Shared Data Banks,", Communications of the ACM 13 (6): p377-387, 1970.
8. J. C. Corbett et al. "Spanner: Google's Globally-Distributed Database,". Proc. of OSDI 2012.
9. A. Das, J. Gehrke, and M. Riedewald. "Approximate join processing over data streams,". Proc. of SIGMOD 2003, pp. 40-51.
10. J. Dean and S. Ghemawat. "MapReduce: Simplified data processing on large clusters,". Proc. of OSDI 2004, pp. 137-149.
11. G. DeCandia et al. "Dynamo: Amazon's Highly Available Key-value Store,". Proc. of SOSP. 2007, pp. 205-220.
12. B. Fitzpatrick. "Distributed Caching with Memcached,". Linux Journal, Issue 124, 2004, pp.5.
13. B. Gedik, P. S. Yu, and R. R. Bordawekar. "Executing stream joins on the cell processor,", Proc. of VLDB 2007, pp. 363-374.
14. S. Ghemawat, H. Gobioff, and S-T Leung. "The Google File System,". 19th Symposium on Operating Systems Principles 2003, pp. 20-43.
15. M. A. Hammad, W. G. Aref, and A. K. Elmagarmid. "Joining multiple data streams with window constraints,". Computer Science Technical Reports, #02-115.
16. J. Kang, J. F. Naughton, and S. D. Viglas. "Evaluating window joins over unbounded streams,". Proc. of VLDB 2002, pp. 341-352.
17. D. Karger et al. "Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web,". Proc. of ACM SOTC 1997, pp. 654-663.
18. L. Lamport. "The part-time parliament,", ACM TOCS 16.2 1998, pp. 133-169.
19. P. Mishra and M. H. Eich. "Join processing in relational databases,". ACM Computing Surveys 1992, 24(1), pp. 63-113.
20. L. Neumeyer et al. "S4: Distributed Stream Computing Platform,". Proc. of KDCloud 2010.
21. J. Rao, E. J. Shekita, and S. Tata. "Using Paxos to Build a Scalable, Consistent, and Highly Available Datastore,". Proc. of VLDB 2011, pp. 243-254.
22. F. B. Schneider. "Implementing fault-tolerant services using the state machine approach: A tutorial,", ACM Computing Surveys 22 1990, pp.299-319 (1990).
23. D. Shasha and P. Bonnet. "Database Tuning: Principles, Experiments, and Troubleshooting Techniques,". Proc. of SIGMOD 2004, pp. 115-116.
24. J. Teubner and R. Mueller. "How soccer players would do stream joins,". Proc. of SIGMOD 2011, pp. 625-636.
25. J. Xie and J. Yang. "A survey of join processing in data streams,". Data Streams - Models and Algorithms 2007, pp. 209-236.
26. M. Zaharia et al. "Discretized Streams: An Efficient and Fault-tolerant Model for Stream Processing on Large Clusters,". Proc. of HotCloud 2012, pp. 10-10.