Muppet: Map reduce style processing of fast data

Proceedings of the VLDB Endowment

Volumn 5, Issue 12, 2012, Pages 1814-1825

  Lam, Wang ^a   Liu, Lu ^a   Prasad, STS ^a   Rajaraman, Anand ^a   Vacheri, Zoheb ^a   Doan, An Hai ^a,b  

^a atWalmartLabs   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA HANDLING; SOCIAL NETWORKING (ONLINE);

FACEBOOK; FIRE-HOSE; HIGH SCALABILITIES; LOW LATENCY; MAP-REDUCE; SENSOR DATA; SOCIAL MEDIA;

BIG DATA;

EID: 84872409772     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2367502.2367520     Document Type: Article

References (21)

1. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik. The Design of the Borealis Stream Processing Engine. In CIDR, pages 277-289, 2005.
2. AWS Case Study: foursquare. http://aws.amazon. com/solutions/case-studies/foursquare/.
3. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and Issues in Data Stream Systems. In PODS, pages 1-16, 2002.
4. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquin. Incoop: MapReduce for Incremental Computations. In SOCC, pages 7:1-7:14, 2011.
5. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, and M. Shah. TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. In CIDR, pages 269-280, 2003.
6. Cloud Scale. http://www.cloudscale.com/.
7. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. MapReduce Online. In NSDI, pages 313-327, 2010.
8. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI, pages 137-150, 2004.
9. Facebook, Inc. Amendment No. 8 to Form S-1 Registration Statement Under The Securities Act of 1933. http://sec.gov/Archives/edgar/data/ 1326801/000119312512235588/d287954ds1a.htm, 2012.
10. M. Garofalakis, J. Gehrke, and R. Rastogi, editors. Data Stream Management. Springer, 2009.
11. B. Gedik, H. Andrade, K.-L. Wu, P. S. Yu, and M. Doo. SPADE: The System S Declarative Stream Processing Engine. In SIGMOD, pages 1123-1134, 2008.
12. Going Social. http://www.economist.com/ events-conferences/americas/information-2012? bclid=1682222098001&bctid=1684182003001. An nterview with Twitter CEO Dick Costolo at Ideas Economy: Information.
13. K. Group. OpenCL. http://www.khronos.org/opencl/.
14. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. J. Shenoy. A Platform for Scalable One-Pass Analytics using MapReduce. In SIGMOD, pages 985-996, 2011.
15. Storm. https://github.com/nathanmarz/storm.
16. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari. S4: Distributed Stream Computing Platform. In ICDMW, pages 170-177, 2010.
17. J. Nickolls, I. Buck, M. Garland, and K. Skadron. Scalable Parallel Programming with CUDA. Queue, 6(2):40-53, 2008.
18. C. Olston, G. Chiou, L. Chitnis, F. Liu, Y. Han, M. Larsson, A. Neumann, V. B. N. Rao, V. Sankarasubramanian, S. Seth, C. Tian, T. ZiCornell, and X. Wang. Nova: Continuous Pig/Hadoop Workflows. In SIGMOD, pages 1081-1090, 2011.
19. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, and M. J. Franklin. Flux: An Adaptive Partitioning Operator for Continuous Query Systems. In ICDE, pages 25-36, 2003.
20. M. Zaharia, T. Das, H. Li, S. Shenker, and I. Stoica. Discretized Streams: An Efficient and Fault-Tolerant Model for Stream Processing on Large Clusters. In HotCloud, 2012.
21. S. Zdonik, M. Stonebraker, M. Cherniack, U. Çetintemel, M. Balazinska, and H. Balakrishnan. The Aurora and Medusa Projects. IEEE Data Engineering Bulletin, 26(1):3-10, 2003.