Using R for iterative and incremental processing

4th USENIX Workshop on Hot Topics in Cloud Computing, HotCloud 2012

Volumn , Issue , 2012, Pages

  Venkataraman, Shivaram ^a,b   Roy, Indrajit ^b   AuYoung, Alvin ^c   Schreiber, Robert S ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; MACHINE LEARNING;

COMPLEX MACHINES; DATA PARALLEL; GRAPH ALGORITHMS; INCREMENTAL COMPUTATION; INCREMENTAL PROCESSING; MAP-REDUCE;

ITERATIVE METHODS;

EID: 85088775823     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. The R project for statistical computing. http://www.r-project.org.
2. P. Bhatotia, A. Wieder, R. Rodrigues, U. A. Acar, and R. Pasquin. Incoop: Mapreduce for incremental computations. In Proc. SOCC'11, Cascais, Portugal, 2011. ACM.
3. S. Brin and L. Page. The anatomy of a large-scale hyper-textual Web search engine. In Proceedings of the seventh international conference on World Wide Web, WWW7, pages 107-117, 1998.
4. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. In Proceedings of OSDI 2006, pages 205-218, Nov. 2006.
5. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. Commun. ACM, 51(1), 2008.
6. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: Distributed data-parallel programs from sequential building blocks. In EuroSys'07, pages 59-72, 2007.
7. U. Kang, B. Meeder, and C. Faloutsos. Spectral Analysis for Billion-Scale Graphs: Discoveries and Implementation. In PAKDD (2), pages 13-25, 2011.
8. R. Kannan. Algorithms: Recent highlights and challenges. In Proc. of ISCA'11, San Jose, USA, 2011. ACM.
9. J. Kepner and J. Gilbert. Graph Algorithms in the Language of Linear Algebra. Fundamentals of Algorithms. SIAM, 2011.
10. G. Malewicz, M. H. Austern, A. J. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: A system for large-scale graph processing. In SIGMOD'10, pages 135-146, 2010.
11. D. G. Murray and S. Hand. CIEL: A universal execution engine for distributed data-flow computing. In NSDI'11, Boston, MA, USA, 2011.
12. D. Peng and F. Dabek. Large-scale incremental processing using distributed transactions and notifications. In OSDI'10, Vancouver, BC, Canada, 2010.
13. L. Popa, M. Budiu, Y. Yu, and M. Isard. DryadInc: Reusing work in large-scale computations. In HotCloud'09, San Diego, California, 2009.
14. R. Power and J. Li. Piccolo: Building fast, distributed programs with partitioned tables. In OSDI'10, Vancouver, BC, Canada, 2010. USENIX Association.
15. Z. Qian, X. Chen, N. Kang, M. Chen, Y. Yu, T. Moscibroda, and Z. Zhang. MadLINQ: large-scale distributed matrix computation for the cloud. In Proceedings of the 7th ACM european conference on Computer Systems, EuroSys'12, pages 197-210, Bern, Switzerland, 2012.
16. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica. Spark: Cluster computing with working sets. In HotCloud'10, Boston, MA, 2010.
17. Y. Zhou, D. Wilkinson, R. Schreiber, and R. Pan. Large-Scale Parallel Collaborative Filtering for the Netflix Prize. In AAIM'08, pages 337-348, Shanghai, China, 2008.