MapIterativeReduce: A framework for reduction-intensive data processing on azure clouds

MapReduce '12 - 3rd International Workshop on MapReduce and Its Applications

Volumn , Issue , 2012, Pages 9-16

  Tudoran, Radu ^a   Costan, Alexandru ^a   Antoniu, Gabriel ^a  

^a INRIA   (France)

Author keywords

Azure; Cloud computing; Data intensive applications; MapReduce

Indexed keywords

AZURE; DATA CLUSTERING; DATA-INTENSIVE APPLICATION; EXECUTION TIME; MAP-REDUCE; MICROSOFT; PROGRAMMING MODELS; REAL-LIFE APPLICATIONS; SYNTHETIC BENCHMARK;

CLOUD COMPUTING; CLUSTERING ALGORITHMS; COMPUTER PROGRAMMING; DATA PROCESSING; SUPERCOMPUTERS; WINDOWS OPERATING SYSTEM;

BENCHMARKING;

EID: 84863957662     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2287016.2287019     Document Type: Conference Paper

References (16)

1. A-Brain, http://www.msr-inria.inria.fr/Projects/a-brain.
2. Azure. http://www.windowsazure.com/en-us/.
3. Azure Crash Report. http://m.zdnet.co.uk/blogs/mapping-babel-10017967/ microsoft-grapples-with-windows-azure-outage-10025520/.
4. A. Agarwal, O. Chapelle, M. Dudik, and J. Langford. A Reliable Effective Terascale Linear Learning System. 2011.
5. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. Haloop: efficient iterative data processing on large clusters. Proc. VLDB Endow., 3:285-296, September 2010.
6. A. Dave, W. Lu, J. Jackson, and R. Barga. Cloudclustering: Toward an iterative data processing pattern on the cloud. In IPDPSW, 2011, pages 1132-1137, may 2011.
7. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: a runtime for iterative mapreduce. In HPDC '10, pages 810-818, 2010.
8. J. Ekanayake, S. Pallickara, and G. Fox. Mapreduce for data intensive scientific analyses. In IEEE eScience '08, pages 277-284, dec. 2008.
9. T. Gunarathne, T.-L. Wu, J. Qiu, and G. Fox. Mapreduce in the clouds for science. In CloudCom10, pages 565-572, 2010.
10. T. Gunarathne, B. Zhang, T.-L. Wu, and J. Qiu. Portable parallel programming on cloud and hpc: Scientific applications of twister4azure. In UCC 2011, pages 97-104, dec. 2011.
11. L. Hong, A. K. Jain, and S. Pankanti. Can multibiometrics improve performance. Technical Report MSU-CSE-99-39, Department of Computer Science, Michigan State University, December 1999. http://www.hlrs.de/mpi/myreduce.html.
12. S. J. Plimpton and K. D. Devine. Mapreduce in mpi for large-scale graph algorithms. Parallel Computing, pages 610-632, 2011.
13. J.-B. Poline, C. Lalanne, A. Tenenhaus, E. Duchesnay, B. Thirion, and V. Frouin. Imaging genetics: bio-informatics and bio-statistics challenges. In 19th International Conference on Computational Statistics, Paris, France, Aug. 2010.
14. R. Tudoran, A. Costan, G. Antoniu, and H. Soncu. TomusBlobs: Towards Communication-Efficient Storage for MapReduce Applications in Azure. In CCGrid'2012, Ottawa, Canada, 2012. in press. Inria-Microsoft Research Centre.
15. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica. Spark: cluster computing with working sets. In HotCloud'10, pages 10-10. USENIX, 2010.
16. Y. Zhang, Q. Gao, L. Gao, and C. Wang. imapreduce: A distributed computing framework for iterative computation. In IPDPSW, 2011, pages 1112-1121, may 2011.