HAMA: An efficient matrix computation with the MapReduce framework

Proceedings - 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010

Volumn , Issue , 2010, Pages 721-726

  Seo, Sangwon ^a   Yoon, Edward J ^b   Kim, Jaehong ^a   Jin, Seongwook ^a   Kim, Jin Soo ^c   Maeng, Seungryoul ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b NHN Corporation   (South Korea)

^c Sungkyunkwan University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

CASE STUDY APPROACH; COMPUTATION ENGINE; MAP-REDUCE; MATRIX COMPUTATION; PARALLEL SYSTEM; SCIENTIFIC COMPUTATION;

COMPUTER SYSTEMS; MATRIX ALGEBRA;

CLOUD COMPUTING;

EID: 79952420862     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2010.17     Document Type: Conference Paper

References (19)

1. Grzegorz Malewicz et al., Pregel: a system for large-scale graph processing. In the Proceedings of the 2010 international conference on Management of data, June. 2010.
2. Sangwon Seo et al., HPMR: Prefetching and Pre-shuffling in Shared MapReduce Computation Environment. In the Proceedings of 11th IEEE International Conference on Cluster Computing, Sep. 2009.
3. Jeffrey Dean and Sanjay Ghemawat, MapReduce:Simplified Data Processing on Large Clusters. In the Proceedings of the 6th Symposium on Operating Systems Design and Implementation, Dec. 2004.
4. Michael Isard et al., Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems, Mar. 2007.
5. Mike Burrows, The Chubby lock service for loosely-coupled distributed systems. In the Proceedings of In the Proceedings of the 7th Symposium on Operating Systems Design and Implementation, Nov. 2006.
6. Me2day: http://me2day.net
7. Fay Chang, et al., Bigtable: A Distributed Storage System for Structured Data. In the Proceedings of In the Proceedings of the 7th Symposium on Operating Systems Design and Implementation, Nov. 2006.
8. Jonathan R. Shewchuk, An Introduction to the Conjugate Gradient Method Without the Agonizing Pain. In Technical Report of School of Computer Science, Carnegie Mellon University, Nov. 2006.
9. http://www.kbs.tu-berlin.de/menue/forschung/projekte/tusci-tu-berlin-sci- cluster/parameter/en
10. http://blog.udanax.org/2009/12/bsp-package-of-hama-on-hadoop-is-now.html
11. HAMA: http://incubator.apache.org/hama/
12. Hadoop: http://hadoop.apache.org/
13. HBase: http://hadoop.apache.org/hbase/
14. Zookeeper: http://hadoop.apache.org/zookeeper/
15. Matei Zaharia et al., Improving MapReduce Performance in Heterogeneous Environments. In the Proceedings of the 8th Symposium on Operating Systems Design and Implementation, Dec. 2008.
16. Guy E. Blelloch, Programming parallel algorithms. In Communications of the ACM, Mar. 1996.
17. http://www.fhi-berlin.mpg.de/th/locserv/alphas/libs/cxml/dxml.3dxml.html
18. Luis F. Romero et al., Nesting OpenMP and MPI in the Conjugate Gradient Method for Band Systems. Lecture Notes in Computer Science (LNCS) 3241,181-190, 2004.
19. Gardner, et al., Artificial neural networks (the multilayer perceptron) - A review of applications in the atmospheric sciences, Atmos. Environ., 32, 2627.2636, 1998.