HPC in Big Data Age: An evaluation report for Java-based data-intensive applications implemented with hadoop and OpenMPI

ACM International Conference Proceeding Series

Volumn 09-12-September-2014, Issue , 2014, Pages 175-180

  Cheptsov, Alexey ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Cloud; Hadoop; HPC; MapReduce; MPI

Indexed keywords

CLOUDS; JAVA PROGRAMMING LANGUAGE; TEXT PROCESSING;

BIG DATA APPLICATIONS; CLOUD INFRASTRUCTURES; DATA-INTENSIVE APPLICATION; HADOOP; HIGH PERFORMANCE COMPUTING (HPC); INFRASTRUCTURE MODELING; LARGE-SCALE DATASETS; MAP-REDUCE;

BIG DATA;

EID: 84959036715     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2642769.2642802     Document Type: Conference Paper

References (10)

1. M. Baker, B. Carpenter, G. Fox, S. Ko, and S. Lim. mpiJava: An object-oriented java interface to mpi. In Proc. International Workshop on Java for Parallel and Distributed Computing IPPS/SPDP, San Juan, Puerto Rico, 1999.
2. R. H. Castain and W. Tan. Mr+. a technical overview. http://www.open-mpi.org/video/mrplus/GreenplumRa1phCastam-1up.pdf, 2012.Accessed : 2014-06-17.
3. A. Cheptsov. Enabling high performance computing for semantic web applications by means of open mpi java bindings. International Journal on Semantic Web and Information Systems, 5(3):1-22, 2009.
4. A. Cheptsov and B. Koller. JUNIPER takes aim at big data. inSiDE-Journal of Innovatives Supercomputing in Deutschland, 11(1):68-69, 2013.
5. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun., 51,1:107-113, 2008.
6. E. Gabriel. Open MPI: Goals, concept, and design of a next generation MPI implementation. In Proc., 11th European PVM/MPI Users' Group Meeting, pages 97-104, Budapest, Hungary, September 2004.
7. MPI Forum. Mpi: A message-passing interface standard. http://www.mcs.anl.gov/research/projects/mpi/mpi-standard/mpi-report-1.1/mpi-report.htm, 1995. Accessed: 2014-06-17.
8. S. J. Plimpton and K. D. Devine. Mapreduce in mpi for large-scale graph algorithms. Parallel Computing, 37:610-632, 2011.
9. Sun Microsystems Inc. Using lustre with apache hadoop. http://wiki.lustre.orgAccessed: 2014-06-17.
10. O. Vega-Gisbert, J. E. Roman, S. Gross, and J. M. Squyres. Towards the availability of java bindings in Open MPI. In Proc. the 20th European MPI Users' Group Meeting, pages 141-142, 2013.