QCG-OMPI: MPI applications on grids

Future Generation Computer Systems

Volumn 27, Issue 4, 2011, Pages 357-369

  Agullo, Emmanuel ^c   Coti, Camille ^b   Herault, Thomas ^b,d,e   Langou, Julien ^f   Peyronnet, Sylvain ^d   Rezmerita, Ala ^d   Cappello, Franck ^b,g   Dongarra, Jack ^a  

^a University of Tennessee   (United States)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

^c UNIVERSITÉ BORDEAUX 1   (France)

^d UNIVERSITÉ PARIS SACLAY   (France)

^e CNRS   (France)

^f UNIVERSITY OF COLORADO   (United States)

^g UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Applications; Collective communications; Dense linear algebra; Grid computing; Masterworker; MPI; Topology aware middleware

Indexed keywords

COLLECTIVE COMMUNICATIONS; DENSE LINEAR ALGEBRA; MASTERWORKER; MPI; TOPOLOGY-AWARE MIDDLEWARE;

ALGEBRA; COMMUNICATION; COMPUTER VIRUSES; MIDDLEWARE; SUPERCOMPUTERS; TOPOLOGY;

GRID COMPUTING;

EID: 78650839228     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2010.11.015     Document Type: Article

References (44)

1. S.M. Larson, C.D. Snow, M. Shirts, V.S. Pande, Folding@home and genome@home: using distributed computing to tackle previously intractable problems in computational biology, 2009. arxiv.org/abs/arxiv:0901.0866.
2. R. Bolze, Analyse et dploiement de solutions algorithmiques et logicielles pour des applications bioinformatiques grande chelle sur la grille, Ph.D. Thesis, cole Normale Suprieure de Lyon, October 2008.
3. B. Allen, C. Christensen, N. Massey, T. Aina, M.A. Marquina, Network computing with einstein@home and climateprediction.net, Technical Report, CERN, Geneva, July 2005, CERN, Geneva, 11 Jul 2005.
4. E. Walker Benchmarking amazon EC2 for high-performance scientific computing USENIX Login 33 5 2008 18 23
5. C. Coti, A. Rezmerita, T. Herault, F. Cappello, Grid services for MPI, in: ACM/IEEE (Ed.), Proceedings of the 14th European PVM/MPI Users' Group Meeting, EuroPVM/MPI, Paris, France, October 2007, pp. 393394.
6. C. Coti, T. Herault, S. Peyronnet, A. Rezmerita, F. Cappello, Grid services for MPI, in: ACM/IEEE (Ed.), Proceedings of the 8th IEEE International Symposium on Cluster Computing and the Grid, CCGrid'08, Lyon, France, May 2008, pp. 417424.
7. V. Kravtsov, D. Carmeli, W. Dubitzky, K. Kurowski, and A. Schuster Grid-enabling complex system applications with qoscosgrid: an architectural perspective H.R. Arabnia, Proceedings of the 2008 International Conference on Grid Computing & Applications, GCA 2008 Las Vegas, Nevada, USA, July 1417, 2008 2008 CSREA Press 168 174
8. P. Bar, C. Coti, D. Groen, T. Herault, V. Kravtsov, A. Schuster, M. Swain, Running parallel applications with topology-aware grid middleware, in: 5th IEEE International Conference on e-Science, eScience 2009, December 2009.
9. E. Agullo, C. Coti, J. Dongarra, T. Herault, J. Langou, QR factorization of tall and skinny matrices in a grid computing environment, in: 24th IEEE International Parallel & Distributed Processing Symposium, IPDPS'10, Atlanta, Ga, April 2010.
10. C. Coti, T. Herault, F. Cappello, MPI applications on grids: a topology-aware approach, in: LNCSm (Ed.), Proceedings of the 15th European Conference on Parallel and Distributed Computing, EuroPar'09, in: Delft, the Netherlands, August 2009.
11. M. Snir, S.W. Otto, S. Huss-Lederman, D.W. Walker, and J. Dongarra MPI: The Complete Reference 1996 MIT Press Cambridge, MA, USA
12. E. Gabriel, G.E. Fagg, G. Bosilca, T. Angskun, J.J. Dongarra, J.M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R.H. Castain, D.J. Daniel, R.L. Graham, T.S. Woodall, Open MPI: goals, concept, and design of a next generation MPI implementation, in: Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004, pp. 97104.
13. W. Gropp, E. Lusk, N. Doss, and A. Skjellum High-performance, portable implementation of the MPI message passing interface standard Parallel Comput. 22 6 1996 789 828
14. E. Gabriel, M.M. Resch, T. Beisel, and R. Keller Distributed computing in a heterogeneous computing environment Vassil N. Alexandrov, Jack Dongarra, Recent Advances in Parallel Virtual Machine and Message Passing Interface, 5th European PVM/MPI Users' Group Meeting Liverpool, UK, September 79, 1998, Proceedings LNCS vol. 1497 1998 Springer 180 187
15. Edgar Gabriel, Michael Resch, Thomas Beisel, and Rainer Keller Distributed Computing in a Heterogenous Computing Environment 1998
16. I. Foster, and N. Karonis A grid-enabled MPI: message passing in heterogeneous distributed computing systems High Performance Networking and Computing, SC98 1998 IEEE/ACM
17. N.T. Karonis, B.R. Toonen, I.T. Foster, MPICH-G2: a grid-enabled implementation of the message passing interface, CoRR, cs.DC/0206040, 2002.
18. I.T. Foster Globus toolkit version 4: software for service-oriented systems J. Comput. Sci. Technol 21 4 2006 513 520
19. F. Gregoretti, G. Laccetti, A. Murli, G. Oliva, and U. Scafuri MGF: a grid-enabled MPI library Future Gener. Comput. Syst. 24 2 2008 158 165
20. W.L. George, J.G. Hagedorn, J.E. Devaney, IMPI: making MPI interoperable, April 25, 2000.
21. R. Rabenseifner, Automatic MPI counter profiling of all users: first results on a CRAY T3E 900-512, January 25, 1999.
22. R. Thakur, and W. Gropp Improving the performance of collective operations in MPICH J. Dongarra, D. Laforenza, S. Orlando, Recent Advances in Parallel Virtual Machine and Message Passing Interface, 10th European PVM/MPI Users' Group Meeting Venice, Italy, September 29October 2, 2003, Proceedings LNCS vol. 2840 2003 Springer 257 267
23. R. Rabenseifner Optimization of collective reduction operations Marian Bubak, G. Dick van Albada, Peter M.A. Sloot, Jack Dongarra, Computational Science ICCS 2004, 4th International Conference Krakw, Poland, June 69, 2004, Proceedings, Part I LNCS vol. 3036 2004 Springer 1 9
24. F. Cappello, P. Fraigniaud, B. Mans, and A.L. Rosenberg HiHCoHP: toward a realistic communication model for hierarchical hyperclusters of heterogeneous processors Proceedings of the 15th International Parallel & Distributed Processing Symposium, 2nd IPDPS'01, San Francisco, CA, USA, April 2001 2001 IEEE Computer Society Los Alamitos, CA 42
25. A. Petitet, S. Blackford, J. Dongarra, B. Ellis, G. Fagg, K. Roche, and S. Vadhiyar Numerical libraries and the grid: the GrADS experiments with ScaLAPACK International Journal of High Performance Computing Applications 15 4 2001 359 374
26. S.-S. Boutammine, D. Millot, and C. Parrot An adaptive scheduling method for grid computing W.E. Nagel, W.V. Walter, W. Lehner, 12th International Euro-Par Conference, Euro-Par'06 Dresden, Germany, AugustSeptember LNCS vol. 4128 2006 Springer-Verlag Berlin, New York 188 197 (Pubitemid 44568389)
27. S. Genaud, A. Giersch, and F. Vivien Load-balancing scatter operations for grid computing Parallel Comput. 30 8 2004 923 946
28. C. Crin, J.-C. Dubacq, and J.-L. Roch Methods for partitioning data to improve parallel execution time for sorting on heterogeneous clusters Y.-C. Chung, J.E. Moreira, Proceedings of the First International Conference on Grid and Pervasive Computing, GPC'06 May LNCS vol. 3947 2006 Springer 175 186
29. R.A. Van Engelen, and K.A. Gallivan The gSOAP toolkit for web services and peer-to-peer computing networks Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID'02, Washington, DC, USA, May 2002 2002 IEEE Computer Society 128 135
30. A. Rezmerita, T. Morlier, V. Nri, and F. Cappello Private virtual cluster: infrastructure and protocol for instant grids W.E. Nagel, W.V. Walter, W. Lehner, Proceedings of the 12th European Conference on Parallel and Distributed Computing, EuroPar'06 LNCS vol. 4128 2006 Springer 393 404
31. C. Coti, T. Herault, F. Cappello, MPI applications on grid: a topology-aware approach, Technical Report 6633, INRIA, September 2008.
32. S. Lacour, C. Prez, T. Priol, A network topology description model for grid application deployment, in: GRID, 2004, pp. 6168.
33. Valentin Kravtsov, Pavel Bar, David Carmeli, Assaf Schuster, and Martin Swain A scheduling framework for large-scale, parallel, and topology-aware applications Journal of Parallel and Distributed Computing 2010 983 992
34. V. Kravtsov, D. Carmeli, A. Schuster, B. Yoshpa, M. Silberstein, W. Dubitzky, Quasi-opportunistic supercomputing in grids, hot topic paper, in: IEEE International Symposium on High Performance Distributed Computing, Monterey Bay California, USA, 2007.
35. V. Kravtsov, D. Carmeli, W. Dubitzky, A. Orda, A. Schuster, M. Silberstein, and B. Yoshpa Quasi-opportunistic supercomputing in grid environments A.G. Bourgeois, S.-Q. Zheng, Proceedings of the 8th International Conference in Algorithms and Architectures for Parallel Processing, ICA3PP 2008 LNCS vol. 5022 2008 Springer 233 244
36. V. Kravtsov, M. Swain, U. Dubin, W. Dubitzky, and A. Schuster A fast and efficient algorithm for topology-aware coallocation M. Bubak, G.D. van Albada, J. Dongarra, P.M.A. Sloot, Proceedings of the 8th International Conference on Computational Science, ICCS 2008, Part I LNCS vol. 5101 2008 Springer 274 283
37. F. Cappello, E. Caron, M. Dayde, F. Desprez, Y. Jegou, P. Vicat-Blanc Primet, E. Jeannot, S. Lanteri, J. Leduc, N. Melab, G. Mornet, B. Quetier, and O. Richard Grid'5000: a large scale and highly reconfigurable grid experimental testbed SC'05: Proc. The 6th IEEE/ACM International Workshop on Grid Computing CD, Seattle, Washington, USA, November 2005 2005 IEEE/ACM 99 106
38. P.K. McKinley, Y.-J. Tsai, and D.F. Robinson Collective communication in wormhole-routed massively parallel computers IEEE Computer 28 12 1995 39 50
39. M. Grunberg, S. Genaud, and C. Mongenet Parallel seismic ray tracing in a global earth model Hamid R. Arabnia, Las Vegas, Nevada, USA, June Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA'02 vol. 3 2002 CSREA Press 1151 1157
40. G.H. Golub, and C.F. Van Loan Matrix Computations 3 edition 1996 Johns Hopkins University Press Baltimore, USA
41. R. Schreiber, and C. Van Loan A storage efficient WY representation for products of Householder transformations SIAM J. Sci. Stat. Comput. 10 1 1989 53 57
42. L.S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, and R. Whaley ScaLAPACK Users' Guide 1997 SIAM
43. J. Demmel, L. Grigori, M. Hoemmen, J. Langou, Communication-avoiding parallel and sequential QR factorizations, CoRR, abs/0806.2159, 2008.
44. Roberto Podest, Victor Iniesta, Ala Rezmerita, and Franck Cappello An information brokering service provider (ibsp) for virtual clusters Proceedings of the On the Move to Meaningful Internet Systems (OTM) Conference Lecture Notes in Computer Science vol. 5870 2009 Springer 165 182