Data distribution for dense factorization on computers with memory heterogeneity

Parallel Computing

Volumn 33, Issue 12, 2007, Pages 757-779

  Lastovetsky, Alexey ^a   Reddy, Ravi ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

Data distribution; Heterogeneous systems; Load balancing and task assignment; LU factorization; Parallel algorithms; Scheduling and task partitioning

Indexed keywords

FACTORIZATION; MATHEMATICAL MODELS; PARALLEL ALGORITHMS; PROBLEM SOLVING; SHAPE MEMORY EFFECT;

DATA DISTRIBUTION; HETEROGENEOUS SYSTEMS; SCHEDULING AND TASK PARTITIONING;

PROGRAM PROCESSORS;

EID: 36248980362     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2007.06.001     Document Type: Article

References (21)

1. D. Arapov, A. Kalinov, A. Lastovetsky, I. Ledovskih, Experiments with mpC: efficient solving regular problems on heterogeneous networks of computers via irregularization, in: Proceedings of the 5th International Symposium on Solving Irregularly Structured Problems in Parallel (IRREGULAR'98), Lecture Notes in Computer Science, vol. 1457, 1998, pp. 332-343.
2. A. Kalinov, A. Lastovetsky, Heterogeneous distribution of computations while solving linear algebra problems on networks of heterogeneous computers, in: Proceedings of the 7th International Conference on High Performance Computing and Networking Europe (HPCN Europe'99), Lecture Notes in Computer Science, vol. 1593, 1999, pp. 191-200.
3. Beaumont O., Boudet V., Petitet A., Rastello F., and Robert Y. A proposal for a heterogeneous cluster ScaLAPACK (dense linear solvers). IEEE Transactions on Computers 50 10 (2001) 1052-1070 October
4. Boulet P., Dongarra J., Rastello F., Robert Y., and Vivien F. Algorithmic issues on heterogeneous computing platforms. Parallel Processing Letters 9 2 (1999) 197-213
5. Barbosa J., Tavares J., and Padilha A.J. Linear algebra algorithms in a heterogeneous cluster of personal computers. Proceedings of the 9th Heterogeneous Computing Workshop (HCW 2000), Cancun, Mexico (2000), IEEE Computer Society Press 147-159 May
6. Barbosa J., Morais C.N., and Padilha A.J. Simulation of data distribution strategies for LU factorization on heterogeneous machines. Proceedings of the 17th International Parallel and Distributed Processing Symposium (IPDPS 2004), 26-30 April 2004, Santa Fe, New Mexico, USA, CD-ROM/Abstracts Proceedings (2004), IEEE Computer Society
7. Du X., Zhang X., and Zhu Z. Memory hierarchy considerations for cost-effective cluster computing. IEEE Transactions on Computers 49 9 (2000) 915-933
8. S. Manegold, P. Boncz, M. Kersten, Generic database cost models for hierarchical memory systems, in: Proceedings of International Conference on Very Large Data Bases (VLDB), August 20-23, 2002, pp. 191-202.
9. Wang Y.-M. Memory latency consideration for load sharing on heterogeneous network of workstations. Journal of Systems Architecture 52 1 (2006) 13-24
10. Rauber T., and Runger G. A hierarchical computation model for distributed shared-memory machines. Proceedings of the 9th Euromicro Workshop on Parallel and Distributed Processing (PDP'01) (2001), IEEE Computer Society 57-64
11. Drozdowski M., and Wolniewicz P. Out-of-core divisible load processing. IEEE Transactions on Parallel and Distributed Systems 14 10 (2003) 1048-1056 October
12. Lastovetsky A., and Reddy R. Data partitioning with a realistic performance model of networks of heterogeneous computers. Proceedings of the 17th International Parallel and Distributed Processing Symposium (IPDPS 2004), 26-30 April 2004, Santa Fe, New Mexico, USA, CD-ROM/Abstracts Proceedings (2004), IEEE Computer Society
13. Lastovetsky A., and Reddy R. Data partitioning with a functional performance model of heterogeneous processors. International Journal of High Performance Computing Applications 21 1 (2007) 76-90
14. Kumar V., Grama A., Gupta A., and Karypis G. Introduction to Parallel Computing: Design and Analysis of Algorithms (1994), Benjamin-Cummings, Addison-Wesley 597 p
15. C.A. Kitchen, M.F. Guest, M.J. Deegan, I. Kozin, R. Wain, The euroben benchmarks 2. Probing Parallel Performance on Xeon, Opteron, Itanium2 and Power5-based Clusters, March 2006. Available from: .
16. van der Steen A.J. The benchmark of the EuroBen group. Parallel Computing 17 10-11 (1991) 1211-1221
17. Lastovetsky A., and Reddy R. Data partitioning for multiprocessors with memory heterogeneity and memory constraints. Scientific Programming 13 2 (2005) 93-112
18. Choi J., Dongarra J., Ostrouchov L.S., Petitet A.P., Walker D.W., and Whaley R.C. The design and implementation of the ScaLAPACK LU, QR, and Cholesky factorization routines. Scientific Programming, 1058-9244 5 3 (1996) 173-184
19. Blackford L.S., Choi J., Cleary A., D'Azevedo E., Demmel J., Dhillon I., Dongarra J., Hammarling S., Henry G., Petitet A., Stanley K., Walker D., and Whaley R.C. ScaLAPACK Users' Guide (1997), SIAM
20. A. Lastovetsky, R. Reddy, R. Higgins, Building the functional performance model of a processor, in: Proceedings of the 21st Annual ACM Symposium on Applied Computing (ACM SAC 2006), April 23-24, Dijon, France, 2006.
21. Dongarra J., Croz J.D., Duff I.S., and Hammarling S. A set of level-3 basic linear algebra subprograms. ACM Transactions on Mathematical Software 16 1 (1990) 1-17 March