Accurate and efficient estimation of parameters of heterogeneous communication performance models

International Journal of High Performance Computing Applications

Volumn 23, Issue 2, 2009, Pages 123-139

  Lastovetsky, Alexey ^a   Rychkov, Vladimir ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

Communication model estimation; Heterogeneous cluster; Heterogeneous communication performance model; MPI

Indexed keywords

ACCURATE ESTIMATION; COMMUNICATION MODEL ESTIMATION; COMMUNICATION MODELS; COMMUNICATION OPERATION; COMPUTATIONAL CLUSTER; EFFICIENT ESTIMATION; HETEROGENEOUS CLUSTER; HETEROGENEOUS CLUSTERS; HETEROGENEOUS COMMUNICATION; HETEROGENEOUS COMMUNICATION PERFORMANCE MODEL; MODEL BASED OPTIMIZATION; MPI; POINT-TO-POINT COMMUNICATION; SCIENTIFIC APPLICATIONS;

COMMUNICATION; EXPERIMENTS; INFORMATION THEORY;

PARAMETER ESTIMATION;

EID: 66449131514     PISSN: 10943420     EISSN: 17412846     Source Type: Journal    
DOI: 10.1177/1094342009103947     Document Type: Article

References (20)

1. Alexandrov, A., Ionescu, M., Schauser, K., and Scheiman, C. (1997). LogGP: Incorporating long messages into the LogP model for parallel computation, J. Parallel and Distributed Computing, 44(1): 71-79.
2. Arnold, D., Casanova, H., and Dongarra, J. (2002). Innovation of the NetSolve grid computing system, Concurrency and Computation: Practice and Experience, 14(13-15): 1457-1479.
3. Bai, J. and Perron, P. (2003). Computation and analysis of multiple structural change models, J. Appl. Econometrics, 18(1): 1-22.
4. Bhat, P., Prasanna, V., and Raghavendra, C. (2003). Efficient collective communication in distributed heterogeneous systems, J. Parallel and Distributed Computing, 63(3): 251-263.
5. Culler, D., Karp, R., Patterson, D., Sahay, A., Schauser, K., Santos, E., Subramonian, R., and Eicken, T. von. (1993). LogP: Towards a realistic model of parallel computation. In Proc. of PPoPP 1993, pp. 1-12. New York: ACM.
6. Culler, D., Liu, L., Martin, R., and Yoshikawa, C. (1996). LogP performance assessment of fast network interfaces, IEEE Micro, 16(1): 35-43.
7. Hatta, J. and Shibusawa, S. (2000). Scheduling algorithms for efficient gather operations in distributed heterogeneous systems. In Proc. of WPP 2000, pp. 173-180. Los Alamitos, CA: IEEE Computer Society.
8. Hockney, R. (1994). The communication challenge for MPP: Intel Paragon and Meiko CS-2, Parallel Comput., 20(3): 389-398.
9. Kielmann, T., Bal, H., and Verstoep, K. (2000). Fast measurement of LogP parameters for message passing platforms. In Proc. of IPDPS 2000, pp. 1176-1183. Berlin: Springer.
10. Kielmann, T., Hofman, R., Bal, H., Plaat, A., and Bhoedjang, R. (1999). MagPIe: MPI's collective communication operations for clustered wide area systems. In Proc. of PPoPP 1999, pp. 131-140. New York: ACM.
11. Lastovetsky, A. (2002). Adaptive parallel computing on heterogeneous networks with mpC, Parallel Comput., 28(10): 1369-1407.
12. Lastovetsky, A. and O' Flynn, M. (2007). A performance model of many-to-one collective communications for parallel computing. In Proc. of IPDPS 2007, pp. 1-8. Los Alamitos, CA: IEEE Computer Society.
13. Lastovetsky, A. and Reddy, R. (2006). HeteroMPI: Towards a message-passing library for heterogeneous networks of computers, J. Parallel and Distributed Computing, 66(2): 197-220.
14. Lastovetsky, A. and Reddy, R. (2007). Data partitioning with a functional performance model of heterogeneous processors, Int. J. High Performance Computing Applications, 21(1): 76-90.
15. Lastovetsky, A., Mkwawa, I., and O' Flynn, M. (2006). An accurate communication model of a heterogeneous cluster based on a switch-enabled Ethernet network. In Proc. of ICPADS 2006, pp. 15-20. Los Alamitos, CA: IEEE Computer Society.
16. Lastovetsky, A., O'Flynn, M., and Rychkov, V. (2008). MPIBlib: Benchmarking MPI communications for parallel computing on homogeneous and heterogeneous clusters. In Proc. of EuroPVM/MPI 2008, pp. 227-238. Berlin: Springer.
17. Pjesivac-Grbovic, J., Angskun, T., Bosilca, G., Fagg, G., Gabriel, E., and Dongarra, J. (2007). Performance analysis of MPI collective operations, Cluster Computing, 10(2): 127-143.
18. Plaza, A., Valencia, D., Plaza J., and Martinez, P. (2006). Commodity cluster-based parallel processing of hyperspectral imagery, J. Parallel and Distributed Computing, 66(3): 345-358.
19. Thakur, R., Rabenseifner, R., and Gropp, W. (2005). Optimization of collective communication operations in MPICH, Int. J. High Performance Computing Applications, 19(1): 49-66.
20. Zeileis, A., Leisch, F., Hornik, K., and Kleiber, C. (2002). Strucchange: An R package for testing for structural change in linear regression models, J. Statistical Software, 7(2): 1-38.