An MPI-stream hybrid programming model for computational clusters

CCGrid 2010 - 10th IEEE/ACM International Conference on Cluster, Cloud, and Grid Computing

Volumn , Issue , 2010, Pages 323-330

  Mancini, Emilio P ^a   Marsh, Gregory ^a   Panda, Dhabaleswar K ^a  

^a The Ohio State University   (United States)

Author keywords

Clusters and financial application; Hybrid programming; MPI; Streams

Indexed keywords

COMPUTATIONAL CLUSTER; ELECTRONIC MARKET; HYBRID PROGRAMMING; HYBRID PROGRAMMING MODEL; LINEAR CHAIN; NETWORK LOCALITY; NETWORK TOPOLOGY; PERFORMANCE IMPROVEMENTS; PROGRAMMING MODELS; STREAM PROGRAMMING; STREAMING MODEL; TRANSMISSION RATES;

CLUSTER COMPUTING; ELECTRIC NETWORK TOPOLOGY; FINANCE; FUZZY CONTROL; GRID COMPUTING; HETEROGENEOUS NETWORKS; NETWORK PROTOCOLS;

HYDRAULICS;

EID: 77954917614     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2010.33     Document Type: Conference Paper

References (21)

1. MPI Forum, "Mpi: A message-passing interface standard, " September 2009, http://www.mpi-forum.org/docs/mpi-2.2/mpi22-report.pdf.
2. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom, "Models and issues in data stream systems, " in PODS '02: Proceedings of the twenty-first ACM SIGMOD-SIGACTSIGART symposium on Principles of database systems. New York, NY, USA: ACM, 2002, pp. 1-16.
3. K. Kandalla, H. Subramoni, G. Santhanaraman, M. Koop, and D. K. Panda, "Designing multi-leader-based allgather algorithms for multi-core clusters, " in Parallel and Distributed Processing Symposium, International, vol. 0. Los Alamitos, CA, USA: IEEE Computer Society, 2009, pp. 1-8.
4. M. Stonebraker, U. Çetintemel, and S. Zdonik, "The 8 requirements of real-time stream processing, " SIGMOD Rec., vol. 34, no. 4, pp. 42-47, 2005.
5. E. P. Mancini, S. Marcarelli, I. Vasilev, and U. Villano, "A grid-aware mip solver: implementation and case studies, " Future Generation Computer Systems, vol. 24, no. 2, pp. 133- 141, February 2007.
6. P. Carpenter, D. Rodenas, X. Martorell, A. Ramirez, and E. Ayguade, "A streaming machine description and programming model." in Proc. of SAMOS'07 Conf., ser. Lecture Notes in Computer Science, S. Vassiliadis and et al., Eds., vol. 4599. Springer, 2007, pp. 107-116.
7. ZeroMQ Stock Exchange Example, http://www.zeromq.org/code:examples- exchange.
8. MPICH2 Message Passing Interface Standard, http://www.mcs.anl.gov/ research/projects/mpich2/.
9. N. T. Karonis, B. Toonen, and I. Foster, "MPICH-G2: A grid-enabled implementation of the message passing interface, " Journal of Parallel and Distributed Computing Special Issue on Computational Grids, vol. 63, pp. 551-563, May 2003.
10. M. M. Gaber, A. Zaslavsky, and S. Krishnaswamy, "Mining data streams: a review, " SIGMOD Rec., vol. 34, no. 2, pp. 18-26, 2005.
11. J. H. Ahn, W. Dally, B. Khailany, U. Kapasi, and A. Das, "Evaluating the imagine stream architecture, " in Computer Architecture, 2004. Proceedings. 31st Annual International Symposium on, June 2004, pp. 14-25.
12. I. Buck, T. Foley, D. Horn, J. Sugerman, K. Fatahalian, M. Houston, and P. Hanrahan, "Brook for gpus: stream computing on graphics hardware, " in SIGGRAPH '04: ACM SIGGRAPH 2004 Papers. New York, NY, USA: ACM, 2004, pp. 777-786.
13. S. Yamagiwa and L. Sousa, "Design and implementation of a stream-based distributed computing platform using graphics processing units, " in CF '07: Proceedings of the 4th international conference on Computing frontiers. New York, NY, USA: ACM, 2007, pp. 197-204.
14. U. J. Kapasi, S. Rixner, W. J. Dally, B. Khailany, J. H. Ahn, P. Mattson, and J. D. Owens, "Programmable stream processors, " Computer, vol. 36, no. 8, pp. 54-62, 2003.
15. A. Wagner and C. Rostoker, "A lightweight stream-processing library using MPI, " Parallel and Distributed Processing Symposium, International, vol. 0, pp. 1-8, 2009.
16. V. Agarwal, D. A. Bader, L. Dan, L.-K. Liu, D. Pasetto, M. Perrone, and F. Petrini, "Faster fast: multicore acceleration of streaming financial data." Computer Science - R&D, vol. 23, no. 3-4, pp. 249-257, 2009.
17. J. Gummaraju and M. Rosenblum, "Stream programming on general-purpose processors, " in MICRO 38: Proceedings of the 38th annual IEEE/ACM International Symposium on Microarchitecture. Washington, DC, USA: IEEE Computer Society, 2005, pp. 343-354.
18. N. Halbwachs, P. Caspi, P. Raymond, and D. Pilaud, "The synchronous data flow programming language LUSTRE, " in Proc. IEEE, vol. 79, no. 9, 1991, pp. 1305-1320.
19. W. R. Mark, R. S. Glanville, K. Akeley, and M. J. Kilgard, "Cg: a system for programming graphics hardware in a clike language, " in SIGGRAPH '03: ACM SIGGRAPH 2003 Papers. New York, NY, USA: ACM, 2003, pp. 896-907.
20. J. H. Spring, J. Privat, R. Guerraoui, and J. Vitek, "Streamflex: high-throughput stream programming in java, " SIGPLAN Not., vol. 42, no. 10, pp. 211-228, 2007.
21. W. Thies, M. Karczmarek, and S. P. Amarasinghe, "Streamit: A language for streaming applications, " in CC '02: Proceedings of the 11th International Conference on Compiler Construction. London, UK: Springer-Verlag, 2002, pp. 179- 196.