Fastflow: High-Level and Efficient Streaming on Multicore

Programming Multicore and Many-Core Computing Systems

Volumn , Issue , 2017, Pages 261-280

  Aldinucci, Marco ^a   Danelutto, Marco ^b   Kilpatrick, Peter ^c   Torquati, Massimo ^b  

^a UNIVERSITY OF TURIN   (Italy)

^b UNIVERSITY OF PISA   (Italy)

^c QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

FastFlow framework; Lock free arbitrary dataflow graph; Multicore architectures; Stream parallel computations; Stream parallelism; Wait free arbitrary dataflow graph

Indexed keywords

COMPUTER ARCHITECTURE; DATA FLOW GRAPHS; FLOW GRAPHS; LOCKS (FASTENERS); MULTICORE PROGRAMMING; QUEUEING THEORY; SOFTWARE ARCHITECTURE;

EFFICIENT IMPLEMENTATION; FASTFLOW; FIRST-IN FIRST-OUT QUEUES; MULTICORE ARCHITECTURES; PARALLEL APPLICATION; PARALLEL COMPUTATION; PROGRAMMING ENVIRONMENT; STREAM PARALLELISM;

DATA FLOW ANALYSIS;

EID: 85015341209     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781119332015.ch13     Document Type: Chapter

References (32)

1. M. Aldinucci, A. Bracciali, P. Liò, A. Sorathiya, and M. Torquati. StochKit-FF: efficient systems biology on multicore architectures. In Euro-Par '10 Workshops, Proc. of the 1st Workshop on High Performance Bioinformatics and Biomedicine (HiBB), volume 6586 of LNCS, pages 167-175. Springer, Ischia, Italy, September 2010.
2. M. Aldinucci and M. Danelutto. Skeleton based parallel programming: functional and parallel semantic in a single shot. Computer Languages, Systems and Structures, 33(3-4):179-192, October 2007.
3. M. Aldinucci, M. Danelutto, and P. Kilpatrick. Skeletons for multi/many-core systems. In Parallel Computing: From Multicores and GPU's to Petascale (Proc. of PARCO 2009, Lyon, France), volume 19 of Advances in Parallel Computing, pages 265-272. IOP Press, September 2009.
4. M. Aldinucci, M. Danelutto, M. Meneghin, P. Kilpatrick, and M. Torquati. Efficient streaming applications on multi-core with FastFlow: the biosequence alignment test-bed. In Parallel Computing: From Multicores and GPU's to Petascale (Proc. of PARCO 09, Lyon, France), volume 19 of Advances in Parallel Computing, pages 273-280. IOP press, September 2009.
5. M. Aldinucci, M. Danelutto, M. Meneghin, P. Kilpatrick, and M. Torquati. Accelerating code on multi-cores with FastFlow. In Proc. of 17th Intl. Euro-Par '11 Parallel Processing, LNCS. Springer, Bordeaux, France, August 2011. To appear.
6. M. Aldinucci, S. Ruggieri, and M. Torquati. Porting decision tree algorithms to multicore using FastFlow. In Proc. of European Conference in Machine Learning and Knowledge Discovery in Databases (ECML PKDD), volume 6321 of LNCS, pages 7-23. Springer, Barcelona, Spain, September 2010.
7. S. Amarasinghe, M. I. Gordon, M. Karczmarek, J. Lin, D. Maze, R. M. Rabbah, and W. Thies. Language and compiler design for streaming applications. International Journal of Parallel Programming, 33(2)261-278, 2005.
8. K. Asanovic, R. Bodik, J. Demmel, T. Keaveny, K. Keutzer, J. Kubiatowicz, N. Morgan, D. Patterson, K. Sen, J. Wawrzynek, D. Wessel, and K. Yelick. A view of the parallel computing landscape. CACM, 52(10)56-67, 2009.
9. P. Ciechanowicz and H. Kuchen. Enhancing Muesli's data parallel skeletons for multi-core computer architectures. In Proc. of the 10th Intl. Conference on High Performance Computing and Communications (HPCC), pages 108-113. IEEE, Los Alamitos, CA, USA, September 2010.
10. M. Cole. Algorithmic Skeletons: Structured Management of Parallel Computations. Research Monographs in Par. and Distrib. Computing. Pitman, 1989.
11. M. Cole. Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming. Parallel Computing, 3(30) 389-406, 2004.
12. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Usenix OSDI '04, pages 137-150, December 2004.
13. J. Giacomoni, T. Moseley, and M. Vachharajani. Fastforward for efficient pipeline parallelism:a cache-optimized concurrent lock-free queue. In Proc. of the 13th ACMSIG-PLAN Symposium on Principles and practice of parallel programming (PPoPP), pages 43-52, New York, NY, USA, 2008.
14. J. Gilchrist. Parallel data compression with bzip2. In Proc. of IASTED Intl. Conf. on Par. and Distrib. Computing and Sys., pages 559-564, 2004.
15. C. H. Gonzalez and B. B. Fraguela. A generic algorithm template for divide-and-conquer in multicore systems. In Proc. of the 10th Intl. Conference on High Performance Computing and Communications (HPCC), pages 79-88. IEEE, Los Alamitos, CA, USA, September 2010.
16. M. Herlihy. Wait-free synchronization. ACM Transactions on Programming Languages and Systems, 13(1)124-149, 1991.
17. Intel Threading Building Blocks, 2011. http://www.threadingbuildingblocks.org/.
18. G. Kahn. The semantics of a simple language for parallel programming. In J. L. Rosenfeld, editor, Information processing, pages 471-475, Stockholm, Sweden, Aug 1974. North Holland, Amsterdam.
19. E. Lee and T. Parks. Dataflow process networks. Proceedings of the IEEE, 83(5):773-801, May 1995.
20. M. Leyton and J. M. Piquer. Skandium: multi-core programming with algorithmic skeletons. In Proc. of Intl. Euromicro PDP 2010: Parallel Distributed and network-based Processing, pages 289-296. IEEE, Pisa, Italy, February 2010.
21. T. Mattson, B. Sanders, and B. Massingill. Patterns for Parallel Programming. Addison-Wesley Professional, first edition, 2004.
22. C. Miranda, P. Dumont, A. Cohen, M. Duranton, and A. Pop. Erbium: a deterministic, concurrent intermediate representation to map data-flow tasks to scalable, persistent streaming processes. In Proc. of the 2010 Intl. Conference on Compilers, Architecture, and Synthesis for Embedded Systems (CASES), pages 11-20. ACM, Scottsdale, AZ, USA, October 2010.
23. L. Petzold. StochKit: stochastic simulation kit web page, 2009. http://www .engineering.ucsb.edu/~cse/StochKit/index.html.
24. J. Quinlan. C4.5: Programs for Machine Learning. Morgan Kauffman, 1993.
25. S. Ruggieri. YaDT: yet another decision tree builder. In 16th IEEE Int. Conf. on Tools with Artificial Intelligence (ICTAI 2004), pages 260-265. IEEE, 2004.
26. A. Shafarenko, C. Grelck, and S.-B. Scholz. Semantics and type theory of S-Net. In Proc. of the 18th Intl. Symposium on Implementation and Application of Functional Languages (IFL'06), TR 2006-S01, pages 146-166. Eötvös Loránd Univ., Faculty of Informatics, Budapest, Hungary, 2006.
27. T. F. Smith and M. S.Waterman. Identification of common molecular subsequences. Journal of Molecular Biology, 147(1):195-197, March 1981.
28. R. Stephens. A survey of stream processing. Acta Informatica, 34(7):491-541, July 1997.
29. A. Szalkowski, C. Ledergerber, P. Krähenbühl, and C. Dessimoz. SWPS3 - fast multi-threaded vectorized Smith-Waterman for IBM Cell/B.E. and x86/SSE2, 2008. http://www.scientificcommons.org/39542148.
30. W. Thies, M. Karczmarek, and S. P. Amarasinghe. StreamIt: a language for streaming applications. In Proc. of the 11th Intl. Conference on Compiler Construction (CC), pages 179-196, London, UK, 2002.
31. M. Torquati. Single-Producer/Single-Consumer Queues on Shared Cache Multi-Core Systems. Technical Report TR-10-20, Dept. Comp. Science, Univ. of Pisa, Nov. 2010. http://compass2.di.unipi.it/TR/Files/TR-10-20.pdf.gz.
32. M. Vanneschi. The programming model of ASSIST, an environment for parallel and distributed portable applications. Parallel Computing, 28(12):1709-1732, December 2002.