Transformer: A new paradigm for building data-parallel programming models

IEEE Micro

Volumn 30, Issue 4, 2010, Pages 55-64

  Wang, Peng ^a   Meng, Dan ^a   Han, Jizhong ^a   Zhan, Jianfeng ^a   Tu, Bibo ^a   Shi, Xiaofeng ^b   Wan, Le ^b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b TENCENT AI LAB   (China)

Author keywords

actor model; all Pairs; cloud computing; data flow; data intensive computing; mapReduce; programming model

Indexed keywords

ACTOR MODEL; ALL-PAIRS; CLOUD COMPUTING; DATA FLOW; DATA-INTENSIVE COMPUTING; MAP-REDUCE; PROGRAMMING MODELS;

DATA FLOW ANALYSIS; DATA PROCESSING; DISTRIBUTED COMPUTER SYSTEMS;

PARALLEL PROGRAMMING;

EID: 77956067483     PISSN: 02721732     EISSN: None     Source Type: Journal    
DOI: 10.1109/MM.2010.75     Document Type: Article

References (14)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," Proc. 6th Conf. Symp. Operating Systems Design & Implementation, Usenix Assoc. Press, vol.6, 2004, pp. 137-150.
2. M. Isard et al., "Dryad: Distributed Data- Parallel Programs from Sequential Building Blocks," ACM SIGOPS Operating Systems Rev., vol.41, no.3, 2007, pp. 59-72.
3. B. Hindman et al., "A Common Substrate for Cluster Computing," Proc. HotCloud Workshop Hot Topics in Cloud Computing, Usenix Assoc. Press, 2009, pp. 91-95.
4. C. Moretti et al., "All-Pairs: An Abstraction for Data-Intensive Cloud Computing," Proc. Int'l Parallel and Distributed Processing Symp., IEEE Press, 2008, pp. 1-11.
5. G. Malewicz et al., "Pregel: A System for Large-Scale Graph Processing," Proc. 28th ACM Symp. Principles of Distributed Computing, ACM Press, 2009, p. 6.
6. R. Pike et al., "Interpreting the Data: Parallel Analysis with Sawzall," Scientific Programming, vol.13, no.4, 2005, pp. 277-298.
7. C. Olston et al., "Pig Latin: A Not-So-Foreign Language for Data Processing," Proc. 2008 ACM SIGMOD Int'l Conf. Management of Data, ACM Press, 2008, pp. 1099-1110.
8. A. Thusoo et al., "Hive-Warehousing Solution over a Map-Reduce Framework," Proc. Int'l Conf. Very Large Data Bases (VLDB), vol.2, no.2, VLDB Endowment, 2009, pp. 1626-1629.
9. R. Chaiken et al., "Scope: Easy and Efficient Parallel Processing of Massive Datasets," Proc. Int'l Conf. Very Large Data Bases (VLDB), vol.1, no.2, VLDB Endowment, 2008, pp. 1265-1276.
10. Y. Yu et al., "DryadLINQ: A SystemforGeneral- Purpose Distributed Data-Parallel Computing Using a High-Level Language," Proc. 8th Symp. Operating Systems Design and Implementation, Usenix Assoc. Press, 2008, pp. 1-14.
11. D. A. Patterson, "Technical Perspective: The Data Center is the Computer," Comm. ACM, vol.51, no.1, 2008, p. 105.
12. L.A. Barroso and U. Hö lzle, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Morgan & Claypool Publishers, 2009.
13. W.M. Johnston, J.R.P. Hanna, and R.J. Millar, "Advances in Dataflow Programming Languages," ACM Computing Surveys, vol.36, no.1, 2004, pp. 1-34.
14. G. Agha, Actors: A Model of Concurrent Computation in Distributed Systems, MIT Press, 1986.