Workload characterization and optimization of high-performance text indexing on the cell broadband enginetm (Cell/B.E.)

Proceedings of the 2009 IEEE International Symposium on Workload Characterization, IISWC 2009

Volumn , Issue , 2009, Pages 13-23

  Scarpazza, Daniele Paolo ^a   Braudaway, Gordon W ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CELL BROADBAND ENGINE; CELL PROCESSOR; CELL-BASED; HIGH THROUGHPUT; LIVE NETWORK TRAFFIC; LOCAL MEMORIES; MOBILE APPLICATIONS; MULTI-CORE PROCESSOR; MULTICORE ARCHITECTURES; NETWORK APPLIANCES; PARALLEL SOFTWARE; PERFORMANCE ANALYSIS; REAL TIME; SONY COMPUTER ENTERTAINMENT; TEXT-INDEXING; TOSHIBA; WIKIPEDIA; WORKLOAD CHARACTERIZATION;

CELLULAR RADIO SYSTEMS; ECONOMIC ANALYSIS; INTERNET; MICROPROCESSOR CHIPS; SEARCH ENGINES; SOFTWARE ARCHITECTURE; SOFTWARE DESIGN; WIRELESS NETWORKS;

INDEXING (OF INFORMATION);

EID: 70649087262     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IISWC.2009.5306798     Document Type: Conference Paper

References (37)

1. IDC Corporation. The expanding digital universe. White Paper, March 2007.
2. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In 6th Symposium on Operating System Design and Implementation (OSDI'04), San Francisco, CA, Dec. 2004.
3. J. A. Kahle, M. N. Day, H. P. Hofstee, C. R. Johns, T. R. Maeurer, and D. Shippy. Introduction to the Cell Multiprocessor. IBM Journal of Research and Development, pages 589-604, July/September 2005.
4. N. Firasta, M. Buxton, P. Jinbo, K. Nasri, and S. Kuo. Intel AVX: New Frontiers in Performance Improvements and Energy Efficiency, Mar. 2008.
5. L. Seiler, D. Carmean, E. Sprangle, T. Forsyth, M. Abrash, P. Dubey, S. Junkins, A. Lake, J. Sugerman, R. Cavin, R. Espasa, E. Grochowski, T. Juan, and P. Hanrahan. Larrabee: A many-core x86 architecture for visual computing. In ACM SIGGRAPH 2008, pages 1-15, New York, NY, USA, 2008. ACM.
6. H. P. Hofstee. Efficient Processor Architecture and the Cell Processor. In Conference on High Performance Computing Architectures (HPCA'05), February 2005.
7. M. Kistler, M. Perrone, and F. Petrini. Cell Processor Interconnection Network: Built for Speed. IEEE Micro, 25(3), May/June 2006.
8. M. Gschwind, H. P. Hofstee, B. Flachs, M. Hopkins, Y. Watanabe, and T. Yamazaki. Synergistic Processing in Cell's Multicore Architecture. IEEE Micro, 26(2):10-24, 2006.
9. J. L. Hennessy, D. A. Patterson, K. Asanovic, R. H. Arpaci-Dusseau, and A. C. Arpaci-Dusseau. Computer architecture: a quantitative approach, fourth edition. Morgan Kauffmann, 2006.
10. The Green500 List, http://www.green500.org/lists/2008/11/list.php, Nov. 2008.
11. IBM. Roadrunner smashes the Petaflop barrier, press release, June 2008.
12. Top 500 supercomputers, http://www.top500.org/, Nov. 2008.
13. K. S. Jones. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation, 28:11-21, 1972.
14. S. Williams, A. Waterman, and D. Patterson. Roofline: an insightful visual performance model for multicore architectures. Communications of the ACM, 52(4):65-76, 2009.
15. D. P. Scarpazza, O. Villa, and F. Petrini. High-Speed String Searching against Large Dictionaries on the Cell/B.E. Processor. In 22nd IEEE Intl. Parallel & Distributed Processing Symposium (IPDPS'08), Miami, Florida, Apr. 2008.
16. Kiwix, version 0.5, www.kiwix.org Mar. 2007.
17. The Apache Software Foundation. CLucene - a C++ search engine, http://sourceforge.net/projects/clucene/.
18. V. Paxson. flex - a fast lexical analyzer generator, 1988.
19. D. P. Scarpazza and G. F. Russell. High-performance regular expression scanning on the Cell/B.E. processor. In 23rd Intl. Conference on Supercomputing (ICS'09), Yorktown Heights, New York, USA, June 2009.
20. C. D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge University Press, July 2008.
21. B. Stolt, Y. Mittlefehldt, S. Dubey, G. Mittal, M. Lee, J. Friedrich, and E. Fluhr. Design and implementation of the POWER6 microprocessor. IEEE Journal on Solid-State Circuits, 43:21-28, Jan. 2008.
22. S. Heinz and J. Zobel. Efficient single-pass index construction for text databases. Journal of the American Society for Information Science and Technology, 54:713-729, 2003.
23. S. Melnik, S. Raghavan, B. Yang, and H. Garcia-Molina. Building a distributed full-text index for the web. In ACM Tenth Intl. World Wide Web Conference (WWW10), Hong Kong, May 2001.
24. H. Inoue, T. Moriyama, H. Komatsu, and T. Nakatani. Aa-sort: A new parallel sorting algorithm for multi-core simd processors. In 16th Intl. Conference on Parallel Architecture and Compilers (PACT '07), pages 189-198, Washington, DC, USA, 2007. IEEE Computer Society.
25. H. S. Heaps. Information Retrieval: Computational and Theoretical Aspects. Academic Press, Inc., Orlando, FL, USA, 1978.
26. P. M. McIlroy, K. Bostic, and M. D. McIlroy. Engineering radix sort. Computing Systems, 6:5-27, 1993.
27. D. E. Knuth. The Art of Computer Programming, Volume III: Sorting and Searching, 2nd Ed. Addison-Wesley, 1998.
28. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis. Evaluating MapReduce for multi-core and multiprocessor systems. In 13th IEEE Intl. Symposium on High-Performance Computer Architecture (HPCA-13), pages 13-24, Phoenix, AZ, Feb. 2007. IEEE Computer Society.
29. M. de Kruijf and K. Sankaralingam. MapReduce for the Cell B.E. architecture. Technical Report CS-TR-2007-1625, University of Wisconsin Computer Sciences, Oct. 2007.
30. B. He, W. Fang, Q. Luo, N. K. Govindaraju, and T.Wang. Mars: A MapReduce framework on graphics processors. In 17th Intl. Conference on Parallel Architectures and Compilation Techniques (PACT'08), Toronto, Canada, Oct. 2008.
31. O. Villa, D. P. Scarpazza, and F. Petrini. Accelerating real-time string searching with multicore processors. IEEE Computer, 41:42-50, Apr. 2008.
32. R. D. Cameron. Method and apparatus for processing character streams, U.S. Patent 7400271, July 2008.
33. R. D. Cameron. A case study in SIMD text processing with parallel bit streams - UTF-8 to UTF-16 transcoding. In 2008 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'08), pages 91-98, Salt Lake City, Utah, Feb. 2008.
34. B. Gedik, R. Bordawekar, and P. S. Yu. Cellsort: High performance sorting on the cell processor. In C. Koch, J. Gehrke, M. N. Garofalakis, D. Srivastava, K. Aberer, A. Deshpande, D. Florescu, C. Y. Chan, V. Ganti, C.-C. Kanne, W. Klas, and E. J. Neuhold, editors, 33rd Intl. Conference on Very Large Data Bases (VLDB'07), pages 1286-1207. ACM, 2007.
35. S. Büttcher and C. L. A. Clarke. Indexing time vs. query time trade-offs in dynamic information retrieval systems. In 14th ACM Conference on Information and Knowledge Management (CIKM'05), pages 317-318, 2005.
36. S. Garcia, H. E. Williams, and A. Cannane. Access-ordered indexes. In New Topological Descriptors, Journal of Chemical Information and Computer Sciences, pages 7-14. Zealand, 2004.
37. G. Navarro. Indexing text using the Ziv-Lempel trie. Journal of Discrete Algorithms, 2:2004, 2002.