Reducing query latencies in web search using fine-grained parallelism

World Wide Web

Volumn 12, Issue 4, 2009, Pages 441-460

  Frachtenberg, Eitan ^a  

^a MICROSOFT   (United States)

Author keywords

Multi core processors; Parallel algorithms; Performance evaluation; Search engines; Semantic web

Indexed keywords

DATA PARALLELISM; DEGREE OF PARALLELISM; ENGINEERING CHALLENGES; FINE-GRAINED PARALLELISM; HYPERNYMS; INFRASTRUCTURE DESIGN; INTERACTIVITY; KEYWORD QUERIES; KEYWORD SEARCH; LOAD-BALANCING; MICROSOFT; MULTI-CORE PROCESSOR; MULTI-CORE PROCESSORS; MULTI-CORE SYSTEMS; NATURAL LANGUAGE PROCESSING; NEW APPLICATIONS; PARALLEL PERFORMANCE; PARALLELIZATIONS; PERFORMANCE EVALUATION; QUERY LATENCY; RESOURCE CONTENTION; SEARCH QUERIES; SEMANTIC INFORMATION; SEMANTIC QUERY; SEMANTIC SEARCH; SEMANTIC SEARCH ENGINES; SEMANTIC WEB SEARCH; TASK PARALLELISM; WEB DOCUMENT; WEB SEARCH ENGINES; WEB SEARCHES;

ARTIFICIAL INTELLIGENCE; CELLULAR ARRAYS; COMPUTATIONAL LINGUISTICS; ENGINES; HEURISTIC METHODS; INFORMATION RETRIEVAL; INFORMATION SERVICES; MICROPROCESSOR CHIPS; NATURAL LANGUAGE PROCESSING SYSTEMS; PARALLEL ALGORITHMS; SEARCH ENGINES; SEMANTIC WEB; SEMANTICS;

WORLD WIDE WEB;

EID: 76449119387     PISSN: 1386145X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11280-009-0066-4     Document Type: Article

References (30)

1. Agarwal, V., Hrishikesh, M. S., Keckler, S. W., Burger, D.: Clock rate versus IPC: the end of the road for conventional microarchitectures. In: 27th International Symposium on Computer Architecture (ISCA), pp. 248-259 (2000). citeseer. ist. psu. edu/agarwal00clock. html.
2. Amdahl, G. M.: Validity of the single processor approach to achieving large scale computing capabilities. In: Proceedings of the AFIPS Spring Joint Computer Conference, vol. 30, pp. 483-485 (1967).
3. Baeza-Yates, R., Gionis, A., Junqueira, F., Murdock, V., Plachouras, V., Silvestri, F.: The impact of caching on search engines. In: Proceedings of the Annual International Conference on Research and Development in Information Retrieval (SIGIR), pp. 183-190. ACM, New York (2007). doi: 10. 1145/1277741. 1277775. portal. acm. org/citation. cfm?id=1277775.
4. Bobrow, D. G., Cheslow, B., Condoravdi, C., Karttunen, L., King, T. H., Nairn, R., de;Paiva, V., Price, C., Zaenen, A.: PARC's bridge and question answering system. In: Proceedings of the Workshop on Grammar Engineering Across Frameworks (GEAF'07), pp. 46-66. CSLI, Stanford, CA (2007). citeseerx. ist. psu. edu/viewdoc/download?doi=10. 1. 1. 90. 4011& rep=rep1& type%=pdf.
5. Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Comput. Networks 30(1-7), 107-117 (1998). citeseer. ist. psu. edu/brin98anatomy. html.
6. Burkowski, F. J.: Retrieval performance of a distributed text database utilizing a parallel processor document server. In: Proceedings of the Second International Symposium on Databases in Parallel and Distributed Systems (DPDS), pp. 71-79. ACM, New York (1990). doi: 10. 1145/319057. 319065. portal. acm. org/citation. cfm?id=319057. 319065.
7. Cherkasova, L., Ciardo, G.: Role of aging, frequency, and size in web cache replacement policies. In: Lecture Notes in Computer Science, vol. 2110, pp. 114-123. Springer, New York (2001). citeseer. ist. psu. edu/cherkasova01role. html.
8. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. In: Symposium on Operating Systems Design and Implementation (OSDI), pp. 137-150. USENIX, Berkeley (2004). labs. google. com/papers/mapreduce. html.
9. Dias, D. M., Kish, W., Mukherjee, R., Tewari, R.: A scalable and highly available web server. In: Compcon'96 'Technologies for the Information Superhighway', Digest of Papers, pp. 85-92 (1996). citeseer. ist. psu. edu/dias96scalable. html.
10. Ding, L., Finin, T., Joshi, A., Pan, R., Cost, R. S., Peng, Y., Reddivari, P., Doshi, V., Sachs, J.: Swoogle: a search and metadata engine for the semantic web. In: Proceedings of the 13th ACM International Conference on Information and Knowledge Management (CIKM'04), pp. 652-659. ACM, New York (2004). http://portal. acm. org/citation. cfm?doid=1031171. 1031289#.
11. Gustafson, J. L.: Reevaluating Amdahl's law. Commun. ACM 31(5), 532-533 (1988). doi: 10. 1145/42411. 42415. http://portal. acm. org/citation. cfm?id=42411. 42415.
12. Harman, D., Candela, G.: Retrieving records from a gigabyte of text on a minicomputer using statistical ranking. J. Am. Soc. Inf. Sci. 41(8), 581-589 (1990). asis. org/Publications/JASIS/Best_Jasist/1991CandelaandHarman. pdf.
13. Intel: Developing Multithreaded Applications: A Platform Consistent Approach. Version 2.0, Chapter 3 (2005). intel. com/cd/ids/developer/asmo-na/eng/53797. htm.
14. Kaplan, R. M., Bresnan, J.: Lexical-functional grammar: a formal system for grammatical representation. In: Bresnan, J. (ed.) The Mental Representation of Grammatical Relations. MIT, Cambridge (1982).
15. Kaplan, R. M., Iii, J. T. M., King, T. H., Crouch, R.: Integrating finite-state technology with deep LFG grammars. In: Proceedings of the Workshop on Combining Shallow and Deep Processing for NLP (ESLLI'04) (2004). http://www2. parc. com/isl/groups/nltt/pargram/esslli04fst-xle. pdf.
16. Kumar, R., Farkas, K., Jouppi, N., Ranganathan, P., Tullsen, D.: A multi-core approach to addressing the energy-complexity problem in microprocessors. In: Workshop on Complexity-Effective Design (WCED) (2003). citeseer. ist. psu. edu/kumar03multicore. html.
17. Lee, B. T., Hendler, J., Lassila, O.: The Semantic Web. Scientific American, New York (2001).
18. Lin, Z., Zhou, S.: Parallelizing I/O intensive applications for a workstation cluster: a case study. In: Proceedings of the Workshop on Input/Output in Parallel Computer Systems, pp. 17-36. Newport Beach, CA (1993). citeseer. ist. psu. edu/37062. html.
19. MacFarlane, A., McCann, J. A., Robertson, S. E.: Parallel search using partitioned inverted files. In: Proceedings of the Seventh International Symposium on String Processing Information Retrieval (SPIRE), pp. 209-220. IEEE Computer Society, Piscataway (2000). http://portal. acm. org/citation. cfm?id=829519. 830829.
20. MacFarlane, A., McCann, J. A., Robertson, S. E.: Parallel methods for the update of partitioned inverted files. ASLIB Proc. New Inf. Perspect. 59(4/5), 367-396 (2007).
21. Maguitman, A. G., Menczer, F., Erdinc, F., Roinestad, H., Vespignani, A.: Algorithmic computation and approximation of semantic similarity. World Wide Web 9(4), 431-456 (2006). http://citeseerx. ist. psu. edu/viewdoc/download?doi=10. 1. 1. 72. 1007.
22. Orlando, S., Perego, R., Silvestri, F.: Design of a parallel and distributed web search engine. In: Proceedings of the Conference on Parallel Computing (ParCo), pp. 197-204. Imperial College Press, London (2001). citeseer. ist. psu. edu/orlando01design. html.
23. Richardson, M., Prakash, A., Brill, E.: Beyond PageRank: machine learning for static ranking. In: Proceedings of the 15th International Conference on World Wide Web, pp. 707-715. ACM, Edinburgh (2006). doi: 10. 1145/1135777. 1135881. research. microsoft. com/~mattri/papers/www2006/staticrank. pdf.
24. Schroeder, T., Goddard, S., Ramamurthy, B.: Scalable Web server clustering technologies. IEEE Netw. 14(3), 38-45 (2000). www. cse. unl. edu/~goddard/papers. html.
25. Seiler, L., Carmean, D., Sprangle, E., Forsyth, T., Abrash, M., Dubey, P., Junkins, S., Lake, A., Sugerman, J., Cavin, R., Espasa, R., Grochowski, E., Juan, T., Hanrahan, P.: Larrabee: a many-core x86 architecture for visual computing. ACM Trans. Graph. 27(3), 1-15 (2008). doi: 10. 1145/1360612. 1360617. portal. acm. org/citation. cfm?doid=1360612. 1360617.
26. Silvestri, F., Orlando, S., Perego, R.: WINGS: a parallel indexer for web contents. In: Proceedings of the International Conference on Computational Science, pp. 263-270. Krakow (2004).
27. Stephens, L. M., Gangam, A. K., Huhns, M. N.: Constructing consensus ontologies for the semantic web: a conceptual approach. World Wide Web 7(4), 421-442 (2004). http://portal. acm. org/citation. cfm?id=1017683. 1017685#.
28. Tsafrir, D., Etsion, Y., Feitelson, D. G., Kirkpatrick, S.: System noise, OS clock ticks, and fine-grained parallel applications. In: 19th ACM International Conference on Supercomputing, pp. 302-312. ACM, Boston (2005). www. cs. huji. ac. il/~feit/papers/Noise05ICS. pdf.
29. Zakos, J., Verma, B.: A novel context-based technique for web information retrieval. World Wide Web 9(4), 485-503 (2006). www. springerlink. com/content/dm7r46l5g557h285/.
30. Zobel, J., Moffat, A.: Inverted files for text search engines. ACM Comput. Surv. 38(2) (2006). doi: 10. 1145/1132956. 1132959. Article 6. http://portal. acm. org/citation. cfm?id=1132959.