How do search engines respond to some non-English queries?

Journal of Information Science

Volumn 31, Issue 1, 2005, Pages 13-28

  Bar Ilan, Judit ^a,c   Gutman, Tatyana ^b  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b Ex Libris Ltd   (Israel)

^c NONE   (Israel)

Author keywords

Diacritics; Inflections; Morphological analysis; Non English languages; Pre And postfixes; Search engines

Indexed keywords

DATA ACQUISITION; DATA REDUCTION; INFORMATION RETRIEVAL; LINGUISTICS; MORPHOLOGY; SURVEYS; TEXT PROCESSING; WORLD WIDE WEB;

DIACRITICS; INFLECTIONS; MORPHOLOGICAL ANALYSIS; NON-ENGLISH LANGUAGES; PRE-AND POSTFIXES;

SEARCH ENGINES;

EID: 12344295749     PISSN: 01655515     EISSN: None     Source Type: Journal    
DOI: 10.1177/0165551505049255     Document Type: Review

References (52)

1. H. Abu-Salem, M. Al-Omari and M.W. Evens, Stemming methodologies over individual query words for an Arabic IR system, Journal of the American Society for Information Science 50 (1999) 524-29.
2. E. Airio, H. Keskustalo, T. Hedlund and A. Pirkola, Multilingual Experiments of UTA at CLEF2003 - the Impact of Different Merging Strategies and Word Normalizing Tools. CLEF 2003, Trondheim, Norway, 21-22 August 2003. Available at: http://clef.iei.pi.cnr.it:2002/2003/WN_web/02.pdf (accessed 25 July 2004).
3. I.A. Al-Kharashi and M.W. Evens, Comparing words, stems, and roots as index terms in an Arabic information retrieval system, Journal of the American Society for Information Science 45(8) (1994) 548-60.
4. R. Alkula, From plain character strings to meaningful words: producing better full text databases for inflectional and compounding languages with morphological analysis software, Information Retrieval 4 (2001) 195-208.
5. O. Andrieu, AltaVista Syntaxe (no date). Available at: www.advantage-yachting.com/outils/av_syntaxe.html(accessed 3 August 2004).
6. O. Andrieu, Google Syntaxe (no date). Available at: www.advantage-yachting.com/outils/goo_syntaxe.html (accessed 3 August 2004).
7. O. Andrieu, All The Web Syntaxe (no date). Available at: http://www.advantage-yachting.com/outils/atw_syntaxe.html (accessed 3 August 2004).
8. O. Andrieu, Voila Syntaxe (no date). Available at: http://outils.abondance.com/vl_syntaxe.html (not accessible on 3 August 2004).
9. R. Attar, Y. Choueka, N. Dershowitz and A.S. Fraenkel, KEDMA - linguistic tools for retrieval systems, Journal of the Association for Computing Machinery 25(1) (1978) 52-66.
10. R. Beard, An On-line Russian Reference Grammar (1996). Available at: www.departments.bucknell.edu/russian/language (accessed 28 July 2004).
11. D. Carmel and Y. Maarek, Morphological disambiguation for Hebrew search systems. In: Proceedings of the 4th International Workshop, NGITS-99. LNCS 1649 (1999) 312-25. [Lecture Notes on Computer Science, 1649]. Available at: http://citeseer.ist.psu.edu/455563.html (accessed 27 September 2004).
12. CLEF, Welcome to Cross Language Evaluation Forum (2004). Available at: http://clef.iei.pi.cnr.it:2002/ (accessed 25 July 2004).
13. Cyber Atlas, Web Pages by Language (2000), Available at: www.clickz.com/stats/big_picture/demographics/article.php/5901_408521 (accessed 25 July 2004).
14. L. Glinert, Hebrew - an essential grammar (Routledge, London, 1994).
15. Global Reach, Global Internet Statistics (by Language) (2004), Available at: www.global-reach.biz/globstats (accessed 25 July 2004).
16. Google Help. (2002). Available at: http://web.archive.org/web/20021101230725/http://www.google.com/help/basics. html (accessed 28 July 2004).
17. Google Language Tools (2002). Available at: http://web.archive.org/web/20021017021900/http://www.google.com/language_tools (accessed 25 July 2004).
18. Google Press Center: Zeitgest. (2004). Available at: www.google.com/press/zeitgeist.html (accessed 3 August 2004).
19. G. Grefenstette, Problems and approaches to cross language information retrieval. In: Proceedings of the 61st Annual Meeting of the ASIS, Pittsburgh, (Information Today, Medford, 1998) 143-152.
20. G. Grefenstette and J. Nioche, Estimation of English and non-English language use on the WWW. In: Proceedings of RIAO 2000 237-246. (2000). Available at: http://arxiv.org/ftp/cs/papers/0006/0006032.pdf (accessed 25 July 2004).
21. D.Z. Hakkani-Tur, K. Oflazer and G. Tur, Statistical morphological disambiguation for agglutinative languages. In: Proceedings of the 18th International Conference on Computational Linguistics, Saarbrucken, Germany. (2000) 285-91. Available at: http://acl.ldc. upenn.edu/C/C00/C00-1042.pdf (accessed 26 July 2004).
22. D. Harman, How effective is suffixing? Journal of the American Society for Information Science 42 (1991) 7-15.
23. T. Hedlind, A. Pirkola and K. Jarvelin, Aspects of Swedish morphology and semantics from the perspective of mono and cross-language information retrieval, Information Processing and Management 37 (2001) 147-61.
24. T.Z. Kalamboukis, Suffix stripping with modern Greek, Program 29 (1995) 313-21.
25. L.S. Larkey, L. Balleteros and M.E. Connell, Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis. In: Proceedings of SIGIR 2002, Tampere, Finland (2002) 275-282. Available at: http://ciir.cs.umass.edu/pubfiles/ir-249.pdf (accessed 27 September 2004).
26. B. Megyesi. The Hungarian Language - a Short Descriptive Grammar (no date). Available at: www.speech.kth.se/~bea/hungarian.pdf (accessed 3 August 2004).
27. H. Moukdad and A. Large, Information retrieval from full-text Arabic databases: can search engines designed for English do the job? Libri 51 (2001) 63-74.
28. C. Monz and M. de Rijke. Shallow morphological analysis on monolingual information retrieval for Dutch, German and Italian. In: Post-Conference Proceedings of the Cross Language Evaluation Forum Workshop (CLEF 2001). (2001). Available at: http://staff.science.uva.nl/~christof/Papers/clef-2001-post.pdf (accessed 25 July 2004).
29. A. Mujoo, M.K. Malviya, R. Moona and T. Prahakar, A search engine for Indian languages. In: K. Bauknecht et al. (eds), Electronic Commerce and Web technologies, First International Conference EC-Web 2000, Procedings (Springer, 2000), 349-58. [Lecture Notes in Computer Science 1875]
30. Nielsen, Top 10 Web properties for the month of September 2002 - France (2002). Available at: http://web.archive.org/web/20021002220941/http://epm.netratings.com/fr/web/ NRpublicreports. toppropertiesmonthly (accessed 25 July 2004).
31. Nielsen, Top 10 Web properties for the month of April 2002 - Israel (2002). Available at: http://web.archive.org/web/20021011081005/http://epm.netratings.com/il /web/NRpublicreports.toppropertiesmonthly (accessed 25 July 2004).
32. NUA Internet Surveys, How many online? (2002). Available at: www.nua.ie/surveys/how_many_online/index.html (accessed 25 July 2004).
33. G. Nunberg, Languages of the Wired World. Presentation at The Politics and the Building of Modern Nations', Institut d'Etudes Politiques de Paris, 2 October 1998 (1998). Available at: http://www-csli.stanford.edu/~nunberg/WebPaper.html (accessed 25 July 2004).
34. D. Oard, Cross-language Information Retrieval Defined (1997). Available at: www.ee.umd.edu/medlab/mlir/mlir_definition.html (accessed 26 July 2004).
35. D. Oard and F.C. Gey, The TREC-2002 Arabic/English CLIR Track (2002). Available at: www.glue.umd.edu/~oard/papers/trec2002overview.pdf (accessed 26 July 2004).
36. D. Oard and A.R. Diekama, Cross language information retrieval, Annual Review of Information Science and Technology 33 (1998) 223-56.
37. OCLC Web Characterization Project, Available at: http://wcp.oclc.org/stats/intnl.html (accessed 25 July 2004).
38. V. Petras, N. Perelman and F. Gey, UC Berkeley at CLEF 2003 - Russian language experiments and domain specific cross language retrieval. In: C. Peters (ed.), Working notes for the CLEF 2003 Workshop, 21-2 August, Trondheim, Norway. Available at: http://clef.iei.pi.cnr.it:2002/2003/WN_web/29a.pdf (accessed 25 July 2004).
39. A. Pirkola, The effects of query structure and dictionary setups in dictionary based cross-language information retrieval. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 24-28 August 1998, Melbourne, Australia (1998) 55-63.
40. M. Popovic, and P. Willett, The effectiveness of stemming for natural language access to Slovene textual data, Journal of the American Society for Information Science 42 (1992) 384-90.
41. J. Savoy, A stemming procedure and stop word list for general French corpora, Journal of the American Society for Information Science 42 (1992) 944-52.
42. J. Savoy, Report on CLEF-2003 monolingual tracks: fusion of probabilistic models for effective monolingual retrieval. CLEF 2003, Trondheim, Norway, 21-22 August 2003. Available at: http://clef.iei.pi.cnr.it:2002/2003/WN_web/22.pdf (accessed 25 July 2004).
43. C. Silverstein, M. Henzinger, H. Marais and M. Moricz, Analysis of a very large Web search engine query log, ACM SIGIR Forum 33(1) (1999). Available at: www.acm.org/sigir/forum/F99/Silverstein.pdf (accessed 28 July 2004).
44. M. Sroka, Web search engines for Polish information retrieval: questions of search capabilities and retrieval performance, International Information & Library Research 32 (2000) 87-98.
45. Solhaut, French Grammar Help Online (2000). Available at: www.geocities.com/sohlhaut/FGHOnline.html (accessed 28 July 2004). [Author's real name is S. Olhaut]
46. D. Sullivan, Nielsen/NetRatings Search Engine Ratings (2002). Available at: http://searchenginewatch.com/mhts/0301-netratings.mht (accessed 25 July 2004).
47. S. Tomlinson, Lexical and algorithmic stemming compared for 9 European languages with Hummingbeard SearchServer at CLEF 2003. CLEF 2003, Trondheim, Norway, 21-22 August 2003. Available at: http://clef.iei.pi.cnr.it:2002/2003/WN_web/19.pdf (accessed 25 July 2004).
48. WebmasterWorld, European Search Engine Chart (2002). Available at: http://www.webmasterworld.com/forum18/544.htm (accessed 10 September 2002).
49. Walla (in Hebrew), The TIM Survey: there are 1.7 Million Internet Users in Israel (2002). Available at: http://news.walla.co.il/ts.cgi?tsscript=item&id=244719 (accessed 25 July 2004).
50. S. Winter, Hebrew computational linguistics: past and future, Artificial Intelligence Review 21(2) (2004) 113-38.
51. D. Wolfram, A. Spink, B.J. Jansen and T. Saracevic, Vox populi: the public searching of the Web, Journal of the American Society for Information Science and Technology 52(12) (2001) 1073-74.
52. Yandex (2002). Available at: http://web.archive.org/web/20021212141832/http://company.yandex.ru/progr ams/dict/ (accessed 28 July 2004).