Creating and using Web corpora

International Journal of Corpus Linguistics

Volumn 10, Issue 4, 2005, Pages 517-541

  Thelwall, Mike ^a  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

Academic language; Web; Web corpus

Indexed keywords

EID: 34248700528     PISSN: 13846655     EISSN: 15699811     Source Type: Journal    
DOI: 10.1075/ijcl.10.4.07the     Document Type: Article

References (65)

1. Adamic, L. & Huberman, B. (2000). The nature of markets in the World Wide Web. Quarterly Journal of Electronic Commerce, 1 (1), 5-12
2. Atwell, E., Gent, P. Medori, J. & Souter, C. (2003). Detecting student copying in a corpus of science laboratory reports: Simple and smart approaches. In D. Archer, P. Rayson, A. Wilson & T. McEnery (Eds.), Proceedings of the Corpus Linguistics 2003 conference (pp. 48-53). Lancaster: University of Lancaster
3. Arasu, A., Cho, J., Garcia-Molina, H. Paepcke, A. & Raghavan, S. (2001). Searching the Web, ACM Transactions on Internet Technology, 1 (1), 2-43
4. Bar-Ilan, J. (2004). The use of Web search engines in information science research. Annual Review of Information Science and Technology, 38, 231-288
5. Barabási, A. & Albert, R. (1999). Emergence of scaling in random networks. Science, 286, 509-512
6. Bauer, L. (1993). Progress with a corpus of New Zealand English and some early results. In C. Souter & E. Atwell (Eds.), Corpus-based computational linguistics (pp. 1-10). Amsterdam: Rodopi
7. Berners-Lee, T. (1992). W3 servers. Available: http://www.w3.org/History/ 19921103-hypertext/hypertext/DataSources/WWW/Servers. html
8. Bharat, K., Broder, A., Dean, J. & Henzinger, M. (2000). A comparison of techniques to find mirrored hosts on the WWW. Journal of the American Society for Information Science, (51) 12, 1114-1122
9. Biber, D. (2003). Variation among University spoken and written registers: A new multi-dimensional analysis. In P. Leistyna & C. F. Meyer (Eds.), Corpus Analysis: Language Structure and Language Use (pp. 47-70). Amsterdam: Rodopi
10. Biber, D. (1995). Dimensions of register variation. Cambridge: Cambridge University Press
11. Biber, D. (1988). Variation across speech and writing. Cambridge: Cambridge University Press
12. Björneborn, L. (2001). Small-world linkage and co-linkage. In Proceedings of the 12th ACM Conference on Hypertext and Hypermedia (pp. 133-134). New York: ACM Press
13. Brin, S. & Page, L. (1998). The anatomy of a large scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30 (1-7), 107-117
14. Broder, A., Kumar, R., Maghoull, F. Raghavan, P., Rajagopalan, S., Stata, S., Tomkins, A. & Wiener, J. (2000). Graph structure in the Web. Computer Networks, 33 (1-6), 309-320
15. Burke, S. (2002). Perl and LWP. Sebastopol, CA: O'Reilly
16. Burnard, L., (Ed.). (1995). Users' reference guide to the British National Corpus. Oxford: Oxford University Computing Services
17. Chakrabarti, S. (2003). Mining the Web. San Francisco: Mogan Kaufmann
18. Cothey, V. (2004). Web-crawling reliability. Journal of the American Society for Information Science and Technology, 55 (14), 1228-1238
19. Davies, M. (2001). Creating and using multi-million word corpora from web-based newspapers. In R.C. Simpson & J. M. Swales (Eds.), Corpus Linguistics in North America (pp. 58-75). Ann Arbor: University of Michigan
20. Fletcher, W. (2002). Making the web a more useful source for corpus linguistics. In U. Connor & T. Upton (Eds.), Corpus Linguistics in North America 2002: Selections from the Fourth North American Symposium of the American Association for Applied Corpus Linguistics (pp. 191-205). Amsterdam: Rodopi
21. Fujii, A. & Ishikawa, T. (2000a). Utilizing the World Wide Web as an encyclopedia: Extracting term descriptions from semi-structured texts. In Association for Computational Linguistics 2000, 488-495
22. Fujii, A. & Ishikawa, T. (2000b). Cross-Language Information Retrieval Based on Query Keyword Translation: An Internet Search Application. International Journal of Computer Processing of Oriental Languages, 13 (1), 1-13
23. Garrido, M. & Halavais, A. (2003). Mapping networks of support for the Zapatista Movement: Applying Social Network Analysis to study contemporary social movements. In M. McCaughey & M. Ayers (Eds.), Cyberactivism: online activism in theory and practice (pp. 165-184). New York: Routledge
24. Greenspan, R. (2002). Senior surfing surges. Available: http://cyberatlas.internet.com/big-picture/demographics/article/0,,5901-3111871, 00.html
25. Henzinger, M., Heydon, A., Mitzenmacher, M. & Najork, M. (1999). Measuring index quality using random walks on the Web. In Proceedings of the 8th International World Wide Web Conference (WWW8) (pp. 213-225)
26. Heydon, A. & Najork, M. (1999). Mercator: A scalable, extensible Web crawler. World Wide Web, 2, 219-229
27. Hofland, K. & Johansson, S. (1982). Word frequencies in British and American English. Bergen: Norwegian Computing Centre for the Humanities
28. Hosali, P. (1991). Some syntactic and lexico-semantic features of an Indian variant of English. Central Institute of English and Foreign Languages Bulletin, 3 (1-2), 65-83
29. Hyland, K. (2000). Discipinary discourses: Social interactions in academic writing. Harlow: Longman
30. Keller, F. & Lapata, M. (2003). Using the Web to obtain frequencies for unseen bigrams. Computational Linguistics, 29 (3), 459-484
31. Kehoe, A. & Renouf, A. (2002). WebCorp: Applying the Web to Linguistics and Linguistics to the Web. In Proceedings of the WWW2002 Conference, Honolulu, Hawaii. http://www2002.org/CDROM/poster/67/
32. Kilgarriff, A. & Grefenstette, G. (2003). Introduction to the special issue on the Web as corpus. Computational Linguistics, 29 (3), 333-347
33. Kilgarriff, A. (2003). BNC database and word frequency lists. Retrieved December 2, 2003, from http://www.itri.brighton.ac.uk/Adam.Kilgarriff/bnc- readme.html
34. Kleinberg, J. (1999). Authoritative sources in a hyperlinked environment. Journal of the ACM, 46 (5), 604-632
35. Kraaij, W., Nie, J. & Simard, M. (2003). Embedding Web-based statistical translation models in cross-language information retrieval. Computational Linguistics, 29 (3), 381-417
36. Lawrence, S. & Giles, C. (1999). Accessibility of information on the Web. Nature, 400, 107-109
37. Ljung, M. (1991). Swedish TEFL meets reality. In S. Johansson & A. Stenström (Eds.), English Computer Corpora: Selected Papers and Research Guide (pp. 245-256). Berlin: Mouton de Gruyter
38. Mair, C. (2003). Tracking ongoing grammatical change and recent diversification in present-day standard English: the complementary role of small and large corpora. Paper presented at the annual ICAME conference, Guernsey. Available: http://fips.igl.unifreiburg.de/lsf/docs/Mair.pdf
39. Marcus, M., Santorini, B. & Marcinkiewicz, M. (1993). Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19 (2), 313-330
40. McEnery, T., Baker, P. & Hardie, A. (2000). Swearing in modern British English. In B. Lewandowska-Tomaszczyk & J. Melia (Eds.), Practical Applications in Language Corpora (pp. 37-48). Europaischer Verlag der Wissenschaften: Peter Lang
41. McEnery, T. & Wilson, A. (1999). Corpus Linguistics. Edinburgh: Edinburgh University Press
42. McEnery, T. (2003). Corpus linguistics. In R. Mitkov (Ed.), The Oxford handbook of computational linguistics (pp. 448-463). Oxford: Oxford University Press
43. Menczer, F. (2002). Growing and navigating the small world Web by local content. Proceedings of the National Academy of Sciences, 99 (22), 14014-14019
44. Mettrop, W. & Nieuwenhuysen, P. (2001). Internet search engines-fluctuations in document accessibility. Journal of Documentation, 57 (5), 623-651
45. Meyer, C., Grabowski, R., Han, H-Y., Mantzouranis, K. & Moses, S. (2003). The World Wide Web as linguistic corpus. Language and Computers, 46 (1), 241-254
46. Middleton, I., McConnell, M. & Davidson, G. (1999). Presenting a model for the structure and content of a university World Wide Web site. Journal of Information Science, 25 (3), 219-227
47. Mihalcea, R. & Moldovan, D. (1999). A method for word sense disambiguation of unrestricted text. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL-99) (Maryland, NY, June 1999) (pp. 152-158)
48. Mikheev, A. (2003). Text segmentation. In R. Mitkov (Ed.), The Oxford handbook of computational linguistics (pp. 201-218). Oxford: Oxford University Press
49. Mitkov, R. (Ed.) (2003). The Oxford handbook of computational linguistics. Oxford: Oxford University Press
50. Morley, B., Renouf, A. & Kehoe, A. (2003). Linguistic research with the XML/RDF aware WebCorp tool. In Proceedings of the WWW2003 Conference, Budapest. http://www2003.org/cdrom/papers/poster/p005/p5-morley.html
51. Peters, P. (1993). American and British influence on Australian verb morphology. In U. Fries, G. Tottie & P. Schneider (Eds.), Creating and using language corpora (pp. 149-158). Amsterdam: Rodopi
52. Peyawary, A. (1999). The core vocabulary of international English: A corpus approach. Bergen: Norwegian Computing Centre for the Humanities
53. Rehm, G. (2002). Towards automatic Web genre identification-A corpus-based approach in the domain of academia by example of the academic's Personal Homepage. In Proceedings of the Hawaii International Conference on System Sciences, Big Island, Hawaii, January. Available: http://www.uni-giessen. de/g91063/pdf/HICSS35-rehm.pdf
54. Resnik, P. & Smith, N. (2003). The Web as a parallel corpus. Computational Linguistics, 29 (3), 349-380
55. Rigau, G., Magnini, B., Agirre, E., Vossen, P. & Carroll, J. (2002). MEANING: A Roadmap to Knowledge Technologies. In Proceedings of COLING Workshop "A Roadmap for Computational Linguistics". Taipei, Taiwan. Available: http://ixa.si.ehu.es/Ixa/Argitalpenak/Artikuluak/1027433016/publikoak/ 2002colingmeaning.pdf
56. Santamaria, C., Gonzalo, J. & Verdejo, F. (2003). Automatic association of Web directories with word senses. Computational Linguistics, 29 (3), 485-503
57. Sinclair, J., Mason, O. Ball, J. & Barnbrook, G. (1998). Language independent statistical software for corpus exploration. Computers and the Humanities, 31, 229-255
58. Spink, A., Wolfram, D., Jansen, B. & Saracevic, T. (2001). Searching the Web: The public and their queries. Journal of the American Society for Information Science, 53 (2), 226-234
59. Sullivan, D. (2001). Inktomi Spam database left open to public. Available: http://searchenginewatch.com/sereport/article.php/2164241, accessed 29 January, 2004
60. Takahashi, J. (2003). Do we talk (or write?) differently over the Net? A lexical enquiry into 'a' Net-EN. In D. Archer, P. Rayson, A. Wilson & T. McEnery (Eds.), Proceedings of the Corpus Linguistics 2003 conference (pp. 764-772). Lancaster: University of Lancaster
61. Thelwall, M., Tang, R. & Price, E. (2003). Linguistic patterns of academic Web use in Western Europe. Scientometrics, 56 (3), 417-432
62. Thelwall, M. (2001). A Web crawler design for data mining. Journal of Information Science, 27 (5), 319-325
63. Thelwall, M. (2002). Methodologies for crawler based Web surveys. Internt Research: Electronic Networking and Applications, 12 (2), 124-138
64. Vaughan, L. & Thelwall, M. (2004). Search engine coverage bias: Evidence and possible causes. Information Processing & Management, 40 (4), 693-707
65. Way, A. & Gough, N. (2003). WebMT: Developing and validating an example-based machine translation system using the world wide Web. Computational Linguistics, 29 (3), 421-457