A survey of methods to ease the development of highly multilingual text mining applications

Language Resources and Evaluation

Volumn 46, Issue 2, 2012, Pages 155-176

  Steinberger, Ralf ^a  

^a JOINT RESEARCH CENTRE   (Italy)

Author keywords

Algorithms; Cross lingual projection; Information extraction; Machine learning; Media monitoring; Methods; Multilinguality; Quotation recognition; Rule based; Saving effort; Sentiment analysis; String similarity calculation; Summarisation; Text mining

Indexed keywords

EID: 84866728506     PISSN: 1574020X     EISSN: 15728412     Source Type: Journal    
DOI: 10.1007/s10579-011-9165-9     Document Type: Article

References (42)

1. Balahur-Dobrescu, A., Steinberger, R., Kabadjov, M., Zavarella, V., van der Goot, E., Halkia, M., et al. (2010). Sentiment analysis in the news. In Proceedings of LREC. Valletta, Malta.
2. Bender, E., & Flickinger, D. (2005). Rapid prototyping of scalable grammars: Towards modularity in extensions to a language-independent core. In Proceedings of IJCNLP. Jeju Island, Korea.
3. Bentivogli, L., Forner, P., & Pianta, E. (2004). Evaluating cross-lingual annotation transfer in the MultiSemCor corpus (pp. 364-370). Geneva, Switzerland: CoLing.
4. Bering, C., Drożdżyński, W., Erbach, G., Guasch, L., Homola, P., Lehmann, S., et al. (2003). Corpora and evaluation tools for multilingual named entity grammar development. Proceedings of the multilingual corpora workshop at corpus linguistics (pp. 42-52). UK: Lancaster.
5. Carenini, M., Whyte, A., Bertorello, L., & Vanocchi, M. (2007). Improving communication in E-democracy using natural language processing. IEEE Intelligent Systems, 22(1), 20-27.
6. Ehrmann, M., & Turchi, M. (2010). Building multilingual named entity-annotated corpora exploiting parallel corpora. In Proceedings of the workshop on annotation and exploitation of parallel corpora (AEPC) (pp. 24-33). Tartu, Estonia.
7. Gamon, M., Lozano, C., Pinkham, J., & Reutter, T. (1997). Practical experience with grammar sharing in multilingual NLP. In Proceedings of ACL/EACL, Madrid, Spain.
8. Gong, Y., & Liu, X. (2002). Generic text summarization using relevance measure and latent semantic analysis. In Proceedings of ACM SIGIR. New Orleans, USA.
9. Goutte, C., Cancedda, N., Dymetman, M., & Foster, G. (2009). Learning machine translation. Cambridge, USA: MIT Press.
10. Grefenstette, G. (2010). Proposition for a web 2. 0 version of linguistic resource creation. Presentation at FLaReNet Forum 2010 in Barcelona on 12. 02. 2010.
11. Ignat C., Pouliquen, B., Ribeiro, A., & Steinberger, R. (2003). Extending an information extraction tool set to central and eastern European languages. In Proceedings of the workshop information extraction for Slavonic and other central and eastern European languages (IESL), held at RANLP. Borovets, Bulgaria, September 8-9, 2003.
12. Kabadjov, M., Atkinson, M., Steinberger, J., Steinberger, R., & van der Goot, E. (2010). NewsGist: A multilingual statistical news summarizer. In J. L. Balcázar, F. Bonchi, A. Gionis, & M. Sebag (Eds.), Proceedings of the European conference on machine learning and principles and practice of knowledge discovery in databases (ECML-PKDD). Barcelona, Spain, September 20-24, 2010. Lecture Notes in Computer Science (Vol. 6323, pp. 591-594). Berlin: Springer.
13. Larkey, L., Feng, F., Connell, M., & Lavrenko, V. (2004). Language-specific models in multilingual topic tracking. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval (pp. 402-409).
14. Lee, C.-J., Chang, J. S., & Jang, J.-S. R. (2006). Extraction of transliteration pairs from parallel corpora using a statistical transliteration model. Information Sciences, 176(1), 67-90.
15. Linge, J., Steinberger, R., Weber, T., Yangarber, R., van der Goot, E., Al Khudhairy, D., et al. (2009). Internet surveillance systems for early alerting of health threats. Euro Surveillance, 14(13). Stockholm, April 2, 2009.
16. Maynard, D., Tablan, V., & Cunningham, H. (2003). NE Recognition without training data on a language you don't speak. In Proceedings of the ACL workshop on multilingual and mixed-language NER: Combining statistical and symbolic methods. Sapporo, Japan.
17. Maynard, D., Tablan, V., Cunningham, H., Ursu, C., Saggion, H., Bontcheva, K., et al. (2002). Architectural elements of language engineering robustness. Journal of Natural Language Engineering, 8(3), 257-274. Special issue on robust methods in analysis of natural language data.
18. Nadeau, D., & Sekine, S. (2009). A survey of entity recognition and classification. In S. Sekine & E. Ranchhod (Eds.), Named entities-recognition, classification and use. Amsterdam/Philadelphia: John Benjamins Publishing Company.
19. Nivre, J., Hall, J., Kübler, S., McDonald, R., Nilsson, J., Riedel, S., et al. (2007). The CoNLL 2007 shared task on dependency parsing. In Proceedings of the CoNLL shared task session of EMNLP-CoNLL (pp. 915-932). Prague, Czech Republic.
20. Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1-2), 1-135.
21. Pastra, K., Maynard, D., Hamza, O., Cunningham, H., & Wilks, Y. (2002). How feasible is the reuse of grammars for named entity recognition? In Proceedings of LREC, Las Palmas, Spain.
22. Pouliquen, B., Steinberger, R., & Best, C. (2007a). Automatic detection of quotations in multilingual news. In Proceedings of the international conference recent advances in natural language processing (RANLP) (pp. 487-492). Borovets, Bulgaria, September 27-29, 2007.
23. Pouliquen, B., Steinberger, R., & Belyaeva, J. (2007b). Multilingual multi-document continuously updated social networks. In Proceedings of the workshop multi-source multilingual information extraction and summarization (MMIES) held at RANLP (pp. 25-32). Borovets, Bulgaria, September 26, 2007.
24. Ranta, A. (2009). The GF resource grammar library. In Linguistic issues in language technology LiLT 2: 2. December 2009.
25. Rayner, M., & Bouillon, P. (1996). Adapting the core language engine to French and Spanish. In Proceedings of the international conference NLP+IA (pp. 224-232), Mouncton, Canada.
26. Rosen, A. (2010). Mediating between incompatible tagsets. In Proceedings of the workshop on annotation and exploitation of parallel corpora (pp. 53-62), Tartu, Estonia.
27. Shinyama, Y., & Sekine, S. (2004). Named entity discovery using comparable news articles. In Proceedings of the 20th international conference on computational linguistics (CoLing) (pp. 848-853). Geneva, Switzerland.
28. Spreyer, K., & Frank, A. (2008). Projection-based acquisition of a temporal labeller. In Proceedings of the 3rd international joint conference on natural language processing (IJCNLP) (pp. 489-496). Hyderabad, India.
29. Steinberger, J., Kabadjov, M., Pouliquen, B., Steinberger, R., & Poesio, M., (2009). WB-JRC-UT's participation in TAC 2009: Update summarization and AESOP tasks. In Proceedings of the text analysis conference 2009 (TAC'2009). National Institute of Standards and Technology, Gaithersburg, Maryland USA, November 16-17, 2009.
30. Steinberger, J., Lenkova, P., Ebrahim, M., Ehrmann, M., Vázquez, S., Hürriyetoǧlu, A., Kabadjov, M., Steinberger, R., Tanev, H., & Zavarella, V. (2011). Creating sentiment dictionaries via triangulation. In Proceedings of the 2nd workshop on computational approaches to subjectivity and sentiment analysis, WASSA, held at the ACL-HLT conference (pp. 28-36). Portland, Oregon, USA, 24 June 2011.
31. Steinberger, R., & Pouliquen, B. (2007). Cross-lingual named entity recognition. In S. Sekine & E. Ranchhod (Eds.), Journal Linguisticae Investigationes, Special issue on named entity recognition and categorisation. LI, 30(1), 135-162. Amsterdam: John Benjamins Publishing Company.
32. Steinberger, R., Pouliquen, B., & Ignat, C. (2008). Using language-independent rules to achieve high multilinguality in text mining. In F.-S. Françoise, D. Perrotta, J. Piskorski, & R. Steinberger (Eds.), Mining massive data sets for security (pp. 217-240). Amsterdam, The Netherlands: IOS Press.
33. Steinberger, R., Pouliquen, B., & van der Goot, E. (2009). An introduction to the europe media monitor family of applications. In F. Gey, N. Kando, & J. Karlgren (Eds.), Information access in a multilingual world-Proceedings of the SIGIR 2009 Workshop (SIGIR-CLIR) (pp. 1-8). Boston, USA, July 23, 2009.
34. Steinberger, R., Pouliquen, B., Widiger, A., Ignat, C., Erjavec, T., Tufiş, D., et al. (2006). The JRC-acquis: A multilingual aligned parallel corpus with 20+ languages. In Proceedings of the 5th international conference on language resources and evaluation (LREC) (pp. 2142-2147). Genoa, Italy, May 24-26, 2006.
35. Steinberger, R., Ombuya, S., Kabadjov, M., Pouliquen, B., Della Rocca, L., Belyaeva, J., De Paola, M., & van der Goot, E. (2011). Expanding a multilingual media monitoring and information extraction tool to a new language: Swahili. Language Resources and Evaluation Journal, 45(3), 311-330.
36. Tanev, H., Zavarella, V., Linge, J., Kabadjov, M., Piskorski, J., Atkinson, M., et al. (2009). Exploiting machine learning techniques to build an event extraction system for Portuguese and Spanish. In linguaMÁTICA-Revista para o Processamento Automático das Línguas Ibéricas (Vol. 2, pp. 55-67).
37. Turchi, M., Steinberger, J., Kabadjov, M., & Steinberger, R. (2010). Using parallel corpora for multilingual (multi-document) summarisation evaluation. In Conference on multilingual and multimodal information access evaluation (CLEF). Padua, Italy, September 20-23, 2010. Springer Lecture Notes for Computer Science LNCS.
38. Vergne, J. (2002). Une méthode pour l'analyse descendante et calculatoire de corpus multilingues: Application au calcul des relations sujet-verbe. In Proceedings of TALN. Nancy, France.
39. Vergne, J. (2009). Defining the chunk as the period of the functions length and frequency of words on the syntagmatic axis. In Proceedings of the language technology conference LTC. Poznan, Poland.
40. Wehrli, E. (2007). Fips, a "Deep" linguistic multilingual parser. In Proceedings of the ACL workshop on deep linguistic processing (pp. 120-127). Prague, Czech Republic.
41. Yarowski, D., Ngai, G., & Wicentowski, R. (2001). Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of the 1st international conference on Human Language Technology research (HLT) (pp. 1-8). Stroudsburg, PA, USA.
42. Zaghouani, W., Pouliquen, B., Ibrahim, M., & Steinberger, R., (2010). Adapting a resource-light highly multilingual Named Entity Recognition system to Arabic. In Proceedings of LREC, Valletta, Malta.