Independent component analysis of word contexts and comparison with traditional categories

Report - Helsinki University of Technology, Signal Processing Laboratory

Volumn 46, Issue , 2004, Pages 300-303

  Väyrynen, Jaakko ^a   Honkela, Timo ^a   Hyvärinen, Aapo ^b  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF HELSINKI   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION RETRIEVAL; LINGUISTICS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PRINCIPAL COMPONENT ANALYSIS; SELF ORGANIZING MAPS; SEMANTICS; VECTORS;

COVARIANCE MATRIX; INDEPENDENT COMPONENT ANALYSIS (ICA); SINGULAR VALUE DECOMPOSITION (SVD); WORD CONTEXTS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 11844287566     PISSN: 14586401     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman, "Indexing by latent semantic analysis," Journal of the American Society of Information Science, vol. 41, no. 6, pp. 391-407, 1990. Available: citeseer.nj.nec.com/deerwester90indexing.html
2. T. K. Landauer, P. W. Foltz, and D. Laham, "An introduction to latent semantic analysis," Discourse Processes, vol. 25, pp. 259-284, 1998.
3. T. Kohonen, Self-Organizing Maps. Berlin, Heidelberg: Springer, 2001.
4. H. Ritter and T. Kohonen, "Self-organizing semantic maps," Biological Cybernetics, vol. 61, pp. 241-254, 1989.
5. T. Honkela, V. Pulkki, and T. Kohonen, "Contextual relations of words in Grimm tales analyzed by self-organizing map," in Proc. ICANN-95, International Conference on Artificial Neural Networks, vol. 2. Nanterre, France: EC2, 1995, pp. 3-7.
6. F. Pereira, N. Tishby, and L. Lee, "Distributional clustering of English words," in Proc. the 31st annual meeting of the Association for Computational Linguistics, 1993.
7. A. Clark, "Inducing syntactic categories by context distribution clustering," in Proc. CoNLL-2000 and LLL-2000, Lisbon, Portugal, 2000, pp. 91-94.
8. J. P. Levy and J. A. Bullinaria, "Learning lexical properties from word usage patterns: Which context words should be used?" in Development and Evolution: Proceedings of the Sixth Neural Computation and Psychology Workshop. London: Springer, 2001, pp. 273-282.
9. C. Jutten and J. Hërault, "Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture," Signal Processing, vol. 24, pp. 1-10, 1991.
10. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. John Wiley & Sons, 2001.
11. T. Honkela, A. Hyvärinen, and J. Väyrynen, "Emergence of linguistic representation by independent component analysis," Helsinki University of Technology, Laboratory of Computer and Information Science, Tech. Rep. A72, 2003.
12. "The FastICA MATLAB package." Available: http://www. cis.hut.fl/projects/ica/fastica/
13. P. Clarkson and R. Rosenfeld, "Statistical language modeling using the CMU-cambridge toolkit," in Proc. Eurospeech '97, Rhodes, Greece, 1997, pp. 2707-2710.