Word-map systems for content-based document classification

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 41, Issue 5, 2011, Pages 662-673

  Tsimboukakis, Nikos ^a   Tambouratzis, George ^a  

^a INSTITUTE FOR LANGUAGE AND SPEECH PROCESSING   (Greece)

Author keywords

Hidden Markov models (HMMs); neural network applications; self organizing feature maps; text processing

Indexed keywords

CONTENT-BASED; DATA SETS; DOCUMENT CLASSIFICATION; NEURAL-NETWORK APPLICATIONS; SELF ORGANIZING; SELF-ORGANIZING FEATURE MAPS;

CONFORMAL MAPPING; HIDDEN MARKOV MODELS; PATTERN RECOGNITION SYSTEMS; TERRORISM; TEXT PROCESSING; WORD PROCESSING;

INFORMATION RETRIEVAL SYSTEMS;

EID: 80052064288     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2010.2096416     Document Type: Article

References (43)

1. T. Kohonen, S. Kaski, K. Lagus, K. Salojärvi, J. Honkela, V. Patero, and A. Saarela, "Self-organisation of a massive document collection, " IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 574-585, May 2000.
2. K. Lagus, S. Kaski, and T. Kohonen, "Mining massive document collections by the WEBSOM method, " Inf. Sci., vol. 163, no. 1-3, pp. 135-156, 2004.
3. T. Kohonen, Self-Organizing Maps (Springer Series in Information Sciences), 2nd ed. Heidelberg, Germany: Springer, 1997.
4. A. Georgakis, C. Kotropoulos, A. Xafopoulos, and I. Pitas, "Marginal median SOM for document organization and retrieval, " Neural Netw., vol. 17, no. 3, pp. 365-377, 2004. (Pubitemid 38376004)
5. S. Kaski, "Dimensionality reduction by random mapping: fast similarity computation for clustering, " in Proc. IJCNN Conf., 1998, vol. 1, pp. 413-418.
6. S. Deerwester, T. Dumais, W. Furnas, T. Landauer, and R. Harshman, "Indexing by latent semantic analysis, " J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391-407, 1990.
7. D. Pullwitt, "Integrating contextual information to enhance SOM-based text document clustering, " Neural Netw., vol. 15, no. 8/9, pp. 1099-1106, 2002.
8. K. Linden, "Evaluation of linguistic features for word sense disambiguation with self-organized document maps, " Comput. Humanities, vol. 38, no. 4, pp. 417-435, 2004.
9. N. L. Bhamidipati and S. K. Pal, "Stemming via distribution-based word segregation for classification and retrieval, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 2, pp. 350-360, Apr. 2007. (Pubitemid 46523225)
10. Y. Yang, "An evaluation of statistical approaches to text categorization, " J. Inf. Retrieval, vol. 1, no. 1/2, pp. 69-90, 1999.
11. J. Wang, Y. Yao, and Z. J. Liu, "A new text classification method based on HMM-SVM, " in Proc. Int. Symp. Commun. Inf. Technol., Sydney, N. S. W., Australia, Oct. 17-19, 2007, pp. 1516-1519.
12. Y. Yang and X. Liu, "A re-examination of text categorization methods, " in Proc. 22nd ACM SIGIR Conf. Res. Dev. Inf. Retrieval, Berkeley, CA, 1999, pp. 42-49.
13. T. Joachims, "Text categorization with support vector machines: learning with many relevant features, " in Proc. ECML Conf., 1998, pp. 137-142, Springer-Verlag. (Pubitemid 128067178)
14. N. Oza, J. P. Castle, and J. Stutz, "Classification of aeronautics system health and safety documents, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 39, no. 6, pp. 670-680, Nov. 2009.
15. A. J. C. Trappey, C. V. Trappey, F. Hsu, and D. W. Hsiao, "A fuzzy ontological knowledge document clustering methodology, " IEEE Trans. Syst., Man, Cybern. B, Cybern, vol. 39, no. 3, pp. 806-814, Jun. 2009.
16. C. D. Manning and H. Schütze, Foundations Of Statistical Natural Language Processing. Cambridge, MA: MIT Press, 1999.
17. G. Tambouratzis, "Assessing the effectiveness of feature groups in author recognition tasks with the SOM model, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 36, no. 2, pp. 249-259, Mar. 2006.
18. G. Tambouratzis and M. Vassiliou, "Employing thematic variables for enhancing classification accuracy within author discrimination experiments, " Literary Ling. Comput., vol. 22, no. 2, pp. 207-224, 2007.
19. L. R. Rabiner, "A tutorial on HMM and selected applications in speech recognition, " Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
20. H. Drucker, D. Wu, and V. Vapnik, "Support vector machines for spam categorization, " IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1048-1054, Sep. 1999.
21. T. Brants, "Tagging and parsing with cascaded Markov models - Automation of corpus annotation, " Saarbrücken Dissertations in Comput. Ling. Lang. Technol., vol. 6, German Res. Center Artif. Intell., Saarland Univ., Saarbruecken, Germany, 1999.
22. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
23. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1999.
24. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval, " Inf. Process. Manage., vol. 24, no. 5, pp. 513-523, 1988.
25. Y. Yang and J. O. Pedersen, "A comparative study on feature selection in text categorization, " in Proc. 14th Int. Conf. Mach. Learn., 1997, pp. 412-420.
26. H. Papageorgiou, P. Prokopidis, V. Giouli, and S. Piperidis, "A unified POS tagging architecture and its application to Greek, " in Proc. LREC Conf., vol. 3, Athens, Greece, 2000, pp. 1455-1462.
27. H. Schmidt, "Probabilistic part-of-speech tagging using decision trees, " in Proc. Int. Conf. New Methods Lang., Manchester, U. K., 1994, pp. 44-49.
28. H. Schmidt, "Improvements in part-of-speech tagging with an application to German, " in Proc. ACL SIGDAT Workshop, Dublin, Ireland, 1995, pp. 47-50.
29. N. Tsimboukakis and G. Tambouratzis, "Self-organizing word map for context-based document classification, " presented at WSOM Workshop, Bielefeld, Germany, 2007.
30. T. Kohonen, "Self-organized formation of topologically correct feature maps, " Biol. Cybern., vol. 43, pp. 59-69, 1982. (Pubitemid 12139984)
31. A. Tanwari, Q. A. Lakhiar, and G. Y. Shaikh, "ABC analysis as an inventory control technique, " Quaid-E-Awam Univ. Res. J. Eng. Sci. Technol., vol. 1, no. 1, 2000.
32. R. Cam and L. Gilles, "A new model of the Pareto effect (80:20 rule) at the brand level, " in Proc. ANZMAC Conf., Melbourne, Vic., Australia, Dec. 02, 2002, pp. 1431-1436.
33. J. Vesanto and E. Alhoniemi, "Clustering of the self-organizing map, " IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 586-600, May 2000.
34. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
35. N. Tsimboukakis and G. Tambouratzis, "Document classification system based on HMM word map, " in Proc. CSTST Conf., Paris, France, Oct. 27-31, 2008, pp. 7-12.
36. M. Riedmiller and H. Braun, "A direct adaptive method for faster back-propagation learning: The RPROP algorithm, " in Proc. ICNN Conf., San Francisco, CA, 1993, pp. 586-591.
37. C. Igel and M. Huesken, "Empirical evaluation of the improved RPROP learning algorithm, " Neurocomputing, vol. 50, pp. 105-123, 2003. (Pubitemid 36131033)
38. D. Mackay, "A practical Bayesian framework for backpropagation networks, " Neural Comput., vol. 4, no. 3, pp. 448-472, 1992.
39. D. Nguyen and B. Widrow, "Improving the learning speed of 2-layer neural networks by choosing initial values of adaptive weights, " in Proc. IJCNN Conf., 1990, vol. 3, pp. 21-26.
40. D. Lewis. Reuters-21578 test collection. (1997). Online. Available: http://www.daviddlewis.com/resources/testcollections/reuters21578/.
41. J. Diederich, J. Kindermann, E. Leopold, and G. Paass, "Authorship attribution with support vector machines, " Appl. Intell., vol. 19, pp. 109-123, 2003.
42. J. Vesanto, J. Himberg, E. Alhoniemi, J. Parhankangas. (2000). SOM Toolbox for MATLAB 5. SOM Toolbox Team, Helsinki Univ. Technol., Helsinki, Finland, Rep. A57 [Online]. Available at: http://www.cis.hut.fi/projects/ somtoolbox/.
43. C.-C. Chang and C.-J. Lin. (2001). LIBSVM: A library for support vector machines [Online]. Available at: http://www.csie.ntu.edu.tw/~cjlin/libsvm.