Descriptive document clustering via discriminant learning in a co-embedded space of multilevel similarities

Journal of the Association for Information Science and Technology

Volumn 67, Issue 1, 2016, Pages 106-133

  Mu, Tingting ^a   Goulermas, John Y ^a   Korkontzelos, Ioannis ^b   Ananiadou, Sophia ^b  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

information retrieval; natural language processing; text mining

Indexed keywords

CLUSTER ANALYSIS; DATA MINING; NATURAL LANGUAGE PROCESSING SYSTEMS;

CLUSTER MEMBERSHIPS; DISCRIMINANT MODELS; DOCUMENT CLUSTERING; EMBEDDING INFORMATION; HETEROGENEOUS OBJECT; NATURAL LANGUAGE PROCESSING; SIMILARITY INFORMATIONS; TEXT MINING;

INFORMATION RETRIEVAL;

DATA BASE; EMBEDDING; EXTRACT; INFORMATION RETRIEVAL; LEARNING; MINING; MODEL; NATURAL LANGUAGE PROCESSING; NOISE;

EID: 84975089751     PISSN: 23301635     EISSN: 23301643     Source Type: Journal    
DOI: 10.1002/asi.23374     Document Type: Article

References (79)

1. Ananiadou, S., Okazaki, N., Procter, R., Rea, B., & Thomas, J. (2009). Supporting systematic reviews using text mining. Social Science Computer Review, 27(4), 509–523.
2. Arai, K., & Ridho, B.A. (2007). Hierarchical k-means: An algorithm for centroids initialization for k-means. Reports of the Faculty of Science and Engineering, 36(1), 25–31.
3. Baeza-Yates, R.A., & Ribeiro-Neto, B.A. (Eds.). (1999). Modern information retrieval. Boston, MA, USA: ACM Press, Addison-Wesley.
4. Baraldi, A., & Blonda, P. (1999a). A survey of fuzzy clustering algorithms for pattern recognition-part I. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2(6), 778–785.
5. Baraldi, A., & Blonda, P. (1999b). A survey of fuzzy clustering algorithms for pattern recognition-part II. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2(6), 786–801.
6. Beil, F., Ester, M., & Xu, X. (2002). Frequent term-based text clustering. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 436–442). New York, NY, USA: ACM.
7. Belkin, M., & Niyogi, P. (2003). Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6), 1373–1396.
8. Bengio, Y., Courville, A., & Vincent, P. (2013). Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8), 1798–1828.
9. Bengio, Y., Ducharme, R., Vincent, P., & Jauvin, C. (2003). A neural probabilistic language model. Journal of Machine Learning Research, 3, 1137–1155.
10. Bharambe, U., & Kale, A. (2011). Landscape of web search results clustering algorithms. Communications in Computer and Information Science, 125(Pt 1), 95–107.
11. Carmel, D., Roitman, H., & Zwerdling, N. (2009). Enhancing cluster labeling using wikipedia. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 139–146). New York, NY, USA: ACM.
12. Carpineto, C., Osiński, S., Romano, G., & Weiss, D. (2009). A survey of Web clustering engines. ACM Computing Surveys, 41(3), 1–38.
13. Chang, Y.F., & Chen, C.-M. (2011). Classification and visualization of the social science network by the minimum span clustering method. Journal of the American Society for Information Science and Technology, 62(12), 2404–2413.
14. Chen, C.H. (2002). Generalized association plots: Information visualization via iteratively generated correlation matrices. Statistica Sinica, 12(1), 7–29.
15. Cheng, Y. (1995). Mean shift, mode seeking, and clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(8), 790–799.
16. Cover, T., & Hart, P. (1967). Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13(1), 21–27.
17. Cribbin, T. (2011). Discovering latent topical structure by second-order similarity analysis. Journal of the American Society for Information Science and Technology, 62(6), 1188–1207.
18. Cristianini, N., & Shawe-Taylor, J. (2002). An introduction to support vector machines. Cambridge, United Kingdom: Cambridge University Press.
19. Cutting, D.R., Karger, D.R., Pedersen, J.O., & Tukey, J.W. (1992). Scatter/gather: A cluster-based approach to browsing large document collections. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 318–329). New York, NY, USA: ACM.
20. Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K., & Harshman, R. (1990). Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6), 391–407.
21. Domingos, P., & Pazzani, M. (1997). On the optimality of the simple bayesian classifier under zero-one loss. Machine Learning, 29, 103–130.
22. Dongen, S. (2000). A Cluster Algorithm for Graphs (Tech. Rep. No. INS-R0010). Amsterdam: National Research Institute for Mathematics and Computer Science in the Netherlands.
23. Drineas, P., Frieze, A., Kannan, R., Vempala, S., & Vinay, V. (1999). Clustering in large graphs and matrices. In Proceedings of the 10th Annual ACM-SIAM Symposium on Discrete Algorithms (pp. 291–299). Philadelphia, PA, USA: Society for Industrial and Applied Mathematics.
24. Dubin, D. (2004). The most influential paper gerard salton never wrote. Library Trends, 52(4), 748–764.
25. Duda, R.O., Hart, P.E., & Stork, D.G. (2001). Pattern classification (2nd ed.). New York, NY: John Wiley and Sons.
26. Eckart, C., & Young, G. (1936). The approximation of one matrix by another of lower rank. Psychometrika, 1(3), 211–218.
27. Frantzi, K., Ananiadou, S., & Mima, H. (2000). Automatic recognition of multi-word terms: The c-value/nc-value method. International Journal of Digital Libraries, 3(2), 117–132.
28. Geraci, F., Pellegrini, M., Maggini, M., & Sebastiani, F. (2006). Cluster generation and cluster labelling for web snippets: A fast and accurate hierarchical solution. String Processing and Information Retrieval, Lecture Notes in Computer Science, 4209, 25–36.
29. Globerson, A., Chechik, G., Pereira, F., & Tishby, N. (2007). Euclidean embedding of co-occurrence data. Journal of Machine Learning Research, 8, 2265–2295.
30. Hatzivassiloglou, V., Gravano, L., & Maganti, A. (2001). An investigation of linguistic features and clustering algorithms for topical document clustering. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR (pp. 224–231). New York, NY, USA: ACM.
31. Haykin, S. (1999). Neural networks: A comprehensive foundation. London, United Kingdom; Upper Saddle River, NJ: Prentice Hall.
32. Hearst, M.A., & Pedersen, J.O. (1996). Reexamining the cluster hypothesis: Scatter/gather on retrieval results. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 76–84). New York, NY, USA: ACM.
33. Hussain, S.F., Bisson, G., & Grimal, C. (2010). An improved co-similarity measure for document clustering. In Proceedings of the Ninth Int'l Conference on Machine Learning and Applications (pp. 190–197). Washington, DC: IEEE Computer Society.
34. Jain, A.K. (2010). Data clustering: 50 years beyond k-means. Pattern Recognition Letters, 31(8), 651–666.
35. Janruang, J., & Guha, S. (2011). Semantic suffix tree clustering. In Proceedings of the First IRAST International Conference on Data Engineering and Internet Technology, DEIT (pp. 35–40). IEEE.
36. Janruang, J., & Kreesuradej, W. (2006). A new web search result clustering based on true common phrase label discovery. In Proceedings of the International Conference on Computational Intelligence for Modelling Control and Automation, and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, CIMCA-IAWTIC (pp. 242–247). IEEE.
37. Jayabharathy, J., Kanmani, S., & Parveen, A.A. (2011). A survey of document clustering algorithms with topic discovery. Journal of Computing, 3(2), 21–27.
38. Jiang, Z., Joshi, A., Kothari, R., & Yi, L. (2000). Retriever: Improving Web Search Engine Results Using Clustering (Tech. Rep.). University of Maryland Baltimore County.
39. Jiang, P., Zhang, C., Guo, G., Niu, Z., & Gao, D. (2009). A k-means approach based on concept hierarchical tree for search results clustering. In Proceedings of the Sixth International Conference on Fuzzy Systems and Knowledge Discovery (pp. 380–386). IEEE.
40. Jones, S., & Paynter, G.W. (2002). Automatic extraction of document key phrases for use in digital libraries: Evaluation and applications. Journal of the American Society for Information Science and Technology, 53(8), 653–677.
41. Kohonen, T. (1990). The self-organizing map. Proceedings of the IEEE, 78(9), 1464–1480.
42. Korkontzelos, I., Mu, T., & Ananiadou, S. (2012). ASCOT: A text mining-based web-service for efficient search and assisted creation of clinical trials. BMC Medical Informatics and Decision Making, 12(Suppl. 1), S3.
43. Koshman, S., Spink, A., & Jansen, B.J. (2006). Web searching on the vivisimo search engine. Journal of the American Society for Information Science and Technology, 57(14), 1875–1887.
44. Kovács, B. (2010). A generalized model of relational similarity. Social Networks, 32(3), 197–211.
45. Krishnapuram, R., Joshi, A., & Yi, L. (1999). A fuzzy relative of the k-medoids algorithm with application to web document and snippet clustering. In Proceedings of the IEEE International Conference on Fuzzy Systems, FUZZ-IEEE (pp. 1281–1286). IEEE.
46. Lagus, K., & Kaski, S. (1999). Keyword selection method for characterizing text document maps. In Proceedings of the Ninth Int'l Conference on Artificial Neural Networks, ICANN (pp. 371–376). IEEE.
47. Lagus, K., Kaski, S., & Kohonen, T. (2004). Mining massive document collections by the WEBSOM method. Information Sciences: An International Journal—Special Issue: Soft Computing Data Mining, 163(1–3), 135–156.
48. Lan, M., Tan, C.-L., Su, J., & Lu, Y. (2009). Supervised and traditional term weighting methods for automatic text categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(4), 721–735.
49. Lam, W., Tsang, I., & Wong, T. (2013). Discovering low-rank shared concept space for adapting text mining models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(6), 1284–1297. doi: 10.1109/TPAMI.2012.243
50. Lewis, D.D. (1997). Reuters-21578 text categorization test collection. Retrieved from http://www.daviddlewis.com/resources/testcollections/reuters21578/
51. Li, Y., Chung, S.M., & Holt, J.D. (2008a). Text Document Clustering Based on Frequent Word Meaning Sequences. Data & Knowledge Engineering, 64(1), 381–404.
52. Li, Z., Peng, H., & Wu, X. (2008b). A new descriptive clustering algorithm based on nonnegative matrix factorization. In Proceedings of the IEEE Int'l Conference on Granular Computing, GRC (pp. 407–412). Hangzhou, China: IEEE.
53. Luxburg, U. (2007). A tutorial on spectral clustering. Statistics and Computing, 17(4), 395–416.
54. Matsumoto, T., & Hung, E. (2010). Fuzzy clustering and relevance ranking of web search results with differentiating cluster label generation. In Proceedings of the IEEE International Conference on Fuzzy Systems, FUZZ-IEEE (pp. 1–8). IEEE.
55. Mu, T., & Goulermas, J.Y. (2013). Automatic generation of co-embeddings from relational data with adaptive shaping. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(10), 2340–2356.
56. Mu, T., Goulermas, J.Y., Tsujii, J., & Ananiadou, S. (2012). Proximity-based frameworks for generating embeddings from multi-output data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(11), 2216–2232.
57. Mu, T., Jiang, J., Wang, Y., & Goulermas, J.Y. (2012). Adaptive data embedding framework for multi-class classification. IEEE Transactions on Neural Networks and Learning Systems, 23(8), 1291–1303.
58. Noel, S., Raghavan, V., & Chu, C.-H.H. (2003). Document clustering, visualization, and retrieval via link mining. Clustering and Information Retrieval, Network Theory and Applications, 11, 161–193.
59. Osiński, S. (2006). Improving quality of search results clustering with approximate matrix factorisations. Advances in Information Retrieval, Lecture Notes in Computer Science, 3969, 167–178.
60. Osiński, S., & Weiss, D. (2005). A concept-driven algorithm for clustering search results. IEEE Intelligent Systems, 20(3), 48–54.
61. Osiński, S., Stefanowski, J., & Weiss, D. (2004). Lingo: Search results clustering algorithm based on singular value decomposition. In Advances in Soft Computing, Intelligent Information Processing and Web Mining, Proceedings of the International IIS: IIPWM'04 Conference (pp. 359–368). Springer Berlin Heidelberg.
62. Ouyang, M., Welsh, W.J., & Georgopoulos, P. (2004). Gaussian mixture clustering and imputation of microarray data. Bioinformatics (Oxford, England), 20(6), 917–992.
63. Rooneya, N., Pattersona, D., Galushkaa, M., & Dobryninb, V. (2006). A scaleable document clustering approach for large document corpora. Information Processing and Management, 42(5), 1163–1175.
64. Salton, G., & Buckley, C. (1987). Term weighting approaches in automatic text retrieval (Research Report). Ithaca, NY: Cornell University.
65. Stefanowski, J., & Weiss, D. (2007). Extending k-means with the description comes first approach. Control and Cybernetics, 36(4), 1010–1035.
66. Syed, Z., Finin, T., & Joshi, A. (2008). Wikipedia as an ontology for describing documents. In Proceedings of the Second International Conference on Weblogs and Social Media, ICWSM (pp. 136–144). Palo Alto, California: AAAI Press.
67. Theodosiou, T., Darzentas, N., Angelis, L., & Ouzounis, C.A. (2008). PuReD-MCL: A graph-based PubMed document clustering methodology. Bioinformatics (Oxford, England), 24(17), 1935–1941.
68. Thomas, J., McNaught, J., & Ananiadou, S. (2011). Applications of text mining within systematic reviews. Research Synthesis Methods, 2(1), 1–14.
69. Torgerson, W.S. (1952). Multidimensional scaling: I. theory and method. Journal Psychometrika, 17(4), 401–419.
70. Treeratpituk, P., & Callan, J. (2006). Automatically labeling hierarchical clusters. In Proceedings of the Int'l Conference on Digital Government Research (pp. 167–176). Digital Government Society of North America.
71. Tseng, Y. (2010). Generic title labeling for clustered documents. Expert Systems with Applications, 37(3), 2247–2254.
72. Tsuruoka, Y., Tateishi, Y., Kim, J., Ohta, T., McNaught, J., Ananiadou, S., & Tsujii, J. (2005). Developing a robust part-of-speech tagger for biomedical text. In Proceedings of the Advances in Informatics-10th Panhellenic Conference on Informatics, LNCS (pp. 117–132). Springer-Verlag Berlin, Heidelberg.
73. Wang, J., Mo, Y., Huang, B., Wen, J., & He, L. (2008). Web search results clustering based on a novel suffix tree structure. Autonomic and Trusted Computing—Lecture Notes in Computer Science, 5060, 540–554.
74. Weiss, D. (2006). Descriptive clustering as a method for exploring text collections. PhD dissertation, Poznan University of Technology Institute of Computing Science, Poland.
75. Xu, R. (2005). Survey of clustering algorithms. IEEE Transactions on Neural Networks, 16(3), 645–678.
76. Xu, W., Liu, X., & Gong, Y. (2003). Document clustering based on non-negative matrix factorization. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 267–273). New York, NY, USA: ACM.
77. Zamir, O.E. (1999). Clustering web document: A phrase-based method for grouping search engine results. Unpublished doctoral dissertation, University of Washington.
78. Zeng, J., Cheung, W., & Liu, J. (2013). Learning topic models by belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(5), 1121–1134. doi: 10.1109/TPAMI.2012.185
79. Zhang, D., & Dong, Y. (2004). Semantic, hierarchical, online clustering of web search results. Advanced Web Technologies and Applications, Lecture Notes in Computer Science, 3007, 69–78.