Text mining infrastructure in R

Journal of Statistical Software

Volumn 25, Issue 5, 2008, Pages 1-54

  Feinerer, Ingo ^a   Hornik, Kurt ^a   Meyer, David ^a  

^a VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS   (Austria)

Author keywords

Count based evaluation; R; String kernels; Text classification; Text clustering; Text mining

Indexed keywords

EID: 46749110035     PISSN: 15487660     EISSN: 15487660     Source Type: Journal    
DOI: 10.18637/jss.v025.i05     Document Type: Article

References (88)

1. Adeva JJG, Calvo R (2006). "Mining Text with Pimiento." IEEE Internet Computing, 10(4), 27-35. ISSN 1089-7801. doi:10.1109/MIC.2006.85.
2. Anderberg M (1973). Cluster Analysis for Applications. Academic Press, New York.
3. Asuncion A, Newman D (2007). "UCI Machine Learning Repository." URL http://www.ics.uci.edu/~mlearn/MLRepository.html.
4. Bates D, Maechler M (2007). Matrix: A Matrix Package for R. R package version 0.999375-2, URL http://CRAN.R-project.org/package= Matrix.
5. Berners-Lee T, Hendler J, Lassila O (2001). "The Semantic Web." Scientific American, pp. 34-43.
6. Berry M (ed.) (2003). Survey of Text Mining: Clustering, Classification, and Retrieval. Springer-Verlag. ISBN 0387955631.
7. Bierner G, Baldridge J, Morton T (2007). "OpenNLP: A Collection of Natural Language Processing Tools." URL http://opennlp. sourceforge.net/.
8. Bill E (1995). "Transformation-based Error-driven Learning and Natural Language Processing: A Case Study in Part-of-Speech Tagging." Computational Linguistics, 21(4), 543-565.
9. Boley D (1998). "Hierarchical Taxonomies Using Divise Partitioning." Technical Report 98-012, University of Minnesota.
10. Boley D, Gini M, Gross R, Han EH, Karypis G, Kumar V, Mobasher B, Moore J, Hastings K (1999). "Partitioning-based Clustering for Web Document Categorization." Decision Support Systems, 27(3), 329-341. ISSN 0167-9236. doi:10.1016/S0167-9236(99)00055-X.
11. Cavnar W, Trenkle J (1994). "N-Gram-based Text Categorization." In "Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval," pp. 161-175. Las Vegas.
12. Chambers J (1998). Programming with Data. Springer-Verlag, New York.
13. Cristianini N, Shawe-Taylor J (2000). An Introduction to Support Vector Machines (and Other Kernel-based Learning Methods). Cambridge University Press. ISBN 0 521 78019 5.
14. Cunningham H, Maynard D, Bontcheva K, Tablan V (2002). "GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications." In "Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics," Philadelphia.
15. Davi A, Haughton D, Nasr N, Shah G, Skaletsky M, Spack R (2005). "A Review of Two Text-Mining Packages: SAS TextMining and WordStat." The American Statistician, 59(1), 89-103.
16. Deerwester S, Dumais S, Furnas G, Landauer T, Harshman R (1990). "Indexing by Latent Semantic Analysis." Journal of the American Society for Information Science, 41(6), 391-407.
17. Dhillon I, Guan Y, Kulis B (2005). "A Unified View of Kernel k-Means, Spectral Clustering and Graph Partitioning." Technical report, University of Texas at Austin.
18. Dong QW, Wang XL, Lin L (2006). "Application of Latent Semantic Analysis to Protein Remote Homology Detection." Bioinformatics, 22(3), 285-290. ISSN 1367-4803. doi:10.1093/bioinformatics/bti801.
19. Feinerer I (2007a). openNLP: OpenNLP Interface. R package version 0.1, URL http://CRAN.R-project.org/package=openNLP.
20. Feinerer I (2007b). tm: Text Mining Package. R package version 0.3, URL http://CRAN.R-project.org/package=tm.
21. Feinerer I (2007c). wordnet: WordNet Interface. R package version 0.1, URL http://CRAN.R-project.org/package=wordnet.
22. Feinerer I, Hornik K (2007). "Text Mining of Supreme Administrative Court Jurisdictions." In C Preisach, H Burkhardt, L Schmidt-Thieme, R Decker (eds.), "Data Analysis, Machine Learning, and Applications (Proceedings of the 31st Annual Conference of the Gesellschaft für Klassifikation e.V., March 7-9, 2007, Freiburg, Germany)," Studies in Classification, Data Analysis, and Knowledge Organization. Springer-Verlag.
23. Feinerer I, Wild F (2007). "Automated Coding of Qualitative Interviews with Latent Semantic Analysis." In H Mayr, D Karagiannis (eds.), "Proceedings of the 6th International Conference on Information Systems Technology and its Applications, May 23-25, 2007, Kharkiv, Ukraine," volume 107 of Lecture Notes in Informatics, pp. 66-77. Gesellschaft für Informatik e.V., Bonn, Germany.
24. Fellbaum C (ed.) (1998). WordNet: An Electronic Lexical Database. Bradford Books. ISBN 0-262-06197-X.
25. Fowler M (2003). UML Distilled: A Brief Guide to the Standard Object Modeling Language. Addison Wesley Professional, third edition. ISBN 0321193687.
26. Gentleman R, Carey V, Huber W, Irizarry R, Dodoit S (eds.) (2005). Bioinformatics and Computational Biology Solutions Using R and Bioconductor. Springer-Verlag.
27. Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J (2004). "Bioconductor: Open Software Development for Computational Biology and Bioinformatics." Genome Biology, 5(10), R80.1-16. URL http://genomebiology.com/2004/5/10/R80.
28. Girón J, Ginebra J, Riba A (2005). "Bayesian Analysis of a Multinomial Sequence and Homogeneity of Literary Style." The American Statistician, 59(1), 19-30.
29. Hartigan J (1972). "Direct Clustering of a Data Matrix." Journal of the American Statistical Association, 67(337), 123-129.
30. Hartigan J (1975). Clustering Algorithms. John Wiley & Sons, Inc., New York.
31. Hartigan JA, Wong MA (1979). "Algorithm AS 136: A K-means Clustering Algorithm (AS R39: 81V30 P355-356)." Applied Statistics, 28, 100-108.
32. Hearst M (1999). "Untangling Text Data Mining." In "Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics," pp. 3-10. Association for Computational Linguistics, Morristown, NJ, USA. ISBN 1-55860-609-3.
33. Herbrich R (2002). Learning Kernel Classifiers Theory and Algorithms. Adaptive Computation and Machine Learning. The MIT Press.
34. Hettich S, Bay S (1999). "The UCI KDD Archive." URL http://kdd.ics.uci.edu/.
35. Holmes D, Kardos J (2003). "Who was the Author? An Introduction to Stylometry." Chance, 16(2), 5-8.
36. Hornik K (2005). "A CLUE for CLUster Ensembles." Journal of Statistical Software, 14(12). URL http://www.jstatsoft.org/v14/i12/.
37. Hornik K (2007a). clue: Cluster Ensembles. R package version 0.3-17, URL http://CRAN.R-project.org/package=clue.
38. Hornik K (2007b). Snowball: Snowball Stemmers. R package version 0.0-1.
39. Hornik K, Zeileis A, Hothorn T, Buchta C (2007). RWeka: An R Interface to Weka. R package version 0.3-9, URL http://CRAN.R-project.org/ package=RWeka.
40. Ingebrigtsen LM (2007). "Gmane: A Mailing List Archive." URL http://gmane.org/.
41. Joachims T (2002). Learning to Classify Text Using Support Vector Machines: Methods, Theory, and Algorithms. The Kluwer International Series In Engineerig And Computer Science. Kluwer Academic Publishers, Boston.
42. Johnson S (1967). "Hierarchical Clustering Schemes." Psychometrika, 2, 241-254.
43. Karatzoglou A, Feinerer I (2007). "Text Clustering with String Kernels in R." In R Decker, HJ Lenz (eds.), "Advances in Data Analysis (Proceedings of the 30th Annual Conference of the Gesellschaft für Klassifikation e.V., Freie Universität Berlin, March 8-10, 2006)," Studies in Classification, Data Analysis, and Knowledge Organization, pp. 91-98. Springer-Verlag.
44. Karatzoglou A, Smola A, Hornik K, Zeileis A (2004). "kernlab - An S4 Package for Kernel Methods in R." Journal of Statistical Software, 11(9). URL http://www.jstatsoft.org/v11/i09/.
45. Karatzoglou A, Smola A, Hornik K, Zeileis A (2006). kernlab: Kernel Methods Lab. R package version 0.8-1, URL http://CRAN.R-project. org/package=kernlab.
46. Landauer T, Foltz P, Laham D (1998). "An Introduction to Latent Semantic Analysis." Discourse Processes, 25, 259-284.
47. Lewis D (1997). "Reuters-21578 Text Categorization Collection Distribution 1.0." URL http://kdd.ics.uci.edu/databases/reuters21578/ reuters21578.html.
48. Lewis D, Yang Y, Rose T, Li F (2004). "RCV1: A New Benchmark Collection for Text Categorization Research." Journal of Machine Learning Research, 5, 361-397.
49. Y, Shawe-Taylor J (2007). "Using KCCA for Japanese-English Cross-Language Information Retrieval and Classification." Journal of Intelligent Information Systems. URL http://eprints.ees.soton.ac.uk/10786/.
50. Lodhi H, Saunders C, Shawe-Taylor J, Cristianini N, Watkins C (2002). "Text Classification Using String Kernels." Journal of Machine Learning Research, 2, 419-444.
51. MacQueen J (1967). "Some Methods for Classification and Analysis of Multivariate Observations." In "Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability," volume 1, pp. 281-297. University of California Press, Berkeley.
52. Manola F, Miller E (2004). RDF Primer. World Wide Web Consortium. URL http://www.w3.org/TR/rdf-primer/.
53. McCallum AK (1996). "Bow: A Toolkit for Statistical Language Modeling, Text Retrieval, Classification and Clustering." http://www.cs.cmu.edu/~mccallum/bow/.
54. Meyer D, Buchta C (2007). proxy: Distance and Similarity Measures. R package version 0.2, URL http://CRAN. R-project.org/package= proxy.
55. Mierswa I, Wurst M, Klinkenberg R, Scholz M, Euler T (2006). "YALE: Rapid Prototyping for Complex Data Mining Tasks." In "KDD '06: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining," pp. 935-940. ACM Press, New York, NY, USA. ISBN 1-59593-339-5. doi: 10.1145/1150402.1150531.
56. Miller TW (2005). Data and Text Mining. Pearson Education International.
57. Mitchell M, Santorini B, Marcinkiewicz MA (1993). "Building a Large Annotated Corpus of English: The Penn Treebank." Computational Linguistics, 19(2), 313-330. URL ftp://ftp.cis.upenn.edu/pub/ treebank/doc/c193.ps.gz.
58. Mueller JP (2006). "ttda: Tools for Textual Data Analysis." R package version 0.1.1, URL http://wwwpeople.unil.ch/jean- pierre.mueller/.
59. Naso PO (2007). "Gutenberg Project." URL http://www.gutenberg. org/.
60. Ng A, Jordan M, Weiss Y (2002). "On Spectral Clustering: Analysis and an Algorithm." In T Dietterich, S Becker, Z Ghahramani (eds.), "Advances in Neural Information Processing Systems," volume 14.
61. Nilo J, Binongo G (2003). "Who Wrote the 15th Book of Oz? An Application of Multivariate Analysis to Authorship Attribution." Chance, 16(2), 9-17.
62. Peng RD (2006). "Interacting with Data Using the Filehash Package." R News, 6(4), 19-24. URL http://CRAN.R-project.org/ doc/Rnews/.
63. Piatetsky-Shapiro G (2005). "Poll on Text Mining Tools Used in 2004." Checked on 2006-09-17, URL http://www.kdnuggets.com/polls/2005/ text_mining_tools.htm.
64. Porter M (1997). "An Algorithm for Suffix Stripping." Readings in Information Retrieval, pp. 313-316. Reprint.
65. R Development Core Team (2007). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.
66. Radlinski F, Joachims T (2007). "Active Exploration for Learning Rankings from Click-through Data." In "Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining," pp. 570-579. ACM, New York, NY, USA. doi:10.1145/1281192.1281254.
67. Sakurai S, Suyama A (2005). "An E-mail Analysis Method Based on Text Mining Techniques." Applied Soft Computing, 6(1), 62-71. doi : 10.1016/j.asoc.2004.10.007.
68. Schölkopf B, Smola A (2002). Learning with Kernels. MIT Press.
69. Sebastiani F (2002). "Machine Learning in Automated Text Categorization." ACM Computing Surveys, 34(1), 1-47. ISSN 0360-0300. doi: 10.1145/505282.505283.
70. Shawe-Taylor J, Cristianini N (2004). Kernel Methods for Pattern Analysis. Cambridge University Press. ISBN 0 521 81397 2.
71. Sibun P, Reynar J (1996). "Language Identification: Examining the Issues." In "Proceedings of SDAIR-96, 5th Symposium on Document Analysis and Information Retrieval," pp. 125-135. Las Vegas.
72. Sonnenburg S, Raetsch G, Schaefer C, Schoelkopf B (2006). "Large Scale Multiple Kernel Learning." Journal of Machine Learning Research, 7, 1531-1565.
73. Steinbach M, Karypis G, Kumar V (2000). "A Comparison of Document Clustering Techniques." In "KDD Workshop on Text Mining," URL http://www.cs.cmu.edu/~dunja/PapersWshKDD2000.html.
74. Strehl A, Ghosh J, Mooney RJ (2000). "Impact of Similarity Measures on Web-page Clustering." In "Proc. AAAI Workshop on AI for Web Search (AAAI 2000), Austin," pp. 58-64. AAAI/MIT Press. ISBN 1-57735-116-9. URL http://strehl.com/download/strehl-aaai00.pdf.
75. Temple Lang D (2004). Rstem: Interface to Snowball Implementation of Porter's Word Stemming Algorithm. R package version 0.2-0, URL http://www.omegahat.org/Rstem/.
76. Temple Lang D (2006). XML: Tools for Parsing and Generating XML within R and S-Plus. R package version 0.99-8, URL http://CRAN.R-project.org/package=XML.
77. Teo C, Vishwanathan S (2006). "Fast and Space Efficient String Kernels Using Suffix Arrays." In "Proceedings of the 23rd International Conference on Machine Learning," URL http://www.icml2006.org/ icml_documents/camera-ready/117_Fast_and_Space_Effic.pdf.
78. Venables WN, Ripley BD (2002). Modern Applied Statistics with S. Springer-Verlag, New York, fourth edition. ISBN 0-387-95457-0, URL http://www.stats.ox.ac.uk/pub/MASS4/.
79. Vishwanathan S, Smola A (2004). "Fast Kernels for String and Tree Matching." In K Tsuda, B Schölkopf, J Vert (eds.), "Kernels and Bioinformatics," MIT Press, Cambridge, MA.
80. Watkins C (2000). "Dynamic Alignment Kernels." In A Smola, P Bartlett, B Schölkopf, D Schuurmans (eds.), "Advances in Large Margin Classifiers," pp. 39-50. MIT Press, Cambridge, MA.
81. Weiss S, Indurkhya N, Zhang T, Damerau F (2004). Text Mining: Predictive Methods for Analyzing Unstructured Information. Springer-Verlag. ISBN 0387954333.
82. Wild F (2005). Isa: Latent Semantic Analysis. R package version 0.57, URL http://CRAN.R-project.org/package=lsa.
83. Witten I, Frank E (2005). Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, San Francisco, second edition.
84. Witten IH, Paynter GW, Frank E, Gutwin C, Nevill-Manning CG (2005). "Kea: Practical automatic keyphrase extraction." In YL Theng, S Foo (eds.), "Design and Usability of Digital Libraries: Case Studies in the Asia Pacific," pp. 129-152. Information Science Publishing, London.
85. Wu YF, Chen X (2005). "eLearning Assessment through Textual Analysis of Class Discussions." In "Fifth IEEE International Conference on Advanced Learning Technologies," pp. 388-390. doi:10.1109/ICALT.2005.132.
86. Zhao Y, Karypis G (2004). "Empirical and Theoretical Comparisons of Selected Criterion Functions for Document Clustering." Machine Learning, 55(3), 311-331. ISSN 0885-6125. doi:10.1023/B:MACH. 0000027785.44527.d6.
87. Zhao Y, Karypis G (2005a). "Hierarchical Clustering Algorithms for Document Datasets." Data Mining and Knowledge Discovery, 10(2), 141-168.
88. Zhao Y, Karypis G (2005b). "Topic-driven Clustering for Document Datasets." In "Proceedings of the 2005 SIAM International Conference on Data Mining (SDM05)," pp. 358-369.