Optimising the hystereses of a two context layer RNN for text classification

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 2936-2941

  Arevian, Garen ^b   Panchev, Christo ^a,b  

^a IEEE

^b UNIVERSITY OF SUNDERLAND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUTOMATIC INDEXING; CHEMICAL ACTIVATION; CLASSIFICATION (OF INFORMATION); COMPUTER NETWORKS; ELASTICITY; HYSTERESIS; INFORMATION SERVICES; LEARNING SYSTEMS; SEARCH ENGINES;

JOINT CONFERENCE; REUTERS-21578 CORPUS;

NEURAL NETWORKS;

EID: 51749087051     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4371427     Document Type: Conference Paper

References (40)

1. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
2. K. Nigam, A. K. Mccallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using em," Machine Learning, vol. 39, no. 2/3, p. 103, 2000.
3. T. Joachims, Learning to Classify Text Using Support Vector Machines. Boston: Kluwer Academic Publishers, 2002.
4. J. L. Elman, "Representation and structure in connectionist models," University of California, San Diego, CA, Tech. Rep. CRL 8903, 1989.
5. S. C. Kremer, "On the computational power of elman-style recurrent networks," IEEE Transactions on Neural Networks, vol. 6, no. 4, pp. 1000-1004, July 1995.
6. T. Kohonen, Self-Organizing Maps. Berlin: Springer, 1995.
7. S. Kaski, T. Honkela, K. Lagus, and T. Kohonen, "WEBSOM - self-organizing maps of document collections," Neurocomputing, vol. 21, pp. 101-117, 1998.
8. S. Wermter, C. Panchev, and G. Arevian, "Hybrid neural plausibility networks for news agents," in Proceedings of the National Conference on Artificial Intelligence, Orlando, USA, 1999, pp. 93-98.
9. J. Wiles and J. Elman, "Learning to count without a counter: A case study of dynamics and activation landscapes in recurrent networks," 1995. [Online]. Available: citeseer.ifi.unizh.ch/wiles95learning.html
10. J. Wiles and B. Tonkes, "On the ability of recurrent nets to learn deeply embedded structures," May 28 1999. [Online]. Available: http://citeseer.ist.psu.edu/247451.html;http://www.neci.nec.com/~giles/IJCAI99/ papers/boden.ps
11. M. Bodén, H. Jacobsson, and T. Ziemke, "Evolving context-free language predictors," in GECCO, L. D. Whitley, D. E. Goldberg, E. Cantú-Paz, L. Spector, I. C. Parmee, and H.-G. Beyer, Eds. Morgan Kaufmann, 2000, pp. 1033-1040.
12. S. Wermter, Hybrid Connectionist Natural Language Processing. London, UK: Chapman and Hall, Thomson International, 1995.
13. S. Wermter, G. Arevian, and C. Panchev, "Recurrent neural network learning for text routing," in Proceedings of the International Conference on Artificial Neural Networks, Edinburgh, UK, 1999, pp. 898-903.
14. D. D. Lewis, "Reuters-21578 text categorization test collection," 1997, http://www.research.att.com/~lewis.
15. X. Shi, Y. Liang, and X. Xu, "An improved elman model and recurrent back-propagation control neural networks," Journal of Software, vol. 14, no. 6, pp. 1110-1119, 2003.
16. K. Kaikhah, "Text summarization using neural networks." Italy: WSEAS, 2004. [Online]. Available: http://www.worldses.org/online/
17. B. Q. Huang and T. Kechadi, "A recurrent neural network recogniser for online recognition of handwritten symbols," in ICEIS, C.-S. Chen, J. Filipe, I. Seruca, and J. Cordeiro, Eds., 2005, pp. 27-34.
18. C. L. Giles, S. Lawrence, and A. C. Tsoi, "Noisy time series prediction using a recurrent neural network and grammatical inference," Machine Learning, vol. 44, no. 1/2, pp. 161-183, July/August 2001.
19. J. L. Elman, "Finding structure in time," University of California, San Diego, CA, Tech. Rep. CRL 8901, 1988.
20. P. Frasconi, M. Gori, and G. Soda, "Local feedback multilayered networks," Neural Computation, vol. 4, no. 1, pp. 120-130, 1992.
21. S. Wermter, G. Arevian, and C. Panchev, "Network analysis in a neural learning internet agent," in Proceedings of the International Conference of Computational Intelligence and Neurosciences, Atlantic City, PA, USA, 2000, pp. 880-884.
22. G. Arevian, S. Wermter, and C. Panchev, "Symbolic state transducers and recurrent neural preference machines for text mining," International Journal of Approximate Reasoning, vol. 32, no. 2-3, pp. 237-258, 2003. [Online]. Available: http://dx.doi.org/10.1016/S0888-613X(02)00085-3
23. R. C. O'Reilly and Y. Munakata, Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain. MIT Press, 2000.
24. C. Koch and I. Segev, Methods in Neuronal Modelling. Cambridge, Massachusetts: MIT Press, 1989.
25. D. Johnston and S. Wu, Foundations of Cellular Neurophysiology. Cambridge, MA, USA: MIT-Press, 1995, hysteresis.
26. S. Grossberg, Neural networks and natural intelligence. Cambridge, MA: MIT Press, 1988.
27. C. Apté, F. J. Damerau, and S. M. Weiss, "Automated learning of decision rules for text categorization," ACM Transactions on Information Systems, vol. 12, no. 3, pp. 233-251, 1994.
28. G. Salton, A. Wong, and C. S. Yang, "A vector space model for automatic indexing," Communications of the ACM, vol. 18, no. 11, pp. 613-620, Nov. 1975.
29. G. Salton and M. J. McGill, Introduction to Modern Information Retrieval. McGraw-Hill, NY, 1983.
30. G. Salton, Automatic Text Processing: The Transformation, Analysis and Retrieval of Information by Computer. Addison Wesley, 1989.
31. R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. Addison-Wesley, 1999. [Online]. Available: http://sunsite.dcc.uchile.cl/irbook
32. D. Jurafsky and J. Martin, Speech and Language Processing. Prentice Hall, 2000.
33. C. J. V. Rijsbergen, Information Retrieval. London: Butterworths, 1979.
34. D. D. Lewis and W. A. Gale, "A sequential algorithm for training text classifiers," 1994.
35. W. G. Baxt and H. White, "Bootstrapping confidence intervals for clinical input variable effects in a network trained to identify the presence of acute myocardial infarction," Neural Computation, vol. 7, no. 3, pp. 624-638, 1995.
36. R. Tibshirani, "A comparison of some error estimates for neural networks," Neural Computation, vol. 8, pp. 152-163, 1996.
37. S. M. Weiss and C. A. Kulikowski, Computer Systems That Learn, Classification and Prediction Methods from Statistics, Neural Networks, Machine Learning and Expert Systems. San Mateo, CA: Morgan Kaufmann, 1991.
38. F. Sebastiani, "Machine learning in automated text categorization," ACM Comput. Surv., vol. 34, no. 1, pp. 1-47, 2002.
39. K. M. Schneider, "A new feature selection score for multinomial naive bayes text classification based on KL-divergence," June 29 2004. [Online]. Available: http://citeseer.ist.psu.edu/673099.html;http://www.phil. uni-passau.de/linguistik/mitarbeiter/schneider/pub/acl2004.ps.gz
40. B. Wang and S. Zhang, "A novel text classification algorithm based on naïve bayes and KL-divergence," in PDCAT. IEEE Computer Society, 2005, pp. 913-915. [Online]. Available: http: //doi. ieeecomputersociety.org/10.1109/PDCAT.2005.36