Probabilistic based recursive model for adaptive processing of data structures

Expert Systems with Applications

Volumn 34, Issue 2, 2008, Pages 1403-1422

  Cho, Siu Yeung ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Adaptive processing of data structures; Expectation maximization algorithm; Gaussian mixture model; Levenberg Marquardt algorithm; Probabilistic recursive model

Indexed keywords

INTERNET; OPTIMIZATION; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS;

ADAPTIVE PROCESSING OF DATA STRUCTURES; GAUSSIAN MIXTURE MODEL; PROBABILISTIC RECURSIVE MODEL; SEMANTIC STRUCTURES;

DATA STRUCTURES;

EID: 36148989601     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.01.021     Document Type: Article

References (51)

1. Bengio Y., and Frasconi P. Input-output HMMs for sequence processing. IEEE Transactions on Neural Networks 7 September (1996) 1231-1249
2. Bengio Y., Simard P., and Frasconi P. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks 5 March (1994) 157-166
3. Bennet, K. P., & Mangasarian, O. L. (1992). Neural network programming via linear programming. In P. M. Parlados (Ed.), Advances in optimization and parallel computing (pp. 56-57).
4. Bianucci A.M., Micheli A., Sperduti A., and Starita A. Application of cascade correlation networks for structures to chemistry. Journal of Applied Intelligence 12 (2000) 117-146
5. Cho S.Y., and Chi Z. Genetic Evolution Processing of Data Structures for Image Classification. IEEE Transactions on Knowledge and Data Engineering 17 2 (2005) 216-231
6. Cho S.Y., Chi Z., Siu W.C., and Tsoi A.C. An improved algorithm for learning long-term dependency problems in Adaptive processing of data structures. IEEE Transactions on Neural Networks 14 4 (2003) 781-793
7. Cho S.Y., and Chow T.W.S. A layer-by-layer least squares based recurrent networks: Stalling and escape. Neural Processing Letter 7 1 (1998) 15-25
8. Clark P., and Niblett T. Induction in noisy domains. In: Bratko I., and Lavrac N. (Eds). Progress in machine learning (1987), Sigma Press 11-30
9. Clark P., and Niblett T. The CN2 Induction Algorithm. Machine Learning 3 4 (1989) 261-283
10. Costa F., Frasconi P., Lombardo V., and Soda G. Towards incremental parsing for natural language using recursive neural networks. Applied Intelligence 19 1-2 (2003) 9-25
11. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society, Series B 39 1 (1977) 1-38
12. Deng Y., and Manjunath B.S. Unsupervised Segmentation of Color-Texture Regions in Images and Video. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 8 (2001)
13. Downs J., Harrison R.F., and Cross S.S. A Decision Support Tool for the Diagnosis of Breast Cancer Based Upon Fuzzy ARTMAP. Neural Computing and Applications 7 2 (1998) 147-165
14. Fracesoni E., Frasconi P., Gori M., Marinai S., Sheng J.Q., Soda G., et al. Logo recognition by recursive neural networks. In: Kasturi R., and Tombre K. (Eds). Graphics recognition - algorithms and systems. Lecture notes in computer science Vol. 1389 (1997), Springer-Verlag, New York 104-117
15. Frasconi P., Gori M., Kuchler A., and Sperduti A. From sequences to data structures: Theory and applications. In: Kolen J., and Kremer S. (Eds). A field guide to dynamical recurrent networks (2001), IEEE Press, New York 351-374
16. Frasconi P., Gori M., and Sperduti A. A general framework for adaptive processing of data structures. IEEE Transactions on Neural Networks 9 September (1998) 768-785
17. Giles C.L., and Gori M. Adaptive processing of sequences and data structures (1998), Springer-Verlag, New York
18. Goller, C., & Kuchler, A. (1996). Learning task-dependent distributed representations by back-propagation through structures. In Proceedings of the IEEE international conference on neural networks (pp. 347-352).
19. Goller, C., Gori, M., & Maggini, M. (1999). Feature extraction from data structures with unsupervised recursive neural networks. In Proceedings of the international joint conference on neural networks, Washington, DC (pp. 425-432).
20. Gori M., and Tesi A. On the problem of local minima in backpropagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 14 January (1992) 76-86
21. Hagan M.T., and Menhaj M.B. Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks 5 6 (1994) 989-993
22. Hagenbuchner M., and Tsoi A.C. A Self-Organizing Map for Adaptive Processing of Structured Data. IEEE Transactions on Neural Networks 14 3 (2003) 491-505
23. Hammer B. Learning with recurrent neural networks. Springer lecture notes in control and information sciences Vol. 254 (2000), Springer-Verlag, New York
24. Hammer, B., & Sperschnedier, V. (1997). Neural networks can approximate mappings on structured objects. Presented at the Proceedings of the 2nd international conference on computational intelligence neuroscience.
25. Hammer B., Micheli A., Sperduti A., and Strickert M. A general framework for unsupervised processing of structured data. Neurocomputing 57 (2004) 3-35
26. Hochreiter S., and Schmidhuber J. Long short-term memory. Neural Computation 9 8 (1997) 1735-1780
27. Hornik K., Stinchcombe M., and White H. Multilayer feedforward network are universal approximation. Neural Networks 2 (1989) 359-366
28. Kermani, B. G., White, M. W., & Nagle, H. T. (1995). Feature extraction for genetic algorithms in neural networks for breast cancer classification. In Proceedings of the 1995 IEEE engineering in medicine and biology international conference (pp. 831-832).
29. Kohonen T. Self-organizing maps. Springer series in information sciences Vol. 30 (1995), Springer, Berlin
30. Kung S.Y., and Taur J.S. Decision-based neural networks with signal/image classification applications. IEEE Transactions on Neural Networks 6 January (1995) 170-181
31. Lin, S. H., Kung, S. Y., & Lin, L. J. (1997). Face recognition/detection by probabilistic decision-based neural network. IEEE Transactions on Neural Networks. Special Issue on Biometric Identification, 8(1), 114-132.
32. Li J., and Wang J.Z. Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 (2003) 1075-1087
33. Mak M.W., and Kung S.Y. Estimation of elliptical basis function parameters by the EM algorithms with application to speaker verification. IEEE Transactions on Neural Networks 11 4 (2000) 961-969
34. Mangasarian O.L., Street W.N., and Wolberg W.H. Breast Cancer Diagnosis and prognosis via linear programming. Operations Research 43 4 (1995) 570-577
35. Meesad, P. (2001). Quantitative measures of a fuzzy expert system. Final Report IEEE NNC Student Summer Research, Intelligent Systems and Control Laboratory, Electrical and Computer Engineering, Oklahoma State University.
36. Michalski R., Mozetic I., Hong J., and Lavrac N. The multi-purpose incremental learning system AQ15 and its testing applications to three medical domains. Proceedings of the fifth national conference on artificial intelligence (1986), Morgan Kaufmann, Philadelphia, PA 1041-1045
37. Ng S.-K., and McLachlan G.J. Using the EM algorithm to train neural networks: Misconceptions and a new algorithm for multiclass classification. IEEE Transactions on Neural Networks 15 3 (2004) 738-749
38. Pollack J.B. Recursive distributed representations. Artificial Intelligence 46 1-2 (1990) 77-106
39. Roberts S., and Tarassenko L. A probabilistic resource allocating network for novelty detection. Neural Computation 6 (1994) 270-284
40. Rumelhart D.E., and McClelland J.L. Parallel distributed processing: Explorations in the microstructure of cognition (1986), MIT Press, Cambrigde, MA
41. Salembier P. Binary partition trees as an efficient representation for image processing, segmentation, and information retrieval. IEEE Transactions on Image Processing 9 April (2000) 561-576
42. Sentiono R. Extracting Rules from Pruned Neural Networks for Breast Cancer Diagnosis. IEEE Transactions on Neural Networks 13 3 (1996) 564-577
43. Sperduti A., and Starita A. Supervised neural networks for classification of structures. IEEE Transactions on Neural Networks 8 May (1997) 714-735
44. Streit D.F., and Luginbuhl T.E. Maximum likelihood training of probabilistic neural networks. IEEE Transactions on Neural Networks 5 5 (1994) 764-783
45. Tsai H.L., and Lee S.-J. Entropy-Based Generation of Supervised Neural Networks for Classification of Structured Patterns. IEEE Transactions on Neural Networks 15 2 (2004) 283-297
46. Tsoi, A. C. (1998). Adaptive processing of data structure: An expository overview and comments. Technical report in Faculty Informatics. Wollongong, Australia: University of Wollongong.
47. Tsoi A.C. Gradient based learning methods. In: Giles C.L., and Gori M. (Eds). Adaptive processing of sequences and data structures (1998), Springer-Verlag, New York 27-62
48. Voegtlin T. Context quantization and contextual self-organizing maps. Proceedings of the international joint conference on neural networks Vol. VI (2000) 20-25
49. Wolberg W.H., Street W.N., Heisey D.M., and Mangasarian O.L. Computerized breast cancer diagnosis and prognosis from fine needle aspirates. Archives of Surgery 130 (1995) 511-516
50. Wu S., and Chow T.W.S. PRSOM: A new visualization method by hybridizing multidimensional scaling and self-organizing map. IEEE Transactions on Neural Networks 16 6 (2005) 1362-1380
51. Yin H. ViSOM: A novel method for multivariate data projection and structure visualization. IEEE Transactions on Neural Networks 13 1 (2002) 237-243