Static and dynamic neural networks: From fundamentals to advanced theory

Static and Dynamic Neural Networks: From Fundamentals to Advanced Theory

Volumn , Issue , 2005, Pages 1-722

  Gupta, Madan M ^a   Jin, Liang ^b   Homma, Noriyasu ^a   Zadeh, Lotfi A ^c  

^a UNIVERSITY OF SASKATCHEWAN   (Canada)

^b AGERE SYSTEMS   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COGNITIVE SYSTEMS;

DYNAMIC NEURAL NETWORKS;

NEURAL NETWORKS;

EID: 52249122452     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/0471427950     Document Type: Book

References (323)

1. Al-Holou, N., Lahdhiri, T., Sung, J. D., Weaver, J., and Al-Abbas, F. (2002). “Sliding Mode Neural Network Inference Fuzzy Logic Control for Active Suspension Systems,” IEEE Trans. Fuzzy Syst., Vol. 10, No. 2, pp. 234-246.
2. Abu-Mostafa, Y. and Jacques, J. St. (1985). “Information Capacity of the Hopfield Model,” IEEE Trans. Inf. Theory, Vol. 7, pp. 1-11.
3. Alahakoon, L. D., Halgamuge, S. K. and Srinivasan, B. (2000). “Dynamic Self Organizing Maps with Controlled Growth for Knowledge Discovery,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 601-614.
4. Amari, S. and Arbib, M. A. (eds.) (1982). “Competition and Cooperation in Neural Nets,” Lecture Notes in Biomathematics, Springer-Verlag, New York, Vol. 45.
5. Amit, D. J. (1989). Modeling Brain Function: The World of Attractor Neural Networks, Cambridge Univ. Press, Cambridge, UK.
6. Anderberg, M. R. (1973). Cluster Analysis for Applications, Academic Press, New York.
7. Anderson, D. (ed.) (1988). Neural Information Processing Systems, American Institute of Physics, New York.
8. Aonishi, T. and Kurata, K. (2000). “Extension of Dynamic Link Matching by Introducing Local Linear Maps,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 817-822.
9. Arbib, M. A. (1987). Brains, Machines and Mathematics, 2nd ed., Springer-Verlag, New York.
10. Asari, V. K. (2001). “Training of a Feedforward Multiple-Valued Neural Network by Error Backpropagation with a Multilevel Threshold Function,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1519-1520.
11. Atiya, A. and Parlos, A. (2000). “New Results on Recurrent Network Training: Unifying the Algorithms and Accelerating Convergence,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 697-709.
12. Avitabile, G., Forti, M., Manetti, S., and Marini, M. (1992). “On a Class of Nonsymmetrical Neural Networks with Application to ADC,” IEEE Trans. Circuits Syst., Vol. 38, No. 2, (Feb.), pp. 202-209.
13. Azimi-Sadjadi, M. R., Yao, D., Huang, Q., and Dobeck, G. J. (2000). “Underwater Target Classification Using Wavelet Packets and Neural Networks,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 784-794.
14. Bargiela, A. (2000). “Operational Decision Support through Confidence Limits Analysis and Pattern Classification,” Plenary Lecture, 5th Int. Conf. Computer Simulation and AI, Mexico, Feb.
15. Barmann, F. and Biegler-Konig, F. (1992). “On a Class of Efficient Learning Algorithms for Neural Networks,” Neural Networks, Vol. 5, pp. 139-144.
16. Battiti, R. (1992). “First and Second-Order Methods for Learning: Between Steepest Descent and Newton’s Method,” Neural Comput., Vol. 4, pp. 141-166.
17. Battiti, R. and Masulli F. (1990). “BFGS Optimization for Faster and Automated Supervised Learning,” Pioc.INCC 90 Paris, Int. Neural Network Conf., pp. 757-760, Kluwer, Dordrecht, Germany.
18. Bellman, R. E. and Zadeh, L. A. (1977). “Local and Fuzzy Logics,” in Modern Uses of Multiple-Valued Logic, Dunn, J. M. and Epstein, G. (eds.), Reidel, Dordrecht, Netherlands, pp. 103-165.
19. Bengio, S. and Bengio, Y. (2000). “Taking on the Curse of Dimensionality in Joint Distribution Using Neural Networks,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 550-557.
20. Bianchini, M., Gori, M., and Scarselli, F. (2001a). “Theoretical Properties of Recursive Networks with Linear Neurons,” IEEE Trans. Neural Networks, Vol. 12, No. 5, pp. 953-967.
21. Bianchini, M., Gori, M., and Scarselli, F. (2001b). “Processing Directed Acyclic Graphs with Recursive Neural Networks,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1464-1470.
22. Blum, E. K. and Li, L. K. (1991). “Approximation Theory and Feedforward Networks,” Neural Networks, Vol. 4, No. 4, pp. 511-515.
23. Brown, B. D. and Card, H. C. (2001). “Stochastic Neural Computation I and II,” IEEE Trans. Comput., Vol. 59 (Sept.).
24. Brack, J. (1990b). “On the Convergence Properties of the Hopfield Model,” Proc. IEEE, Vol. 78, No. 10, pp. 1579-1585.
25. Bryson, A. E. and Ho, Y.-C. (1969). Applied Optimal Control, Blaisdell.
26. Buckley, J. J. and Hayashi, Y. (1993a). “Numerical Relationships between Neural Networks, Continuous Functions and Fuzzy Systems,” Fuzzy Sets Syst., Vol. 60, pp. 1-8.
27. Buckley, J. J. and Hayashi, Y. (1993b). “Hybrid Neural Nets can be Fuzzy Controllers and Fuzzy Expert Systems,” Fuzzy Sets Syst, Vol. 60, pp. 135-142.
28. Buckley, J. J. and Hayashi, Y. (1993c). “Can Fuzzy Neural Nets Approximate Continuous Fuzzy Functions,” Fuzzy Sets Syst., Vol. 61, pp. 43-52.
29. Buckley, J. J. and Hayashi, Y. (1994a). “Fuzzy Genetic Algorithm and Applications” Fuzzy Sets Syst., Vol. 61, pp. 129-136.
30. Buckley, J. J. and Hayashi, Y. (1994b). “Fuzzy Neural Networks: A Survey,” Fuzzy Sets Syst., Vol. 66, No. 1, pp. 1-13.
31. Buntine, W. and Weigend, A. S. (1994). “Computing Second Derivatives in Feed-forward Networks: A Review,” IEEE Trans. Neural Networks, Vol. 5, No. 3, pp. 480-88.
32. Burrascano, P. (1991). “A Norm Selection Criterion for the Generalized Delta Rule,” IEEE Trans. Neural Networks, Vol. 2, No. 1, pp. 125-130.
33. Cabrelli, C, Molter, U., and Shonkwiler, R. (2000). “A Constructive Algorithm to Solve ‘Convex Recursive Deletion’ (CoRD) Classification Problems via Two-Layer Perceptron Networks,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 811-816.
34. Card, H. C. (2001). “Compound Binomial Processes in Neural Integration,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1505-1512.
35. Carroll, B. W. and Dickinson, B. D. (1989). “Construction of Neural Net Using The Radon Transform,” Proc. Int. Joint Conf. Neural Networks, Vol. I, pp. 607-611.
36. Castro, J. L., Delgado, M., and Mantas, C. J. (2000). “SEPARATE: A Machine Learning Method Based on Semi-Global Partitions,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 710-720.
37. Chauvin, Y. (1989). “A Back-propagation Algorithm with Optimal Use of Hidden Units,” in Advances in Neural Information Processing Systems, Touretzky, D. S. (ed.), Vol. 1, Morgan Kaufmann, San Jose, CA.
38. Chen, K. and Wang, D. L. (2001). “Perceiving Geometric Patterns: From Spirals to Inside-Outside Relations by a Neural Oscillator Network,” IEEE Trans. Neural Networks, Vol. 12. pp. 1084-1102.
39. Chen, S., Cowan, C. F. N., and Grant, P. M. (1991). “Orthogonal Least Squares Learning Algorithm for Radial Basis Function Networks,” IEEE Trans. Neural Networks, Vol. 2 (Feb.), pp. 302-309.
40. Chen, S., Gunn, S. R., and Harris, C. J. (2000). “Decision Feedback Equalizer Design Using Support Vector Machines,” Proc. Inst. Elect. Eng. Vision, Image, Signal Processing, Vol. 147, No. 3, pp. 213-219.
41. Chen, S., Gunn, S. R., and Harris, C. J. (2001a). “The Relevance Vector Machine Technique for Channel Equalization Application,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1529-1531.
42. Chen, S., Samingan, A. K., and Hanzo, L. (2001b). “Support Vector Machine Multiuser Receiver for DS-CDMA Signals in Multipafh Channels,” IEEE Trans. Neural Networks, Vol. 12, pp. 604-611.
43. Chen, T. (2001). “Global Convergence of Delayed Dynamical Systems,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1532-1535.
44. Chen, T. P. and Amari, S. (2001a). “Exponential Convergence of Delayed Dynamical Systems?” Neural Comput., Vol. 13, No. 3, pp. 621-636.
45. Chen, T. P. and Amari, S. (2001b). “New Theorems on Global Convergence of Some Dynamical Systems,” Neural Networks, Vol. 14, No. 3. pp. 251-255.
46. Chen, T. P. and Amari, S. (2001c). “Stability of Asymmetric Hopfield Networks,” IEEE Trans. Neural Networks, Vol. 12, pp. 159-163.
47. Churchland, P. S. (1988). Neurophilosophy, MIT Press, Cambridge, MA.
48. Churchland, P. S. and Sejnowski, T. J. (1988). “Perspectives on Cognitive Neuroscience,” Science, Vol. 242, pp. 741-745.
49. Churchland, P. S. and Sejnowski, T. J. (1992). The Computational Brain, MIT Press, Cambridge, MA.
50. Cohen, M. A. and Grossberg, S. (1983). “Absolute Stability of Global Pattern Information and Parallel Memory Storage by Competitive Neural Networks,” IEEE Trans. Syst. Man Cybernet., Vol. 13, pp. 815-826
51. Cotter, N. (1990). ‘The Stone-Weierstrass Theorem and Its Application to Neural Networks,” IEEE Trans. Neural Networks, Vol. 1, No. 4, pp. 290-295.
52. Cristianini, N. and Shawe-Taylor, J. (2000). An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge Univ. Press, Cambridge, UK.
53. Cybenko, G. (1989). “Approximation by Superpositions of a Sigmoidal Function,” Math. Control Signal System, Vol. 2, No. 3, pp. 303-314.
54. Darken, C, Chang, J., and Moody, J. E. (1992). “Learning Rate Schedules for Faster Stochastic Gradient Search,” Proc. Neural Networks for Signal Processing 2.
55. Darken, C. and Moody, J. E. (1991). “Note on Learning Rate Schedules for Stochastic Optimization,” in Advances in Neural Information Processing Systems, Lippmann, R. P., Moody, J.E., and Touretzky, D. S. (eds.), Vol. 3, Morgan Kaufmann, San Mateo, CA, pp. 832-838.
56. Darken, C. and Moody, J. E. (1992). “Towards Faster Stochastic Gradient Search,” in Adcances in Neural Information Processing Systems, Morgan Kaufmann, San Mateo, CA, Vol. 4, pp. 1009-1016.
57. Dasgupta, S., Ghosh, A., and Cuykendall, R. (1989). “Convergence in Neural Memories (Corresp.),” IEEE Trans. Inform. Theory, Vol. 35, pp. 1069-1072.
58. Datta, A., Pal, S., and Pal, N. R. (2000). “A Connectionist Model for Convex-Hull of a Planar Set,” Neural Networks, Vol. 13, pp. 377-384.
59. Deco, G. and Schiirmann, B. (1997). “Dynamic Modelling Chaotic Time Series,” Computational Learning Theory and Neural Learning Systems, Vol. 4 of series, Making Learning Systems Practical, MIT Press, Cambridge, MA, Chapter 9, pp. 137-153.
60. Denker, J. S. (1986). “Neural Network Models of Learning and Adaptation,” Physica D, Vol. 22, pp. 216-232.
61. Ding, H. and Gupta, M. M. (2000). “Competitive and Cooperative Adaptive Reasoning with Fuzzy Causal Knowledge,” J. Intell. Fuzzy Syst., Vol. 3, No. 6, pp. 245-254.
62. Douglas, S. C. andMeng, T. H. Y. (1991). “Linearized Least-Squares Training of Multilayer Feedforward Neural Networks,” Proc. IEEE IJCNN, Vol. I, pp. 307-312, Seattle, WA, June.
63. Dubois, D. and Prade, H. (1980). Fuzzy Sets Syst.: Theory and Applications., Academic Press, Orlando, FL.
64. Eichfeld, H., Kunemund, T., and Menke, M. (1996). “A 12b General-Purpose Fuzzy Logic Controller Chip,” IEEE Trans. Fuzzy Syst, Vol. 4, No. 4, pp. 460-475.
65. Engelbrecht, A. P. (2001). “A New Pruning Heuristic Based on Variance Analysis of Sensitivity Information,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1386-1399.
66. Fernandez de Canete, J., Barreiro, A., Garcia-Cerezo, A., and Garcia-Moral, I. (2001). “An Input-Output Based Robust Stabilization Criterion for Neural-Network Control of Nonlinear Systems,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1491-1497.
67. Floréen, P. (1991). “Worst-Case Convergence Times for Hopfield Memories,” IEEE Trans. Neural Networks, Vol. 2, No. 5, pp. 533-535.
68. Fogelman-Soulie, E, Gallinari, P., LeCun, Y., and Thiria, S. (1987). “Automata Networks and Artificial Intelligence,” in Automata Networks in Computer Science: Theory and Applications, Princeton Univ. Press, pp. 133-186.
69. Franco, L. and Cannas, S. A. (2001). “Generalization Properties of Modular Networks: Implementing the Parity Function,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1306-1313.
70. Fu, H. C, Lee, Y P., Chiang, C. C, and Pao, H. T. (2001). “Divide-and-Conquer Learning and Modular Perceptron Networks,” IEEE Trans. Neural Networks, Vol. 12, pp. 250-263.
71. Fu, L. M. and Shortliffe, E. H. (2000). “The Application of Certainty Factors to Neural Computing for Rule Discovery,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 647-657.
72. Fujimori, A., Nikiforuk, P. N., and Gupta, M. M. (2001a). “A Flight Control Design of a Re-Entry Vehicle Using a Double-Loop Control System with Fuzzy Gain Scheduling,” Proc. Inst. Mech. Engineers, Vol. 215, Part G, pp. 1-12.
73. Fujimori, A., Teramoto, M., Nikiforuk, P. N., and Gupta, M. M. (2001b). “Cooperative Collision Avoidance between Multiple Mobile Robots,” J. Robotic Syst., Vol. 17, No. 7, pp. 347-363.
74. Funahashi, K. (1989). “On the Approximate Realization of Continuous Mappings by Neural Networks,” Vol. 2, No. 3, pp. 183-192.
75. Gabrys, B. and Bargiela, A. (2000). “General Fuzzy Min-Max Neural Network for Clustering and Classification,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 769-783.
76. Gallant, A. R. and White, H. (1988). “There Exists a Neural Network that Do Not Make Avoidable Mistakes,” Proc. IEEE Conf Neural Networks, San Diego, Vol. 1, pp. 657-664.
77. Gers, F. A. and Schmidhuber, J. (2000). “Recurrent Nets that Time and Count,” Proc. Int. Joint Conf. Neural Networks, Como, Italy.
78. Gers, F. A. and Schmidhuber, J. (2001). “LSTM Recurrent Networks Learn Simple Context-Free and Context-Sensitive Languages,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1333-1380.
79. Gers, F. A., Schmidhuber, J. and Cummins, F. (2000). “Learning to Forget: Continual Prediction with LSTM,” Neural Comput., Vol. 12, No. 10, pp. 2451-2471.
80. Gerschgorin, S. (1931). “Uber die Abgrenzung der Eigenwerte Einer Matrix,” Izv. Akad. NaukSSSR, Ser. fiz.-mat., Vol. 6, pp. 749-754.
81. Giles, C. L. and Maxwell, T. (1987). “Learning Invariance, and Generalization in Higher-Order Networks,” Appl. Optics, Vol. 26, pp. 4972-4978.
82. Girolami, M. (2001). “The Topographic Organization and Visualization of Binary Data Using Multivariate-Bernoulli Latent Variable Models,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1367-1374.
83. Goles, E. (1986). “Antisymmetric Neural Networks,” Discrete Appl. Math., Vol. 13, pp. 97-100.
84. Goles, E” Fogelman, F., and Pellegrin, D. (1985). “Decreasing Energy Functions as a Tool for Studying Threshold Networks,” Discrete Appl. Math., Vol. 12, pp. 261-277.
85. Gori, M., Maggini, M., Martinelli, E., and Scarselli, F. (2000). “Learning User Profiles in NAUTILUS,” Proc. Int. Conf. Adaptive Hypermedia Adaptive Web-Based Systems-Lecture Notes Compututational Science, 1892, Trento, Italy.
86. Grossberg, S. (1990). “Content-addressable Memory Storage by Neural Networks: A General Model and Global Lyapunov Method,” in Computational Neuroscience, Schwartz, E. L. (ed.), MIT Press, Cambridge, MA, pp. 56-68.
87. Guez, A., Protopopsecu, V, and Bahren, J. (1988). “On the Stability, Storage Capacity, and Design of Continuous Nonlinear Neural Networks,” IEEE Trans. Syst. Man Cybernet., Vol. 18, No. 1, pp. 80-87.
88. Gupta, M. M. (1994). “Fuzzy Logic and Neural Networks,” in Neuro Control, Gupta, M. M. and Rao, D. H. (eds.), IEEE Press, New York, pp. 403-116.
89. Gupta, M. M. (2001). “Fuzzy Sets, Fuzzy Logic and Fuzzy Systems,” in Encyclopedia of Physical Science and Technology, Meyer, R. A. (ed.), Academic Press, San Diego.
90. Gupta, M. M. and Knopf, G. K. (1992). “A Multitask Visual Information Processor with a Biologically Motivated Design,” J. Visual Commun. Image Represent., Vol. 3. No. 3 (Sept.), pp. 230-246.
91. Gupta, M. M. and Knopf, G. K. (eds.) (1994). Neuro-Vision Systems: Principles and Applications, a volume of selected reprints, IEEE Neural Networks Council, IEEE Press, New York.
92. Gupta, M.M. and Qi, J. (1991). “On Fuzzy Neuron Models,” Proc. 1991 IJCNN, Vol. 1, July, pp. 431-56.
93. Gupta, M. M. and Qi, J. (1992a). “On Fuzzy Neuron Models,” in Fuzzy Logic for the Management of Uncertainty, Zadeh, L. and Kacprzyk, J. (eds.), Wiley, New York, pp. 479-491.
94. Gupta, M. M. and Qi, J. (1992b). “Theory of T Nouns and Fuzzy Inference Method,” Fuzzy Sets Syst., Vol. 40, pp. 431-50.
95. Gupta, M. M., Ragade, R. K., and Yager, R. R. (eds.) (1979). Advances in Fuzzy Set Theory and Applications, North-Holland Publishing, Oct.
96. Gupta, M. M. and Rao, D. H. (eds.) (1994a). Neuro-Control Systems: Theory and Applications, a volume of selected reprints, IEEE Neural Networks Council, IEEE Press, New York.
97. Gupta, M. M. and Rao, D. H. (1994b). “On the Principles of Fuzzy Neural Networks,” Fuzzy Sets Syst., Vol. 61, No. 1, pp. 1-18.
98. Gupta, M. M. and Sinha, N. K. (eds.) (1995). Intelligent Control Systems: Theory and Applications, a volume of 29 invited chapters, Sponsor: IEEE Neural Networks Council and Co-sponsor: IEEE Control Systems Society, IEEE Press, New York (Revised 2nd ed., 1997).
99. Gupta, M. M. and Yamakawa, T. (eds.) (1988a). Fuzzy Computing: Theory Hardware and Applications, North Holland.
100. Gupta, M. M. and Yamakawa, T. (eds.) (1988b). Fuzzy Logic in Knowledge-Based Systems, Decision and Control, North Holland, Amsterdam, New York.
101. Harston, C. T. (1990). “The Neurological Basis for Neural Computation,” in Handbook of Neural Computing Applications, Maren, A. J., Harston, C. T., and Pap, R. M. (eds.), Academic Press, New York, pp. 29-14.
102. Hassibi, B. and Stork, D. G. (1993). “Second-Order Derivatives for Network Pruning: Optimal Brain Surgeon,” in Advances in Neural Information Processing Systems, Hanson, S. J., Cowan, J. D., and Giles, C. L. (eds.), Vol. 5, Morgan Kaufmann, San Jose, CA, pp. 164-172.
103. Haykin, S. (1991). Adaptive Filter Theory, Prentice-Hall, Englewood Cliffs, NJ.
104. Haykin, S. and Principe, J. (1998). “Making Sence of Complex World: Using Neural Networks to Dynamically Model Chaotic Events Such as Sea Clutter,” IEEE Signal Processing Magazine, Vol. 15, No. 3, pp.66-81.
105. Hebb, D. O. (1949). The Organization of Behavior, Wiley, New York.
106. Hecht-Nielsen, R. (1987). “Kolmogorov’s Mapping Neural Network Existence Theorem,” Proc. 1987 ICNN, Vol. III, pp. 11-14.
107. Hecht-Nielsen, R. (1989). “Theory of the Back-Propagation Neural Network,” Proc. Int. Joint Conf Neural Networks, Vol. I, pp. 593-605.
108. Hecht-Nielsen, R. (1990). Neurocomputing, Addison-Wesley, Reading, MA.
109. Heskes, T. (2001). “Self-Organizing Maps, Vector Quantization, and Mixture Modeling,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1299-1305.
110. Hiramoto, M., Hiromi, Y, Giniger, E., and Hotta, Y. (2000). “The Drosophila Netrin Receptor Frazzled Guides Axons by Controlling Netrin Distribution,” Nature, Vol. 406, No. 6798, pp. 886-888.
111. Hirose, Y, Yamashita, K., andHijiya, S. (1991). “Back-Propagation Algorithm which Varies the Number of Hidden Units,” Neural Networks, Vol. 4, pp. 61-66.
112. Hirsch, M. W. (1989). “Convergent Activation Dynamics in Continuous Time Networks,” Neural Networks, Vol. 1 (May), pp. 331-349.
113. Hirsch, M. W. and Smale, S. (1974). Differential Equations, Dynamical Systems, and Linear Algebra, Academic Press, New York.
114. Homma, N. and Gupta, M. M. (2002a). “Superimposing Neural Learning by Dynamic and Spatial Changing Weights,” Proc. 7th Int. Symp. Artificial Life and Robotics, Vol. 1, pp. 165-168.
115. Homma, N. and Gupta, M. M. (2002b). “A General Second-order Neural Unit,” Bull. Coll. Med. Sci. Tohoku Univ., Vol. 11, No. 1, pp. 1-6.
116. Homma, N., Sakai, M., Gupta, M. M., and Abe, K. (2001). “Stochastic Analysis of Chaos Dynamics in Recurrent Neural Networks,” Proc. Joint 9th IPSA World Congress and 20th NAF1PS Int. Conf, Vancouver, BC, Canada, July, pp. 1372-1376.
117. Honma, N., Kamauchi, T, Abe, K., and Takeda, H. (1999a). “Auto-Learning by Dynamical Recognition Networks,” Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, Vol. III, pp. 211-216.
118. Honma, N., Sakai, M., Abe, K., and Takeda, H. (1999b). “Control Method of the Lyapunov Exponents for Recurrent Neural Networks,” Proc. 14th IFAC World Congress, Beijing, Vol. K, pp. 51-56.
119. Hopfield, J. (1982). “Neural Networks and Physical Systems with Emergent Collective Computational Abilities,” Proc. Nat. Acad. Sci. USA, Vol. 79, pp. 2554-2558.
120. Hopfield, J. (1984). “Neurons with Graded Response Have Collective Computational Properties Like Those of Two-State Neurons,” Proc. Nat. Acad. Sci. USA, Vol. 81, pp. 3088-3092.
121. Hopfield, J. and Tank, D. W. (1986). “Computing with Neural Circuits: A Model,” Science, Vol. 233, pp. 625-633.
122. Hoppensteadt, F. C. and Izhikevich, (2000). “Pattern Recognition via Synchronization in Phase-Locked Loop Neural Networks”IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 734-738.
123. Horn, R. A. and Johnson, C. R. (1985). Matrix Analysis, Cambridge Univ. Press.
124. Hornik, K. (1991). “Some New Results on Neural Network Approximation,” Neural Networks, Vol. 6, No. 8, pp. 1069-1072.
125. Hornik, K., Stinchcombe, M., and White, H. (1989). “Multilayer Feedforward Networks Are Universal Approximators,” Neural Networks, Vol. 2, No. 5, pp. 359-366.
126. Hornik, K., Stinchcombe, M., and White, H. (1990). “Universal Approximation of an Unknown Mapping and Its Derivatives Using Multilayer Feedforward Networks,” Neural Networks, Vol. 3, No. 6, pp. 551-560.
127. Hoya, T. and Chambers, J. A. (2001). “Heuristic Pattern Correction Scheme Using Adaptively Trained Generalized Regression Neural Networks,” IEEE Trans. Neural Networks, Vol. 12, pp. 91-100.
128. Huang, G. B., Chen, Y. Q., and Babri, H. A. (2000). “Classification Ability of Single Hidden Layer Feedforward Neural Networks,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 799-801.
129. Hush, D. R. and Home, B. G. (1993). “Progress in Supervised Neural Networks,” IEEE Signal Process. Mag., Vol. 10, No. 1 (Jan.), pp. 8-39.
130. Hyvarinen, A. (2001). “Blind Source Separation by Nonstationarity of Variance: A Cumulant-Based Approach,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1471-1474.
131. Hyvarinen, A., Karhunen, J., and Oja, E. (2001). Independent Component Analysis, Wiley, New York.
132. Hyvarinen, A. and Oja, E. (1997). “A Fast Fixed-Point Algorithm for Independent Component Analysis,” Neural Comput., Vol. 9, No. 7, pp. 1483-1492.
133. Indiveri, G. (2000). “Modeling Selective Attention Using a Neuromorphic Analog VLSI Device,” Neural Comput., Vol. 12, No. 12, pp. 2857-2880.
134. Indiveri, G. (2001a). “A Current-Mode Analog Hysteretic Winner-Take-All Network, with Excitatory and Inhibitory Coupling,” J. Analog Integrated Circuits Signal Process., Vol. 28, pp. 279-291.
135. Indiveri, G. (2001b). “A Neuromorphic VLSI Device for Implementing 2-D Selective Attention Systems,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1455-1463.
136. Indiveri, G., Murer, R., and Kramer, J. (2001). “Active Vision Using an Analog VLSI Model of Selective Attention,” IEEE Trans. Circuits Syst. II, Vol. 48, pp. 492-500.
137. Isermann, R. (1989). “A Review on Detection and Diagnosis Illustrates that Process Faults Can Be Detected When Based on the Estimation of Unmeasurable Process Parameters and State Variables,” Automatica: IFAC J., Vol. 20, No. 4, pp. 387-04.
138. Itti, L. and Koch, C. (2001). “Computational Modeling of Visual Attention,” Nature Neurosci. Rev., Vol. 2, pp. 194-204.
139. Iyer, M. S. and Wunsch, I. I. (2001). “Dynamic Reoptimization of a Fed-Batch Fermentor Using Adaptive Critic Designs,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1433-1444.
140. Jacobs, R. A. (1988). “Increased Rates of Convergence through Learning Rate Adaptation,” Neural Networks, Vol. 1, No. 4, pp. 295-308.
141. Jang, J. S. R. (1992). “Self-Learning Fuzzy Controllers Based on Temporal Back-Propagation,” IEEE Trans. Neural Networks, Vol. 3 (Sept.), pp. 714-723.
142. Jang, J. S. R. and Sun, C. T. (1990). “Neuro-Fuzzy Modeling and Control,” Proc. IEEE, Vol. 83, No. 3 (March), pp. 378-406.
143. Jang, J. S. R. and Sun, C. T. (1993). “Functional Equivalence between Radial Basis Function Networks and Fuzzy Inference Systems,” IEEE Trans. Neural Networks, Vol. 4, No. 1 (Jan.), pp. 156-159.
144. Jin, L. and Gupta, M. M. (1996a). “Equilibrium Capability of Analog Feedback Neural Networks,” IEEE Trans. Neural Networks, Vol. 7, pp. 782-787.
145. Jin, L. and Gupta, M. M. (1996b). “Globally Asymptotical Stability of Discrete-Time Analog Neural Networks,” IEEE Trans. Neural Networks, Vol. 7, No. 4, pp. 1024-1031.
146. Jin, L. and Gupta, M. M. (1999). “Stable Dynamic Backpropagation Learning in Recurrent Neural Networks,” IEEE Trans. Neural Networks, Vol. 10, pp. 1321- 1334.
147. Jin, L., Gupta, M. M., and Nikiforuk, P. N. (1993a). “Computational Neural Architectures for Control Applications,” in Soft Computing: Fuzzy Logic, Neural Networks, and Distributed Artificial Intelligence, Prentice-Hall, Englewood Cliffs, NJ, Chapter 6, pp. 121-152.
148. Jin, L., Nikiforuk, P. N., and Gupta, M. M. (1993b). “Stable Fixed Point Learning Using Parallel Synaptic and Somatic Adaptation,” Proc. 1993 World Congress on Neural Networks, Vol. II, pp. 945-950.
149. Jin, L., Gupta, M. M., and Nikiforuk, P. N. (1994a). “Approximation Capabilities of Feedforward and Recurrent Neural Networks,” in Intelligent Control Systems, Gupta M. M. and Sinha, N. K. (eds.), IEEE Press, Chapter 10, pp. 234-264.
150. Jin, L., Nikiforuk, P. N., and Gupta, M. M. (1994b). “Absolute Stability Conditions for Discrete-time Recerrent Neural Networks,” IEEE Trans. Neural Networks, Vol. 5, pp. 954-964.
151. Jin, L., Gupta, M. M., and Nikiforuk, P. N. (1995). “Neural Networks and Fuzzy Basis Functions for Functional Approximation,” in Fuzzy Logic and Intelligent Control, Li, H. and Gupta, M. M. (eds.), Kluwer Academic Publishers, Chapter 2, pp. 17-68.
152. Jin, L., Nikiforuk, P. N., and Gupta, M. M. (1995). “Approximation of Discrete-time State-space Trajectories Using Dynamic Recurrent Neural Networks,” IEEE Trans. Automatic Control, Vol. 40, pp. 1266-1270.
153. Johansson, E. M., Dowla, F. U., and Goodman D. M. (1990). Backpropaga-tion Learning for Multi-Layer Feed-Forward Neural Networks Using the Conjugate Gradient Method, Lawrence Livermore National Laboratory, Berkeley, CA, Preprint UCRL-JC-104850.
154. Kahane, J. P. (1975). “Sur le Theoreme de Superposition de Kolmogorov,” J. Approx. Theory, Vol. 13, pp. 229-234.
155. Kalman, R. E. and Bertram, J. E. (1960). “Control System Analysis and Design via the Second Method of Lyapunov: II Discrete-time systems,” Trans. ASME J. Basic Eng., Vol. 82, pp. 394-400.
156. Kandel, E. R. and Schwartz, J. H. (1985). Principles of Neural Science, New York, North-Holland.
157. Karnin, E. D. (1990). “A Simple Procedure for Pruning Back-propagation Trained Neural Networks,” IEEE Trans. Neural Networks, Vol. 1, No. 2, pp. 239-242.
158. Kaszkurewicz, E. and Bhaya, A. (1993). “Robust Stability and Diagonal Lia-punov Functions,” SIAMJ. Matrix Analy. Appl, Vol. 14, No. 2, pp. 508-520.
159. Kaufmann, A. and Gupta, M. M. (1985). Introduction to Fuzzy Arithmetic, Theory and Applications, 2nd ed., Van Nostrand Reinhold, New York (Japanese transl. by Atsuka, M., OhmshaLtd., Tokyo, 1991).
160. Kaufmann, A. and Gupta, M. M. (1988). Fuzzy Mathematical Models in Engineering and Management Science, North Holland, Amsterdam (revised 1992; Japanese transl. by Matsuoka, H. and Tanaka, H., Ohmsha Ltd., Tokyo).
161. Kelly, D. G. (1990). “Stability in Contractive Nonlinear Neural Networks,” IEEE Trans. Biomed. Eng., Vol. 37, pp. 231-242.
162. Kelly, K. A., Caruso, M. J., and Austin, J. A. (1993). “Wind-forced Variations in Sea Surface Height in The Northeast Pacific Ocean,” J. Phys. Oceanogr., Vol. 23, pp. 2392-2411.
163. Kewley, R., Embrechts, M., andBreneman, C. (2000). “Data Strip Mining for the Virtual Design of Pharmaceuticals with Neural Networks,” IEEE Trans. Neural Networks, Vol. 11, No. 3, pp. 668-679.
164. Khalil, H. (1992). Nonlinear Systems, Macmillan, New York.
165. Kim, T, Kim, Y, Park, J., Ko, K., Choi, S., Kang, C, and Hong, D. (2000). “Performance of an MC-CDMA System with Frequency Offsets in Correlated Fading,” Proc. IEEE ICC 2000, Vol. 2, pp. 1095-1099.
166. Kiszka, J., Gupta, M. M., and Nikiforuk, P. N. (1985). “Energetistic Stability of Fuzzy Dynamic Systems,” IEEE Trans. Syst. Man Cybernet., Vol. 15, No. 5, pp. 783-792.
167. Ko, K., Choi, S., and Hong, D. (2000a). “Multiuser Detector with an Ability of Channel Estimation Using an RBF Network in an MC-CDMA System,” Proc. IJCNN2000, Vol. 5, pp. 348-353.
168. Ko, K., Choi, S., Kang, C, and Hong, D. (2000b). “RBF Multiuser Detector with Channel Estimation Capability in a Synchronous MC-CDMA System,” IEEE Trans. Neural Networks, Vol. 12, No. 6, pp. 1536-1538.
169. Kohara, K., Kitamura, A., Morishima, M., and Tsumoto, T. (2001). “Activity-Dependent Transfer of Brain-Derived Neurotrophic Factor to Postsynaptic Neurons,” Science, Vol. 291 (March), pp. 2419-2423.
170. Kohonen, T. (1988). “An Introduction to Neural Computing,” Neural Networks, Vol. 1, No. 1, pp. 3-16.
171. Kohonen, T., Kaski, S., Lagus, K., Salogarvi, J., Honkela, J, Paatero, V., and Sarrela, A. (2000). “Self-Organization of a Massive Document Collection,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 574-585.
172. Kolmogorov, A. N. (1957). “On the Representation of Continuous Functions of Several Variables by Superposition of Continuous Functions of One Variable and Addition,” Dokl Akad. Nauk USSR, Vol. 114, pp. 953-956.
173. Konig, A. (2000). “Interactive Visualization and Analysis of Hierarchical Neural Projections for Data Mining,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 615-624.
174. Kosko, B. (1992). “Neural Networks and Fuzzy Systems,” Prentice-Hall, Engle-wood Cliffs, NJ.
175. Kosko, B. (1994). “Fuzzy Systems as Universal Approximators,” IEEE Trans. Comput, Vol. 43, No. 11, pp. 1329-1333.
176. Krasovskii, N. N. (1963). Stability of Motion, Stanford Univ. Press.
177. Kurkova, V. (1992). “Kolmogorov’s Theorem and Multilayer Neural Networks,” Neural Networks, Vol. 5, No. 3, pp. 501-506.
178. Langari, R. and Berenji, H. R. (1992). “Fuzzy Logic in Control Engineering,” in Handbook of Intelligent Control., Van Nostrand, New York, pp. 93-140.
179. Lapedes, A. and Farber, R. (1987). “How Neural Nets Work,” in Neural Information Processing Systems, Anderson, D. Z. (ed.), American Institute of Physics, New York, pp. 442-456.
180. LeCun, Y. (1987). Modeles Connexionnistes de I’apprentissage (Connectionist Learning Models), Ph.D. thesis, Universite’ P. et M. Curie (Paris 6).
181. LeCun, Y. (1988). “A Theoretical Framework for Back-Propagation,” in Proc. 1988, Connectionist Model Summer School, Touretzky, D., Hinton C, and Sejnowski T. (eds.), June 17-26, Morgan Kaufmann, pp. 21-28.
182. LeCun, Y, Boser, B., and Denker, J. S. (1989). “Backpropagation Applied to Handwritten Zip Code Recognition,” Neural Computation, Vol. 1, pp. 541-551.
183. LeCun, Y, Boser, B., and Sofia, S. A. (1990). “Optimal Brain Damage,” in Advances in Neural Information Processing Systems, Touretzky, D. S. (ed.), Vol. 2, Morgan Kaufmann, pp. 598-605.
184. Lee, C. C. (1990a). “Fuzzy Logic in Control Systems: Fuzzy Logic Controller, Part I,” IEEE Trans. Syst. Man Cybernet, Vol. 20, No. 2, pp. 404-418.
185. Lee, C. C. (1990b). “Fuzzy Logic in Control Systems: Fuzzy Logic Controller, Part II,” IEEE Trans. Syst. Man Cybernet., Vol. 20, No. 2, pp. 419-435.
186. Lee, R. S. T. and Liu, J. N. K. (2000). “Tropical Cyclone Identification and Tracking System Using Integrated Neural Oscillatory Elastic Graph Matching and Hybrid RBF Network Track Mining Techniques,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 680-689.
187. Lee, S. and Kil, R. M. (1991). “A Gaussian Potential Function Network with Hierarchically Self-organizing Learning,” Neural Networks, Vol. 4, pp. 207-224.
188. Lee, S.C. and Lee, E.T. (1974). “Fuzzy Sets and Neural Networks,” J. Cybernet., Vol. 4, pp. 83-101.
189. Lehtokangas, M. (2000). “Cascade-Correlation Learning for Classification,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 784-794.
190. Leistritz, L., Galicki, M., Witte, H., and Kochs, E. (2001). “Initial State Training Procedure Improves Dynamic Recurrent Networks with Time-Dependent Weights,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1513-1518.
191. Leung, C. S., Tsoi, A.-C, and Chan, L. W. (2001). “Two Regularizes for Recursive Least Squared Algorithms in Feedforward Multilayered Neural Networks,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1314-1332.
192. Li, J. H., Michel, A. N., and Porod, W. (1989). “Analysis and Synthesis of a Class of Neural Networks: Linear Systems Operating on a Closed Hypercube,” IEEE Trans. Circuits Syst, Vol. 36, pp. 1405-1422.
193. Li, L.-H., Lin, I.-C, and Hwang, M.-S. (2001). “A Remote Password Authentication Scheme for Multiserver Architecture Using Neural Networks,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1498-1504.
194. Li, L. K. (1992). “Fixed Point Analysis for Discrete-Time Recurrent Neural Networks,” Proc. Int. Joint Conf. Neural Networks, June, Vol. IV, pp. 134-139.
195. Li, W.-J. and Lee, T. (2001). “Hopfield Neural Networks for Affine Invariant Matching,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1400-1410.
196. Liang, X. B. (2001 a). “A Recurrent Neural Networks for Nonlinear Continuously Differentiable Optimization Over a Compact Convex Set,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1487-1490.
197. Liang, X. B. (2001b). “Qualitative Analysis of a Recurrent Neural Network for Nonlinear Continuously Differentiable Convex Minimization over a Nonempty Closed Convex Subset Set,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1521-1524.
198. Liang, X. B. and Wang, J. (2000). “A Recurrent Neural Network for Nonlinear Optimization with a Continuously Differentiable Objective Function and Bound Constraints,” IEEE Trans. Neural Networks, Vol. 11 (Nov.), pp. 1251-1262.
199. Light, W. A. (1992). “Some Aspects of Radial Basis Function Approximation,” in Approximation Theory, Spline Functions and Applications, Singh, S. P. (ed.), Kluwer Academic, Boston, NATO ASI Series Vol. 256, pp. 163-190.
200. Lim, T.-S., Loh, W-Y., and Shih, Y.-S. (2000). “A Comparison of Prediction Accuracy, Complexity, and Training Time of 33 Old and New Classification Algorithms,” Machine Learning, Vol. 40, pp. 203-228.
201. Lin, C.-J. (2001). “On the Convergence of the Decomposition Method for Support Vector Machines,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1278-1287.
202. Lorentz, G. G. (1962). “Metric Entropy, Widths, and Superposition of Functions,” Am. Math. Monthly, Vol. 69, pp. 469-185.
203. Lorentz, G. G. (1966). “Metric Entropy and Approximation,” Bull. Am. Math. Soc, Vol. 72 (Nov.), pp. 903-937.
204. Lorentz, G. G. (1986). Approximation of Functions, Chelsea Publishing, New York.
205. Lu, H. (2000). “On Stability of Nonlinear Continuous-Time Neural Networks with Delays,” Neural Networks, Vol. 13, No. 10, pp. 1135-1144.
206. Mackey, M. C. and Glass, L. (1977). “Oscillation and Chaos in Physiological Control Systems,” Science, Vol. 197, pp. 287-289.
207. Marcus, C. M. and Westervelt, R. M. (1989). “Dynamics of Iterated Map Neural Networks,” Phys. Rev. A, Vol. 40, No. 1, pp. 577-587.
208. Matsuoka, K. (1992). “Stability Conditions for Nonlinear Continuous Neural Networks with Asymmetric Connection Weights,” Neural Networks, Vol. 5, pp. 495-500.
209. Mays, C. H. (1963). Adaptive Threshold Logic, Ph.D. thesis, Technical Report 1557-1, Stanford Electron. Labs., Stanford, CA.
210. McClelland, J. L. and Rumelhart, D. E. (1988). Exportations in Parallel Distributed Processing, MIT Press, Cambridge, MA.
211. McCulloch, W. S. and Pitts, W. H. (1943). “A Logical Calculus of the Ideas Imminent in Nervous Activity,” Bull. Math. Biophys., Vol. 5, pp. 115-133.
212. McEliece, R., Posner, E., Rodemich, E., and Venkatesh, S. (1987). “The Capacity of the Hopfield Associative Memory,” IEEE Trans. Inform. Theory, Vol. 33, pp. 461-182.
213. McLachlan, G. and Peel, D. (2000). Finite Mixture Models, Wiley series, Probability and Statistics, Wiley, New York.
214. Mendel, J. M. (1995). “Fuzzy Logic Systems for Engineering: A Tutorial,” Proc. IEEE, Vol. 83, No. 3 (March), pp. 345-377.
215. Micchelli, C. A. (1986). “Interpolation of Scattered Data: Distance Matrices and Conditionally Positive Definite Functions,” Construct. Approx., Vol. 2, pp. 11-22.
216. Michel, A. N. and Miller, R. K. (1977). Qualitative Analysis of Large Scale Dynamical Systems, Academic Press, New York.
217. Mitra, S. and Hayashi, Y. (2000). “Neuro-Fuzzy Rule Generation: Survey in Soft Computing Framework,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 748-768.
218. Moller, M. (1993). “A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning,” Neural Networks, Vol. 6, No. 4, pp. 525-534.
219. Mozer, M. C. and Smolensky, P. (1989). “Skeletonization: A Technique for Trimming the Fat From a Network via Relevance Assessment,” in Advances in Neural Information Processing Systems, Touretzky, D. S. (ed.), Vol. 1, Morgan Kaufmann, pp. 107-115.
220. Mozer, M. C, Wolniewicz, R., Grimes, D. B., Johnson, E., and Kaushanksy, H. (2000). “Predicting Subscriber Dissatisfaction and Improving Retention in the Wireless Telecommunications Industry,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 690-696.
221. Müller, B. and Reinhardt, J. (1991). Neural Networks: AnIntroduction, Spiingcr-Verlag, Berlin.
222. Muroga, S. (1971). Threshold Logic and Its Application, Wiley, New York.
223. Musavi, M., Ahmed, W, Chan, K. H., Faris, K. B., and Hummels, D. M. (1992). “On the Training of Radial Basis Function Classifiers,” Neural Networks, Vol. 5, pp. 595-603.
224. Musilek, P. and Gupta, M. M. (2000). “Fuzzy Neural Models Based on Some New Fuzzy Arithmetic Operations,” J. Adv. Comput. Intell, Vol. 3, No. 6, pp. 245-254.
225. Nabney, T. (1999). “Efficient Training of RBF Networks for Classification,” Proc. 9th ICANN, Vol. 1, pp. 210-215.
226. Nadeau, C. and Benjio, Y. (2000). “Inference for the Generalization Error,” in Advances in Neural Information Processing Systems, Vol. 12, MIT Press, Cambridge, MA.
227. Narendra, K. S. and Parthasarathy, K. (1990). “Identification and Control of Dynamical Systems Using Neural Networks,” IEEE Trans. Neural Networks, Vol. 1, No. 1, pp. 4-27.
228. Nicholls, J. G., Martin, A. R., Wallace, B. G., Fuchs, P. A. (2001). From Neuron to Brain, 4th ed., Sinauer Assoc., Sunderland, MA.
229. Nishiyama, K. and Suzuki, K. (2001). “H∞-Learning of Layered Neural Networks,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1265-1277.
230. Pal, S. K., Datta, A., and Pal, N. R. (2001). “A Multilayer Self-Organizing Model for Convex-Hull,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1341-1347.
231. Pao, Y. H. (1989). Adaptive Pattern Recognition and Neural Networks, Addison-Wesley, Reading, MA.
232. Papadpopoulos, G., Edwards, P. J., and Murray, A. F. (2001). “Confidence Estimation Methods for Neural Networks: A Practical Comparison,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1278-1287.
233. Parlos, A. G., Menton, S. K., and Atiya, A. F. (2001). “An Algorithmic Approach to Adaptive State Filtering Using Recurrent Neural Networks,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1411-1432.
234. Pavlov, I. P. (1993). Psychopathology and Psychiatry, revised ed., Transaction Publishers, New Brunswick, Canada.
235. Pedrycz, W. (1991a). “Neurocomputations in Relational Systems,” IEEE Trans. Pattern Anal. Machine Intell, Vol. 13, pp. 289-297.
236. Pedrycz, W. (1991b). “A Referential Scheme of Fuzzy Decision Making and Its Neural Network Structure,” IEEE Trans. Syst. Man Cybernet., Vol. 21, pp. 1593-1604.
237. Pedrycz, W. (1993). “Fuzzy Neural Networks and Neurocomputations,” Fuzzy Sets Syst., Vol. 56, No. 1, pp. 1-28.
238. Pedrycz, W. (1995). “Genetic Algorithms for Learning in Fuzzy Relational Structures,” Fuzzy Sets Syst., Vol. 69, No. 1, pp. 37-52.
239. Persidskii, S. K. (1969). “Problem of Absolute Stability,” Automation Remote Control, Vol. 12, pp. 1889-1895.
240. Personnaz, L., Guyon, I., and Dreyfus, G. (1986). “Collective Computational Properties of Neural Networks: New Learning Mechanisms,” Phys. Rev. A, Vol. 34, pp. 4217-4228.
241. Pham, D.-T. and Cardoso, J.-F. (2000). “Blind Separation of Instantaneous Mixtures of Nonstationary Sources,” Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2000), Helsinki, Finland, pp. 187- 193.
242. Pineda, F. J. (1987). “Generalization of Back-propagation to Recurrent Neural Networks,” Physical Rev. Lett., Vol. 59, No. 19, pp. 2229-2232.
243. Pineda, F. J. (1988). “Dynamics and Architecture for Neural Computation,” J. Complexity, Vol. 4, pp. 216-245.
244. Poggio, T. andGirosi, F. (1989). “A Theory of Networks for Approximation and Learning,” AI Memo No. 1140, July, CBIP Paper 31.
245. Poggio, T. and Girosi, F. (1990). “Networks for Approximation and Learning,” Proc. IEEE, Vol. 78, pp. 1481-1497.
246. Principe, J. C. and Kuo, J. (1995). “Dynamic Modelling Chaotic Time Series with Neural Networks,” in Advances in Neural Information Processing System, Tesauro, G., Touretzky, D., and Leen, T. (eds.), Vol. 7, MIT Press, Cambridge, MA, pp. 311-318.
247. Psaltis, D., Sideris, A., and Yamamura, A. A. (1988). “A Multilayered Neural Network Controller” IEEE Control Syst. Mag., Vol. 8, pp. 17-21.
248. Rao, D. H., Gupta, M. M., and Sinha, N. K. (2000). “Dynamic Neural Networks: An Overview,” Int. Conf. Industrial Technology, Gao, India, Jan., pp. 491-96.
249. Ray, W. O. (1988). Real Analysis, Prentice-Hall, Englewood Cliffs, NJ.
250. Reed, R. (1993). “Pruning Algorithms-A Survey,” IEEE Trans. Neural Networks, Vol. 4, No. 5, pp. 740-747.
251. Ridella, S. and Zunnio, R. (2001). “Empirical Measure of Multiclass Generalization Performance: The K-Winner Machine Class,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1525-1528.
252. Rissanen, J. (1989). Stochastic Complexity in Statistical Inquiry, World Scientific, Singapore.
253. Robinson, A. J. and Fallside, F. (1987). “Static and Dynamic Error Propagation Networks with Application to Speech Coding,” Proc. Neural Information Processing Systems, Anderson, D. Z. (ed.), American Institute of Physics.
254. Rumelhart, D. E., Hinton, G. E., and Williams, R. J. (1986). “Learning Internal Representations by Error Propagation,” in Parallel Distributed Processing: Explorations in the Micro structure of Cognition, Rumelhart, D. E. and McClelland, J. L. (eds.), Vol. 1, MIT Press, Cambridge, MA, pp. 318-362.
255. Rumelhart, D. E. and McClelland, J. L. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations, Vol. 1, MIT Press, Cambridge, MA.
256. Rosenblatt, F. (1958). “The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain,” Psychological Review, Vol. 65, pp. 386-408.
257. Saarinen, S., Bramley, R., and Cybenko, G. (1991). The Numerical Solution of Neural Network Training Problems, CRSD Report 1089, Center for Supercom-puting Research and Development, Univ. Illinois, Urbana, IL.
258. Saarinen, S., Bramley, R., and Cybenko, G. (1992). “Neural Networks, Back-propagation, and Automatic Differentiation,” in Automatic Differentiation of Algorithms: Theory, Implementation, and Application, Griewank, A. and Corliss, G. F. (eds.), SIAM, Philadelphia, pp.31-42.
259. Sakaguchi, H. (1988). “Oscillatory and Excitable Behaviours in a Population of Model Neuron,” Progress Theor. Phys., Vol. 79, No. 5, pp. 1061-1068.
260. Scott, A. C. (1977). Neurophysics, Wiley, New York.
261. Sebald, D. J. and Bucklew, J. A. (2000). “Support Vector Machine Techniques for Nonlinear Equalization,” IEEE Trans. Signal Process., Vol. 48 (Nov.), pp. 3217-3226.
262. Segee, B. E. and Carter, M. J. (1991). “Fault Tolerance of Pruned Multilayer Networks,” Proc. Int. Joint Conf. Neural Networks, Vol. II, Seattle, pp. 447-452.
263. Shin, C. K., Yu, S. J., Yun, U. T, and Kim H. K. (2000). “A Hybrid Approach of Neural Network and Memory-Based Learning to Data Mining,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 637-646.
264. Shin, Y. and Ghosh, J. (1991). “The Pi-sigma Network: An Efficient Higher-order Neural Network for Pattern Classification and Function Approximation,” Proc. Int. Joint Conf. on Neural Networks, Vol. I, Seattle, WA, July, pp. 13-18.
265. Sietsma, J. and Dow, R. J. F. (1991). “Creating Artificial Neural Networks that Generalize,” Neural Networks, Vol. 4, pp. 67-79.
266. Silva, F. M. and Almeida, L. B. (1990). “Speeding up Backpropagation,” in Advances of Neural Computers, Eckmiller, R. (ed.), Elsevier Science Publishers B.V., North-Holland, pp. 151-158.
267. Simmon, D. (2001). “Distributed Fault Tolerance in Optimal Interpolative Nets,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1348-1357.
268. Simone, G. and Morabito, F. C. (2001). “RBFNN-Based Hole Identification System in Conducting Plates,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1445-1454.
269. Singhal, S. and Wu, L. (1989). “Training Multilayer Perceptrons with the Extended Kalman Algorithm,” in Advances in Neural Information Processing Systems I, Morgan Kaufmann, San Mateo, CA, pp. 133-140.
270. Sinha, M., Gupta, M. M., and Nikiforuk, P. N. (2001). “A Compensatory Wavelet Neuron Model,” Joint 9th IPSA World Congress and 20th NAFIPS Int. Conf, Vancouver, BC, Canada, July 25-28, pp. 1372-1376.
271. Sinha, N. K. and Gupta, M. M. and Zadeh, L. A. (1999). Soft-Computing and Intelligent Control Systems, Theory and Applications, Academic Press, New York.
272. Skarda, C. A. and Freeman, W. J. (1987). “How Brains Make Chaos in Order to Make Sense of the World,” Behav. Brain Sci., Vol. 10, pp. 161-195.
273. Smagt, P. (1994). “Minimisation Methods for Training Feedforward Neural Networks,” Neural Networks, Vol. 7, No. 1, pp. 1-11.
274. Soffky, R. W. and Kammen, D. M. (1991). “Correlations in High Dimensional or Asymmetrical Data Sets: Hebbian Neuronal Processing,” Neural Networks, Vol. 4, No. 3, pp. 337-347.
275. Spath, H. (1980). Cluster Analysis Algorithms for Data Reduction and Classification of Objects, Ellis Horwood Ltd., Chichester, UK.
276. Sprecher, D. A. (1965). “On the Structure of Continuous Functions of Several Variables,” Trans. Amer. Math. Soc, Vol. 115, pp. 340-355.
277. Sprecher, D. A. (1993). “A Universal Mapping for Kolmogorov’s Superposition Theorem,” Neural Networks, Vol. 6, No. 8, pp. 1089-1094.
278. Su, M. C. and Chang, H.-T. (2000). “Fast Self-Organizing Map Algorithm,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 721-733.
279. Sudharsanan, S. I. and Sundareshan, M. K. (1991a). “Equilibrium Characterization of Dynamical Neural Networks and a Systematic Synthesis Procedure for Associative Memories,” IEEE Trans. Neural Networks, Vol. 2, No. 5 (Sept.), pp. 509-521.
280. Sudharsanan, S. I. and Sundareshan, M. K. (1991b). ‘Training of a Three-Layer Dynamical Recurrent Neural Network for Nonlinear Input-Output Mapping,” Proc. Int. Joint Conf. Neural Networks, Nov., pp. 447-115.
281. Taylor, J. G. and Commbes, S. (1993). “Learning Higher Order Correlations,” Neural Networks, Vol. 6, No. 3, pp. 423-28.
282. Tipping, M. E. (2000). “The Relevance Vector Machine,” in Advances in Neural Information Processing Systems 12, Solla, S. A., Leen, T. K., and Muller, K.-R. (eds.), MIT Press, Cambridge, MA.
283. Tishby, N., Levin, E., and Solla, S. (1989). “Consistent Inference on Probabilities in Layered Networks, Predictions and Generalization,” Proc. Int. Joint Conf. Neural Networks, Washington, DC, IEEE Press, pp. 403-410.
284. Vesanto, J. and Alhoniemi, E. (2000). “Clustering of the Self-Organizing Map,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 586-600.
285. Vogl, T. P., Mangis, J. K., Rigler, A. K., Zink, W. T, and Allcon, D. L. (1988). “Accelerating the Convergence of the Back-propagation Method,” Biol. Cybernet., 59, pp. 257-263.
286. Wang, L. X. (1993). “Stable Adaptive Fuzzy Control of Nonlinear Systems,” IEEE Trans. Fuzzy Syst., Vol. 1 (Jan.), pp. 146-155.
287. Wang, L. X. and Mendel, J. M. (1992a). “Fuzzy Basis Functions, Universal Approximation, and Orthogonal Least Square Learning,” IEEE Trans. Neural Networks, Vol. 3, No. 5, pp. 807-814.
288. Wang, L. X. and Mendel, J. M. (1992b). “Generating Fuzzy Rules from Numerical Data, with Applications,” IEEE Trans. Syst. Man Cybernet., Vol. 32, pp. 1414-1472.
289. Wang, L. X. and Mendel, J. M. (1993). “Fuzzy Adaptive Filters, with Application to Nonlinear Channel Equalization,” IEEE Trans. Fuzzy Syst., Vol. 1 (March), pp. 161-170.
290. Wang, Y. F., Luo, L., Freedman, M. T., and Kung, S.-Y. (2000). “Probabilistic Principal Component Subspaces: A Hierarchical Finite Mixture Model for Data Visualizations,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 625-636.
291. Watanabe, S. (2001). “Learning Efficiency of Redundant Neural Networks in Bayesian Estimation,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1475-1486.
292. Werbos, P. J. (1974). Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences, Ph.D. thesis, Applied Mathematics, Harvard Univ., Boston, MA, Nov.
293. Weymaere, N. and Martens, J. P. (1991). “A Fast Robust Learning Algorithm for Feedforward Neural Networks,” Neural Networks, Vol. 4, pp. 361-369.
294. Widrow, B. (1962). “Generalization and Information Storage in Networks of Adaline Neurons,” in Self-Organizing Systems, Yovitz, M., Jocobi, G, and Goldstein, C. (eds.), Spartan Books, Washington, DC, pp. 435-461.
295. Widrow, B. and Hoff, M. E. (1960). “Adaptive Switching Circuits,” in IRE WESCON Convention Record, Vol. 4, New York, pp. 96-104.
296. Widrow, B. and Lehr, M. A.(1990). "30 Years of Adaptive Neural Networks: Per-ceptron, Madaline, and Backpropagation,” Proc. IEEE, Vol. 78, No. 9, pp. 1415-1442.
297. Williams, R. J. and Zipser, D. (1989). “A Learning Algorithm for Continually Running Fully Recurrent Neural Networks,” Neural Comput., Vol. 1, pp. 270-280.
298. Williams, R. J. and Zipser, D. (1990). Gradient-based Learning Algorithms for Recurrent Connectionist Networks, Technical Report NU-CCS-90-9, Northeastern Univ., College of Computer Science, Boston.
299. Xu, L., Oja, E., and Suen, C. Y. (1992). “Modified Hebbian Learning for Curve and Surface Fitting,” Neural Networks, Vol. 5, No. 3, pp. 441-457.
300. Xu, X., He, H. G., and Hu, D. (2002). “Efficient Reinforcement Learning Using Recursive Least-Squares Methods,” J. Artificial Intelligence Research, Vol. 16, pp. 259-292.
301. Yan, L. and Miller, D. J. (2000). “General Statistical Inference for Discrete and Mixed Spaces by an Approximate Application of the Maximum Entropy Principle,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 558-573.
302. Yanai, H. and Sawada, Y. (1990). “Integrator Neurons for Analog Neural Networks,” IEEE Trans. Circuit Syst., Vol. 36, pp. 854-856.
303. Yang, T.-N. and Wang, S.-D. (2000). “Fuzzy Auto-Associative Neural Networks for Principal Component Extraction of Noisy Data,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 799-801.
304. Yidliz, O. T. (2001). “Omnivariate Decision Trees,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1539-1546
305. Yidliz, O. T. and Alpaydin, E. (2000). “Linear Discriminant Trees,” Proc. 17th Int. Conf. Machine Learning, Langely, P. (ed.), Morgan Kaufmann, San Mateo, CA, pp. 1175-1182.
306. Yuan, C, Azimi-Sadjadi, M. R., Wilbur, J., and Dobeck, G. (2000). “Underwater Target Detection Using Multichannel Subb and Adaptive Filtering and High Order Correlation Schemes,” IEEE J. Ocean. Eng., Vol. 25 (Jan.), pp. 192-205.
307. Zadeh, L. A. (1965). “Fuzzy Sets,” Inform. Control, Vol. 8, pp. 338-353.
308. Zadeh, L. A. (1968). “Probability Measures of Fuzzy Events,” J. Math. Anal. Appl., Vol. 23, pp. 421-427.
309. Zadeh, L. A. (1972a). “A Fuzzy-Set - Theoretic Interpretation of Linguistic Hedges,” J. Cybernet., Vol. 2, pp. 4-34.
310. Zadeh, L. A. (1972b). “A Rational for Fuzzy Control,” J. Dynamic Syst., Meas. Control, Vol. 34, pp. 3-4.
311. Zadeh, L. A. (1973). “Outline of a New Approach to the Analysis of Complex Systems and Decision Processes,” IEEE Trans. Syst. Man Cybernet., Vol. 3, pp. 28-44.
312. Zadeh, L. A. (1984). “Making Computers Think Like People,” IEEE Spectrum, Vol. 21, No. 8 (Aug.), pp. 26-32.
313. Zadeh, L. A. (1986). “Outline of a Computational Approach to Meaning and Knowledge Representation Based on a Concept of a Generalized Assignment Statement,” Proc. Int. Seminar on Artificial Intelligence and Man-Machine Systems, Thoma, M. and Wyner, A. (eds.), Springer-Verlag, Heidelberg, Germany, pp. 198-211.
314. Zadeh, L. A. (1994). “Fuzzy Logic, Neural Networks, and Soft-computing,” Commun. ACM, Vol. 37, pp. 77-84.
315. Zadeh, L. A. (1996). “Fuzzy Logic = Computing with Words,” IEEE Trans. Fuzzy Systems, Vol. 4, pp. 103-111.
316. Zadeh, L. A. (1997). “Toward a Theory of Fuzzy Information Granulation and its Centrality in Human Reasoning and Fuzzy Logic,” Fuzzy Sets Syst., Vol. 90, pp. 111-127.
317. Zadeh, L. A. (1999). “From Computing with Numbers to Computing with Words-from Manipulation of Measurements to Manipulation of Perceptions,” IEEE Trans. Circuits Syst., Vol. 45, pp. 105-119.
318. Zeng, Z. and Yeung, D. S. (2001). “Sensitivity Analysis of Multilayer Perceptron to Input and Weight Perturbations,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1358-1366.
319. Zhang, J. and Jin, X. (2000). “Global Stability Analysis in Delayed Hopfield Neural Models,” Neural Networks, Vol. 13, No. 7, pp. 745-753.
320. Zhang, Y. Q., Fraser, M. D., Gagliano, R. A., and Kandel, A. (2000). “Granular Neural Networks for Numerical-Linguistic Data Fusion and Knowledge Discovery,” IEEE Trans. Neural Networks, Vol. 11, No. 3 (May), pp. 658-667.
321. Zhao, L. and Macau, E. E. N. (2001). “A Network of Dynamically Coupled Chaotic Maps for Scene Segmentation,” IEEE Trans. Neural Networks, Vol. 12, No. 6 (Nov.), pp. 1375-1385.
322. Zhao, L., Macau, E. E. N., and Omar, N. (2000). “Scene Segmentation of the Chaotic Oscillator Network,” Int. J. Bifurcation Chaos, Vol. 10, No. 7, pp. 1697-1708.
323. Zurada, J. M. (1992). Introduction to Artificial Neural Systems, West Publishing Company, St. Paul, MN.