Kolmogorov's spline complex network and adaptive dynamic modeling of data

Complex-Valued Neural Networks: Utilizing High-Dimensional Parameters

Volumn , Issue , 2009, Pages 56-78

  Igelnik, Boris ^a  

^a BMI Research Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77951994574     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-214-5.ch003     Document Type: Chapter

References (74)

1. Adeli, H., & Hung, S-L. (1995). Machine learning. Neural networks, genetic algorithms, and fuzzy systems. New York, NY: John Wiley & Sons.
2. Adeli, H., & Samant, A. (2000). Wavelets to enhance computational intelligence. In P. Sincak (Ed). Quo vadis computational intelligence? New trends and approaches in computational intelligence (pp. 399-407). Heidelberg; New York: Physica-Verlag.
3. Aizenberg, I. N., Aizenberg, N. N., & Vandewalle, J. (2000). Multi-valued and universal binary neurons- Theory, learning, and applications. Boston, MA: Kluwer Academic Publishers.
4. Albert, A. (1972). Regression and the Moore-Penrose pseudoinverse. New York, NY: Academic Press.
5. Antony, R.T. (1995). Principles of data fusion automation. Norwood, MA: Artech House.
6. Arena P., Fortuna, L., Muscato, G., & Xibilia, M. G. (1998). Neural networks in multidimensional domains. Fundamentals and new trends in modeling and control. New York: Springer.
7. Astrom, K., & Wittenmark, B. (1995). Adaptive control. Reading, MA: Addison-Wesley.
8. Bäck, T. (1996). Evolutionary algorithms in theory and practice. New York, NY: Oxford University Press.
9. Barron, A. R. (1993). Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory, 39(4), 930-945.
10. Barron, A. R. (1994). Approximation and estimation bounds for artificial neural networks. Machine Learning, 14(1), 115-133.
11. Bezdek, J. (1992). On the relationship between neural networks, pattern recognition and intelligence. International Journal on Approximating Reasoning, 6(2), 85-107.
12. Bezdek, J. C., Keller, J., Krishnapuram, R., & Pal, N. R. (1999). Fuzzy models and algorithms for pattern recognition and image processing. Norwell, MA: Kluwer Academic Publishers.
13. Bishop, C. M. (1995). Neural networks for pattern recognition. New York, NY: Oxford University Press.
14. Bradley, P. S., & Fayyad, U. M. (1998). Refining initial points for K-means clustering. In 15th International Conference on Machine Learning (pp. 91-99). Los Altos, CA: Morgan Kaufmann.
15. Breiman, L., Friedman, J. H., Olshen, R. A, & Stone, C.J. (1984). Classification and regression trees. Boca Raton, FL: Chapman & Hall/CRC.
16. Breiman, L. (1993). Hinging hyperplanes for regression, classification, and function approximation. IEEE Transactions on Information Theory, 39(4), 999-1013.
17. Breiman, L. (1996). Bagging predictors. Machine Learning, 24(1), 123-140.
18. Breiman, L. (1999). Combining predictors. In A. Sharkey (Ed.), Combining artificial neural nets: Ensemble and modular multi-net systems (pp. 31-50). London: Springer.
19. Congdon, P. (2006). Bayesian statistical modeling. Chichester, West Sussex: John Wiley & Sons, Ltd.
20. Cristianini, N., & Shawe-Taylor, J. (2000). An introduction to support vector machines. Cambridge, UK: Cambridge University Press.
21. Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification. New York, NY: JohnWiley & Sons, Inc.
22. Fishman, G. S. (1995). Monte Carlo. Concepts, algorithms, and applications. New York, NY: Springer.
23. Fukunaga, K. (1990). Introduction to statistical pattern recognition. New York, NY: Academic Press.
24. Georgiou, G, & Koutsougeras, C. (1992). Complex domain back-propagation. IEEE Transactions on Circuits and Systems-II: Analog and Digital Signal Processing, 39(5), 330-334.
25. Girosi, F., & Poggio, T. (1989). Representation properties of networks: Kolmogorov's theorem is irrelevant. Neural Computation, 1(4), 465-469.
26. Goswami, J. C., & Chan, A. K. (1999). Fundamentals of wavelets. Theory, algorithms, and applications. New York, NY: John Wiley & Sons, Inc.
27. Hawkins, J, & Blakeslee, S. (2004). On intelligence. New York: Henry Holt and Company.
28. Haykin, S. (2002). Adaptive filter theory. Fourth edition. Upper Saddle River, NJ: Prentice Hall.
29. Haykin, S. (1994). Neural networks, a comprehensive foundation. New York, NY: IEEE Press.
30. Haykin, S. (Ed.) (2001). Kalman filtering and neural networks. New York, NY: John Wiley & Sons.
31. Hecht-Nielsen, R. (1987). Kolmogorov's mapping neural network existence theorem. In IEEE International Conference on Neural Networks, 3, 11-13. New York, NY: IEEE Press.
32. Hirose, A. (Ed.) (2003). Complex-valued neural networks. Singapore: World Scientific Publishers.
33. Hirose, A. (2006). Complex-valued neural networks. Berlin: Springer.
34. Hovanessian, S. A. (1984). Introduction to sensor systems. Norwood, MA: Artech House.
35. Igelnik, B., & Pao, Y-H. (1995). Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Transactions on Neural Networks, 6(6), 1320-1329.
36. Igelnik, B., Pao, Y-H., & LeClair, S. R. (1996). An approach for optimization of a continuous function with many local minima. In 30th Annual Conference on Information Sciences and Systems, 2, 912-917. Department of Electrical Engineering, Princeton University, Princeton, NJ.
37. Igelnik, B., Pao, Y-H., LeClair, S. R., & Shen, C. Y. (1999). The ensemble approach to neural network learning and generalization. IEEE Transactions on Neural Networks, 10(1), 19-30.
38. Igelnik, B. (2000). Some new adaptive architectures for learning, generalization, and visualization of multivariate data. In P. Sincak & J. Vascak (Eds.), Quo Vadis Computational Intelligence? New Trends and Approaches in Computational Intelligence (pp. 63-78). Heidelberg; New York, NY: Physica-Verlag.
39. Igelnik, B., Tabib-Azar, M., & LeClair, S. (2001a). A net with complex weights. IEEE Transactions on Neural Networks, 12(2), 236-249.
40. Igelnik, B. (2001b). Method for visualization of multivariate data in a lower dimension. In SPIE Visual Data Exploration and Analysis VIII, 4302, 168-179, San Jose, CA.
41. Igelnik, B., & Parikh, N. (2003a). Kolmogorov's spline network. IEEE Transactions on Neural Networks, 14(3), 725-733.
42. Igelnik, B. P.I. (2003b). Visualization of large multidimensional datasets in a lower dimension. SBIR Phase I Final Report, #0232775, NSF.
43. Igelnik, B. P.I. (2003c). Visualization of large multidimensional datasets in a lower dimension. SBIR Phase II Proposal, #0349713, NSF.
44. Jackson, P. (1986). Introduction to expert systems. Reading, MA: Addison-Wesley.
45. Kalos, M., & Witlock, P. A. (1986). Monte Carlo methods. New York, NY: John Wiley & Sons.
46. Kim, M. S., & Guest, C. C. (1990). Modification of back-propagation for complex-valued signal processing in frequency domain. In International Joint Conference on Neural Networks 1990 San Diego (pp. 27-31). New York: IEEE.
47. Kurková, V. (1991). Kolmogorov's theorem is relevant. Neural Computation, 3(4), 617-622.
48. Kurková, V. (1992). Kolmogorov's theorem and multilayer neural networks. Neural Networks, 5(3), 501-506.
49. Kolmogorov, A. N. (1957). On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition. Doklady Akademii Nauk SSSR, 114(5), 953-956. (1963). Translations American Mathematical Society, 2(28), 55-59.
50. Leung, H., & Haykin, S. (1991). The complex backpropagation algorithm. IEEE Transactions on Signal Processing, 39(9), 2101-2104.
51. Li, G., & Yu, K. B. (1988). Modeling and simulation of coherent Weibull clutter. IEE Proceedings, Part. F, 136(1), 1-9.
52. Ljung, L. (2000). System identification theory for the user. Englewood Cliffs, NJ: Prentice Hall.
53. Lorentz, G. G., von Golitschek, M., & Makovoz, Y. (1996). Constructive approximation. Advanced problems. New York: Springer.
54. Luo, F-L., & Unbehauen, R. (1997). Applied neural networks for signal processing. NY: Cambridge University Press.
55. Mhascar, H., & Miccheli, C. (1992). Approximation by superposition of sigmoidal and radial basis functions. Advances in Applied Mathematics, 13(3), 350-373.
56. Mitchell, M. (1996). An introduction to genetic algorithms. Cambridge, MA: The MIT Press.
57. Niederreiter, H. (1978). Quasi-Monte Carlo methods and pseudorandom numbers. Bulletin of American Mathematical Society, 84, 957-1041.
58. Nilsson, N. J. (1998). Artificial intelligence. A new synthesis. SanFrancisco, CA: Morgan Kaufmann Publishers.
59. Nitta, T. (1997). An extension of the backpropagation algorithm to complex numbers. Neural Networks, 10(8), 1391-1415.
60. Nitta, T. (2003). On the inherent property of the decision boundary in complex-valued neural networks. Neurocomputing, 50(1), 291-303.
61. Oppenheim, A. V., & Schafer, R. W. (1975). Digital signal processing. Englewood Cliffs, NJ: Prentice Hall.
62. Pedricz, W. (1998). Computational intelligence. An introduction. Boca Raton, FL: CRC Press.
63. Prenter, P. M. (1975). Splines and variational methods. New York, NY: John Wiley & Sons.
64. Rihaczek, A. W., & Hershkowitz, S. J. (1996). Radar resolution and complex-image analysis. Norwood, MA: Artech House.
65. Scolnik, M. I. (Ed.) (1990). Radar handbook. Second edition. New York, NY: McGraw-Hill.
66. Shidlovskii, A. B. (1989). Transcendental numbers. Berlin: Walter de Gruyter.
67. Sprecher, D. A. (1965). On the structure of continuous functions of several variables. Transactions of American Mathematical Society, 115(3), 340-355.
68. Sprecher, D. A. (1996). A numerical implementation of Kolmogorov's superpositions. Neural Networks, 9(5), 765-772.
69. Sprecher, D. A. (1997). A numerical implementation of Kolmogorov's superpositions II. Neural Networks, 10(3), 447-457.
70. Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society, B 36(1), 11-147.
71. Stone, L. D., Barlow, C. A., & Corwin, T. L. (1999). Bayesian multiple target tracking. Boston, MA: Artech House.
72. Stroud, A. H. (1971). Approximate calculation of multiple integrals. Englewood Cliffs, NJ: Prentice-Hall.
73. Zapranis, A. D., & Refenes, A-P. (1999). Principles of neural model identification, selection and adequacy. London: Springer.
74. Zurada, J., Marks, R., & Robinson, C. (Eds.) (1994). Introduction to computational intelligence: Imitating life. Piscataway, NJ: IEEE Press.