Training Pi-sigma network by online gradient algorithm with penalty for small weight update

Neural Computation

Volumn 19, Issue 12, 2007, Pages 3356-3368

  Xiong, Yan ^a,b   Wu, Wei ^a   Kang, Xidai ^a   Zhang, Chao ^a  

^a DALIAN UNIVERSITY OF TECHNOLOGY   (China)

^b UNIVERSITY OF SCIENCE AND TECHNOLOGY LIAONING   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; NEURAL NETWORKS (COMPUTER);

EID: 36849072477     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2007.19.12.3356     Document Type: Article

References (12)

1. Durbin, R., & Rumelhart, D. (1989). Product units: A computationally powerful and biologically plausible extension to backpropagation networks. Neural Computation, 1, 133-142.
2. Giles, C. L., & Maxwell, T. (1987). Learning invariance and generalization in higherorder neural networks. Applied Optics, 26(23), 4972-4978.
3. Hussaina, A. J., & Liatsisb, P. (2002). Recurrent pi-sigma networks for DPCM image coding. Neurocomputing, 55, 363-382.
4. Jiang, L. J., Xu, F., & Piao, S. R. (2005). Application of pi-sigma neural network to real-time classification of seafloor sediments. Applied Acoustics, 24, 346-350.
5. Li, C. K. (2002). Memory-based sigma-pi-sigma neural network. International Conference on Systems, Man and Cybernetics, 4, 1-6.
6. Li, C. K. (2003). A sigma-pi-sigma neural network (SPSNN). Neural Processing Letters, 17, 1-19.
7. Shin, Y., & Ghosh, J. (1991). The pi-sigma network: An efficient higher-order neural network for pattern classification and function approximation. International Joint Conference on Neural Networks, 1, 13-18.
8. Shin, Y., & Ghosh, J. (1992). Approximation of multivariate functions using ridge polynomial networks. In Proceedings of International joint Conference on Neural Networks (Vol. 2, pp. 380-385). Piscataway, NJ: IEEE Press.
9. Shin, Y., & Ghosh, J. (1995). Ridge polynomial networks. IEEE Transactions on Neural Networks, 6(3), 610-622.
10. Sinha, M., Kumar, K., & Kalra, P. K. (2000). Some new neural network architectures with improved learning schemes. Soft Computing, 4(4), 214-223.
11. Voutriaridis, C., Boutalis, Y S., & Mertzios, B. G. (2003). Ridge polynomial networks in pattern recognition. In 4th EURASIP Conference Focused on Video I Image Processing and Multimedia Communications (Vol. 2, pp. 519-524). Piscataway, NJ: IEEE Press.
12. Xin, L. (2002). Interpolation by ridge polynomials and its application in neural networks, Journal of Computational and Applied Mathematics, 144, 197-209.