Neural networks trained with the EEM algorithm: Tuning the smoothing parameter

WSEAS Transactions on Systems

Volumn 4, Issue 4, 2005, Pages 295-299

  Santos, Jorge M ^a,b   Marques de Sá, Joaquim ^a   Alexandre, Luís A ^c  

^a INEB INSTITUTO DE ENGENHARIA BIOMÉDICA   (Portugal)

^b INSTITUTO SUPERIOR DE ENGENHARIA DO PORTO   (Portugal)

^c IT Networks and Multimedia Group   (Portugal)

Author keywords

Cost function; Entropy; Parzen; Smoothing parameter

Indexed keywords

LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION; PROBABILITY DENSITY FUNCTION;

COST FUNCTION; ERROR ENTROPY MINIMIZATION (EEM) ALGORITHM; SMOOTHING PARAMETER;

NEURAL NETWORKS;

EID: 21844450579     PISSN: 11092777     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (8)

1. D. Erdogmus and J. Principe, "An Error-Entropy Minimization Algorithm for Supervised Training of Nonlinear Adaptive Systems", Trans. On Signal Processing, Vol. 50, No. 7, 2002, pp. 1780-1786.
2. J. M. Santos, L. A. Alexandre, and J. Marques de Sá, "The error entropy minimization algorithm for neural network classification," in Proceedings of the 5th International Conference on Recent Advances in Soft Computing, A. Lofti, Ed. Nottingham Trent University, 2004, pp. 92-97.
3. J. M. Santos, J. Marques de Sá, L. A. Alexandre, and F. Sereno, "Optimization of the error entropy minimization algorithm for neural network classification," in Intelligent Engineering Systems Through Artificial Neural Networks, C.H.Dagli, A. L. Buczak, D. L. Enke, M. J. Embrechts, and O. Ersoy, Eds., vol. 14. ASME Press, 2004, pp. 81-86.
4. D. Erdogmus and J. Principe, "Entropy Minimization Algorithm for Neural Networks," Proceedings of the Intl. Joint Conf. on Neural Networks, 2001, pp. 3003-3008.
5. D. Xu and J. Princpe, "Training mlps layer-by-layer with the information potential," in Intl. Joint Conf. on Neural Networks, 1999, pp. 1716-1720.
6. B. W. Silverman, Density Estimation for Statistics and Data Analisys. Chapman & Hall, 1986, vol. 26.
7. A. W. Bowman and A. Azzalini, Applied Smooting Techniques for Data Analysis. London: Oxford University Press, 1997.
8. R. Jacobs, M. Jordan, S. Nowlan, and G. Hinton, "Adaptive mixtures of local experts," Neural Computation, pp. 79-87, 1991.