How to not get frustrated with neural networks

Proceedings of the IEEE International Conference on Industrial Technology

Volumn , Issue , 2011, Pages 5-11

  Wilamowski, Bogdan M ^a  

^a AUBURN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERROR BACK PROPAGATION; LM ALGORITHM; MATRIX; MULTI LAYER PERCEPTRON; TRAINING PATTERNS;

ALGORITHMS; LAGRANGE MULTIPLIERS; NETWORK ARCHITECTURE; NETWORK LAYERS; WIRELESS SENSOR NETWORKS;

NEURAL NETWORKS;

EID: 79955939517     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIT.2011.5754336     Document Type: Conference Paper

References (21)

1. Stuttgart Neural Network Simulator SNNS http://www.ra.cs.uni-tuebingen. de/SNNS/
2. Rumelhart, D. E., Hinton, G. E. and Wiliams, R. J, "Learning representations by back-propagating errors", Nature, vol. 323, pp. 533-536, 1986
3. Scott E. Fahlman. Faster-learning variations on back-propagation: An empirical study. In T. J. Sejnowski G. E. Hinton and D. S. Touretzky, editors, 1988 Connectionist Models Summer School, San Mateo, CA, 1988. Morgan Kaufmann.
4. K. Levenberg, "A method for the solution of certain problems in least squares". Quarterly of Applied Machematics, 5, pp. 164-168, 1944.
5. Hagan, M. T. and Menhaj, M., "Training feedforward networks with the Marquardt algorithm", IEEE Transactions on Neural Networks, vol. 5, no. 6, pp. 989-993, 1994
6. MATLAB Neural Network ToolBox http://www.mathworks.com/products/ neuralnet/
7. B. M. Wilamowski, N. J. Cotton, O. Kaynak, G. Dundar, "Computing Gradient Vector and Jacobian Matrix in Arbitrarily Connected Neural Networks," IEEE Trans. on Industrial Electronics, vol. 55, no. 10, pp. 3784-3790, Oct 2008
8. B. M. Wilamowski, H. Yu, "Improved Computation for Levenberg Marquardt Training," IEEE Trans. on Neural Networks, vol. 21, no. 6, pp. 930-937, June 2010
9. B. M. Wilamowski and H. Yu, "Neural Network Learning Without Backpropagation," IEEE Trans. on Neural Networks, vol. 21, no.11, pp. 1793-1803 Nov. 2010
10. B. M. Wilamowski, " Neural Network Architectures and Learning algorithms", IEEE Industrial Electronics Magazine, vol 3, no 4, pp.56-63, (2009)
11. Bogdan M. Wilamowski "Efficient Neural Network Architectures and Advanced Training Algorithms", Gdańsk University of Technology Faculty of ETI Annals, Vol 18, pp. 345-352, 2010
12. B. Wilamowski, D. Hunter, A. Malinowski, "Solving Parity-n Problems with Feedforward Neural Network," Proc. of the IJCNN'03 International Joint Conference on Neural Networks, pp. 2546-2551, Portland, Oregon, July 20-23, 200.
13. nd Edition, chapter 10, pp. 10-1 to 10-8, CRC Press 2011.
14. B. M. Wilamowski, "Challenges in Applications of Computational Intelligence in Industrial Electronics" ISIE10 - International Symposium on Industrial Electronics, Bari, Italy, July 4-7, 2010, pp. 15-22.
15. B. M. Wilamowski, N. J. Cotton, O. Kaynak,, and G. Dundar, "Method of computing gradient vector and Jacobean matrix in arbitrarily connected neural networks" ISIE 2007- IEEE International Symposium on Industrial Electronics, Vigo, Spain, 4-7 June 2007, pp. 3298-3303
16. B. M. Wilamowski, N. Cotton, J. Hewlett, and O. Kaynak, "Neural Network Trainer with Second Order Learning Algorithms", 11th INES 2007 -International Conference on Intelligent Engineering Systems, Budapest, Hungary, June 29 2007-July 1 2007, pp. 127-132H.
17. Yu and B. M. Wilamowski, "Fast and efficient and training of neural networks," in Proc. 3nd IEEE Human System Interaction Conf. HSI 2010, Rzeszow, Poland, May 13-15, 2010, pp. 175-181
18. Jian-Xun Peng, Kang Li, G.W. Irwin, "A New Jacobian Matrix for Optimal Learning of Single-Layer Neural Networks," IEEE Trans. on Neural Networks, vol. 19, no. 1, pp. 119-129, Jan 2008.
19. Sugeno and G. T. Kang, "Structure Identification of Fuzzy Model," Fuzzy Sets and Systems, Vol. 28, No. 1, pp. 15-33, 1988.
20. T. Takagi and M. Sugeno, "Fuzzy Identification of Systems and Its Application to Modeling and Control," IEEE Transactions on System, Man, Cybernetics, Vol. 15, No. 1, pp. 116-132, 1985.
21. NBN training software http://www.eng.auburn.edu/~wilambm/nnt/ NBNTrainer210.zip