Random weights search in compressed neural networks using overdetermined pseudoinverse

IEEE International Symposium on Industrial Electronics

Volumn II, Issue , 2003, Pages 678-683

  Manic, M ^a   Wilamowski, B ^a  

^a UNIVERSITY OF IDAHO   (United States)

Author keywords

Convergence; Educational institutions; Intelligent networks; Iterative algorithms; Iterative methods; Neural networks; Neurons; Robustness; Search methods; USA Councils

Indexed keywords

ALGORITHMS; HARDWARE; INDUSTRIAL ELECTRONICS; INTELLIGENT NETWORKS; NETWORK ARCHITECTURE; NETWORK LAYERS; NEURAL NETWORKS; NEURONS; ROBUSTNESS (CONTROL SYSTEMS);

CONVERGENCE; EDUCATIONAL INSTITUTIONS; ITERATIVE ALGORITHM; SEARCH METHOD; USA COUNCILS;

ITERATIVE METHODS;

EID: 50049111214     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIE.2003.1267901     Document Type: Conference Paper

References (16)

1. J.M. Zurada. Artificial Neural Systems, PWS Publishing Company, St. Paul. MN, 1995.
2. Rumelhart, D.E., Hinton, G.E., and Williams, R.J., Learning internal representation by error propagation, Parallel Distributed Processing. Vol.1. pp.318-362, MIT Press, Cambridge, MA., 1986
3. Sejnowski T.J., Rosenberg, C.R., Parallel networks that learn to pronounce English text, Complex Systems 1:145-168, 1987.
4. Fahlman S.E., "Faster-learning variations on backpropagation: An empirical study", Proceedings of the Connectionist Models Summer School, eds. D.Touretzky, G. Hinton, and T.Sejnowski, Morgan Kaufmann, San Mateo, CA, 1988.
5. Wilamowski, M., Torvik, L., "Modification of gradient computation in the back propagation algorithm", Artificial Neural Network in Engineering, Nov., St.Louis, Missou., 1993.
6. Glover, F., "Future paths for integer programming and links to artificial intelligence", Computers & Operations Research 13, pp.533-549, 1986.
7. Hansen, P., "The steepest ascent mildest descent heuristic for combinatorial programming", Talk presented at the Congresss on Numerical Methods in Combinatorial Optimization, Capri, 1986.
8. Glover, F., Tabu Search:part I. ORSA Journal on Computing 1, pp. 190-206, 1989.
9. Glover, F., Tabu Search:part II. ORSA Journal on Computing 2, pp.4-32, 1990.
10. de Werra, D., Hertz, A., "Tabu search techniques: a tutorial and an application to neural networks". OR Spektrum 11, pp.131-141, 1989.
11. Battiti, R; Tecchiolli, G. "Training Neural Nets with the Reactive Tabu Search". IEEE transactions on neural networks, no. 5, pp. 1185-1201, 1995.
12. Vaithyanathan, S; Burke, L.I, Magent, M.A., "Massively parallel analog tabu search using neural networks applied to simple plant location problems", European Journ. of Operat. Research. 93, no. 2, pp. 317-321, 1996.
13. Magent, M.A., Combining neural networks and TABU search in a fast neural network simulation for combinatorial optimization. Thesis manuscript, Lehigh University, 1997.
14. Pham D.T., Karaboga, D., Intelligent optimisation techniques : genetic algorithms, tabu search, simulated annealing and neural networks, London : New York : Springer, 2000.
15. Laguna, M., Martí, R., "Neural network prediction in a system for optimizing simulations", IIE Transactions 34, no. 3, pp. 273-282, 2002.
16. Rao, C., Mitra, S., Generalized inverse of matrices and its applications, John Wiley & Sons, New York, 1971.