Global optimization for artificial neural networks: A tabu search application

European Journal of Operational Research

Volumn 106, Issue 2-3, 1998, Pages 570-584

  Sexton, Randall S ^a   Alidaee, Bahram ^c   Dorsey, Robert E ^b   Johnson, John D ^c  

^a BALL STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MISSISSIPPI   (United States)

^c NONE

Author keywords

Neural networks; Optimization; Tabu Search

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; BACKPROPAGATION; CHAOS THEORY; CONVERGENCE OF NUMERICAL METHODS; MATHEMATICAL MODELS; MONTE CARLO METHODS; OPTIMIZATION; TIME SERIES ANALYSIS;

GLOBAL OPTIMIZATION; TABU SEARCH METHODS;

NEURAL NETWORKS;

EID: 0032051287     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0377-2217(97)00292-0     Document Type: Article

References (49)

1. Archer, N., Wang, S., 1993. Application of the back propagation neural network algorithm with monotonicity constraints for two-group classification problems. Decision Sciences 24(1), 60-75.
2. Bland, J.A., Dawson, G.P., 1991. Tabu search and design optimisation. Computer Aided Design 23, 195-201.
3. Bland, J.A., 1993. Nonlinear optimization of constrained functions using tabu search. International Journal of Mathematical Education in Science and Technology 24 (5), 741-747.
4. Bland, J.A., 1994. A derivative-free exploratory tool for function minimisation based on tabu search. Advances in Engineering Software, 91-96.
5. Chen, J.R., Mars, P., 1990. Stepsize variation methods for accelerating the back propagation algorithm. Proceedings of the International Joint Conference on Neural Networks, Washington, DC, 1, pp. 601-604.
6. Crainic, T., Gendreay, M., Soriano, P., Toulouse, M., 1991. A tabu search procedure for multicommodity location/allocation with balancing requirements. Publication #797, Centre de Recherche sur les Transports, Université de Montreal.
7. de Werra, D., Hertz, A., 1989. Tabu search techniques: A tutorial and an application to neural networks. Operations Research Spektrum 11, 131-141.
8. Franzini, M.A., 1987. Speech recognition with back propagation. Proceedings of the IEEE/Ninth Annual Conference of the Engineering in Medicine and Biology Society, Boston, MA, 9, 1702-1703.
9. Funahashi, K., 1989. On the approximate realization of continuous mappings by neural networks. Neural Networks 2 (3), 183-192.
10. Gallant, R.A., White, H., 1992. On learning the derivatives of an unknown mapping with multilayer feedforward networks. Artificial Neural Networks. Blackwell Cambridge, MA, pp. 206-223.
11. Glover, F., 1986. Future paths for integer programming and links to artificial intelligence. Computer Operations Research 13, 533-549.
12. Glover, F., 1988. Tabu search. CAAI Report 88-3, University of Colorado, Boulder.
13. Glover, F., 1990. Tabu search: A tutorial. Interfaces 20, 74-94.
14. Glover, F., Laguna, M., 1993. Bandwidth packing: A tabu search approach. Management Science 39 (4) 492-500.
15. Goffe, W.L., Ferrier, G.D., Rogers, J., 1994. Global optimization of statistical functions with simulated annealing. Journal of Econometrics 60, 65-99.
16. Hadar, J., 1971. Mathematical Theory of Economic Behavior. Addison-Wesley, Philippines, pp. 31-33.
17. Hansen, P., Jaumard, B., 1987. Algorithms for the maximum satisfiability problem. RUTCOR Research Report 43-87. Rutgers University, New Brunswick, NJ.
18. Hertz, A., de Werra, D., 1990. The tabu search metaheuristic: How we used it. Annals of Mathematics and Artificial Intelligence 1, 111-121.
19. Holt, M.J., Semnani, S., 1990. Convergence of back propagation in neural networks using a log-likelihood cost function. Electron Letters 26, 1964-1965.
20. Hornik, K., Stinchcombe, M., White, H., 1989. Multilayer feed-forward networks are universal approximators. Neural Networks 2 (5), 359-366.
21. Hsiung, J.T., Suewatanakul, W., Himmelblau, D.M., 1990. Should backpropagation be replaced by more effective optimization algorithms? Proceedings of the International Joint Conference on Neural Networks (IJCNN), 7, pp. 353-356.
22. Izui, Y., Pentland, A., 1990. Analysis of neural networks with redundancy. Neural Computation 2, 226-238.
23. Kelly, J., Golden, B., Assad, A., 1993. Large-scale controlled rounding using tabu search with strategic oscillation. Annals of Operation Research 41, 69-84.
24. Knox, J.E., 1989. The Application of Tabu Search to the Symmetric Traveling Salesman Problems. Ph.D. Thesis, University of Colorado, USA.
25. Laguna, M., Kelly, J., González, V., Glover, F., 1995. Tabu search for the multilevel generalized assignment problem. European Journal of Operational Research 82, 176-189.
26. LeCun, Y., 1986. Learning Processes in an Asymmetric Threshold Network. Disordered Systems and Biological Organization, Springer, Berlin, pp. 233-40.
27. LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jsckel, L.D., 1989. Backpropagation applied to handwritten zip code recognition. Neural Computation 1, 541-551.
28. Lee, J., Bien, Z., 1991. Improvement on function approximation capability of backpropagation neural networks. Proceedings of the International Joint Conference on Neural Computation, 1, 541-551.
29. Lenard, M., Alam, P., Madey, G., 1995. The applications of neural networks and a qualitative response model to the auditor's going concern uncertainty decision. Decision Sciences 26 (2), 209-227.
30. Madey, G.R., Denton, J., 1988. Credit evaluation with missing data fields. Proceedings of the INNS, Boston, p. 456.
31. Matsuoka, K., Yi, J., 1991. Backpropagation based on the logarithmic error function and elimination of local minima. Proceedings of the International Joint Conference on Neural Networks, Singapore, 2, pp. 1117-1122.
32. Parker, D., 1985. Learning logic (Technical Report TR-87). Center for Computational Research in Economics and Management Science, MIT, Cambridge, MA.
33. Plaut, D.C., Nowlan, S.J., Hinton, G.E., 1988. Experiments on learning by back propagation (CMU-CS-86-126), Department of Computer Science, Carnegie-Mellon University, Pittsburgh, PA.
34. Rumelhart, D., Hinton, G., Williams, R., 1986. Learning internal representations by error propagation. In: Rumelhart, D., McCleeland, J. (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1. MIT Press, Cambridge, MA.
35. Salchenberger, L.M., Cinar, E.M., Lash, N.A., 1992. Neural networks: A new tool for predicting thrift failures,. Decision Sciences 23, 899-916.
36. Samad, T., 1990. Backpropagation improvements based heuristic arguments. Proceedings of the International Joint Conference on Neural Networks, Washington, DC, vol. I, pp. 565-568.
37. Shang, Y., Wah B.W., 1996. Global optimization for neural network training, Computer, March, 45-54.
38. Shoemaker, P.A., Carlin, M.J., Shimabukuro, R.L., 1991. Back propagation learning with trinary quantization of weight updates,. Neural Networks 4, 231-241.
39. Sietsma, J., Dow, R.J.F., 1991. Creating artificial neural networks that generalize. Neural Networks 2, 67-79.
40. Skorin-Kapov, J., 1990. Tabu search applied to the quadratic assignment problem. ORSA Journal on Computing 2, 33-45.
41. Solla, S.A., Levin, E., Fleisher, M., 1988. Accelerated learning in layered neural networks. Complex Systems 2, 34-39.
42. Subramanian, V., Hung, M.S., 1990. A GRG@-based system for training neural networks: Design and computational experience,. ORSA Journal on Computing 5 (4), 386-394.
43. van Ooyen, A., Nienhuis, B., 1992. Improving the convergence of the back propagation algorithm. Neural Networks 5, 465-471.
44. Wang, S., 1995. The unpredictability of standard back propagation neural networks in classification applications,. Management Science 41 (3), 555-559.
45. Watrous, R.L., 1987. Learning algorithms for connections and networks: Applied gradient methods of nonlinear optimization. Proceedings of the IEEE Conference on Neural Networks 2, IEEE, San Diego, CA, pp. 619-627.
46. Weigend, A.S., Rumelhart, D.E., Huberman, B.A., 1991. Back propagation, weight-elimination and time series prediction. In: Touretzky, D.S., Elman, J.L., Sejnowski, T.J., Hinton, G.E. (Eds.), Connectionist Models. Proceedings of the 1990 Connectionist Models Summer School. Morgan Kaufmann, San Mateo, CA, pp. 105-116.
47. Werbos, P.J., 1974. Beyond regression: New tools for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard University, Cambridge, MA, 1974.
48. Werbos, P., 1993. The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting. John Wiley, New York, NY.
49. White, H., 1987. Some asymptotic results for back-propagation. Proceedings of the IEEE Conference on Neural Networks 3, IEEE, San Diego, CA, pp. 261-66.