Beyond backpropagation: Using simulated annealing for training neural networks

Journal of End User Computing

Volumn 11, Issue 3, 1999, Pages 3-10

  Sexton, Randall S ^a   Dorsey, Robert E ^b   Johnson, John D ^b  

^a BALL STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MISSISSIPPI   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0005942504     PISSN: 10632239     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (18)

1. Alpsan, D., Towsey, M., Ozdamar, O., Tsoi, A. C., & Ghista, D. N. (1995) "Efficacy of modified backpropagation and optimisation methods on a real-world medical problem," Neural Networks, 8(6), 945-962.
2. Archer, N. & Wang, S. (1993). "Application of the back propagation neural network algorithm with monotonicity constraints for two-group classification problems," Decision Sciences, 24(1), 60-75.
3. Cemy, V. (1985). "Thermodynamical approach to the traveling salesman problem: An efficient simulation algorithm," J. Opt. Theory Appl., 45, 41-51.
4. Corana, A., Marchesi, M., Martini, C., & Ridella, S. (1987). "Minimizing multimodal functions of continuous variables with the simulated annealing algorithm," ACM Transactions on Mathematical Software, 13, 262-80.
5. Dorsey, R. E., Johnson, J. D., & Mayer, W. J. (1994). "A genetic algorithm for the training of feedforward neural networks," Advances in Artificial Intelligence in Economics, Finance, and Management (J. D. Johnson and A. B. Whinston, eds.) Greenwich, CT: JAI Press Inc., 1, 93-111.
6. Gallant, R. A. & White, H. (1992). "On learning the derivatives of an unknown mapping with multilayer feedforward networks," Artificial Neural Networks. Cambridge, MA: Blackwell Publishers, 206-223.
7. Goffe, W. L., Ferrier, G. D., & Rogers, J., (1994). "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, 60, 65-99.
8. Hornik, K., Stinchcombe, M., & White, H. (1989). "Multilayer feed-forward networks are universal approximators," Neural Networks, 2(5), 359-366.
9. Kirkpatrick, S., Gelatt Jr. C. D. & Vecchi, M. P. (1982). "Optimization by simulated annealing," IBM Research Report RC 9355.
10. LeCun, Y. (1986). "Learning processes in an asymmetric threshold network," Disordered Systems and Biological Organization, Berlin: Springer Verlag, 233-240.
11. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., & Teller, E. (1953). "Equation of state calculations by fast computing machines," Journal of Chemistry and Physics, 21, 1087-1090.
12. Parker, D. (1985). Learning logic, 'Technical Report TR-87," Cambridge, MA: Center for Computational Research in Economics and Management Science, MIT.
13. Rumelhart, D. E., Hinton, G. G., & Williams, R. J. (1986a). "Learning internal representations by error propagation," Parallel Distributed Processing: Exploration in the Microstructure of Cognition (pp. 318-362). Cambridge MA: MIT Press.
14. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986b). Learning representations by back propagating errors," Nature 323: 533-536.
15. Salchenberger, L. M., Cinar, E. M., & Lash, N. A., "Neural networks: A new tool for predicting thrift failures," Decision Sciences, 23, 899-916.
16. Sexton, R. S., Dorsey, R.E., & Johnson, J. D. (1998). "Toward a global optimum for neural networks: A comparison of the genetic algorithm and backpropagation. Decision Support Systems, 22(2), 171-186.
17. Sexton, R. S., Alidaee, B., Dorsey, R. E., & Johnson, J. D. (1998). "Global optimization for artificial neural networks: A tabu, search application. European Journal of Operational Research, 106/2(3), 570-584.
18. Sexton, R. S. & Dorsey, R. E. (1998). "The use of parsimonious neural networks for forecasting financial time series," Journal of Computational Intelligence in Finance, 6(1), 24-31.