Neural network output optimization using interval analysis

IEEE Transactions on Neural Networks

Volumn 20, Issue 4, 2009, Pages 638-653

  de Weerdt, E ^a   Chu, Q P ^a   Mulder, J A ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Feedforward neural networks (FFNNs); Global optimization; Inclusion function; Interval analysis; Optimization methods; Polynomial set; Radial basis function neural networks (RBFNNs); Taylor expansion; Taylor model (TM)

Indexed keywords

INCLUSION FUNCTION; INTERVAL ANALYSIS; OPTIMIZATION METHODS; POLYNOMIAL SET; RADIAL BASIS FUNCTION NEURAL NETWORKS (RBFNNS); TAYLOR EXPANSION; TAYLOR MODEL (TM);

ATTITUDE CONTROL; EDUCATION; GLOBAL OPTIMIZATION; OPTIMIZATION; POLYNOMIAL APPROXIMATION; RADIAL BASIS FUNCTION NETWORKS; REINFORCEMENT;

NEURAL NETWORKS;

EID: 67349202450     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2011267     Document Type: Article

References (38)

1. G. Zhang, Neural Networks in Business Forecasting. Hershey, PA: Information Science Publishing, 2003.
2. K. Smith and J. Gupta, Neural Networks in Business: Techniques and Applications. Hershey, PA: IGI Global, 2002.
3. P. Bhagat, Pattern Recognition in Industry. New York: Elsevier, 2005.
4. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
5. B. Ripley, Pattern Recognition and Neural Networks. Cambridge, U.K.: Cambridge Univ. Press, 1996.
6. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
7. M. Smith, Neural Networks for Statistical Modeling. New York: Van Nostrand, 1993.
8. S. Haykin, Neural Networks a Comprehensive Foundation. Upper Saddle River, NJ: Prentice-Hall, 1994.
9. W. McCulloch and W. Pitts, "A logical calculus of the ideas immanent in nervous activity," Bull. Math. Biophys., vol. 5, pp. 115-133, 1943.
10. P. Werbos, The Roots of Backpropagation. New York: Wiley, 1994.
11. Y. Shang and B. Wah, "Global optimization for neural network training," IEEE Comput. Sci. Eng., vol. 29, no. 3, pp. 45-54, Mar. 1996.
12. B. Cetin, J. Burdick, and J. Barhen, "Global descent replaces gradient descent to avoid local minima problem in learning with artificial neural networks," in Proc. IEEE Int. Conf. Neural Netw., 1993, pp. 836-842.
13. N. Baba, Y. Mogami, M. Kohzaki, Y. Shiraishi, and Y. Yoshida, "A hybrid algorithm for finding the global minimum of error function of neural networks and its application," Neural Netw., vol. 7, no. 8, pp. 1253-1265, 1994.
14. L. Hamm, B. Brorsen, and M. Hagan, "Comparison of stochastic global optimization methods to estimate neural network weights," Neural Process. Lett., vol. 26, pp. 145-158, 2007.
15. K. Toh, "Deterministic global optimization for FNN training," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 33, no. 6, pp. 977-983, Dec. 2003.
16. Z. Tang and G. Koehler, "Deterministic global optimal FNN training algorithms," Neural Netw., vol. 7, pp. 301-311, 1994.
17. H. Li, H. Li, and Y. Du, "A global optimization algorithm based on novel interval analysis for training neural networks," in Advances in Computation and Intelligence. Cambridge, MA: MIT Press, 2007, vol. 4683, pp. 286-295.
18. E. de Weerdt, Q. Chu, and J. Mulder, "Continuous state and action advantage-learning using interval analysis and neural networks," in Proc. AIAA Guid. Navigat. Control Conf. Exhibit, 2007, AIAA-2007-6522.
19. R. S. Sutton and A. G. Barto,, T. Dietterich, Ed., Reinforcement Learning, An Introduction, 3rd ed. Cambridge, MA: MIT Press, 1998, printing (2000).
20. L. Baird, "Reinforcement learning in continuous time: Advantage updating," in Proc. IEEE Int. Conf. Neural Netw., Jun.-Jul. 1994, vol. 4, pp. 2448-2453.
21. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996, vol. 1.
22. G. Cybenko, "Approximations by superpositions of a sigmoidal function," Math. Control Signals Syst., vol. 2, pp. 303-314, 1989.
23. R. Moore, Interval Analysis. Englewood Cliffs, NJ: Prentice-Hall, 1966.
24. E. van Kampen, Q. Chu, J. Mulder, and M. van Emden, "Nonlinear aircraft trim using interval analysis," in Proc. AIAA Guid. Navigat. Control Conf. Exhibit, Aug. 2007, AIAA-2007-6766.
25. S. Juliana, Q. Chu, J. Mulder, and T. van Baten, "Flight envelope clearance of atmospheric re-entry module with flight control," in Proc. AIAA Guid. Navigat. Control Conf. Exhibit, 2004, AIAA-2004-5170.
26. E. de Weerdt, E. van Kampen, Q. Chu, and J. Mulder, "Integer ambiguity resolution using interval analysis," J. Navigation, 2008, to be published,.
27. C. Hu and L. T. He, "An application of interval methods to stock market forecasting," Reliable Comput., vol. 13, no. 5, pp. 423-434, Oct. 2007.
28. J. Garloff, I. Idriss, and A. Smith, "Guaranteed parameter set estimation for exponential sums: The three-terms case," Reliable Comput., vol. 13, no. 4, pp. 351-359, Aug. 2007.
29. A. Neumaier, "Taylor forms - Use and limits," Reliable Comput., vol. 9, pp. 43-79, 2002.
30. K. Makino and M. Berz, "Taylor models and other validated functional inclusion functions," Int. J. Pure Appl. Math., vol. 4, no. 4, pp. 379-356, 2003.
31. K. Makino and M. Berz, "Higher order multivariate automatic differentiation and validated computation of remainder bounds," Trans. Comput., vol. 4, pp. 1611-1618, Nov. 2005.
32. K. Makino and M. Berz, "New applications of Taylor model methods," Automatic Differentiation of Algorithms: From Simulation to Optimization pp. 359-364, 2000, ISBN: 0-387-95305-1.
33. K. Makino and M. Berz, "Higher order verified inclusions of multidimensional systems by Taylor models," Nonlinear Anal., vol. 47, pp. 3503-3514, 2001.
34. M. Berz and G. Hoffstatter, "Computation and application of Taylor polynomials with interval remainder bounds," Reliable Comput., vol. 4, pp. 83-97, 1998.
35. E. Hansen and G. Walster, Global Optimization Using Interval Analysis 2nd ed. New York: Marcel Dekker/Sum Microsystems, 2004.
36. R. Moore, Methods and Applications of Interval Analysis. Philadelphia, PA: SIAM, 1979.
37. L. Jaulin, M. Kieffer, O. Didrit, and E. Walter, Applied Interval Analysis. New York: Springer-Verlag, 2001.
38. E. Hansen, A Generalized Interval Arithmetic. Berlin, Germany: Springer-Verlag, 1975, vol. 29.