Stochastic validation for automated tuning of neural network's hyper-parameters

Robotics and Autonomous Systems

Volumn 21, Issue 1, 1997, Pages 83-93

  Dubrawski, Artur ^a,b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b INSTITUTE OF FUNDAMENTAL TECHNOLOGICAL RESEARCH   (Poland)

Author keywords

Mobile robot positioning; Neural networks; Parameter tuning; Stochastic validation

Indexed keywords

LEARNING ALGORITHMS; MOBILE ROBOTS; NEURAL NETWORKS; OPTIMIZATION; PARAMETER ESTIMATION; POSITION CONTROL; RANDOM PROCESSES;

HYPER PARAMETERS; STOCHASTIC VALIDATION;

LEARNING SYSTEMS;

EID: 0031176030     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0921-8890(97)00008-0     Document Type: Article

References (16)

1. K. Balakrishnan and V. Honavar, Evolutionary design of neural architectures - a preliminary taxonomy and guide to literature, Technical Report CS TR 95-01, Iowa State University, 1995.
2. G.E.P. Box and N.R. Draper, Empirical Model-Building and Response Surfaces (Wiley, New York, 1987).
3. G.A. Carpenter, S. Grossberg, N. Markuzon, J.H. Reynolds and D.B. Rosen, Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multi-dimensional maps, IEEE Transaction on Neural Networks 3 (5) (1992) 689-713.
4. G.A. Carpenter, S. Grossberg and D. Rosen, Fuzzy ART: Fast stable learning of analog patterns by an adaptive resonance system, Neural Networks 4 (1991) 759-771.
5. K. Deng and A.W. Moore, Multiresolution instance-based learning, Int. Joint Conf. on Artificial Intelligence, Montreal, Canada (1995).
6. A. Dubrawski, Neurocomputing for mobile robot navigation - successful and promising attempts (unpublished lecture notes), Proc. 3rd Int. Symp. on Intelligent Robotics Systems SIRS'95, Pisa, Italy (1995).
7. A. Dubrawski, Memory-based stochastic optimization for automated tuning neural network's high level parameters, Proc. 4th Int. Symp. on Intelligent Robotic Systems SIRS'96, Lisbon, Portugal (1996).
8. A. Dubrawski and J.L. Crowley, Self-supervised system for reactive navigation, IEEE Int. Conf. on Robotics and Automation, San Diego, USA (1994).
9. A. Dubrawski and P. Reignier, Learning to categorize perceptual space of a mobile robot using fuzzy-ART neural network, IEEE/RSJ Int. Conf. on Intelligent Robots and Systems IROS'94, Munich, Germany (1994).
10. A. Dubrawski and J. Schneider, Memory-based stochastic optimization for validation and tuning of function approximators, Proc. 6th Int. Workshop on Artificial Intelligence and Statistics AISTATS-97, Fort Lauderdale, Florida, USA (1997), to appear.
11. L.P. Kaelbling, Learning in embedded systems, Ph.D. Thesis, Technical Report TR-90-04, Department of Computer Science, Stanford University, 1990.
12. A.W. Moore, C.G. Atkeson and S. Schaal, Memory-based learning for control, Technical Report CMU-RI-TR-95-18, The Robotics Institute, Carnegie Mellon University, 1995.
13. A.W. Moore and J. Schneider, Memory-based stochastic optimization, Advances in Neural Information Processing Systems 8 (1995).
14. J. Racz and A. Dubrawski, Artificial neural network for mobile robot topological localization, Robotics and Autonomous Systems 16 (1) (1995) 73-80.
15. S.M. Weiss and C.A. Kulikowski, Computer Systems That Learn (Kaufman, Los Altos, CA, 1991).
16. X. Yao, A review of evolutionary artificial neural networks, International Journal of Intelligent Systems 8 (4) (1993) 539-567.