A new reinforcement learning vehicle control architecture for vision-based road following

IEEE Transactions on Vehicular Technology

Volumn 49, Issue 3, 2000, Pages 997-1005

  Oh, Se Young ^a   Lee, Jeong Hoon ^b   Choi, Doo Hyun ^c  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

^b Penta Security Systems Inc   (South Korea)

^c Seoul National University   (South Korea)

Author keywords

Lateral control; Neural networks; Reinforcement learning; Road following; Vehicle dynamics

Indexed keywords

HIGH CURVATURE ROADS; LATERAL CONTROL; REINFORCEMENT LEARNING; VEHICLE CONTROL; VEHICLE DYNAMICS; VISION BASED ROAD FOLLOWING;

COMPUTER SIMULATION; CONTROL SYSTEM SYNTHESIS; CURVES (ROAD); GROUND VEHICLES; IMAGE PROCESSING; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEURAL NETWORKS;

INTELLIGENT CONTROL;

EID: 0033685792     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/25.845116     Document Type: Article

References (18)

1. D. Pomerleau, Neural network perception for mobile robot guidance, Ph.D. dissertation, Carnegie-Mellon Univ., Pittsburgh, PA, 1992.
2. Y. Wang, D. Shen, E. K. Teoh, and H. Wang, A novel lane model for lane boundary detection, in MVA'98, pp. 27-30.
3. A. Broggi, Parallel and local feature extraction: A real-time approach to road boundary detection, IEEE Trans. Image Processing, vol. 4, no. 2, pp. 217-223, 1995.
4. Z. G. Zhu, S. Q. Yang, G. Y. Xu, X. Y. Lin, and D. J. Shi, Fast road classification and orientation estimation using omni-view images and neural networks, IEEE Trans. Image Processing, vol. 7, no. 8, pp. 1182-1197, 1998.
5. C. F. Lin and K. H. Hsieh, Straight line motion control for autonomous land vehicles using ID image-processing techniques, J. Robotic Syst., vol. 15, no. 10, pp. 537-549, 1998.
6. C. Roman and C. Reinholtz, Robust course-boundary extraction algorithms for autonomous vehicles, IEEE Expert, vol. 13, no. 6, pp. 32-39, 1998.
7. H. Mayer, I. Laptev, and A. Baumgartner, Multi-scale and snakes for automatic road extraction, in ECCV'98, pp. 720-733.
8. D. Pomerleau and T. Jochem, A rapidly adapting machine vision for automated vehicle steering, IEEE Expert, vol. 11, pp. 19-27, 1996.
9. J. K. Hedrick, M. Tomizuka, and P. Varaiya, Control issues in automated highway systems, IEEE Trans. Control Syst., pp. 21-32, 1994.
10. E. D. Dickmanns and B. G. Mysliwetz, Recursive 3-D road and relative ego-state recognition, IEEE Trans. Pattern Anal. Machine Intell, vol. 14, pp. 199-213, 1992.
11. D.-H. Choi, S.-Y Oh, and K. Kim, Connectionist-nonconnectionist fusion architecture for high speed road following, Neural, Parallel Sei. Comput., vol. 4, no. 3, pp. 367-386, Sept. 1996.
12. G. Yu and I. K. Sethi, Road following with continuous learning, in P roc. Intelligent Vehicle'95, Detroit, MI, pp. 412-117.
13. L. P. Kaelbling, M. L. Littman, and A. W. Moore, Reinforcement learning: A survey, J. Artificial Intell., pp. 237-285, 1986.
14. R. S. Sutton, Learning to predict by the methods of temporal difference, Machine Learning, vol. 3, pp. 9-14, 1988.
15. A. G. Barto, R. S. Sutton, and C. W. Anderson, Neuronlike adaptive elements that can solve difficult learning control problems, IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 5, 1983.
16. V. Gullapalli, A stochastic reinforcement learning algorithm for learning real-valued functions, Neural Networks, vol. 3, no. 6, pp. 671-692, 1990.
17. J. Lee, S.-Y. Oh, and D.-H. Choi, TD based reinforcement learning using neural networks in control problems with continuous action space, in Int. Joint Conf. Neural Networks, Alaska, May 1998, pp. 2028-2033.
18. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision. Reading, MA: Addison-Wesley, 1992, vol. 1.