On the roles of eye gaze and head dynamics in predicting driver's intent to change lanes

IEEE Transactions on Intelligent Transportation Systems

Volumn 10, Issue 3, 2009, Pages 453-462

  Doshi, Anup ^a   Trivedi, Mohan Manubhai ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Driver behavior; Driver intent inference; Driver assistance systems; Intelligent vehicles; Machine vision; Sparse Bayesian learning

Indexed keywords

DRIVER BEHAVIOR; DRIVER INTENT INFERENCE; DRIVER-ASSISTANCE SYSTEMS; INTELLIGENT VEHICLES; MACHINE VISION; SPARSE BAYESIAN LEARNING;

BAYESIAN NETWORKS; COMPUTER VISION; INTELLIGENT VEHICLE HIGHWAY SYSTEMS;

AUTOMOBILE DRIVERS;

EID: 70349178650     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2009.2026675     Document Type: Article

References (46)

1. J. C. McCall, D. Wipf, M. M. Trivedi, and B. Rao, "Lane change intent analysis using robust operators and sparse Bayesian learning," IEEE Trans. Intell. Transp. Syst., vol.8, no.3, pp. 431-440, Sep. 2007.
2. M. Peden, R. Scurfield, D. Sleet, D. Mohan, A. A. Hyder, E. Jarawan, and C. Mathers, Eds., World Report on Road Traffic Injury Prevention. Geneva, Switzerland: World Health Org., 2004.
3. S. E. Lee, C. B. Olsen, and W. W. Wierwille, "A comprehensive examination of naturalistic lane changes," Nat. Highway Traffic Safety Admin., U.S. Dept. Transp., Washington, DC, Rep. DOT HS 809702, Mar. 2004.
4. L. Angell, J. Aufiick, P. A. Austria, D. Kochhar, L. Tijerina, W. Biever, T. Diptiman, J. Hogsett, and S. Kiger, "Driver workload metrics task 2 final report," Nat. Highway Traffic Safety Admin., U.S. Dept. Transp., Washington, DC, Rep. DOT HS 810635, Nov. 2006.
5. M. M. Trivedi, T. Gandhi, and J. C. McCall, "Looking in and looking out of a vehicle: Computer vision-based enhanced vehicle safety," IEEE Trans. Intell. Transp. Syst., vol.8, no.1, pp. 108-120, Mar. 2007.
6. M. M. Trivedi and S. Y. Cheng, "Holistic sensing and active displays for intelligent driver support systems," Computer, vol.40, no.5, pp. 60-68, May 2007.
7. S. Y. Cheng and M. M. Trivedi, "Turn intent analysis using body-pose for intelligent driver assistance," Pervasive Comput.-Special Issue Intell. Transp. Syst., vol.5, no.4, pp. 28-37, Oct.-Dec. 2006.
8. J. C. McCall and M. M. Trivedi, "Driver behavior and situation aware brake assistance for intelligent vehicles," Proc. IEEE, vol.95, no.2, pp. 374-387, Feb. 2007.
9. E. Murphy-Chutorian, A. Doshi, and M. M. Trivedi, "Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation," in Proc. IEEE Int. Transp. Syst. Conf., Sep. 2007, pp. 709-714.
10. S. Baker, I. Matthews, J. Xiao, R. Gross, T. Ishikawa, and T. Kanade, "Real-time non-rigid driver head tracking for driver mental state estimation," Robot. Inst., Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. 04-10, Feb. 2004.
11. Y. Zhu and K. Fujimara, "Head pose estimation for driver monitoring," in Proc. IEEE Intell. Vehicles Symp., 2004, pp. 501-506.
12. M. Smith and H. Zhang, "Safety vehicles using adaptive interface technology (task 8): A literature review of intent inference," in "SAVE-IT Phase 1 Final Report," Volpe Nat. Transp. Syst. Center, Cambridge, MA, 2004. [Online]. Available: http://www.volpe.dot.gov/hf/roadway/ saveit/
13. J. E. Hoffman, "Visual attention and eye movements," in Attention, H. Pashler, Ed. London, U.K.: Psychol., 1998, ch. 3.
14. R. R. Mourant and R. J. Donahue, Mirror Sampling Characteristics of Drivers. Warrendale, PA: Soc. Automotive Eng., 1974. no.740964.
15. L. Tijerina, W. R. Garrott, D. Stoltzfus, and E. Parmer, "Eye glance behavior of van and passenger car drivers during lane change decision phase," Trans. Res. Rec., vol.1937, pp. 37-43, 2005.
16. V. D. Bhise, J. Meldrum, D. Jack, G. Troell, D. Hoffmeister, and L. Forbes, Driver Head Movements in Left Outside Mirror Viewing. Warrendale, PA: Soc. Automotive Eng., 1981. no.810761.
17. G. H. Robinson, D. Erickson, G. Thurston, and R. Clark, "Visual search by automobile drivers," Hum. Factors, vol.14, no.4, pp. 315-323, 1972.
18. M. F. Land, "Predictable eye-head coordination during driving," Nature, vol.359, no.6393, pp. 318-320, Sep. 1992.
19. Y. Liang, M. L. Reyes, and J. D. Lee, "Real-time detection of driver cognitive distraction using SVM," IEEE Trans. Intell. Transp. Syst.,vol.8, no.2, pp. 340-350, Jun. 2007.
20. Q. Ji and X. Yang, "Real-time eye, gaze, and face pose tracking for monitoring driver vigilance," Real-Time Imaging, vol.8, no.5, pp. 357- 377, Oct. 2002.
21. D. D. Salvucci and A. Liu, "The time course of a lane change: Driver control and eye-movement behavior," Trans. Res. Part F: Traffic Psychol. Behavior, vol.5, no.2, pp. 123-132, Jun. 2002.
22. H. Zhou, M. Itoh, and T. Inagaki, "Detection of lane change intention via analyses of eye and head movement behaviors," in Proc. SICE Symp. Syst. Inf., 2006, pp. 231-236.
23. E. C. B. Olsen, S. E. Lee, and W. W. Wierwille, "Eye glance behavior during lane changes and straight-ahead driving," Trans. Res. Rec., vol.1937, pp. 44-50, 2005.
24. M. Itoh, K. Yoshimura, and T. Inagaki, "Inference of large truck driver's intent to change lanes to pass a lead vehicle via analyses of driver's eye glance behavior in the real world," in Proc. SICE Annu. Conf., Sep. 2007, pp. 2385-2389.
25. X. Liu, F. Xu, and K. Fujimura, "Real-time eye detection and tracking for driver observation under various light conditions," in Proc. IEEE Intell. Vehicles Symp., Jun. 2002, pp. 344-351.
26. R. Smith, M. Shah, and N. da Vitoria Lobo, "Determining driver visual attention with one camera," IEEE Trans. Intell. Transp. Syst., vol.4, no.4, pp. 205-218, Dec. 2003.
27. J. P. Batista, "A real-time driver visual attention monitoring system," in Proc. Iberian Conf. Pattern Recog. Image Anal., 2005, pp. 200-208.
28. L. M. Bergasa, J. Nuevo, M. A. Sotelo, R. Barea, and M. E. Lopez, "Real-time system for monitoring driver vigilance," IEEE Trans. Intell. Transp. Syst., vol.7, no.1, pp. 63-77, Mar. 2006.
29. S. Y. Cheng, S. Park, and M. M. Trivedi, "Multi-spectral and multi-perspective video arrays for driver body tracking and activity analysis," Comput. Vis. Image Underst., vol. 106, no. 2/3, pp. 245-257, May 2007. DOI:10.1016/j.cviu.2006.08.010. (Pubitemid 46670741)
30. M. J. Henning, O. Georgeon, and J. F. Krems, "The quality of behavioral and environmental indicators used to infer the intention to change lanes," in Proc. 4th Int. Driving Symp. Human Factors Driver Assessment, Training, Vehicle Des., Jul. 2007, p. 231.
31. A. Doshi and M. M. Trivedi, "A comparative exploration of eye gaze and head motion cues for lane change intent prediction," in Proc. IEEE Intell. Vehicles Symp., Jun. 2008, pp. 49-54.
32. J. C. McCall and M. M. Trivedi, "Video based lane estimation and tracking for driver assistance: Survey, system, and evaluation," IEEE Trans. Intell. Transp. Syst., vol.7, no.1, pp. 20-37, Mar. 2006.
33. P. Viola and M. J. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2001, pp. 511-518.
34. J. Wu and M. M. Trivedi, "Simultaneous eye tracking and blink detection with interactive particle filters," EURASIP J. Advances Signal Process., vol.2008, no.11, pp. 1-17, 2008.
35. N. Kuge, T. Yamamura, O. Shimoyama, and A. Liu, "A driver behavior recognition method based on a driver model framework," in Proc. Soc. Automotive Eng. World Congr., 2000, pp. 469-476.
36. N. Oliver and A. P. Pentland, "Graphical models for driver behavior recognition in a smartcar," in Proc. IEEE Intell. Vehicles Symp., 2000, pp. 7-12. (Pubitemid 32135633)
37. D. D. Salvucci, H. M. Mandalia, N. Kuge, and T. Yamamura, "Lanechange detection using a computational driver model," Hum. Factors, vol.49, no.3, pp. 532-542, Jun. 2007.
38. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol.1, pp. 211-244, Sep. 2001.
39. M. E. Tipping and A. C. Faul, "Fast marginal likelihood maximisation for sparse Bayesian models," in Proc. 9th Int. Workshop Artif. Intell. Statist., C. M. Bishop and B. J. Frey, Eds., pp. 3-6, Jan. 2003.
40. W. H. Zangemeister and L. Stark, "Types of gaze movement: Variable interactions of eye and head movements," Exp. Neurol., no.77, pp. 563- 577, 1982. (Pubitemid 12011170)
41. P. Finnegan and P. Green, "The time to change lanes: A literature review," Univ. Michigan Intell. Vehicle-Highway Syst., Ann Arbor, MI, Tech. Rep. 90-113, Sep. 1990.
42. J. C. McCall, O. Achler, M. M. Trivedi, P. Fastrez, D. Forster, J. B. Haue, J. Hollan, and E. Boer, "A collaborative approach for human-centered driving assistance systems," in Proc. IEEE Int. Transp. Syst. Conf., Oct. 2004, pp. 663-667.
43. R. R. Mourant and C. G. Grimson, "Predictive head-movements during automobile mirror sampling," Perception Motor Skills, vol.44, no.1, pp. 283-286, Feb. 1977.
44. D. D. Salvucci, "Inferring driver intent: A case study in lane-change detection," in Proc. Human Factors Ergonomics Soc. 48th Annu. Meeting, 2004, pp. 2228-2231.
45. A. Doshi and M. M. Trivedi, "Investigating the relationships between gaze patterns, dynamic vehicle surround analysis, and driver intentions," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 887-892.
46. A. Doshi and M. M. Trivedi, "Head and gaze dynamics in visual attention and context learning," in Proc. CVPR Workshop VCL, Jun. 2009, pp. 77-84.