A probabilistic framework for modeling and real-time monitoring human fatigue

IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans

Volumn 36, Issue 5, 2006, Pages 862-875

  Ji, Qiang ^a   Lan, Peilin ^b   Looney, Carl ^b  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

^b University of Nevada   (United States)

Author keywords

Bayesian networks (BNs); dynamic Bayesian networks (DBNs); human fatigue monitoring; information fusion; vigilance test

Indexed keywords

EID: 85008002490     PISSN: 10834427     EISSN: 15582426     Source Type: Journal    
DOI: 10.1109/TSMCA.2005.855922     Document Type: Article

References (50)

1. “Evaluation of U.S. Department of Transportation efforts in the 1990s to address operator fatigue,” Nat. Transportation Safety Board, Washington, DC, Safety Rep. NTSB/SR-99/01, PB99-917002 Notation 7155, May 1999.
2. M. R. Rosekind, E. L. Co, K. B. Gregory, and D. L. Miller, “Crew factors in flight operations XIII: A survey of fatigue factors in corporate/executive aviation Operations,” Ames Res. Center, Nat. Aeronautics Space Admin., Moffett Field, CA, Tech. Rep. NASA/TM-2000-209610, Sep. 2000.
3. P. Sherry, Fatigue Countermeasures in the Railroad Industry: Past and Current Developments. Washington, D.C.: AAR Press, 2000.
4. M. R. Rosekind, “Physiological considerations of fatigue,” in Fatigue Symp. Proc. Tyson Corners, VA: Nat. Transportation Safety Board and NASA Ames Res. Center, Nov. 1995, p. 17.
5. C. A. Czeisler, “Lecture on fatigue,” Fatigue Symp. Proc. Tyson Corners, VA: Nat. Transportation Safety Board and NASA Ames Res. Center, Nov. 1995, p. 59.
6. Q. Ji and X. Yang, “Real-time eye, gaze, and face pose tracking for monitoring driver vigilance,” Real-Time Imag., vol. 8, no. 5, pp. 357–377, Oct. 2002.
7. C. D. Wylie, T. Shultz, J. C. Miller, M. M. Mitler, and R. R. Mackie, “Commercial motor vehicle driver fatigue and alertness study: Technical summary,” Federal Motor Carrier Safety Administration, Washington D.C., Tech. Rep. FHWA-MC-97-001, TC Rep. TP 12876E, Nov. 1996.
8. E. L. Co, K. B. Gregory, J. M. Johnson, and M. R. Rosekind, “Crew factors in flight operations XI: A survey of fatigue factors in regional airline operations,” NASA, Ames Res. Center, Moffett Field, CA, Tech. Rep. NASA/TM-1999-208799, Oct. 1999.
9. M. R. Rosekind, K. B. Gregory, E. L. Co, D. L. Miller, and D. F. Dinges, “Crew factors in flight operations XII: A survey of sleep quantity and quality in on-board crew rest facilities,” NASA, Ames Res. Center, Moffett Field, CA, Tech. Rep. NASA/TM-2000-209611, Sep. 2000.
10. L. Hartley, T. Horberry, N. Mabbott, and G. P. Krueger. (Sep. 2000). Review of fatigue detection and prediction technologies. Nat. Road Transport Commission, Melbourne, Vic., Australia, Tech. Rep. ISBN 0 642 54469 7. [Online]. Available: www.nrtc.gov.au
11. Q. Ji and X. Yang, “Real time visual cues extraction for monitoring driver vigilance,” in Proc. Int. Workshop Computer Systems, Vancouver, Canada, Jul. 2001, pp. 107–124.
12. Q. Ji, Z. Zhu, and P. Lan, “Real time non-intrusive monitoring and prediction of driver fatigue,” IEEE Trans. Veh. Technol., vol. 53, no. 4, pp. 1052–1068, Jul. 2004.
13. W. Harris, “Fatigue, circadian rhythm, and truck accidents,” in Vigilance: Theory, Operational Performance and Physiological Correlates, R. Mackie, Ed. New York: Plenum, 1997, pp. 133–146.
14. T. H. L. C. Department, “Fatigue: Its impact on motor vehicle accidents,” The Hartford, Hartford, CT, Tech. Rep. TIPS S 331.002, 2000.
15. J. Empson, Human Brainwaves: The Psychological Significance of the Electroencephalogram. London, U.K.: Macmillan, 1986.
16. T. Monk, D. Buysse, and L. Rose, “Wrist actigraphic measures of sleep in space,” Sleep, vol. 22, no. 7, pp. 948–954, Nov. 1999.
17. M. A. Carskadon and W. C. Dement, “The multiple sleep latency test: What does it measure?” Sleep, vol. 5, no. Suppl. 2, pp. S67-S72, 1982.
18. A. Sadeh, K. M. Sharkey, and M. A. Carskadon, “Activity-based sleep-wake identification: An empirical test of methodological issues,” Sleep, vol. 7, no. 3, pp. 201–207, Apr. 1994.
19. W. W. Wierville, “Overview of research on driver drowsiness definition and driver drowsiness detection,” in Proc. Enhanced Safety Vehicles (ESV) Conf., Munich, Germany, 1994, pp. 462–468.
20. D. F. Dinges, M. Mallis, G. Maislin, and J. W. Powell, “Evaluation of techniques for ocular measurement as an index of fatigue and the basis for alertness management,” Dept. Transportation Highway Safety Publication, Washington, DC, Tech. Rep. 808 762, Apr. 1998.
21. W. W. Wierville, L. A. Ellsworth et al., “Research on vehicle based driver status/performance monitoring: Development, validation, and refinement of algorithms for detection of driver drowsiness,” Nat. Highway Traffic Safety Admin., Washington, DC, Tech. Rep. DOT HS 808 247, 1994.
22. Anon, “Proximity array sensing system: Head position monitor/metric,” Advanced Safety Concepts Inc., Sante Fe, NM, Tech. Rep. NM 87504, 1999.
23. A. C. Stein, Z. Parseghian, R. W. Allen, and J. T. Haynes, “The development of a low cost portable system for the detection of truck driver fatigue,” in Proc. 34th Annu. Association Advancement Automotive Medicine, Scottsdale, AZ, 1990, pp. 523–536.
24. R. W. Allen, A. C. Stein, and J. C. Miller, “Performance testing as a determinant of fitness-for-duty,” presented at the SAE Aerotech, Long Beach, CA, 1990, Paper 457.
25. S. G. Charlton and M. E. Ashton, “Review of fatigue management strategies in the transport industry,” Land Transport Safety Authority, Wellington, New Zealand, Tech. Rep. 97–91, 1998.
26. N. A. Mabbott, M. Lydon, L. Hartley, and P. Arnold, “Procedures and devices to monitor operator alertness whilst operating machinery in open-cut coal mines. Stage 1: State-of-the-art review,” in ARRB Transport Res., Vermont South, Vic., Australia, Rep., RC 7433, 1999.
27. D. Dawson, N. Lamond, K. Donkin, and K. Reid, “Quantitative similarity between the cognitive psychomotor performance decrement associated with sustained wakefulness and alcohol intoxication,” in Fatigue and Transport, L. R. Hartley, Ed. Amsterdam, The Netherlands: Elsevier, 1998, pp. 231–256.
28. G. Belenky, T. J. Balkin, D. P. Redmond, H. C. Sing, M. L. Thomas, D. R. Thorne, and N. J. Wesensten, “Sustained performance during continuous operations: The U.S. army's sleep management system,” in Managing Fatigue in Transportation. Proc. 3rd Int. Conf. Fatigue and Transportation, Fremantle, W.A., Australia, L. R. Hartley, Ed. Oxford, U.K.: Elsevier, 1998.
29. T. Aerstedt and S. Folkard, “The three-process model of alertness and its extension to performance, sleep latency and sleep length,” Chronobiol. Int., vol. 14, no. 2, pp. 115–123, 1997.
30. K. Yabuta, H. Iizuka, T. Yanagishima, Y. Kataoka, and T. Seno, “The development of drowsiness warning devices,” presented at the 10th Int. Tech. Conf. Experimental Safety Vehicles, Washington, DC, 1985.
31. The das 2000 Road Alert System. [Online]. Available: www.premiersystems.com/market/
32. Zzzzalert Driver Fatigue Warning System, 2003. [Online]. Available: http://www.zzzzalert.com
33. Travalert Early Warning System, 2003. [Online]. Available: http://www. travalert.com/
34. S. Boverie et al., “Intelligent systems for video monitoring of vehicle cockpit,” in Proc. Int. Congr. Exposition ITS: Advanced Controls and Vehicle Navigation Systems, Anaheim, CA, 1998, pp. 1–5.
35. T. Ishii et al., “Automatic recognition of driver's facial expression by image analysis,” J. Soc. Automot. Eng. Jpn., vol. 41, no. 12, pp. 1398—1403, 1987.
36. H. Saito et al., “Applications of driver's line of sight to automobiles—What can driver's eye tell,” in Proc. Vehicle Navigation and Information Systems Conf, Yokohama, Japan, Aug. 1994, pp. 21–26.
37. H. Ueno et al., “Development of drowsiness detection system,” in Proc. Vehicle Navigation and Information Systems Conf, Yokohama, Japan, Aug. 1994, pp. 15–20.
38. R. Grace, (2001, Aug.) Drowsy driver monitor and warning system. Proc. Int. Driving Symp. Human Factors Driver Assessment, Training and Vehicle Design, Aspen, CO. [Online]. Available: http://www.ri.cmu.edu/pub_files/pub3/grace_richard_200l_l/grace_richard_2001_1.pdf
39. A. Heitmann, R. Guttkuhn, U. Trutschel, and M. Moore-Ede, “Technologies for the monitoring and prevention of driver fatigue,” in Proc. 1st Int. Driving Symp. Human Factors Driving Assessment, Training, and Vehicle Design, Aspen, CO, 2001, pp. 81–86.
40. K. F. V. Orden, T.-P. Jung, and S. Makeig, “Combined eye activity measures accurately estimate changes in sustained visual task performance,” Biol. Psychol., vol. 52, no. 3, pp. 221–240, 2000.
41. Learning in Graphical Models, M. I. Jordan, Ed. Cambridge, MA: MIT Press, 1999.
42. C. Looney. (2003, Oct.). Bayesian/belief networks. Lecture for CS 773c—Intelligent Systems Applications: Information Fusion. [Online]. Available: http://ultima.cs.unr.edu/cs773c/
43. F. V. Jensen, Bayesian Networks and Decision Graphs, Statistics for Engineering and Information Science. New York: Springer-Verlag, 2001.
44. W. Buntine, “Operations for learning with graphical models,” J. Artif. Intell. Res., vol. 2, pp. 159–225, 1994.
45. G. Cooper and E. Herskovits, “A Bayesian method for the induction of probabilistic network from data,” Mach. Learn., vol. 9, no. 4, pp. 309–347, 1992.
46. V. Pavlovic, A. Garg, J. Rehg, and T. S. Huang, “Multimodal speaker detection using error feedback dynamic Bayesian networks,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Hilton Head Island, SC, 2000, vol. 2, pp. 34–41.
47. D. F. Dinges and R. Grace, “Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance,” U.S. Dept. Transportation, Federal Highway Admin., Washington, DC, Tech. Rep. Publication No. FHWA-MCRT-98-006, Oct. 1998.
48. V. Mihaljlovic, M. Petkovi (2001) Dynamic Bayesian Networks: A state of the art. Comput. Sci. Dept., Univ. Twente, Enschede, The Netherlands. [Online]. Available: http://doc.utwente.nl/fid/1228
49. Z. Ghahramani, “Introduction to hidden Markov models and Bayesian networks,” Int. J. Pattern Recogn. Artif. Intell., vol. 15, no. 1, pp. 9–12, 2001.
50. R. Schafer and T. Weyrath, “Assessing temporally variable user properties with dynamic Bayesian networks,” in User Modelling: Proc. 6th Int. Conf, Sardinia, Italy, 1997, pp. 377–388.