Multimodality inferring of human cognitive states based on integration of neuro-fuzzy network and information fusion techniques

Eurasip Journal on Advances in Signal Processing

Volumn 2008, Issue , 2008, Pages

  Yang, G ^a   Lin, Y ^b   Bhattacharya, P ^c  

^a MINZU UNIVERSITY OF CHINA   (China)

^b Northeastern University   (United States)

^c University of Concordia   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; HUMAN COMPUTER INTERACTION; MATHEMATICAL MODELS; STATE SPACE METHODS; UNCERTAIN SYSTEMS;

COGNITIVE STATES; HUMAN COGNITIVE STATES; MULTIMODALITY INFERRING; NEURO-FUZZY NETWORKS;

FUZZY NEURAL NETWORKS;

EID: 36949004998     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1155/2008/371621     Document Type: Article

References (56)

1. Q. Ji Z. Zhu P. Lan Real-time non-intrusive monitoring and prediction of driver fatigue. IEEE Transactions on Vehicular Technology 53 2004 4 1052 1068
2. B. Fasel beat.fasel@idiap.ch J. Luettin juergen.luettin@ascom.ch Automatic facial expression analysis: a survey. Pattern Recognition 36 1 2003 259 275
3. Q. Ji P. Lan C. G. Looney A probabilistic framework for modeling and real-time monitoring human fatigue. IEEE Transactions on Systems, Man and Cybernetics A 36 2006 5 862 875
4. T. Oron-Gilad D. Shinar Driver fatigue among military truck drivers. Transportation Research Part F 3 2000 4 195 209
5. G. Hamouda F. F. Saccomanno Neural network model for truck driver fatigue accident detection. Proceedings of the Canadian Conference on Electrical and Computer Engineering 1 Montreal, Quebec, Canada 1995 362 365
6. C. D. He C. C. Zhao Evaluation of the critical value of driving fatigue based on the fuzzy sets theory. Environmental Research 61 1 1993 150 156
7. S. K. L. Lal sara.lal@uts.edu.au A. Craig P. Boord L. Kirkup H. Nguyen Development of an algorithm for an EEG-based driver fatigue countermeasure. Journal of Safety Research 34 3 2003 321 328
8. R.-C. Wu allen.ece86g@nctu.edu.tw C.-T. Lin S.-F. Liang T.-Y. Huang Y.-C. Chen T.-P. Jung jung@sccn.ucsd.edu Estimating driving performance based on EEG spectrum and fuzzy neural network. Proceedings of the IEEE International Joint Conference on Neural Networks 1 Budapest, Hungary 2004 585 590
9. B. J. Wilson T. D. Bracewell Alertness monitor using neural networks for EEG analysis. Proceedings of the IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing (NNSP '00) 2 Sydney, Australia 2000 814 820
10. T. H. Linh linh@iem.pw.edu.pl M. Stodolski S. Osowski sto@iem.pw.edu.pl On-line heart beat recognition using Hermite polynomials and neuro-fuzzy network. IEEE Transactions on Instrumentation and Measurement 52 4 2003 1224 1231
11. M. Lagerholm C. Peterson G. Braccini L. Edenbrandt L. Sörnmo Clustering ECG complexes using Hermite functions and self-organizing maps. IEEE Transactions on Biomedical Engineering 47 7 2000 838 848
12. R. W. Picard E. Vyzas J. A. Healey Toward machine emotional intelligence: analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 2001 1175 1191
13. E. Vyzas R. W. Picard AAAI Fall Symposium Series Affective pattern classification. Emotional and Intelligent: the Tangled Knot of Cognition Orlando, Fla, USA 1998
14. W.-B. Horng horng@mail.tku.edu.tw C.-Y. Chen Y. Chang C.-H. Fan chunhai@mail.tku.edu.tw Driver fatigue detection based on eye tracking and dynamic template matching. Proceedings of the IEEE International Conference on Networking, Sensing and Control 1 Taipei, Taiwan 2004 7 12
15. Y. Norimatsu S. Mita K. Kozuka T. Nakano S. Yamamoto 1 Detection of the gaze direction using the time-varying image processing. Proceedings of the 6th IEEE Annual Conference on Intelligent Transportation Systems Shanghai, China 2003 74 79
16. D.-J. Kim djkim@mail.kaist.ac.kr Z. Bien zbien@ee.kaist.ac.kr K.-H. Park akaii@robotian.net Fuzzy neural networks(FNN)-based approach for personalized facial expression recognition with novel feature selection method. Proceedings of the 12th IEEE International Conference on Fuzzy Systems (FUZZ '03) 2 St. Louis, Mo, USA 2003 908 913
17. S. K. L. Lal sara.lal@uts.edu.au A. Craig A critical review of the psychophysiology of driver fatigue. Biological Psychology 55 3 2001 173 194
18. P. Vysok vysoky@fd.cvut.cz Changes in car driver dynamics caused by fatigue. Neural Network World 14 1 2004 109 117
19. P. Vysok Central fatigue identification of human operator. Neural Network World 11 5 2001 525 535
20. Y. Lin ylin@ece.concordia.ca P. Tang W. J. Zhang wjz485@engr.usask.ca Q. Yu Artificial neural network modelling of driver handling behaviour in a driver-vehicle-environment system. International Journal of Vehicle Design 37 1 2005 24 45
21. C. Conati Probabilistic assessment of user's emotions in educational games. Applied Artificial Intelligence 16 7-8 2002 555 575
22. X. Li xylum@umich.edu Q. Ji qji@ecse.rpi.edu Active affective state detection and user assistance with dynamic Bayesian networks. IEEE Transactions on Systems, Man, and Cybernetics A 35 1 2005 93 105
23. Y. Zhang Q. Ji C. G. Looney 1 Active information fusion for decision making under uncertainty. Proceedings of the 5th International Conference on Information Fusion Annapolis, Md, USA 2002 643 650
24. C.-F. Juang C.-T. Lin An on-line self-constructing neural fuzzy inference network and its applications. IEEE Transactions on Fuzzy Systems 6 1 1998 12 32
25. G. Beliakov Methods of construction of OWA operators from data. Proceedings of the 10th IEEE International Conference on Fuzzy Systems 1 Melbourne, Australia 2001 184 187
26. T. Calvo tomasa.calvo@uib.es R. Mesiar mesiar@math.sk R. R. Yager yager@panix.com Quantitative weights and aggregation. IEEE Transactions on Fuzzy Systems 12 1 2004 62 69
27. D. Filev R. R. Yager ryager@iona.edu On the issue of obtaining OWA operator weights. Fuzzy Sets and Systems 94 2 1998 157 169
28. M. O'Hagan Aggregating template or rule antecedents in real-time expert systems with fuzzy set logic. Proceedings of the 22nd Asilomar Conference Signals, Systems and Computers 2 Pacific Grove, Calif, USA 1988 681 689
29. V. Torra Learning weights for weighted OWA operators. Proceedings of the 26th Annual Confjerence of the IEEE Industrial Electronics Society (IECON '00) 4 Nagoya, Japan 2000 2530 2535
30. R. R. Yager On ordered weighted averaging aggregation operators in multicriteria decision making. IEEE Transactions on Systems, Man and Cybernetics 18 1988 1 183 190
31. R. R. Yager 1 OWA neurons: a new class of fuzzy neurons. Proceedings of the International Joint Conference on Neural Networks (IJCNN '92) Baltimore, Md, USA 1992 226 231
32. R. R. Yager yager@panix.com Modeling prioritized multicriteria decision making. IEEE Transactions on Systems, Man, and Cybernetics B 34 6 2004 2396 2404
33. R. R. Yager yager@panix.com OWA aggregation over a continuous interval argument with applications to decision making. IEEE Transactions on Systems, Man, and Cybernetics B 34 5 2004 1952 1963
34. P. Thiffault pierre.thiffault@mcgill.ca J. Bergeron Monotony of road environment and driver fatigue: a simulator study. Accident Analysis & Prevention 35 3 2003 381 391
35. T.-P. Jung S. Makeig M. Stensmo T. J. Sejnowski Estimating alertness from the EEG power spectrum. IEEE Transactions on Biomedical Engineering 44 1 1997 60 69
36. J. C. Principe S. K. Gala T. G. Chang Sleep staging automaton based on the theory of evidence. IEEE Transactions on Biomedical Engineering 36 5 1989 503 509
37. G. Calcagnini G. Biancalana F. Giubilei S. Strano S. Cerutti Spectral analysis of heart rate variability signal during sleep stages. Proceedings of the 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society Baltimore, Md, USA 2 1994 1252 1253
38. C. Li C. Zheng C. Tai Detection of ECG characteristic points using wavelet transforms. IEEE Transactions on Biomedical Engineering 42 1 1995 21 28
39. J. P. Martínez jpmart@unizar.es R. Almeida S. Olmos A. P. Rocha P. Laguna A wavelet-based ECG delineator evaluation on standard databases. IEEE Transactions on Biomedical Engineering 51 4 2004 570 581
40. J. S. Sahambi S. N. Tandon R. K. P. Bhatt Using wavelet transforms for ECG characterization. An on-line digital signal processing system. IEEE Engineering in Medicine and Biology Magazine 16 1 1997 77 83
41. K. Murai Y. Hayashi N. Wakabayashi Analysis of heart rate variability of navigator at in/from ports by wavelet transform. Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM '01) 2 Victoria, BC, Canada 2001 681 685
42. W. W. Wierwille L. A. Ellsworth S. S. Wreggit R. J. Fairbanks C. L. Kim Research on vehicle-based driver status/performance monitoring: development, validation, and refinement of algorithms for detection of driver drowsiness. National Highway Traffic Safety Administration Final Report: DOT HS 808 247 1994
43. S. Barada sulbarada@aol.com H. Singh Generating optimal adaptive fuzzy-neural models of dynamical systems with applications to control. IEEE Transactions on Systems, Man and Cybernetics C 28 3 1998 371 391
44. S. Abe R. Thawonmas A fuzzy classifier with ellipsoidal regions. IEEE Transactions on Fuzzy Systems 5 3 1997 358 368
45. S. Osowski sto@iem.pw.edu.pl T. H. Linh K. Brudzewski Neuro-fuzzy TSK network for calibration of semiconductor sensor array for gas measurements. IEEE Transactions on Instrumentation and Measurement 53 3 2004 630 637
46. M. Sugeno T. Yasukawa Fuzzy-logic-based approach to qualitative modeling. IEEE Transactions on Fuzzy Systems 1 1 1993 7 31
47. R. R. Yager D. P. Filev Approximate clustering via the mountain method. IEEE Transactions on Systems, Man and Cybernetics 24 8 1994 1279 1284
48. C.-C. Wong C.-C. Chen A hybrid clustering and gradient descent approach for fuzzy modeling. IEEE Transactions on Systems, Man, and Cybernetics B 29 6 1999 686 693
49. D. Filev R. R. Yager Learning OWA operator weights from data. Proceedings of the 3rd IEEE Conference on Fuzzy Systems, IEEE World Congress on Computational Intelligence 1 Orlando, Fla, USA 1994 468 473
50. J. A. Healey Wearable and automotive systems for affective recognition from physiology. Massachusetts Institute of Technology Mass, USA 2000 Doctoral thesis
51. V. Torra Learning weights for weighted OWA operators. Proceedings of the 26th Annual Confjerence of the IEEE Industrial Electronics Society (IECON '00) 4 Nagoya, Japan 2000 2530 2535
52. Y. Zhang zhangy5@rpi.edu Q. Ji qji@ecse.rpi.edu Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 5 2005 699 714
53. Q. Wang nustdaisy@gmail.com J. Yang nustdaisy@gmail.com M. Ren nustdaisy@gmail.com Y. Zheng nustdaisy@gmail.com Driver fatigue detection: a survey. Proceedings of the 6th World Congress on Intelligent Control and Automation (WCICA '06) 2 Dalian, China 2006 8587 8591
54. R. Grace V. E. Byrne D. M. Bierman 2 A drowsy driver detection system for heavy vehicles. Proceedings of the 17th Digital Avionics Systems Conference (DASC '98) Bellevue, Wash, USA 1998 I36/1 I36/8
55. http://www.optalert.com/optalertTM_technology.html
56. A. Smiley Fatigue management: lessons from research. Managing Fatigue in Transportation L. Hartley Elsevier Oxford, UK 1998 1 23