Using brain-computer interfaces to detect human satisfaction in human-robot interaction

International Journal of Humanoid Robotics

Volumn 8, Issue 1, 2011, Pages 87-101

  Esfahani, Ehsan Tarkesh ^a   Sundararajan, V ^a  

^a University of California Riverside   (United States)

Author keywords

Brain computer interfaces; EEG; emotional response; human robot interaction; satisfaction detection

Indexed keywords

BRAIN ACTIVITY; COLLABORATIVE ENVIRONMENTS; EEG; EEG SIGNALS; EMOTIONAL FEEDBACK; EMOTIONAL RESPONSE; FEATURE VECTORS; HUMAN BRAIN; HUMANOID ROBOT; LARGEST LYAPUNOV EXPONENT; LEVEL OF SATISFACTION; LINEAR DISCRIMINANT CLASSIFIER; SATISFACTION DETECTION;

ANTHROPOMORPHIC ROBOTS; BRAIN; ELECTROENCEPHALOGRAPHY; FREQUENCY BANDS; HUMAN COMPUTER INTERACTION; HUMAN ROBOT INTERACTION; INTERFACES (COMPUTER); LYAPUNOV METHODS; POWER SPECTRAL DENSITY; SPECTRAL DENSITY; STATISTICAL TESTS;

BRAIN COMPUTER INTERFACE;

EID: 79955958972     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843611002356     Document Type: Review

References (38)

1. P. J. Hinds, T. L. Roberts and H. Jones, Whose job is it anyway? A study of human- robot interaction in a collaborative task, Human-Computer Interaction 19(1) (2004) 151-181.
2. K. Kawamura, R. Alan II, D. M. Wilkes, W. A. Alford and T. E. Rogers, ISAC: foundations in human-humanoid interaction, IEEE Intelligent Systems 15(4) (2000) 38-45.
3. H. Ueno, A knowledge-based information modeling for autonomous humanoid service robot, IEICE Transactions on Information and Systems E85D(4) (2002) 657-665. (Pubitemid 34452653)
4. P. F. Dominey, A. Mallet and E. Yoshida, Real-time spoken language programming for coopetative interaction with a humanoid apprentice, International Journal of Humanoid Robotics 6(2) (2009) 147-171.
5. J. Forlizzi, Robot products to assist the aging population, Interactions 12(2) (2005) 16-18.
6. K. R. Scherer, Vocal communication of emotion: A review of research paradigms, Speech Communication 40(1) (2003) 227-256.
7. T. Waaramaa, A. Laukkanen, M. Airas and P. Alku, Perception of emotional valences and activity levels from vowel segments of continuous speech, Journal of Voice 24(1) (2010) 30-38.
8. B. Yang and M. Lugger, Emotion recognition from speech signals using new harmony features, Signal Processing 90(5) (2010) 1415-1423.
9. L. Devillers, L. Vidrascu and L. Lamel, Challenges in real-life emotion annotation and machine learning based detection, Neural Networks 18(4) (2005) 407-422. (Pubitemid 40922648)
10. M. Pantic and L. J. M. Rothkrantz, Automatic analysis of facial expressions: The state of the art, IEEE Transactions on Pattern Analysis and Machine Intelligence , 22(12), 2000, 1424-1445. (Pubitemid 32088469)
11. M. Pantic and L. J. M. Rothkrantz, Expert system for automatic analysis of facial expressions, Image Vision Computing 18(11) (2000) 881-905.
12. J. Anttonen and V. Surakka, Emotions and heart rate while sitting on a chair, in ACM SIGCHI Conference on Human Factors in Computing System (2005), pp. 491-499. (Pubitemid 41809086)
13. K. H. Kim, S. W. Bang and S. R. Kim, Emotion recognition system using short-term monitoring of physiological signals, Medical Biological Engineering and Computing 42(3) (2004) 419-427. (Pubitemid 38786706)
14. K. Takahashi, Remarks on SVM-based emotion recognition from multi-modal biopotential signals, in IEEE International Workshop on Robot and Human Interactive Communication (2004), pp. 95-100. (Pubitemid 40822650)
15. J. A. Coan and J. J. B. Allen, Frontal EEG asymmetry as a moderator and mediator of emotion, Biological Psychology 67(1-2) (2004) 7-50.
16. S. K. Sutton and R. J. Davidson, Prefrontal brain asymmetry: A biological substrate of the behavioral approach and inhibition systems, Psychological Science 8(3) (1997) 204-210.
17. Q. Zhang and M. Lee, Analysis of positive and negative emotions in natural scene using brain activity and GIST, Neurocomputing 72(4-6) (2009) 1302-1306.
18. K. Schaaff and T. Schultz, Toward an EEG-based emotion recognizer for humanoid robot, in IEEE International Symposium on Robot and Human Interactive Communications (2009).
19. C. Frantzidis, C. Bratsas, M. Klados, E. Konstantinidis, C. Lithari, A. Vivas, C. Papadelis, E. Kaldoudi, C. Pappas and P. Bamidis, On the classification of emotional biosignals evoked while viewing affective pictures: An integrated data mining based approach for healthcare applications, IEEE Transactions on Information Technology Biomedical 14(2) (2010) 309-318.
20. http://www.emotiv.com.
21. R. J. Davidson, P. Ekman, C. D. Sarona, J. A. Senulis and W. V. Friesen, Approach withdrawal and cerebral asymmetry: Emotional expression and brain physiology, Journal of Personality Social Psychology 58(2) (1990) 330-341.
22. M. Kostyunina and M. Kulikov, Frequency characteristics of EEG spectra in the emotions, Neuroscience and Behavioral Physiology 26(4) (1996) 340-343. (Pubitemid 126723278)
23. K. Ko, H. Yang and K. Sim, Emotion recognition using EEG signals with relative power values and Bayesian network, International Journal of Control Automation and System 7(5) (2009) 865-870.
24. L. Zhang, W. He, C. He and P. Wang, Improving mental task classification by adding high frequency band information, Journal of Medical System 34(1) (2010) 51-60.
25. P. Petrantonakis and L. Hadjileontiadis, Emotion recognition from EEG using higherorder crossings, IEEE Transactions on Information Technology Biomedical 14(2) (2010) 186-197.
26. G. Pfurtscheller, C. Neuper, A. Schlogl and K. Lugger, Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters, IEEE Transactions on Rehabilitation Engineering 6(3) (1998) 316-325. (Pubitemid 28409340)
27. T. Wang, J. Deng and B. He, Classifying EEG-based motor imagery tasks by means of time-frequency synthesized spatial patterns, Clinical Neurophysiology 115(12) (2004) 2744-2753. (Pubitemid 39531337)
28. F. Lotte, M. Congedo, A. Lecuyer, F. Lamarch and B. Arnaldi, A review of classification algorithms for EEG-based braincomputer interface, Journal of Neural Engineering 4(2) (2007) R1-R13. (Pubitemid 46603810)
29. D. Garrett, D. A. Peterson, C. W. Anderson and M. H. Thaut, Comparison of linear, nonlinear, and feature selection methods for EEG signal classification, IEEE Transactions on Rehabilitation Engineering 11(2) (2003) 141-144. (Pubitemid 36935042)
30. C. J. Stam, Nonlinear Brain Dynamics (Nova Biomedical Publication, 2004).
31. K. Natarajan, R. Acharya, F. Alias, T. Tiboleng and S. Puthusserypady, Nonlinear analysis of EEG signals at different mental states, Biomedical Engineering Online 3(7) (2004).
32. X. Li, Z. Deng and J. Zhang, Function of EEG temporal complexity analysis in neural activities measurement, Advances in Neural Network (Springer, Berlin, 2009), pp. 209- 218.
33. P. D. Welch, The use of fast Fourier transforms for the estimation of power spectra: A method based on time averaging over short modified periodograms, IEEE Transactions on Audio Electroacoustics 15 (1967) 70-73.
34. N. H. Packard, J. P. Crutchfield, J. D. Farmer and R. S. Shaw, Geometry from a time series, Physical Review Letters 45 (1980) 712-716.
35. F. Takens, Detection strange attractor in turbulence, D. A. Rand and L. S.
36. A. Wolf, J. B. Swift, L. H. Swinney and J. A. Vastano, Determining Lyapunov exponent from a time series, Physica D 16(3) (1985) 285-317.
37. C. Merkwirth, U. Parlitz, I.Wedekind, D. Engster and W. Lauterborn, OpenTSTOOL (2009). URL:http://www.dpi.physik.uni-goettingen.de/tstool/.
38. G.W. Corder and D. I. Foreman, Nonparametric Statistics for Non-Statisticians (John Wiley & Sons, 2009).