Fuzzy sets and systems in building closed-loop affective computing systems for human-computer interaction: Advances and new research directions

IEEE International Conference on Fuzzy Systems

Volumn , Issue , 2012, Pages

  Wu, Dongrui ^a  

^a GE GLOBAL RESEARCH   (United States)

Author keywords

affect control; affect modeling; affect recognition; Affective computing; affective engineering; affective medicine; fuzzy logic; Kansei engineering

Indexed keywords

AFFECT RECOGNITION; AFFECTIVE COMPUTING; AFFECTIVE ENGINEERING; CLOSED-LOOP; FUZZY SETS AND SYSTEMS; HUMAN COMPUTER INTERFACES; IN-BUILDINGS; KANSEI ENGINEERING; RESEARCH COMMUNITIES; RESEARCH DIRECTIONS; TYPE-2 FUZZY SET;

BEHAVIORAL RESEARCH; FUZZY LOGIC; FUZZY SETS; FUZZY SYSTEMS; RESEARCH;

HUMAN COMPUTER INTERACTION;

EID: 84867616337     PISSN: 10987584     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FUZZ-IEEE.2012.6250779     Document Type: Conference Paper

References (74)

1. "Advance personalized learning," accessed in December 2011. [Online] Available: http://www.engineeringchallenges.org/cms/8996/9127.aspx
2. "The measured life," accessed in December 2011. [Online]. Available: http://www.technologyreview.com/biomedicine/37784/
3. S. Achiche and S. Ahmed, "Mapping shape geometry and emotions using fuzzy logic," in Proc. ASME Int'l Design Engineering Technical Conf., Brooklyn, NY, August 2008.
4. C. Averett and D. Heise, "Modified social identities: Amalgamations, attributions, and emotions," Journal of Mathematical Sociology, vol. 13, pp. 103-132, 1987.
5. J. Bachorowski and M. Owren, "Not all laughs are alike: voiced but not unvoiced laughter readily elicits positive affect," Psychological Science, vol. 12, no. 3, pp. 252-257, 2001. (Pubitemid 33653539)
6. T. Balomenos, A. Raouzaiou, S. Ioannou, A. Drosopoulos, K. Karpouzis, and S. Kollias, "Emotion analysis in man-machine interaction systems," in Proc. 1st Int'l. Workshop on Machine Learning for Multimodal Interaction, Martigny, Switzerland, June 2004, pp. 318-328.
7. J. T. Cacioppo, "Introduction: Emotion and health," in Handbook of Affective Stress, R. J. Davidson, K. R. Scherer, and H. H. Goldsmith, Eds. Oxford University Press, 2003.
8. A. Chakraborty, A. Konar, A. Halder, and E. Kim, "Emotion control by audio-visual stimulus using fuzzy automata," in Proc. IEEE Int'l. Conf. on Fuzzy Systems, Barcelona, Spain, June 2010.
9. A. Chakraborty and A. Konar, Emotional Intelligence: A Cybernetic Approach. Springer, 2009.
10. A. Chakraborty, A. Konar, U. K. Chakraborty, and A. Chatterjee, "Emotion recognition from facial expressions and its control using fuzzy logic," IEEE Trans. on Systems, Man, and Cybernetics-A, vol. 39, no. 4, pp. 726-743, 2009.
11. R. Cowie and R. Cornelius, "Describing the emotional states that are expressed in speech," Speech Communication, vol. 40, pp. 5-32, 2003.
12. K. Dautenhahn and I. Werry, "Towards interactive robots in Autism therapy: Background, motivation and challenges," Pragmatics & Cognition, vol. 12, no. 1, pp. 1-35, 2004.
13. M. El-Nasr and J. Yen, "Agents, emotional intelligence and fuzzy logic," in Proc. NAFIPS, Pensacola Beach, FL, August 1998, pp. 301-305.
14. J. W. Ellison and D. W. Massaro, "Featural evaluation, integration, and judgment of facial affect," Journal of Experimental Psychology: Human Perception and Performance, vol. 23, no. 1, pp. 213-226, 1997. (Pubitemid 127456165)
15. A. Friberg, "A fuzzy analyzer of emotional expression in music performance and body motion," in Proc. Music and Music Science, Stockholm, Sweden, October 2004.
16. J. Furnkranz and E. Hullermeier, "Preference learning," Kunstliche Intelligenz, vol. 19, no. 1, pp. 60-61, 2005.
17. K. Gilleade, A. Dix, and J. Allanson, "Affective videogames and modes of affective gaming: Assist me, challenge me, emote me," in Proc. Digital Games Research Association (DiGRA) Conf., Vancouver, Canada, June 2005, pp. 16-20.
18. R. Glaser, D. Pearl, J. Kiecolt-Glaser, and W. Malarkey, "Plasma cortisol levels and reactivation of latent epstein-barr virus in response to examination stress," Psychoneuroendocrinology, vol. 19, no. 8, pp. 765-772, 1994.
19. M. Grimm, E. Mower, K. Kroschel, and S. S. Narayanan, "Combining categorical and primitives-based emotion recognition," in Proc. European Signal Processing Conf., Florence, Italy, September 2006.
20. H. Hagras, "A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots," IEEE Trans. on Fuzzy Systems, vol. 12, pp. 524-539, 2004.
21. A. Halder, R. Mandal, A. Chakraborty, A. Konar, and R. Janarthanan, "Application of general type-2 fuzzy set in emotion recognition from facial expression," Lecture Notes in Computer Science, vol. 7076, pp. 460-468, 2011.
22. M. Hemphill, "A note on adults' color-emotion associations," The Journal of Genetic Psychology, vol. 157, no. 3, pp. 275-280, 1996. (Pubitemid 126454846)
23. S. Jun, S. Rho, B. jun Han, and E. Hwang, "A fuzzy inference-based music emotion recognition system," in Proc. 5th Int'l. Conf. on Visual Information Engineering, Xi'An, China, July 2008, pp. 673-677.
24. R. E. Kaliouby, R. Picard, and S. Baron-Cohen, "Affective computing and Autism," Annals of New York Academy of Sciences, vol. 1093, pp. 228-248, 2006. (Pubitemid 47092380)
25. A. Kazemzadeh, S. Lee, and S. S. Narayanan, "An interval type-2 fuzzy logic system to translate between emotion-related vocabularies," in Proc. InterSpeech, Brisbane, Australia, September 2008, pp. 2747-2750.
26. R. Khushaba, S. Kodagoda, S. Lal, and G. Dissanayake, "Driver drowsiness classification using fuzzy wavelet-packet-based feature-extraction algorithm," IEEE Trans. on Biomedical Engineering, vol. 58, no. 1, pp. 121-131, 2011.
27. J. M. Kivikangas, I. Ekman, G. Chanel, S. Jarvela, B. Cowley, M. Salminen, P. Henttonen, and N. Ravaja, "Review on psychophysiological methods in game research," in Proc. 1st Nordic Digital Games Research Association (DiGRA) Conf, Stockholm, Sweden, August 2010.
28. P. Laukka, "Uses of music and psychological well-being among the elderly," Journal of Happiness Studies, vol. 8, pp. 215-242, 2006.
29. C. M. Lee and S. Narayanan, "Emotion recognition using a datadriven fuzzy inference system," in Proc. 8th European Conf. on Speech Communication and Technology, Geneva, Switzerland, September 2003, pp. 157-160.
30. Z. Li and X. Wang, "Emotion modeling of the driver based on fuzzy logic," in Proc. 12th IEEE Int'l. Conf. on Intelligent Transportation Systems, St. Louis, MO, October 2009, pp. 819-823.
31. C. Lisetti, F. Nasoz, C. LeRouge, O. Ozyer, and K. Alvarez, "Developing multimodal intelligent affective interfaces for tele-home health care," Int'l. Journal of Human-Computer Studies, vol. 59, no. 1-2, pp. 245-255, 2003.
32. F. Liu and J. M. Mendel, "Encoding words into interval type-2 fuzzy sets using an Interval Approach," IEEE Trans. on Fuzzy Systems, vol. 16, no. 6, pp. 1503-1521, 2008.
33. A. Luneski, P. D. Bamidis, and M. Hitoglou-Antoniadou, "Affective computing and medical informatics: State of the art in emotion-aware medical applications," Studies in Health Technology and Informatics, vol. 136, pp. 517-522, 2008.
34. R. Mandal, A. Haider, P. Bhowmik, A. Konar, A. Chakraborty, and A. Nagar, "Uncertainty management in type-2 fuzzy face-space for emotion recognition," in Proc. IEEE Int'l. Conf. on Fuzzy Systems, Taipei, Taiwan, June 2011, pp. 1902-1909.
35. R. L. Mandryk and M. S. Atkins, "A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies," Int'l. Journal of Human-Computer Studies, vol. 65, pp. 329-347, 2007. (Pubitemid 46216840)
36. D. W. Massaro and M. M. Cohen, "Perception of synthesized audible and visible speech," Psychological Science, vol. 1, no. 1, pp. 55-63, 1990.
37. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions. Upper Saddle River, NJ: Prentice-Hall, 2001.
38. J. M. Mendel and D. Wu, Perceptual Computing: Aiding People in Making Subjective Judgments. Hoboken, NJ: Wiley-IEEE Press, 2010.
39. D. Murray, "Autism and information technology: therapy with computers," in Autism and learning: a guide to good practice, S. Powell and R. Jordan, Eds. Routledge, 1997, pp. 100-117.
40. L. E. Nacke, M. Kalyn, C. Lough, and R. L. Mandryk, "Biofeedback game design: Using direct and indirect physiological control to enhance game interaction," in Proc. CHI, Vancouver, BC, Canada, May 2011.
41. M. Nagamachi, "Kansei engineering: A new ergonomic consumer-oriented technology for product development," International Journal of Industrial Ergonomics, vol. 15, no. 1, pp. 3-11, 1995.
42. M. Nagamachi, "Perspectives and new trend of kansei/affective engineering," The TQM Journal, vol. 20, no. 4, pp. 290-298, 2008.
43. A. Nijholt, D. P.-O. Bos, and B. Reuderink, "Turning shortcomings into challenges: Braincomputer interfaces for games," Entertainment Computing, vol. 1, pp. 85-94, 2009.
44. S. E. Palmer, T Langlois, T Tsang, K. B. Schloss, and D. J. Levitin, "Color, music, and emotion," Journal of Vision, vol. 11, no. 11, 2011.
45. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, 2010.
46. R. Picard, Affective Computing. Cambridge, MA: The MIT Press, 1997.
47. R. Picard, "Affective medicine: Technology with emotional intelligence," in Future of Health Technology, R. Bushko, Ed. Amsterdam, NL: IOS Press, Amsterdam, NL, 2002, pp. 69-83.
48. A. Pope and O. Palsson, "Helping video games "rewire our minds"," 2004, accessed in Junuary 2012. [Online]. Available: http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20040086464-2004090499.pdf/
49. P. Rani, N. Sarkar, C. Smith, and J. Adams, "Affective communication for implicit human-machine interaction," in Proc. IEEE Int'l. Conf. on Systems, Man and Cybernetics, Washington, DC, October 2003, pp. 4896-4903.
50. K. Scherer, "What are emotions? and how can they be measured?" Social Science Information, vol. 44, no. 4, pp. 695-729, 2005. (Pubitemid 41666684)
51. M. Seif El-Nasr and M. Skubic, "A fuzzy emotional agent for decision-making in a mobile robot," in Proc. IEEE Int'l. Conf. on Fuzzy Systems, Anchorage, AK, May 1998, pp. 135-140.
52. N. Serbedzija and S. Fairclough, "Biocybernetic loop: From awareness to evolution," in Proc. IEEE Congress on Evolutionary Computation, Trondheim, Norway, May 2009, pp. 2063-2069.
53. R. N. Smith and W. J. Frawley, "Affective computing: Medical applications," in Proc. 8th Int'l. Conf. on Human-Computer Interaction, Munich, Germany, August 1999.
54. J. Stets and J. H. Turner, Eds., Handbook of the Sociology of Emotions. Springer, 2006.
55. P. Subasic and A. Huettner, "Affect analysis of text using fuzzy semantic typing," IEEE Trans. on Fuzzy Systems, vol. 9, no. 4, pp. 483-496, 2001. (Pubitemid 32933037)
56. N. Tsapatsoulis, K. Karpouzis, G. Stamou, F. Piat, and S. Kollias, "A fuzzy system for emotion classification based on the MPEG-4 facial definition parameter set," in Proc. European Signal Processing Conference, Tampere, Finland, September 2000.
57. J. Um, K. Eum, and J. Lee, "A study of the emotional evaluation models of color patterns based on the adaptive fuzzy system and the neural network," Color Research and Application, vol. 27, no. 3, pp. 208-216, 2002. (Pubitemid 34491708)
58. A. van der Heide, D. Sanchez, and G. Trivino, "Computational models of affect and fuzzy logic," in Proc. European Society for Fuzzy Logic and Technology, Aix-les-Bains, France, July 2011, pp. 620-627.
59. L.-X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least-squares learning," IEEE Trans. on Neural Networks, vol. 3, pp. 807-813, 1992.
60. L.-X. Wang and J. M. Mendel, "Generating fuzzy rules by learning from examples," IEEE Trans. on Systems, Man, and Cybernetics, vol. 22, no. 2, pp. 1414-1427, 1992.
61. D. Wu, "On the fundamental differences between interval type-2 and type-1 fuzzy logic controllers," IEEE Trans. on Fuzzy Systems, 2012, in press.
62. D. Wu, C. G. Courtney, B. J. Lance, S. S. Narayanan, M. E. Dawson, K. S. Oie, and T. D. Parsons, "Optimal arousal identification and classification for affective computing: Virtual Reality Stroop Task," IEEE Trans. on Affective Computing, vol. 1, no. 2, pp. 109-118, 2010.
63. D. Wu and J. M. Mendel, "A comparative study of ranking methods, similarity measures and uncertainty measures for interval type-2 fuzzy sets," Information Sciences, vol. 179, no. 8, pp. 1169-1192, 2009.
64. D. Wu and J. M. Mendel, "Perceptual reasoning for perceptual computing: A similarity-based approach," IEEE Trans. on Fuzzy Systems, vol. 17, no. 6, pp. 1397-1411, 2009.
65. D. Wu and J. M. Mendel, "Linguistic summarization using IF-THEN rules and interval type-2 fuzzy sets," IEEE Trans. on Fuzzy Systems, vol. 19, no. 1, pp. 136-151, 2011.
66. D. Wu, J. M. Mendel, and S. Coupland, "Enhanced Interval Approach for encoding words into interval type-2 fuzzy sets and its convergence analysis," IEEE Trans. on Fuzzy Systems, 2012, in press.
67. D. Wu and T. D. Parsons, "Inductive transfer learning for handling individual differences in affective computing," in Affective Computing and Intelligent Interaction, Memphis, TN, October 2011.
68. D. Wu and W. W. Tan, "Genetic learning and performance evaluation of type-2 fuzzy logic controllers," Engineering Applications of Artificial Intelligence, vol. 19, no. 8, pp. 829-841, 2006. (Pubitemid 44667712)
69. D. Wu and W. W. Tan, "A simplified type-2 fuzzy controller for real-time control," ISA Transactions, vol. 15, no. 4, pp. 503-516, 2006. (Pubitemid 44672361)
70. Y.-H. Yang, C.-C. Liu, and H.-H. Chen, "Music emotion classification: A fuzzy approach," in Proc. ACM Multimedia 2006, Santa Barbara, CA, October 2006, pp. 81-84. (Pubitemid 47113509)
71. G. Yannakakis, "Preference learning for affective modeling," in Proc. 3rd Int'l. Conf. on Affective Computing and Intelligent Interaction, Amsterdam, September 2009.
72. R. Yerkes and J. Dodson, "The relation of strength of stimulus to rapidity of habit-formation," Journal of Comparative Neurology and Psychology, vol. 18, pp. 459-482, 1908.
73. L. A. Zadeh, "Fuzzy sets," Information and Control, vol. 8, pp. 338-353, 1965.
74. L. A. Zadeh, "The concept of a linguistic variable and its application to approximate reasoning-1," Information Sciences, vol. 8, pp. 199-249, 1975.