Intelligent affect regression for bodily expressions using hybrid particle swarm optimization and adaptive ensembles

Expert Systems with Applications

Volumn 42, Issue 22, 2015, Pages 8678-8697

  Zhang, Yang ^a   Zhang, Li ^a   Neoh, Siew Chin ^a   Mistry, Kamlesh ^a   Hossain, Mohammed Alamgir ^b  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

^b ANGLIA RUSKIN UNIVERSITY   (United Kingdom)

Author keywords

Adaptive ensemble regression; Bodily expression; Genetic algorithm; Mutation distributions; Particle swarm optimization; Support vector regression

Indexed keywords

ALGORITHMS; CORRELATION METHODS; FEATURE EXTRACTION; GENETIC ALGORITHMS; MEAN SQUARE ERROR; OPTIMIZATION; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS; THREE TERM CONTROL SYSTEMS;

ADAPTIVE ENSEMBLE REGRESSION; BODILY EXPRESSION; DISCRIMINATIVE FEATURES; EXPLORATION AND EXPLOITATION; HYBRID PARTICLE SWARM OPTIMIZATION; MUTATION DISTRIBUTION; PEARSON CORRELATION COEFFICIENTS; SUPPORT VECTOR REGRESSION (SVR);

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 84940461083     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.07.022     Document Type: Article

References (93)

1. Andrews P.S. An investigation into mutation operators for particle swarm optimization Proceedings of the IEEE congress on evolutionary computation 2006 Vancouver, BC, Canada 1044 1051
2. Atkinson A.P., Dittrich W.H., Gemmell A.J., Young A.W. Emotion perception from dynamic and static body expressions in point-light and full light displays Perception 33 6 2004 717 746
3. Atkinson A.P., Tunstall M.L., Dittrich W.H. Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures Cognition 104 1 2007 59 72
4. Audhkhasi K., Narayanan S. A globally-variant locally constant model for fusion of labels from multiple diverse experts without using reference labels IEEE Transactions on Pattern Analysis and Machine Intelligence 35 4 2013 769 783
5. Baltrušaitis T., Banda N., Robinson P. Dimensional affect recognition using continuous conditional random fields Proceedings of IEEE international conference on automatic face and gesture recognition 2013 China
6. Basak D., Pal S., Patranabis D.C. Support vector regression Neural Information Processing - Letters and Review 10 10 2007 203 224
7. Bernhardt D., Robinson P. Detecting affect from non-stylized body motions LNCS: Process second international conference on affective computing and intelligent interaction 2007 59 70
8. Bianchi-Berthouze N., Kleinsmith A. A categorical approach to affective gesture recognition Cognitive Science 15 2003 259 269
9. Boone T.R., Cunningham J.G. Children's expression of emotional meaning in music through expressive body movement Journal of Nonverbal Behavior 25 1 2001 21 41
10. Breazeal C. Emotion and sociable humanoid robots International Journal of Human-Computer Studies 59 2003 119 155
11. Bull P.E. Posture and gesture vol. 16 1987 Pergamon Press
12. Camurri A., ILagerlöf I., Volpe G. Recognizing emotion from dance movement: Comparison of spectator recognition and automated techniques International Journal of Human-Computer Studies 59 1-2 2003 213 225
13. Camurri A., Mazzarino B., Ricchetti M., Timmers R., Volpe G. Multimodal analysis of expressive gesture in music and dance performances Gesture-based communication in HCI 2004 20 39
14. Castellano G., Villalba S., Camurri A. Recognizing human emotions from body movement and gesture dynamics ACII'07: Proceedings of the second international conference on affective computing and intelligent interaction 2007 71 82
15. Chang C.-C., Lin C.-J. LIBSVM: A library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 27 2011 1 27
16. Chang W. A modified particle swarm optimization with multiple subpopulations for multimodal function optimization problems Applied Soft Computing 33 2015 170 182
17. Chen W.N., Zhang J., Lin Y., Chen N., Zhang Z.H., Chung S.H., Li H., Shi Y.H. Particle swarm optimization with an aging leader and challengers IEEE Transactions on Evolutionary Computation 17 2 2013 241 258
18. Chen Y.P., Peng W.C., Jian M.C. Particle swarm optimization with recombination and dynamic linkage discovery IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 37 2007 1460 1470
19. Clarke T.J., Bradshaw M.F., Field D.T., Hampson S.E., Rose D. The perception of emotion from body movement in point-light displays of interpersonal dialogue Perception 34 2003 1171 1180
20. Coulson M. Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence Journal of Nonverbal Behavior 28 2 2004 117 139
21. Cowie R., Sawey M. GTrace - General trace program from Queen's, Belfast 2011
22. De Gelder B. Why bodies? Twelve reasons for including bodily expressions in affective neuroscience Philosophical Transactions of the Royal Society 364 3 2009 3475 3484
23. De Gelder B., Snyder J., Greve D., Gerard G., Hadjikhani N. Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body Proceedings of the National Academy of Science 101 47 2003 16701 16706
24. D'Mello S., Graesser A. Multimodal semi-automated affect detection from conversational cues, gross body language and facial features User Model User-Adapted Interaction 20 2 2010 147 187
25. Douglas-Cowie E., Cowie R., Sneddon I., Cox C., Lowry O., McRorie M. The HUMAINE database: Addressing the needs of the affective computing community Affective computing and intelligent interaction: Proceedings of the second international conference on affective computing and intelligent interaction 2007 Lisbon, Portugal 488 500
26. Ekman P., Friesen W.V. Head and body cues in the judgment of emotion: A reformulation Perceptual and Motor Skills 24 1967 711 724
27. Ekman P., Friesen W.V. Pictures of facial affect 1967 Consulting Psychologists Press
28. Ekman P., Friesen W.V., Hager J.C. Facial action coding system, the manual 2002 Research Nexus Division of Network Information Research Corporation
29. Ercan M.F., Li X. Particle swarm optimization and its hybrids International Journal of Computer and Communication Engineering 2 1 2013 52 55
30. Farid D.M., Rahman C.M. Assigning weights to training instances increases classification accuracy International Journal of Data Mining & Knowledge Management Process 3 2013 13 25
31. Fragopanagos N., Taylor J.G. Emotion recognition in human-computer interaction Neural Networks 18 4 2005 389 405
32. Garcia-Pedrajas N., Hervás-Martínez C., Ortiz-Boyer D. Cooperative coevolution of artificial neural network ensembles for pattern classification IEEE Transactions on Evolutionary Computation 9 3 2005 271 302
33. Giese M.A., Poggio T. Neural mechanisms for the recognition of biological movements Neuroscience 4 2003 179 191
34. G'Mussel A.S., Hewig J. The value of a smile: Facial expression affects ultimatum-game responses Judgment and Decision Making 8 3 2013 381 385
35. Goldberg D.E. Genetic algorithms in search, optimization and machine learning 1989 Addison-Wesley/Longman Publishing Co., Inc Boston, MA, USA
36. Gunes H., Pantic M. Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners Proceedings of the international conference on intelligent virtual agents 2010 371 377
37. Hakli H., Uʇuz H. Levy flight distribution for scout bee in artificial bee colony algorithm Lecture Notes on Software Engineering 1 3 2013 254 258
38. Hamann S. Mapping discrete and dimensional emotions onto the brain: Controversies and consensus Trends in Cognitive Sciences 16 9 2012 458 466
39. Han J., Shao L., Xu D., Shotton J. Enhanced computer vision with Microsoft Kinect sensor: A review IEEE Transactions on Cybernetics 43 5 2013 1318 1334
40. Harrigan J., Rosenthal R., Scherer K. The new handbook of methods in nonverbal behavior research 2005 Oxford University Press
41. Hecht-Nielsen R. Theory of the backpropagation neural network International joint conference on neural networks, IJCNN 1989 San Diego, CA, USA
42. Hendtlass T. A combined swarm differential evolution algorithm for optimization problems Lecture Notes on Computer Science 2070 2001 11 18
43. Hendtlass T. WoSP: A multi-optima particle swarm algorithm Proceedings of IEEE congress on evolutionary computation 2005 727 734
44. Huang C.L., Wang C.J. A GA-based feature selection and parameters optimization for support vector machine Expert Systems with Applications 31 2 2006 231 240
45. Izard C.E. Innate and universal facial expressions: Evidence from developmental and cross-cultural research Psychological Bulletin 115 2 1994 288 299
46. Izard C.E., Ackerman P.B., Schoff K.M., Fine S.E. Self-organization of discrete emotions, emotion patterns, and emotion cognition relations D.L. Marc I. Granic Emotion, development, and self-organization: Dynamic systems approaches to emotional development 2002 Cambridge University Press 15 36
47. Jordehi A.R. Enhanced leader PSO (ELPSO): A new PSO variant for solving global optimisation problems Applied Soft Computing 26 2015 401 417
48. Kamisato S., Odo S., Ishikawa Y., Hoshino K. Extraction of motion characteristics corresponding to sensitivity information using dance movement Journal of Advanced Computational Intelligence and Intelligent Informatics 8 2 2004 167 178
49. Kapur A., Kapur A., Virji-Babul N., Tzanetakis G., Driessen P.F. Gesture-based affective computing on motion-capture data Proceeding of first international conference on affective computing and intelligent interaction 2005 1 7
50. Karg M., Kuhnlenz K., Buss M. Recognition of affect based on gait patterns IEEE Trans on Systems, Man, and Cybernetics, Part B 40 4 2010 1050 1061
51. Kennedy J., Eberhart R. Particle swarm optimization Proceedings of the IEEE international conference on neural network 4 1995 1942 1948
52. KIran M.S., Gündüz M. A recombination-based hybridization of particle swarm optimization and artificial bee colony algorithm for continuous optimization problems Applied Soft Computing 13 4 2013 2188 2203
53. Kleinsmith A., Bianchi-Berthouze N. Recognizing affective dimensions from body posture Proceedings of the international conference on affective computing and intelligent interaction 2007 48 58
54. Kleinsmith A., Bianchi-Berthouze N. Affective body expression perception and recognition: A survey IEEE Transactions on Affective Computing 4 1 2013 15 33
55. Kleinsmith A., Bianchi-Berthouze N., Steed A. Automatic recognition of non-acted affective postures IEEE Transactions on Systems, Man, and Cybernetics Part B 41 4 2011 1027 1038
56. Kleinsmith A., Fushimi T., Bianchi-Berthouze N. An incremental and interactive affective posture recognition system Proceedings: International workshop on adapting the interaction style to affective factors 2005
57. Kostov V., Fukuda S. Emotion in user interface, voice interaction system IEEE international conference on systems, man, and cybernetics 2007 798 803
58. Lange J., Lappe M. The role of spatial and temporal information in biological motion perception Advances in Cognitive Psychology 3 4 2007 419 428
59. Levy P. Théorie de l'Addition des Variables Aléatoires 2nd ed. 1954 Gauthier-Villars Paris
60. Li Y., Chen J., Zhao Y., Ji Q. Data-free prior model for facial action unit recognition IEEE Transactions on Affective Computing 4 2 2013 127 141
61. Liu Y., Wang G., Chen H., Dong H. An improved particle swarm optimization for feature selection Journal of Bionic Engineering 8 2 2011 191 200
62. Lucey P., Cohn J., Lucey S., Matthews I., Sridharan S., Prkachin K. Automatically detecting pain using facial actions Proceedings of the international conference on affective computing and intelligent interaction 2009 1 8
63. Mendes-Moreira J.A., Soares C., Jorge A.M., Sousa J.F.D. Ensemble approaches for regression: A survey ACM Computing Surveys 45 1 2012 1 40
64. Meng H., Kleinsmith A., Bianchi-Berthouze N. Multi-score learning for affect recognition: The case of body postures Affective computing and intelligent interaction. Lecture notes in computer science vol. 6974 2011 225 234
65. Metallinou A., Katsamanis A., Narayanan S. Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information Image and Vision Computing 31 2 2013 137 152
66. Microsoft Corporation Kinect for windows SDK programming guide 2013 version 1.8
67. Neoh S.C., Zhang L., Mistry K., Hossain M.A., Lim C.P., Aslam N., Kinghorn P. Intelligent facial emotion recognition using a layered encoding cascade optimization model Applied Soft Computing 34 2015 72 93
68. Nicolaou M., Gunes H., Pantic M. Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space IEEE Transactions on Affective Computing 2 2 2011 92 105
69. Oh I.S., Lee J.S., Moon B.R. Hybrid genetic algorithms for feature selection IEEE Transactions on Pattern Analysis and Machine Intelligence 26 11 2004 1424 1437
70. Oudeyer P.Y. The production and recognition of emotions in speech: Features and algorithms International Journal of Human-Computer Studies 59 2003 157 183
71. Owusu E., Zhan Y., Mao Q.R. A neural-AdaBoost based facial expression recognition system Expert Systems with Applications 41 7 2014 3383 3390
72. Park H., Park J., Kim U., Woo W. Emotion recognition from dance image sequences using contour approximation LNCS: Proceedings of the international workshop on structural, syntactic, and statistical pattern recognition 2004 547 555
73. Poli R., Chio C.D., Langdon W.B. Exploring extended particle swarms: A genetic programming approach Proceedings of the conference on genetic and evolutionary computation Washington, DC 2005 169 176
74. Pollick F.E., Paterson H.M., Bruderlin A., Sanford A.J. Perceiving affect from arm movement Cognition 82 2 2001 B51 B61
75. Posner J., Russell J.A., Peterson B.S. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology Development and Psychopathology 17 3 2005 715 734
76. Rao K.S., Saroj V.K., Maity S., Koolagudi S.G. Recognition of emotions from video using neural network models Expert Systems with Applications 38 10 2011 13181 13185
77. Roether C., Omlin L., Christensen A., Giese M.A. Critical features for the perception of emotion from gait Journal of Vision 8 6 2009 1 32
78. Röhler A.B., Chen S. Multi-swarm hybrid for multi-modal optimization Proceedings of the IEEE congress on evolutionary computation 2012 1759 1766
79. Ryan A., Cohn J., Lucey S., Saragih J., Lucey P., Rossi A. Automated facial expression recognition system Proceedings of the international Carnahan conference on security technology 2009 172 177
80. Savva N., Scarinzi A., Bianchi-Berthouze N. Continuous recognition of player's affective body expression as dynamic quality of aesthetic experience IEEE Transactions on Computational Intelligence and AI in Games 4 3 2012 199 212
81. Scherer K.R., Wallbott H.G. Ausdruck von Emotionen 1990 Hogrefe 345 422
82. Sun S., Li J. A two-swarm cooperative particle swarms optimization Swarm and Evolutionary Computation 15 2014 2014 1 18
83. Tranmer M., Elliot M. Multiple linear regression 2008 The Cathie Marsh Centre for Census and Survey Re-search (CCSR)
84. Unler A., Murat A. A discrete particle swarm optimization method for feature selection in binary classification problems European Journal of Operational Research 206 3 2010 528 539
85. Van den Stock J., Righart R., De Gelder B. Body expressions influence recognition of emotions in the face and voice Emotion 7 3 2007 487 494
86. Vania L.M., Lemay M., Bienfang D.C., Choi A.Y., Nakayama K. Intact biological motion and structure from motion perception in a patient with impaired motion mechanisms: A case study Visual Neuroscience 5 1990 353 369
87. Vapnik V.N. The nature of statistical learning theory 2nd ed. 2001 Springer New York
88. Wallbott H.G. Bodily expression of emotion European Journal of Social Psychology 28 6 1998 879 896
89. Wang W., Athanasopoulos G., Patsis G., Enescu V., Sahli H. Real-time emotion recognition from natural bodily expressions in child-robot interaction Computer vision - ECCV 2014 workshops. LNCS vol. 8927 2015 424 435
90. Webb J., Ashley J. Beginning Kinect programming with the Microsoft Kinect SDK 2012 Apress
91. Wollmer M., Eyben F., Reiter S., Schuller B., Cox C., Douglas-Cowie E., Cowie R. Abandoning emotion classes - towards continuous emotion recognition with modelling of long-range dependencies Proceedings of the ninth international speech conference 2008 597 600
92. Xue B., Zhang M., Browne W.N. Particle swarm optimization for feature selection in classification: A multi-objective approach IEEE Transactions on Cybernetics 43 6 2012 1656 1671
93. Zhang J., Huang D.S., Liu K.H. Multi-sub-swarm particle swarm optimization algorithm for multimodal function optimization Proceedings of IEEE congress on evolutionary computation 2007 3215 3220