Comparative learning applied to intensity rating of facial expressions of pain

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 28, Issue 5, 2014, Pages

  Werner, Philipp ^a   Al Hamadi, Ayoub ^a   Niese, Robert ^a  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

comparative learning; Facial expression recognition; learning to rank; machine learning; pain recognition; pattern recognition

Indexed keywords

ARTIFICIAL INTELLIGENCE; GESTURE RECOGNITION; HEALTH; LEARNING SYSTEMS; PATTERN RECOGNITION; RATING;

ABSOLUTE INTENSITY; COMPARATIVE LEARNING; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; INTENSITY FUNCTIONS; LEARNING TO RANK; PAIN RECOGNITION; PERFORMANCE MEASURE;

FACE RECOGNITION;

EID: 84905454381     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001414510082     Document Type: Article

References (40)

1. A. B. Ashraf, S. Lucey, J. F. Cohn, T. Chen, Z. Ambadar, K. M. Prkachin and P. E. Solomon, The painful face-pain expression recognition using active appearance models, Image Vis. Comput. 27 (2009) 1788-1796.
2. M. Bartlett, G. Littlewort, M. Frank and K. Lee, Automatic decoding of facial movements reveals deceptive pain expressions, Curr. Biol. 24 (2014) 738-743.
3. S. Brahnam, C.-F. Chuang, F. Y. Shih and M. R. Slack, SVM classification of neonatal facial images of pain, in Fuzzy Logic and Applications, eds. I. Bloch, A. Petrosino and A. G. B. Tettamanzi, Vol. 3849 (Springer Berlin Heidelberg, Berlin, Heidelberg, 2006), pp. 121-128.
4. S. Brahnam, C.-F. Chuang, R. S. Sexton and F. Y. Shih, Machine assessment of neonatal facial expressions of acute pain, Decis. Support Syst. 43 (2007) 1242-1254.
5. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton and G. Hullender, Learning to rank using gradient descent, in Proc. 22nd Int. Conference on Machine Learning, ICML'05, New York, NY, USA (ACM, 2005), pp. 89-96.
6. W. W. Cohen, R. E. Schapire and Y. Singer, Learning to order things, J. Artif. Intell. Res. 10 (1999) 243-270.
7. J. F. Cohn, Z. Ambadar and P. Ekman, Observer-based measurement of facial expression with the facial action coding system, in The Handbook of Emotion Elicitation and Assessment (Oxford University Press, 2007), pp. 203-221.
8. K. D. Craig, S. A. Hyde and C. J. Patrick, Genuine, suppressed and faked facial behavior during exacerbation of chronic low back pain, Pain 46 (1991) 161-171.
9. J. R. Delannoy and J. McDonald, Automatic estimation of the dynamics of facial expression using a three-level model of intensity, 8th IEEE Int. Conf. Automatic Face & Gesture Recognition, 2008. FG'08, September 2008 (IEEE), pp. 1-6.
10. P. Ekman and W. V. Friesen, Facial Action Coding System: A Technique for the Measurement of Facial Movements (Consulting Psychologist Press, Palo Alto, 1978).
11. P. Ekman, E. T. Rolls, D. I. Perrett and H. D. Ellis, Facial expressions of emotion: An old controversy and new findings [and discussion], Phil. Trans. R. Soc. Lond. 335 (1992) 63-69.
12. Y. Freund, R. Iyer, R. E. Schapire and Y. Singer, An efficient boosting algorithm for combining preferences, J. Mach. Learn. Res. 4 (2003) 933-969.
13. Z. Hammal and M. Kunz, Pain monitoring: A dynamic and context-sensitive system, Pattern Recogn. 45 (2012) 1265-1280.
14. C.-W. Hsu, C.-C. Chang and C.-J. Lin, A practical guide to support vector classifi- cation, Ttech. Rep., Department of Computer Science, National Taiwan University (2003).
15. T. Joachims, Optimizing search engines using clickthrough data, in Proc. Eighth ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining (2002), pp. 133-142.
16. S. Kaltwang, O. Rudovic and M. Pantic, Continuous pain intensity estimation from facial expressions, in Advances in Visual Computing, eds. G. Bebis, R. Boyle, B. Parvin, D. Koracin, C. Fowlkes, S. Wang, M.-H. Choi, S. Mantler, J. Schulze, D. Acevedo, K. Mueller and M. Papka, Lecture Notes in Computer Science, Vol. 7432 (Springer, Berlin Heidelberg, 2012), pp. 368-377.
17. M. Kunz, S. Scharmann, U. Hemmeter, K. Schepelmann and S. Lautenbacher, The facial expression of pain in patients with dementia, Pain 133 (2007) 221-228.
18. G. C. Littlewort, M. S. Bartlett and K. Lee, Automatic coding of facial expressions displayed during posed and genuine pain, Image Vis. Comput. 27 (2009) 1797-1803.
19. P. Lucey, J. F. Cohn, K. M. Prkachin, P. E. Solomon, S. Chew and I. Matthews, Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database, Image Vis. Comput. 30 (2012) 197-205.
20. P. Mahalanobis, On the generalised distance in statistics, in Proc. National Institute of Science, India, Vol. 2, April 1936, pp. 49-55.
21. B. J. Matuszewski, W. Quan and L.-K. Shark, High-resolution comprehensive 3-d dynamic database for facial articulation analysis, 1st Workshop on Benchmarking Facial Image Analysis Technologies, ICCV2011 (Barcelona, 2011), pp. 2128-2135.
22. M. M. Monwar, S. Rezaei and D. K. Prkachin, Eigenimage based pain expression recognition, IAENG Int. J. Appl. Math. 36(2) (2007) 1-6.
23. M. M. Monwar and S. Rezaei, Pain recognition using artificial neural network, 2006 IEEE Int. Symp. Signal Processing and Information Technology, August 2006 (IEEE), pp. 28-33.
24. M. M. Monwar and S. Rezaei, Support vector machine for automatic pain recognition, in Proc. SPIE, San Jose, CA, USA (2009), pp. 724613-724613-8.
25. R. Niese, A. Al-Hamadi, A. Panning, D. Brammen, U. Ebmeyer and B. Michaelis, Towards pain recognition in post-operative phases using 3D-based features from video and support vector machines, Int. J. Digital Content Technol. Appl. 3(4) (2009) 21-33.
26. R. Niese, A. Al-Hamadi, A. Panning and B. Michaelis, Emotion recognition based on 2D- 3D facial feature extraction from color image sequences, J. Multimedia 5 (2010) 488-500.
27. T. Pahikkala, E. Tsivtsivadze, A. Airola, J. Jrvinen and J. Boberg, An efficient algorithm for learning to rank from preference graphs, Mach. Learn. 75(1) (2009) 129-165.
28. D. Parikh and K. Grauman, Relative attributes, 2011 IEEE Int. Conf. Computer Vision (ICCV) (IEEE, 2011), pp. 503-510.
29. K. M. Prkachin, The consistency of facial expressions of pain: A comparison across modalities, Pain 51 (1992) 297-306.
30. K. M. Prkachin and P. E. Solomon, The structure, reliability and validity of pain expression: Evidence from patients with shoulder pain, Pain 139 (2008) 267-274.
31. O. Rudovic, V. Pavlovic and M. Pantic, Automatic pain intensity estimation with heteroscedastic conditional ordinal random fields, Advances in Visual Computing - 9th International Symposium, ISVC 2013, Rethymnon, Crete, Greece, July 29-31, 2013. Proceedings, Part II, eds. G. Bebis, R. Boyle, B. Parvin, D. Koracin, B. Li, F. Porikli, V. B. Zordan, J. T. Klosowski, S. Coquillart, X. Luo, M. Chen and D. Gotz, Lecture Notes in Computer Science, Vol. 8034 (Springer, 2013), pp. 234-243.
32. M. A. Sayette, J. F. Cohn, J. M. Wertz, M. A. Perrott and D. J. Parrott, A psychometric evaluation of the facial action coding system for assessing spontaneous expression, J. Nonverbal Behav. 25(3) (2001) 167-185.
33. C. Schensted, Longest increasing and decreasing subsequences, in Classic Papers in Combinatorics, eds. I. Gessel and G.-C. Rota, Modern Birkhuser Classics (Birkhuser Boston, 1987), pp. 299-311.
34. Y. Tian, T. Kanade and J. F. Cohn, Facial expression recognition, in Handbook of Face Recognition, eds. S. Z. Li and A. K. Jain (Springer London, 2011), pp. 487-519.
35. M.-F. Tsai, T.-Y. Liu, T. Qin, H.-H. Chen and W.-Y. Ma, FRank: A ranking method with fidelity loss, in Proc. 30th Annual Int. ACM SIGIR Conf. Research and Development in Information Retrieval (2007), pp. 383-390.
36. P. Werner, A. Al-Hamadi, R. Niese, S. Walter, S. Gruss and H. C. Traue, Towards pain monitoring: Facial expression, head pose, a new database, an automatic system and remaining challenges, in Proc. British Machine Vision Conf. (2013), pp. 119.1-119.13.
37. P. Werner, A. Al-Hamadi and R. Niese, Pain recognition and intensity rating based on comparative learning, in 2012 19th IEEE Int. Conf. Image Processing (ICIP), Orlando (2012), pp. 2313-2316.
38. P. Yang, Q. Liu and D. Metaxas, RankBoost with l1 regularization for facial expression recognition and intensity estimation, 2009 IEEE 12th Int. Conf. Computer Vision (September, 2009), pp. 1018-1025.
39. Z. Zeng, M. Pantic, G. I. Roisman and T. S. Huang, A survey of affect recognition methods: Audio, visual, and spontaneous expressions, IEEE Trans. Pattern Anal. Mach. Intell. 31 (2009) 39-58.
40. X. Zhu, Semi-supervised learning literature survey, Tech. Rep. 1530, Computer Sciences, University of Wisconsin-Madison (2005).