Pain monitoring: A dynamic and context-sensitive system

Pattern Recognition

Volumn 45, Issue 4, 2012, Pages 1265-1280

  Hammal, Zakia ^a   Kunz, Miriam ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b CENTRE DE RECHERCHE   (Canada)

Author keywords

Classification; Context based recognition; Pain expression; Spontaneous facial expressions; Transferable Belief Model

Indexed keywords

CLASSIFICATION RATES; CONTEXT SENSITIVE; CONTEXT-BASED; DYNAMIC INFORMATION; DYNAMIC RECOGNITION; FACIAL EXPRESSIONS; FACIAL FEATURE; FUSION MODEL; HUMAN OBSERVERS; MACHINE-LEARNING; MEAN CLASSIFICATION; PAIN EXPRESSION; STATIC IMAGES; TRANSFERABLE BELIEF MODEL; TRANSIENT FEATURES; VIDEO SEQUENCES;

CLASSIFICATION (OF INFORMATION); FACE RECOGNITION; FEATURE EXTRACTION; PATIENT MONITORING;

HEALTH;

EID: 83655201286     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.09.014     Document Type: Article

References (66)

1. K.M. Prkachin, and P.E. Solomon. The structure, reliability and validity of pain expression: evidence from patients with shoulder pain Pain 139 2008 267 274
2. Z. Hammal, L. Couvreur, A. Caplier, and M. Rombaut Facial expressions classification: a new approach based on transferable belief model International Journal of Approximate Reasoning 46 3 2007 542 567 (Pubitemid 350101081)
3. P. Ekman, and E.L. Rosenberg What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System 2nd edition 2005 Oxford University Press
4. Z. Hammal, L. Couvreur, A. Caplier, M. Rombaut, Facial expressions recognition based on the belief theory: comparison with different classifiers, in: Proceedings of the 13th International Conference on Image Analysis and Processing (ICIAP), Cagliari, Italy, September 68, 2005.
5. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Transactions on Pattern Analysis and Machine Intelligence 31 1 2009
6. J.F. Cohn, and K.L. Schmidt. The timing of facial motion in posed and spontaneous smiles Wavelets, Multiresolution & Information Processing 2 2 2004 121 132
7. G.C. Littlewort, M.S. Bartlett, L. Kang, Faces of pain: automated measurement of spontaneous facial expressions of genuine and posed pain, in: Proceedings of ICMI, Nagoya, Aichi, Japan, November 1215, 2007.
8. M.S. Bartlett, G.C. Littlewort, M.G. Frank, C. Lainscsek, I. Fasel, and J.R. Movellan Automatic recognition of facial actions in spontaneous expressions Journal of Multimedia 1 6 2006 22 35
9. M.F. Valstar, M. Pantic, Z. Ambadar, J.F. Cohn, Spontaneous vs. posed facial behavior: automatic analysis of brow actions, in: Proceedings of the ACM International Conference on Multimodal Interfaces, 2006, pp. 162170.
10. R. El Kaliouby, P. Robinson, Mind reading machines: automated inference of cognitive mental states from video, in: Proceedings of the International Conference on Systems, Man and Cybernetics, 2004, vol. 1, pp. 682688.
11. Q. Ji, P. Lan, and C. Looney. A probabilistic framework for modeling and real-time monitoring human fatigue IEEE Transactions on Systems, Man and Cybernetics A 36 5 2006 862 875
12. U. Hess, and R.E. Kleck Differentiating emotion elicited and deliberate emotional facial expressions European Journal of Social Psychology 20 5 1990 369 385
13. A.B. Ashraf, S. Lucey, T. Chen, K. Prkachin, P. Solomon, Z. Ambadar, J. Cohn, The painful face: pain expression recognition using active appearance models, in: Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI), 2007, pp. 914.
14. M. Pantic, and L.J.M. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 2000 1424 1445 (Pubitemid 32088469)
15. M. Kunz, S. Scharmann, U. Hemmeter, K. Schepelmann, and S. Lautenbacher S. The facial expression of pain in patients with dementia Pain 133 13 2007 221 228 (Pubitemid 350138323)
16. V.T. Lehr, P.S. Zeskind, J.P. Ofenstein, E. Cepeda, I. Warrier, and J.V. Aranda Neonatal facial coding system scores and spectral characteristics of infant crying during newborn circumcision Clinical Journal of Pain 23 5 2007 417 424 (Pubitemid 46791489)
17. A.C. Lints-Martindale, T. Hadjistavropoulos, B. Barber, and S.J. Gibso. A psychophysical investigation of the facial action coding system as an index of pain variability among older adults with and without Alzheimers disease Pain 8 8 2007 678 689 (Pubitemid 350142915)
18. M. Pantic, and M.S. Bartlett K. Delac, M. Grgic, Machine analysis of facial expressions, in: Face Recognition 2007 2007 I-Tech Education and Publishing Vienna, Austria 377 416
19. B. Fasel, and J. Luettin Automatic facial expression analysis: A survey Pattern Recognition 1 30 2003 259 275
20. S. Roy, C. Roy, Z. Hammal, D. Fiset, C.Blais, B. Jemel, F. Gosselin. The use of spatio-temporal information in decoding facial expression of emotions, in: Proceedings of the Vision Science Society (VSS) Conference, 914 May 2008, Naples Grand Hotel, Floride.
21. C. Roy, S. Roy, D. Fiset, Z. Hammal, C. Blais, P. Rainvill, F. Gosselin. Recognizing static and dynamic facial expressions of pain: gaze-tracking and bubbles experiments, in: Proceedings of the Vision Science Society (VSS) Conference, 914 May 2008, Naples Grand Hotel, Floride.
22. K. Forbes-Riley, D. Litman, Predicting emotion in spoken dialogue from multiple knowledge sources, in: Proceedings of the International Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL), 2004.
23. A. Kapoor, W. Burleson, and R.W. Picard Automatic prediction of frustration International Journal of HumanComputer Studies 65 8 2007 724 736 (Pubitemid 46810294)
24. D.J. Litman, K. Forbes Riley, Predicting student emotions in computer human tutoring dialogues, in: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL), July 2004, International Conference on Acoustics, Speech, and Signal Processing.
25. P. Smets, Data fusion in the transferable belief model, in: Proceedings of the International Conference on Information Fusion, July 2000, Paris, France, pp. 2133.
26. T. Denoeux Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence Artificial Intelligence 172 23 2008 234 264 (Pubitemid 350256729)
27. P. Ekman, and W.V. Friesen. The Facial Action Coding System (FACS): A Technique for the Measurement of Facial Action 1978 Consulting Psychologists Press Palo Alto, CA
28. S. Roy, C. Roy, I. Fortin, C. Either-Majcher, P. Belin, F. Gosselin, A dynamic facial expression database, in: Proceedings of the Vision Sciences Society (VSS) Conference, Sarasota, Florida, 2007.
29. Z. Hammal, N. Eveno, A. Caplier, and P.Y. Coulon Parametric models for facial features segmentation Signal Processing 86 2006 399 413 (Pubitemid 41705763)
30. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, Canada, August 1981, vol. 18, No. 11, pp. 674680.
31. Cohn Kanade database, 2000, 〈http://vasc.ri.cmu.edu/idb/html/face/ facial expression〉.
32. M. Dailey, G.W. Cottrell & J. Reilly. California Facial Expressions (cafe), University of California, San Diego, 2001, unpublished digital images.
33. Hammal Caplier database, 2003). 〈http://viscog.psy.umontreal.ca/ zakia/index.htm〉.
34. P. Smets, and R. Kruse. The transferable belief model Artificial Intelligence 66 1994 191 234
35. Z. Ambadar, W.S. Schooler, and J.F. Cohn. The importance of facial dynamics in interpreting subtle facial expressions Psychological Science 16 5 2005 403 410 (Pubitemid 40763688)
36. A.C. Williams Facial expression of pain: an evolutionary account Behavioral and Brain Sciences 25 4 2002 439 455 (Pubitemid 36827139)
37. Z. Hammal, Facial Features Segmentation: Analysis and Recognition of Facial Expressions Using the Transferable Belief Model, Ph.D. Thesis, LIS Laboratory, Grenoble, France, June 2006.
38. B. Ristic, P. Smets. Kalman filters for tracking and classification and the transferable belief model, in: Proceedings of the International Conference on Information Fusion ICIF 04, 2004, Stockholm, Sweden.
39. T. Denoeux, Pattern recognition and information fusion using belief functions: some recent developments, in: Proceedings of ECSQARU 2007, p. 1.
40. P. Smets Decision making in the TBM: the necessity of the pignistic transformation International Journal of Approximate Reasoning 38 2005 133 147
41. A.W. Young, D. Rowland, A.J. Calder, N.L. Etcoff, A. Seth, and D.I. Perrett Facial expression megamix Cognition 63 1997 271 313
42. Md. Maruf Monwar, Siamak Rezaei, Pain recognition using artificial neural network, in: Proceedings of the IEEE International Symposium on Signal Processing and Information Technology, 2006.
43. P. Ekman, W.V. Friesen, and J.C. hager Facial Action Coding System: Research Nexus 2002 Network Research Information Salt Lake City, UT
44. J. Yang, R. Stiefelhagen, U. Meier, A. Waibe, Real-time face and facial feature tracking and applications, in: Proceedings of the Auditoryvisual Speech Processing (AVSP) Conference, NSW, Australia, 1998.
45. Y. Tian, L. Brown, Real world real-time automatic recognition of facial expressions, in: Proceedings of the IEEE Workshop on Performance Evaluation of Tracking and Surveillance, Graz, Austria, 2003.
46. K.D. Craig, K.M. Prkachin, and R.V.E. Grunau. The Facial Expression of Pain D.C. Turk, R. M Handbook of Pain Assessment 2nd edition 2001 Guilford New York
47. I. Fasel, B. Fortenberry, and J.A. Movellan Generative framework for real time object detection and classification Computer Vision and Image Understanding 98 2005 182 210
48. Z. Hammal, C. Massot, Holistic and feature-based information towards dynamic multi-expressions recognition, in: Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), Angers, France, May 2010.
49. Z. Hammal, C. Massot, Dynamic facial expression classification based on human visual cues information, in: Proceedings of the Fourth Workshop on Emotion and Computing - Current Research and Future Impact, Paderborn, KI, 15.9.2009.
50. Z. Hammal, M. Arguin, and F. Gosselin Comparing a novel model based on the Transferable Belief Model with humans during the recognition of partially occluded facial expressions International Journal of Vision 9 2 2009 22 10.1167/9.2.22 119
51. A. Kapoor, W. Burleson, and R.W. Picard Automatic prediction of frustration International Journal of HumanComputer Studies 65 8 2007 724 736 (Pubitemid 46810294)
52. Y. Zhang, and J. Qiang Active and dynamic information fusion for facial expression understanding from image sequences IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 699 714 (Pubitemid 40608403)
53. Z. Hammal. Context based recognition of pain expression intensities, in: Proceedings of the Fifth Workshop on Emotion in HumanComputer Interaction - Real World Challenges held at the 23rd BCS HCI Group Conference, Cambridge University, Cambridge, UK, September 2009.
54. S. Brahnam, C.-F. Chuang, F.Y. Shih, and M.-R. Slack Machine recognition and representation of neonatal facial displays of acute pain Articial Intelligence in Medicine 36 2006 211 222 (Pubitemid 43379018)
55. M. Kunz, C. Chatelle, S. Lautenbacher, and P. Rainville. The relation between catastrophizing and facial responsiveness to pain Pain 140 2008 127 134
56. T. Denoeux, and M.-H. Masson. EVCLUS: Evidential clustering of proximity data IEEE Transactions on Systems, Man and Cybernetics B 34 1 2004 95 109
57. A. Aregui, T. Denoeux, Fusion of one-class classifiers in the belief function frame-work, in: Proceedings of the 10th International Conference on Information Fusion, Quebec, Canada, July 2007.
58. D. Mercier, B. Quost, and T. Denoeux Refined modeling of sensor reliability in the belief function framework using contextual discounting Information Fusion 9 2 2008 246 258 (Pubitemid 351312921)
59. B. Quost, T. Denoeux, and M.-H. Masson Pairwise classifier combination using belief functions Pattern Recognition Letters 28 5 2007 644 653 (Pubitemid 46073222)
60. T. Denoeux, and P. Smets Classification using belief functions: the relationship between the case-based and model-based approaches IEEE Transactions on Systems, Man and Cybernetics B 36 6 2006 1395 1406
61. Z. Elouedi, K. Mellouli, and P. Smets Belief decision trees: theoretical foundations International Journal of Approximate Reasoning 28 2001 91 124 (Pubitemid 32833458)
62. S. Trabelsi, Z. Elouedi, and K. Mellouli Pruning belief decision tree methods in averaging and conjunctive approaches International Journal of Approximate Reasoning 46 3 2007 568 595 (Pubitemid 350103813)
63. E. Ramasso, M. Rombaut, and D. Pellerin State filtering and change detection using TBM conflict application to human action recognition in athletics videos IEEE Transactions on Circuits and Systems for Video Technology 17 2007 944 949 (Pubitemid 47159723)
64. S. Petit-Renaud, and T. Denoeux Nonparametric regression analysis of uncertain and imprecise data using belief functions International Journal of Approximate Reasoning 35 1 2004 1 28
65. M.-H. Masson, and T. Denoeux Clustering interval-valued data using belief functions Pattern Recognition Letters 25 2 2004 163 171 (Pubitemid 38003128)
66. L. Valet, G. Mauris, P. Bolon, A statistic overview of a recent literature in information fusion, in: Procedings of Information Fusion ICIF 00, Paris, France, pp. 2229.