Towards multimodal pain assessment for research and clinical use

RFMIR 2014 - Proceedings of the 2014 ACM Roadmapping the Future of Multimodal Interaction Research Including Business Opportunities and Challenges, Co-located with ICMI 2014

Volumn , Issue , 2014, Pages 13-17

  Hammal, Zakia ^a   Cohn, Jeffrey F ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Affective Computing; Pain; Pain Intensity

Indexed keywords

INTELLIGENT SYSTEMS; PATIENT TREATMENT;

AFFECTIVE COMPUTING; HEALTH CARE PROVIDERS; INDIVIDUAL DIFFERENCES; OBJECTIVE MEASUREMENT; PAIN; PAIN INTENSITY; RELIABLE ASSESSMENT; SOCIAL CONTEXT;

CLINICAL RESEARCH;

EID: 84919380865     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2666253.2666257     Document Type: Conference Paper

References (62)

1. Prkachin KM, Solomon P, Hwang T, Mercer SR. 2001. Does experience influences judgments of pain behaviour? Evidence from relatives of pain patients and therapists. Pain Res. Manag., 6, 105-112.
2. Craig KD, Korol CT, Pillai RR. 2002. Challenges of judging pain in vulnerable infants. Clin. Perinatol., 29, 445-457.
3. Chambers CT, Reid GJ, Craig KD, McGrath PJ, Finley GA. 1998. Agreement between child and parent reports of pain. Clin. J. Pain., 14, 336-342
4. K. M. Prkachin &P. E. Solomon. 2008. The structure, reliability and validity of pain expression: Evidence from patients with shoulder pain. Pain, 139, 267-274.
5. K. D. Craig, K. M. Prkachin, and R. V. E. Grunau. 2001. The facial expression of pain. In D. C. Turk and R. M., editors, Handbook of pain assessment. Guilford, New York, 2nd edition.
6. P. Ekman &E.L. Rosenberg. 2005. What the face reveals: basic and applied studies of spontaneous expression using the facial action coding system. 2nd edition, Oxford University Press.
7. Lucey, P., Cohn, J. F., Prkachin, K. M., Solomon, P., &Matthews, I. 2012. Painful data: The UNBC-McMaster shoulder pain expression archive database, Image, Vision, and Computing Journal, 30, 197-205.
8. Maruf Monwar, Md. and Siamak R. 2006. Pain Recognition Using Artificial Neural Network. Proc. IEEE ISSPIT.
9. Littlewort, G.C., Bartlett, M.S. &Kang, M.S. 2007. Faces of Pain: Automated Measurement of Spontaneous Facial Expressions of Genuine and Posed Pain. Proc. ICMI, Nagoya, Aichi, Japan, November 12-15.
10. Ashraf, A., B., Lucey, S., Cohn, J. F., Chen, T, Prkachin, K. M. and Solomon, P. E. 2009. The painful face: Pain expression recognition using active appearance models, Image and Vision Computing, 27, 1788-1796.
11. Lucey, P., Cohn, J. F., Howlett, J., Member, S. L., &Sridharan, S. 2011. Recognizing emotion with head pose variation: Identifying pain segments in video. Systems, Man, and Cybernetics-Part B, 41(3), 664-674.
12. Littlewort, Bartlett, &Lee 2009. Automatic coding of Facial Expressions displayed during Posed and Genuine Pain. Image and Vision Computing, 27(12), 1741-1844.
13. Bartlett, M., Littlewort, G., Frank, M., and Lee, K. 2014. Automated Detection of Deceptive Facial Expressions of Pain. Current Biology, 24(7), 738-743.
14. Kaltwang, S., Rudovic, O., Pantic, M. 2012. Continuous pain intensity estimation from facial expressions. Bebis, G., et al. (eds.), Part II. LNCS 7432, 368-377. Springer, Heidelberg.
15. Werner, P., Al-Hamadi, A., &NIESE, R. 2014. Comparative learning applied to intensity rating of facial expressions of pain. J. of Pattern Recognition and Artificial Intelligence.
16. Sikka, K., Dhall, A., and Bartlett, M. 2014. Weakly Supervised Pain Localization and Classification with Multiple Segment Learning, Image &Vision Computing, (in press).
17. Hammal Z., Cohn J.F. 2012. Automatic Detection of Pain Intensity. Proc. 14th ICMI, 47-52, Santa Monica, October 23rd-25th.
18. Hammal, Z., and Kunz, M. 2012. Pain Monitoring: A Dynamic and Context-sensitive System. Pattern Recognition. 45(4), 1265-1280.
19. D. Keltner 1995. Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement and shame, J. Personality Social Psychol., 68(3), 441-454, 1995.
20. J. F. Cohn, L. I. Reed, T. Moriyama, J. Xiao, K. L. Schmidt, and Z. Ambadar. 2004. Multimodal coordination of facial action, head rotation, and eye motion, Proc. 6th IEEE AFGR, Seoul, Korea, 129-138.
21. Craig, K. D., Versloot, J., Goubert, L., Vervoort, T., &Crombez, G. 2010. Perceiving pain in others: Automatic and controlled mechanisms. The Journal of Pain, 11(8), 101-108.
22. Coll, M.P., Gregoire, M., Latimer, M., Eugene, F., &Jackson, P.L. 2011. Perception of pain in others: Implications for caregivers. Pain Management, 1(3), 257-265.
23. Scherer, K.R., and Wallbott, H.G. 1985. Analysis of Nonverbal Behavior. Handbook of discourse: Analysis, 2(11), Academic Press London.
24. DeMeijer, M. 1989. The contribution of general features of body movement to the attribution of emotions. J. Nonverbal Behavior, 13, 247-268.
25. Wallbott, H.G. 1998. Bodily expression of emotion. European Journal of Social Psychology, European. J. Social Psychology, 28, 879-896.
26. Boone, R.T., Cunningham, J.G. 1998. Children's decoding of emotion in expressive body movement: The development of cue attunement. Developmental Psychology, 34, 1007-1016.
27. F.J. Keefe and A.R. Block. 1982. Development of an observation method for assessing pain behaviour in chronic low back pain patients. Behaviour Therapy, 13(4).
28. Bernhardt, D., Robinson, P. 2007. Detecting affect from nonstylised body motions. Proc. 2nd ACII. Lisbon, Portugal September 12-14.
29. Castellano, G., Villalba, S., Camurri, A. 2007. Recognising human emotions from body movement and gesture dynamics. In A. Paiva, R. Prada, R. W. Picard (Ed.), Affective Computing and Intelligent Interaction, LNCS 4738, 71-82.
30. Kleinsmith, A., Bianchi-Berthouze, N. 2013. Affective Body Expression Perception and Recognition: A Survey. IEEE Trans. Affect. Comp. 4(1), 15-33.
31. Joshi, J., Dhall, A., Goecke, R., &Cohn, J. 2013. Relative Body Part Movement for Automatic Depression Analysis, Proc. 5th ACII, Geneva, Switzerland, September 2-5.
32. Vlaeyen, J.W.S. &Linton, S.J. 2000. Fear-Avoidance and Its Consequences in Muscle skeleton Pain: A State of the Art, Pain, 85(3), 317-332.
33. Kvale, A., Ljunggren, A.E. &Johnsen, T.B. 2003. Examination of Movement in Patients with Long-Lasting Musculoskeletal Pain: Reliability and Validity, Physiotherapy Research Intl, 8, 36-52.
34. Haugstad, G.K., Haugstad, T.S., Kirste, U.M., Leganger, S., Wojniusz, S., Klemmetsen, I., &Malt, U.F. 2006. Posture, Movement Patterns, and Body Awareness in Women with Chronic Pelvic Pain, J. Psychosomatic Research, 61(5), 637-644.
35. Scherer, K.R. 2003. Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227-256.
36. M. El Ayadi, M.S. Kamel, and F. Karray. 2011. Survey on speech emotion recognition: Features, classification schemes, and databases. Pattern Recognition, 44(3), 572-587.
37. Schuller, B., Batliner, A., Steidl, S., &Seppi, D. 2011, Recognizing Realistic Emotions and Affect in Speech: State of the Art and Lessons Learnt from the First Challenge, Speech Communication, Special Issue: Sensing Emotion and Affect-Facing Realism in Speech Processing, ELSEVIER, 53(9/10), 1062-1087.
38. Yang, Y., Fairbairn, C., &Cohn, J.F. (2013). Detecting depression severity from intra-and interpersonal vocal prosody. IEEE Trans. Affect. Comp. 4(2), 142-150.
39. Williamson, J.R., Quatieri, T.F., Helfer, B.S., Horwitz, R., Daryush, B.Y., &Mehta, D. 2013. Vocal biomarkers of depression based on motor incoordination. Proc. ACM AVEC, 41-48
40. Cummins, N., Epps, J. &Ambikairajah, E. 2013. Spectro Temporal Analysis of Speech Affected by Depression and Psychomotor Retardation, IEEE ICASSP, 7542-7546.
41. http://www.emo-pain.ac.uk/index.html
42. Hammal Z., Cohn J. F., Messinger D. S., Masson W., &Mahoor M. 2013. Head Movement Dynamics During Normal and Perturbed Parent-Infant Interaction. Proc. 5th ACII, Geneva, Switzerland, September 2-5.
43. Hammal, Z., Cohn, J.F., &George, D.T. 2014. Interpersonal Coordination of Head Motion in Distressed Couples. IEEE Trans. on Affective Computing, 5(2), 155-167, doi: http://dx.doi.org/10.1109/TAFFC.2014.2326408.
44. Ragiba Zagyapan, Cihan Iyem, Ayla Kurkcuoglu, Can Pelin, and Mustafa Agah Tekindal. 2012. The Relationship between Balance, Muscles, and Anthropomorphic Features in Young Adults. Hindawi Publishing Corporation, Anatomy Research International.
45. Zeng, Z., Pantic, M., Roisman, G.I., &Huang, T.S. 2009. A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions, IEEE Trans. PAMI, 31(1), 39-58.
46. Craig, K. D. 2009. The social communication model of pain. Canadian Psychology, 50 (1), 22-32.
47. Hadjistavropoulos, T., Craig, K.D., Duck, S., Cano, A., Goubert, L., Jackson, P.L., Mogil, J.S., Rainville, P., Sullivan, M.J.L., de C Williams, A.C., Vervoort, T., &Fitzgerald, T.D. 2011. A biopsychosocial formulation of pain communication. Psychological Bulletin, 137(6), 910-939.
48. Peters, M. L., &Vancleef, L. M. G. 2008. The role of personality traits in pain perception and disability. Reviews in Analgesia, 10, 11-21
49. Hofle, M., Hauck, M., Engel, A. K., &Senkowski, D. 2012. Viewing a needle pricking a hand that you perceive as yours enhances unpleasantness of pain. Pain, 153 (3), 1074-81.
50. Werner, P., Al-Hamadi, A., Niese, R., Walter, S., Gruss, S., &Traue, H. C. Towards Pain Monitoring: Facial Expression, Head Pose, a new Database, an Automatic System and Remaining Challenges, Proc. BMVC
51. M. Karg, A.A. Samadani, R. Gorbert, K. Kuhnlenz, J. Hoey, and Kulic D. 2014. Body movements for affective expression: A survey of automatic recognition and generation. IEEE Trans. Affect. Comp. 4(4), 341-359.
52. Z. Chen, R. Ansari and D.J. Wilkie, 2011. Automated detection of pain from facial expressions: A rule based approach using AAM. Proc. SPIE 8314.
53. Arif, M., Grap, M. J., Munro, C. L., Lyon, D. E., Sessler, D. C. N., &Cohn, J. F. 2010. Facial expression and pain in the critically-ill, non-communicative patient: State of science review. Intensive and critical care medicine, 26, 343-352.
54. Horgas AL. 2003. Assessing pain in persons with dementia. In: Boltz M, series ed. Try This: Best Practices in Nursing Care for Hospitalized Older Adults with Dementia, 1(2). The Hartford Institute for Geriatric Nursing.
55. Warden V, Hurley AC, Volicer L. 2003. Development and psychometric evaluation of the Pain Assessment in Advanced Dementia scale. J. Am. Med. Dir. Ass. 4(1), 9-15.
56. National Initiative on Pain Control. Pain Assessment Scales. http://www.painedu.org/Downloads/NIPC/Pain Assessment Scales.pdf
57. de Knegt NC, Pieper MJ, Lobbezoo F, Schuengel C, Evenhuis HM, Passchier J, Scherder EJ. 2013. Behavioral pain indicators in people with intellectual disabilities: a systematic review. J. of Pain, 14(9), 885-96.
58. Dubois A, Bringuier S, Capdevilla X, Pry R. 2008. Vocal and verbal expression of postoperative pain in preschoolers. Pain Manag. Nurs., 9(4), 160-165.
59. W. Janig. 1995. The sympathetic nervous system in pain. Eur. J. Anaesthesiol., Suppl., 10, 53-60.
60. M.Z. Poh, D. J. McDuff, and R. Picard. 2011. Advancements in noncontact, multiparameter physiological measurements using a webcam, IEEE Trans. Biomed. Eng. 58, 7-11.
61. Xu S, Sun L, Rohde GK. 2014. Robust efficient estimation of heart rate pulse from video. Biomedical Optics Express, 5(4), 1124-1135.
62. S.J. Sheinkopf, J.M. Iverson, M.L. Rinaldi, B. M. Lester. 2012. Atypical Cry Acoustics in 6-Month-Old Infants at Risk for Autism Spectrum Disorder Autism Res. 5(5), 331-339.