A validated approach to evaluating psychometric properties of pain assessment tools for use in nonverbal critically ill adults

Seminars in Respiratory and Critical Care Medicine

Volumn 34, Issue 2, 2013, Pages 153-168

  Gélinas, Céline ^a,b   Puntillo, Kathleena ^c   Joffe, Aaronm ^d   Barr, Juliana ^e,f  

^a MCGILL UNIVERSITY   (Canada)

^b MCGILL UNIVERSITY   (Canada)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF WASHINGTON   (United States)

^e VA PALO ALTO HEALTH CARE SYSTEM   (United States)

^f STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

intensive care unit; nonverbal adult; pain assessment tools; reliability; validity

Indexed keywords

ARTICLE; CONTENT VALIDITY; CONVERGENT VALIDITY; CRITERION RELATED VALIDITY; CRITICALLY ILL PATIENT; DISCRIMINANT VALIDITY; FEASIBILITY STUDY; HUMAN; INTENSIVE CARE UNIT; INTERNAL CONSISTENCY; INTERRATER RELIABILITY; PAIN ASSESSMENT; PRIORITY JOURNAL; PSYCHOMETRY; SCORING SYSTEM; SPEECH DISORDER; TEST RETEST RELIABILITY;

ADULT; CRITICAL ILLNESS; FEASIBILITY STUDIES; HUMANS; INTENSIVE CARE; INTENSIVE CARE UNITS; NONVERBAL COMMUNICATION; PAIN MANAGEMENT; PAIN MEASUREMENT; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 84878412072     PISSN: 10693424     EISSN: 10989048     Source Type: Journal    
DOI: 10.1055/s-0033-1342970     Document Type: Article

References (87)

1. Chanques G., Sebbane M., Barbotte E., Viel E., Eledjam J. J., Jaber S. A prospective study of pain at rest: incidence and characteristics of an unrecognized symptom in surgical and trauma versus medical intensive care unit patients. Anesthesiology: 2007; 107 5 858 860 (Pubitemid 351325993)
2. Puntillo K. A., White C., Morris A. B., et al. Patients' perceptions and responses to procedural pain: results from Thunder Project II. Am J Crit Care: 2001; 10 4 238 251 (Pubitemid 33605313)
3. Arroyo-Novoa C. M., Figueroa-Ramos M. I., Puntillo K. A., et al. Pain related to tracheal suctioning in awake acutely and critically ill adults: a descriptive study. Intensive Crit Care Nurs: 2008; 24 1 20 27
4. Gélinas C. Management of pain in cardiac surgery ICU patients: have we improved over time? Intensive Crit Care Nurs: 2007; 23 5 298 303
5. Siffleet J., Young J., Nikoletti S., Shaw T. Patients' self-report of procedural pain in the intensive care unit. J Clin Nurs: 2007; 16 11 2142 2148
6. Stotts N. A., Puntillo K., Bonham Morris A., et al. Wound care pain in hospitalized adult patients. Heart Lung: 2004; 33 5 321 332 (Pubitemid 39302545)
7. Puntillo K. A., Wild L. R., Morris A. B., Stanik-Hutt J., Thompson C. L., White C. Practices and predictors of analgesic interventions for adults undergoing painful procedures. Am J Crit Care: 2002; 11 5 415 429, quiz 430-431
8. Chanques G., Jaber S., Barbotte E., et al. Impact of systematic evaluation of pain and agitation in an intensive care unit. Crit Care Med: 2006; 34 6 1691 1699 (Pubitemid 43810050)
9. Recommended by the IASP Subcommittee on Taxonomy Pain terms: a list with definitions and notes on usage. Pain: 1979; 6 3 249
10. Shannon K., Bucknall T. Pain assessment in critical care: what have we learnt from research. Intensive Crit Care Nurs: 2003; 19 3 154 162 (Pubitemid 36747894)
11. Herr K., Coyne P. J., McCaffery M., Manworren R., Merkel S. Pain assessment in the patient unable to self-report: position statement with clinical practice recommendations. Pain Manag Nurs: 2011; 12 4 230 250
12. Li D., Puntillo K., Miaskowski C. A review of objective pain measures for use with critical care adult patients unable to self-report. J Pain: 2008; 9 1 2 10
13. Pudas-Tähkä S. M., Axelin A., Aantaa R., Lund V., Salanterä S. Pain assessment tools for unconscious or sedated intensive care patients: a systematic review. J Adv Nurs: 2009; 65 5 946 956
14. Zwakhalen S. M., Hamers J. P., Abu-Saad H. H., Berger M. P. Pain in elderly people with severe dementia: a systematic review of behavioural pain assessment tools. BMC Geriatr: 2006; 6 3
15. Payen J. F., Bru O., Bosson J. L., et al. Assessing pain in critically ill sedated patients by using a behavioral pain scale. Crit Care Med: 2001; 29 12 2258 2263 (Pubitemid 34038155)
16. Gélinas C., Fillion L., Puntillo K. A., Viens C., Fortier M. Validation of the critical-care pain observation tool in adult patients. Am J Crit Care: 2006; 15 4 420 427 (Pubitemid 44859184)
17. American Educational Research Association (AERA), American Psychological Association (APA), National Council in Measurement in Education (NCME) Standards for Educational and Psychological Testing. Washington, DC American Educational Research Association: 1999
18. Streiner D. L., Norman G. R. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. Oxford Oxford University Press: 2008
19. Strickland O. L. When is internal consistency reliability assessment inappropriate? J Nurs Meas: 1999; 7 1 3 4
20. Voepel-Lewis T., Zanotti J., Dammeyer J. A., Merkel S. Reliability and validity of the face, legs, activity, cry, consolability behavioral tool in assessing acute pain in critically ill patients. Am J Crit Care: 2010; 19 1 55 61, quiz 62
21. Guyatt G. H., Oxman A. D., Vist G. E., et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. Journal of Evidence-Based Medicine: 2009; 9 1 8 11
22. Chen Y-Y, Lai Y-H, Shun S-C, Chi N-H, Tsai P-S, Liao Y-M. The Chinese Behavior Pain Scale for critically ill patients: translation and psychometric testing. Int J Nurs Stud: 2011; 48 4 438 448
23. Ahlers S. J., van der Veen A. M., van Dijk M., Tibboel D., Knibbe C. A. The use of the Behavioral Pain Scale to assess pain in conscious sedated patients. Anesth Analg: 2010; 110 1 127 133
24. Aïssaoui Y., Zeggwagh A. A., Zekraoui A., Abidi K., Abouqal R. Validation of a behavioral pain scale in critically ill, sedated, and mechanically ventilated patients. Anesth Analg: 2005; 101 5 1470 1476 (Pubitemid 41531890)
25. Juarez P., Bach A., Baker M., et al. Comparison of two pain scales for the assessment of pain in the ventilated adult patient. Dimens Crit Care Nurs: 2010; 29 6 307 315
26. Young J., Siffleet J., Nikoletti S., Shaw T. Use of a Behavioural Pain Scale to assess pain in ventilated, unconscious and/or sedated patients. Intensive Crit Care Nurs: 2006; 22 1 32 39 (Pubitemid 43092187)
27. Ahlers S. J., van Gulik L., van der Veen A. M., et al. Comparison of different pain scoring systems in critically ill patients in a general ICU. Crit Care: 2008; 12 1 R15
28. Gélinas C., Harel F., Fillion L., Puntillo K. A., Johnston C. C. Sensitivity and specificity of the critical-care pain observation tool for the detection of pain in intubated adults after cardiac surgery. J Pain Symptom Manage: 2009; 37 1 58 67
29. Chanques G., Payen J-F, Mercier G., et al. Assessing pain in non-intubated critically ill patients unable to self report: an adaptation of the Behavioral Pain Scale. Intensive Care Med: 2009; 35 12 2060 2067
30. Puntillo K. A., Morris A. B., Thompson C. L., Stanik-Hutt J., White C. A., Wild L. R. Pain behaviors observed during six common procedures: results from Thunder Project II. Crit Care Med: 2004; 32 2 421 427 (Pubitemid 38234121)
31. Ely E. W., Margolin R., Francis J., et al. Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med: 2001; 29 7 1370 1379 (Pubitemid 32641799)
32. Gélinas C., Fillion L., Puntillo K. A. Item selection and content validity of the Critical-Care Pain Observation Tool for non-verbal adults. J Adv Nurs: 2009; 65 1 203 216
33. Gélinas C., Johnston C. Pain assessment in the critically ill ventilated adult: validation of the Critical-Care Pain Observation Tool and physiologic indicators. Clin J Pain: 2007; 23 6 497 505 (Pubitemid 46956186)
34. Vázquez M., Pardavila M. I., Lucia M., Aguado Y., Margall M. A., Asiain M. C. Pain assessment in turning procedures for patients with invasive mechanical ventilation. Nurs Crit Care: 2011; 16 4 178 185
35. Nürnberg Damström D., Saboonchi F., Sackey P. V., Björling G. A preliminary validation of the Swedish version of the critical-care pain observation tool in adults. Acta Anaesthesiol Scand: 2011; 55 4 379 386
36. Paulson-Conger M., Leske J., Maidl C., Hanson A., Dziadulewicz L. Comparison of two pain assessment tools in nonverbal critical care patients. Pain Manag Nurs: 2011; 12 4 218 224
37. Gélinas C., Arbour C. Behavioral and physiologic indicators during a nociceptive procedure in conscious and unconscious mechanically ventilated adults: similar or different? J Crit Care: 2009; 24 4 e7 e17
38. Lee K. I., Oh H. S., Suh Y. O., Seo W. S. Patterns and clinical correlates of pain among brain injured patients in critical care assessed with the critical care pain observation tool. Pain Manag Nurs, In press
39. Gélinas C. Nurses' evaluations of the feasibility and the clinical utility of the Critical-Care Pain Observation Tool. Pain Manag Nurs: 2010; 11 2 115 125
40. Gélinas C., Arbour C., Michaud C., Vaillant F., Desjardins S. Implementation of the critical-care pain observation tool on pain assessment/management nursing practices in an intensive care unit with nonverbal critically ill adults: a before and after study. Int J Nurs Stud: 2011; 48 12 1495 1504
41. Le Q., Gelinas C., Arbour C., Rodrigue N. Description of behaviors in traumatic brain injury patients when exposed to common procedures in the intensive care unit: a pilot study. Pain Manag Nurs. In press
42. Merkel S. I., Voepel-Lewis T., Shayevitz J. R., Malviya S. The FLACC: a behavioral scale for scoring postoperative pain in young children. Pediatr Nurs: 1997; 23 3 293 297
43. Feldt K. S. The checklist of nonverbal pain indicators (CNPI). Pain Manag Nurs: 2000; 1 1 13 21
44. Klein D. G., Dumpe M., Katz E., Bena J. Pain assessment in the intensive care unit: development and psychometric testing of the nonverbal pain assessment tool. Heart Lung: 2010; 39 6 521 528
45. Odhner M., Wegman D., Freeland N., Steinmetz A., Ingersoll G. L. Assessing pain control in nonverbal critically ill adults. Dimens Crit Care Nurs: 2003; 22 6 260 267
46. Wegman D. A. Tool for pain assessment. [letter to the editor] Crit Care Nurse: 2005; 25 1 14 15
47. Kabes A. M., Graves J. K., Norris J. Further validation of the nonverbal pain scale in intensive care patients. Crit Care Nurse: 2009; 29 1 59 66
48. Topolovec-Vranic J., Canzian S., Innis J., Pollmann-Mudryj M. A., McFarlan A. W., Baker A. J. Patient satisfaction and documentation of pain assessments and management after implementing the adult nonverbal pain scale. Am J Crit Care: 2010; 19 4 345 354, quiz 355
49. Puntillo K. A., Stannard D., Miaskowski C., Kehrle K., Gleeson S. Use of a pain assessment and intervention notation (P.A.I.N.) tool in critical care nursing practice: nurses' evaluations. Heart & Lung. The Journal of Acute and Critical Care: 2002; 31 4 303 314 (Pubitemid 34774981)
50. Puntillo K. A., Miaskowski C., Kehrle K., Stannard D., Gleeson S., Nye P. Relationship between behavioral and physiological indicators of pain, critical care patients' self-reports of pain, and opioid administration. Crit Care Med: 1997; 25 7 1159 1166 (Pubitemid 27310256)
51. McGrath P. J., Johnson G. I., Goodman J. T., Schillinger J., Dunn J., Chapman J. CHEOPS: A behavioral scale for rating postoperative pain in children. In: Fields H. L., Dubner R., Cervero F., eds. Pain Research and Therapy. Vol 9. New York Raven: 1985; 395 402
52. Li D., Miaskowski C., Burkhardt D., Puntillo K. Evaluations of physiologic reactivity and reflexive behaviors during noxious procedures in sedated critically ill patients. J Crit Care: 2009; 24 3 e9 e13
53. Arbour C., Gélinas C. Are vital signs valid indicators for the assessment of pain in postoperative cardiac surgery ICU adults? Intensive Crit Care Nurs: 2010; 26 2 83 90
54. Kastrup M., von Dossow V., Seeling M., et al. Key performance indicators in intensive care medicine: a retrospective matched cohort study. J Int Med Res: 2009; 37 5 1267 1284
55. Ahlers S. J., van der Veen A. M., van Dijk M., Tibboel D., Knibbe C. A. The use of the Behavioral Pain Scale to assess pain in conscious sedated patients. Anesth Analg: 2010; 110 1 127 133
56. Ahlers S. J., van Gulik L., van der Veen A. M., et al. Comparison of different pain scoring systems in critically ill patients in a general ICU. Crit Care: 2008; 12 1 R15
57. Aïssaoui Y., Zeggwagh A. A., Zekraoui A., Abidi K., Abouqal R. Validation of a behavioral pain scale in critically ill, sedated, and mechanically ventilated patients. Anesth Analg: 2005; 101 5 1470 1476 (Pubitemid 41531890)
58. Chanques G., Jaber S., Barbotte E., et al. Impact of systematic evaluation of pain and agitation in an intensive care unit. Crit Care Med: 2006; 34 6 1691 1699 (Pubitemid 43810050)
59. Chen Y-Y, Lai Y-H, Shun S-C, Chi N-H, Tsai P-S, Liao Y-M. The Chinese Behavior Pain Scale for critically ill patients: translation and psychometric testing. Int J Nurs Stud: 2011; 48 4 438 448
60. Juarez P., Bach A., Baker M., et al. Comparison of two pain scales for the assessment of pain in the ventilated adult patient. Dimens Crit Care Nurs: 2010; 29 6 307 315
61. Payen J. F., Bru O., Bosson J. L., et al. Assessing pain in critically ill sedated patients by using a behavioral pain scale. Crit Care Med: 2001; 29 12 2258 2263 (Pubitemid 34038155)
62. Young J., Siffleet J., Nikoletti S., Shaw T. Use of a Behavioural Pain Scale to assess pain in ventilated, unconscious and/or sedated patients. Intensive Crit Care Nurs: 2006; 22 1 32 39 (Pubitemid 43092187)
63. Chanques G., Payen J-F, Mercier G., et al. Assessing pain in non-intubated critically ill patients unable to self report: an adaptation of the Behavioral Pain Scale. Intensive Care Med: 2009; 35 12 2060 2067
64. Gélinas C. Nurses' evaluations of the feasibility and the clinical utility of the Critical-Care Pain Observation Tool. Pain Manag Nurs: 2010; 11 2 115 125
65. Gélinas C., Arbour C. Behavioral and physiologic indicators during a nociceptive procedure in conscious and unconscious mechanically ventilated adults: similar or different? J Crit Care: 2009; 24 4 e7 e17
66. Gélinas C., Arbour C., Michaud C., Vaillant F., Desjardins S. Implementation of the critical-care pain observation tool on pain assessment/management nursing practices in an intensive care unit with nonverbal critically ill adults: a before and after study. Int J Nurs Stud: 2011; 48 12 1495 1504
67. Gélinas C., Fillion L., Puntillo K. A. Item selection and content validity of the Critical-Care Pain Observation Tool for non-verbal adults. J Adv Nurs: 2009; 65 1 203 216
68. Gélinas C., Fillion L., Puntillo K. A., Viens C., Fortier M. Validation of the critical-care pain observation tool in adult patients. Am J Crit Care: 2006; 15 4 420 427 (Pubitemid 44859184)
69. Gélinas C., Harel F., Fillion L., Puntillo K. A., Johnston C. C. Sensitivity and specificity of the critical-care pain observation tool for the detection of pain in intubated adults after cardiac surgery. J Pain Symptom Manage: 2009; 37 1 58 67
70. Gélinas C., Johnston C. Pain assessment in the critically ill ventilated adult: validation of the Critical-Care Pain Observation Tool and physiologic indicators. Clin J Pain: 2007; 23 6 497 505 (Pubitemid 46956186)
71. Lee K. I., Oh H. S., Suh Y. O., Seo W. S. Patterns and clinical correlates of pain among brain injured patients in critical care assessed with the critical care pain observation tool. Pain Manag Nurs. In press
72. Nürnberg Damström D., Saboonchi F., Sackey P. V., Björling G. A preliminary validation of the Swedish version of the critical-care pain observation tool in adults. Acta Anaesthesiol Scand: 2011; 55 4 379 386
73. Paulson-Conger M., Leske J., Maidl C., Hanson A., Dziadulewicz L. Comparison of two pain assessment tools in nonverbal critical care patients. Pain Manag Nurs: 2011; 12 4 218 224
74. Vázquez M., Pardavila M. I., Lucia M., Aguado Y., Margall M. A., Asiain M. C. Pain assessment in turning procedures for patients with invasive mechanical ventilation. Nurs Crit Care: 2011; 16 4 178 185
75. Feldt K. S. The checklist of nonverbal pain indicators (CNPI). Pain Manag Nurs: 2000; 1 1 13 21
76. Merkel S. I., Voepel-Lewis T., Shayevitz J. R., Malviya S. The FLACC: a behavioral scale for scoring postoperative pain in young children. Pediatr Nurs: 1997; 23 3 293 297
77. Voepel-Lewis T., Zanotti J., Dammeyer J. A., Merkel S. Reliability and validity of the face, legs, activity, cry, consolability behavioral tool in assessing acute pain in critically ill patients. Am J Crit Care: 2010; 19 1 55 61, quiz 62
78. Klein D. G., Dumpe M., Katz E., Bena J. Pain assessment in the intensive care unit: Development and psychometric testing of the nonverbal pain assessment tool. Heart Lung: 2010; 39 6 521 528
79. Juarez P., Bach A., Baker M., et al. Comparison of two pain scales for the assessment of pain in the ventilated adult patient. Dimens Crit Care Nurs: 2010; 29 6 307 315
80. Kabes A. M., Graves J. K., Norris J. Further validation of the nonverbal pain scale in intensive care patients. Crit Care Nurse: 2009; 29 1 59 66
81. Odhner M., Wegman D., Freeland N., Steinmetz A., Ingersoll G. L. Assessing pain control in nonverbal critically ill adults. Dimens Crit Care Nurs: 2003; 22 6 260 267
82. Topolovec-Vranic J., Canzian S., Innis J., Pollmann-Mudryj M. A., McFarlan A. W., Baker A. J. Patient satisfaction and documentation of pain assessments and management after implementing the adult nonverbal pain scale. Am J Crit Care: 2010; 19 4 345 354, quiz 355
83. Puntillo K. A., Miaskowski C., Kehrle K., Stannard D., Gleeson S., Nye P. Relationship between behavioral and physiological indicators of pain, critical care patients' self-reports of pain, and opioid administration. Crit Care Med: 1997; 25 7 1159 1166 (Pubitemid 27310256)
84. Puntillo K. A., Stannard D., Miaskowski C., Kehrle K., Gleeson S. Use of a pain assessment and intervention notation (P.A.I.N.) tool in critical care nursing practice: nurses' evaluations. Heart Lung: 2002; 31 4 303 314 (Pubitemid 34774981)
85. Li D., Miaskowski C., Burkhardt D., Puntillo K. Evaluations of physiologic reactivity and reflexive behaviors during noxious procedures in sedated critically ill patients. J Crit Care: 2009; 24 3 e9 e13
86. McGrath P. J., Johnson G. I., Goodman J. T., Schillinger J., Dunn J., Chapman J. CHEOPS: A behavioral scale for rating postoperative pain in children. In: Fields H. L., Dubner R., Cervero F., eds. Pain Research and Therapy. Vol 9. New York Raven: 1985; 395 402
87. Puntillo K. A., Morris A. B., Thompson C. L., Stanik-Hutt J., White C. A., Wild L. R. Pain behaviors observed during six common procedures: results from Thunder Project II. Crit Care Med: 2004; 32 2 421 427 (Pubitemid 38234121)