When and how to evaluate interrater reliability of patient assessment tools

AACN Advanced Critical Care

Volumn 22, Issue 4, 2011, Pages 412-417

  Gélinas, Céline ^a,b  

^a MCGILL UNIVERSITY   (Canada)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DELIRIUM; HUMAN; INTENSIVE CARE; OBSERVER VARIATION; PAIN; REPRODUCIBILITY;

CRITICAL CARE; DELIRIUM; HUMANS; OBSERVER VARIATION; PAIN; REPRODUCIBILITY OF RESULTS;

EID: 81255150063     PISSN: 15597768     EISSN: 15597776     Source Type: Journal    
DOI: 10.1097/NCI.0b013e31822db44e     Document Type: Article

References (21)

1. Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. New York, NY: Oxford University Press; 2008.
2. American Educational Research Association, American Psychological Association, National Council in Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association; 1999.
3. Goodwin LD. Changing conceptions of measurement validity: An update on the new standards. J Nurs Educ. 2002;41:100-106.
4. Goodwin LD, Prescott PA. Issues and approaches to estimating interrater reliability in nursing research. Res Nurs Health. 1981;4:323-337.
5. Jacobi J, Fraser GL, Coursin DB, et al. Clinical practice guidelines for the sustained use of sedatives and analgesics in the critically ill adult. Crit Care Med. 2002;30:119-141.
6. Herr K, Coyne PJ, Key T, et al. Pain assessment in the nonverbal patient: Position statement with clinical practice recommendations. Pain Manag Nurs. 2006;7:44-52.
7. Payen JF, Bru O, Bosson JL, et al. Assessing pain in critically ill sedated patients by using a behavioral pain scale. Crit Care Med. 2001;29:2258-2263.
8. Gélinas C, Fillion L, Puntillo K, Viens C, Fortier M. Validation of a Critical-Care Pain Observation Tool in adult patients. Am J Crit Care. 2006;15:420-427.
9. Puntillo KA, Morris AB, Thompson CL, Stanik-Hutt J, White CA, Wild LR. Pain behaviors observed during six common procedures: Results from Thunder Project II. Crit Care Med. 2004;32:421-427.
10. Sessler CN, Gosnell MS, Grap MJ, et al. The Richmond Agitation Sedation Scale: Validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166:1338-1344.
11. Riker RR, Picard JT, Fraser GL. Prospective evaluation of the Sedation Agitation Scale for adult critically ill patients. Crit Care Med. 1999;27:1325-1329.
12. Ely EW, Margolin R, Francis J, et al. Evaluation of delirium in critically ill patients: Validation of the Confusion Assessment Method for the Intensive Care Unit (CAMICU). Crit Care Med. 2001;29:1370-1379.
13. Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive Care Delirium Screening Checklist: Evaluation of a new screening tool. Int Care Med. 2001;27:859-864.
14. Topf M. Three estimates of interrater reliability for nominal data. Nurs Res. 1986;35:253-255.
15. Waltz CF, Strickland OL, Lenz ER. Measurement in Nursing and Health Research. 4th ed. New York: Springer Publishing Company; 2010.
16. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33: 15-174.
17. Fleiss J. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76:378-382.
18. Laschinger HKS. Intraclass correlations as estimates of interrater reliability in nursing research. West J Nurs Res. 1992;14:246-251.
19. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37-46.
20. Streiner DL. A checklist for evaluating the usefulness of rating scales. Can J Psychiatry. 1993;38:140-148.
21. Haidet KK, Tate J, Divirgilio-Thomas D, Kolanowski A, Happ MB. Methods to improve reliability of videorecorded behavioural data. Res Nurs Health. 2009;32: 465-474.