Effect of standardised scoring conventions on inter-rater reliability in the endoscopic evaluation of Crohn's disease

Journal of Crohn's and Colitis

Volumn 10, Issue 9, 2016, Pages 1006-1014

  Dubcenco, Elena ^a   Zou, Guangyong ^a   Stitt, Larry ^a   Baker, Jeffrey P ^b   Jeejeebhoy, Khursheed N ^b   Kandel, Gabor ^b   Kim, Young in ^b   Grover, Samir C ^b   McDonald, John W D ^a   Shackelton, Lisa M ^a   Khanna, Reena ^a   D'Haens, Geert ^c   Sandborn, William J ^d   Feagan, Brian G ^a   Levesque, Barrett G ^d  

^a ROBARTS RESEARCH INSTITUTE   (Canada)

^b ST MICHAEL'S HOSPITAL   (Canada)

^c UNIVERSITY HOSPITALS LEUVEN   (Belgium)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Crohn's disease; Endoscopic indices; Training

Indexed keywords

ARTICLE; ASSESSMENT OF HUMANS; COLONOSCOPY; CROHN DISEASE; CROHN DISEASE ACTIVITY INDEX; CROHN'S DISEASE ENDOSCOPIC INDEX OF SEVERITY; GASTROENTEROLOGIST; GASTROINTESTINAL ENDOSCOPY; GLOBAL EVALUATION OF LESION SEVERITY; HUMAN; INTERRATER RELIABILITY; OUTCOME ASSESSMENT; PRIORITY JOURNAL; SIMPLIFIED ENDOSCOPIC SCORE FOR CROHN'S DISEASE; SURFACE AREA; ULCER; VIDEORECORDING; VISUAL ANALOG SCALE; ADOLESCENT; ADULT; AGED; CLINICAL DECISION MAKING; DIAGNOSTIC IMAGING; EDUCATION; EVALUATION STUDY; FEMALE; GASTROENTEROLOGY; MALE; MEDICAL EDUCATION; MIDDLE AGED; OBSERVER VARIATION; ONTARIO; PATHOLOGY; PROCEDURES; REPRODUCIBILITY; SEVERITY OF ILLNESS INDEX; SINGLE BLIND PROCEDURE; VERY ELDERLY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; AGED, 80 AND OVER; CLINICAL DECISION-MAKING; COLONOSCOPY; CROHN DISEASE; EDUCATION, MEDICAL, CONTINUING; FEMALE; GASTROENTEROLOGY; HUMANS; MALE; MIDDLE AGED; OBSERVER VARIATION; ONTARIO; REPRODUCIBILITY OF RESULTS; SEVERITY OF ILLNESS INDEX; SINGLE-BLIND METHOD; VIDEO RECORDING; YOUNG ADULT;

EID: 85012283231     PISSN: 18739946     EISSN: 18764479     Source Type: Journal    
DOI: 10.1093/ecco-jcc/jjw120     Document Type: Article

References (31)

1. Mary JY, Modigliani R. Development and validation of an endoscopic index of the severity for Crohn's disease: a prospective multicentre study. Groupe d'Etudes Thérapeutiques des Affections Inflammatoires du Tube Digestif [GETAID]. Gut 1989; 30:983-89.
2. Daperno M, D'Haens G, Van Assche G, et al. Development and validation of a new, simplified endoscopic activity score for Crohn's disease: the SESCD. Gastrointest Endosc 2004;60:505-12.
3. Gottlieb K, Travis S, Feagan B, et al. Central reading of endoscopy endpoints in inflammatory bowel disease trials. Inflamm Bowel Dis 2015;21:2475-82.
4. Khanna R, Zou GY, D'Haens G, et al. Reliability among central readers in the evaluation of endoscopic findings from patients with Crohn's disease. Gut 2016;65:1119-25.
5. Christensen R, Pearson LM, Johnson W. Case-deletion diagnostics for mixed models. Technometrics 1992;34:38-45.
6. Modigliani R, Mary JY. Reproducibility of colonoscopic findings in Crohn's disease: a prospective multicenter study of interobserver variation. Groupe d'Etudes Thérapeutiques des Affections Inflammatoires du Tube Digestif [GETAID]. Dig Dis Sci 87;32:1370-9.
7. Modigliani R, Mary JY, Simon JF, et al. Clinical, biological, and endoscopic picture of attacks of Crohn's disease. Evolution on prednisolone. Groupe d'Etude Thérapeutique des Affections Inflammatoires Digestives. Gastroenterology 1990;98:811-8.
8. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
9. Giraudeau B, Porcher R, Mary JY. Power calculation for the likelihood ratio-test when comparing two dependent intraclass correlation coefficients. Comput Methods Programs Biomed 2005;77:165-73.
10. Kowalik D, Choi Y-H, Zou GY. Confidence interval estimation for a difference between two dependent intraclass correlation coefficients with variable class sizes. J Stat Theory Pract 2011;5:613-25.
11. Schnitzler F, Fidder H, Ferrante M, et al. Mucosal healing predicts longterm outcome of maintenance therapy with infliximab in Crohn's disease. Inflamm Bowel Dis 2009;15:1295-301.
12. Baert F, Moortgat L, Van Assche G, et al. Mucosal healing predicts sustained clinical remission in patients with early-stage Crohn's disease. Gastroenterology 2010;138:463-8.
13. Rutgeerts P, Van Assche G, Sandborn WJ, et al. Adalimumab induces and maintains mucosal healing in patients with Crohn's disease: data from the EXTEND trial. Gastroenterology 2012;142:1102-11.
14. Bjorkesten CG, Nieminen U, Sipponen T, et al. Mucosal healing at 3 months predicts long-term endoscopic remission in anti-TNF-treated luminal Crohn's disease. Scand J Gastroenterol 2013;48:543-51.
15. Bruera E, Kuehn N, Miller MJ, et al. The Edmonton Symptom Assessment System [ESAS]: a simple method for the assessment of palliative care patients. Palliat Care 1991;7:6-9.
16. Kremer E, Atkinson JH, Ignelzi RJ. Measurement of pain: patient preference does not confound pain measurement. Pain 1981;10:241-8.
17. Ferriera-Valente MA, Pais-Ribeiro JL, Jensen MP. Validity of four pain intensity rating scale. Pain 2011;152:2399-404.
18. Scott J, Huskisson EC. Graphic representation of pain. Pain 1976; 2:175-84.
19. Hyland ME, Sodergren SC. Development of a new type of global quality of life scale, and comparison of performance and preference for 12 global scales. Qual Life Res 1996;5:469-80.
20. Armstrong GA. Quantitative descriptive analysis [QDA] utilizing the human instrument. Nutr Food Sci 1999;99:317-23.
21. Lingjaerde O, Foreland AR. Direct assessment of improvement in winter depression with a visual analogue scale: high reliability and validity. Psychiatr Res 1998;81:387-92.
22. Mortimore C, Anderson IM. d-Fenfluramine in panic disorder: a dual role for 5-hydroxytryptamine. Psychopharmacology 2000;149:251-8.
23. Steiner M, Streiner DL. Validation of a revised visual analogue scale for premenstrual mood symptoms: results from prospective and retrospective trials. Can J Psychiatry 2005;50:327-32.
24. Maxwell C. Sensitivity and accuracy of the visual analogue scale: A psycho-physical classroom experiment. Br J Clin Pharmacol 1978;6:15-24.
25. Price DD, McGrath PA, Rafii A, et al. The validation of visual analogue scales as ratio scale measures for chronic and experimental pain. Pain 1983;17:45-56.
26. DeLoach LJ, Higgins MS, Caplan AB, et al. The visual analog scale in the immediate post-operative period: Intra-subject variability and correlation with a numeric scale. Anesth Analg 1998;86:102-6.
27. Hartrick CT, Kovan JP. The numeric rating scale for clinical pain measurement: A ratio measure? Pain Pract 2003;3:310-6.
28. Myles PS, Troedel S, Boquest M, et al. The pain visual analog scale: Is it linear or nonlinear? Anesth Analg 1999;89:1517-20.
29. Dixon JS, Bird HA. Reproducibility along a 10 cm vertical visual analogue scale. Ann Rheum Dis 1981;40:87-9.
30. Guyatt GH, Townsend M, Berman LB, et al. A comparison of Likert and visual analogue scales for measuring change in function. J Chronic Dis 1987;40:1129-33.
31. Moskal BM, Leydens JA. Scoring rubric development: Validity and reliability. Pract ical Assessment, Research & Evaluation 2000;7:71-81.