Consensus conference follow-up: Inter-rater reliability assessment of the Best Evidence in Emergency Medicine (BEEM) rater scale, a medical literature rating tool for emergency physicians

Academic Emergency Medicine

Volumn 18, Issue 11, 2011, Pages 1193-1200

  Worster, Andrew ^a   Kulasegaram, Kulamakan ^a   Carpenter, Christopher R ^b   Vallera, Teresa ^a   Upadhye, Suneel ^a   Sherbino, Jonathan ^a   Brian Haynes, R ^a  

^a MCMASTER UNIVERSITY   (Canada)

^b WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEST EVIDENCE IN EMERGENCY MEDICINE RATER SCALE; CLINICAL PRACTICE; CONFERENCE PAPER; EMERGENCY MEDICINE; FOLLOW UP; HUMAN; INTERNAL CONSISTENCY; INTERRATER RELIABILITY; PRIORITY JOURNAL; RATING SCALE;

BENCHMARKING; CONSENSUS DEVELOPMENT CONFERENCES AS TOPIC; EMERGENCY MEDICINE; EVIDENCE-BASED EMERGENCY MEDICINE; HUMANS; REPRODUCIBILITY OF RESULTS;

EID: 81755181032     PISSN: 10696563     EISSN: 15532712     Source Type: Journal    
DOI: 10.1111/j.1553-2712.2011.01214.x     Document Type: Conference Paper

References (43)

1. Sherbino J, Upadhye S, Worster A,. Self-reported priorities and resources of academic emergency physicians for the maintenance of clinical competence: a pilot study. CJEM. 2009; 11: 230-4.
2. McGlynn EA, Asch SM, Adams J, et al., The quality of health care delivered to adults in the United States. N Engl J Med. 2003; 348: 2635-45. (Pubitemid 36741592)
3. Miller SH,. American Board of Medical Specialties and repositioning for excellence in lifelong learning: maintenance of certification. J Contin Educ Health Prof. 2005; 25: 151-6.
4. American Board of Emergency Medicine. Emergency Medicine Continuous Certification. Available at:. Accessed Aug 24, 2011.
5. Schrock JW, Cydulka RK,. Lifelong learning. Emerg Med Clin North Am. 2006; 24: 785-95. (Pubitemid 44108555)
6. Upadhye S, Carpenter CR, Diner B,. Methodological quality of the American Board of Emergency Medicine lifelong self-assessment reading lists [abstract]. Acad Emerg Med. 2008; 15: S131.
7. Shaughnessy AF, Slawson DC, Bennett JH,. Becoming an information master: a guidebook to the medical information jungle. J Fam Pract. 1994; 39: 489-99. (Pubitemid 24346741)
8. McKibbon KA, Wilczynski NL, Haynes RB,. What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals? BMC Med. 2004; 2: 33.
9. McMaster University. Health Information Research Unit. Homepage. Available at:. Accessed Aug 24, 2011.
10. McMaster University. HIRU Inclusion Criteria. Available at:. Accessed Aug 24, 2011.
11. Haynes RB, Cotoi C, Holland J, et al., Second-order peer review of the medical literature for clinical practitioners. JAMA. 2006; 295: 1801-8.
12. McMaster University. McMaster Online Rating of Evidence. Available at:. Accessed Aug 24, 2011.
13. McMaster University. McMaster PLUS. Available at:. Accessed Aug 24, 2011.
14. Dillman DA,. Mail and Internet Surveys: The Tailored Design Method. 2nd ed. Hoboken, NJ: John Wiley & Sons, 1999.
15. Dillman DA, Bowker DK,. The web questionnaire challenge to survey methodologists. In:, Reips UD, Bosnjak M, (eds). Dimensions of Internet Science. Lengerich, Germany: Pabst Science, 2001, pp 159-78.
16. Streiner DL, Norman GR,. Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd ed. New York, NY: Oxford University Press, 2003.
17. Carpenter CR, Kane BG, Carter M, et al., Incorporating evidence-based medicine into resident education: a CORD survey of faculty and resident expectations. Acad Emerg Med. 2010; 17 (Suppl 2): S54-61.
18. Emergency Physicians Monthly Inc. Homepage. Available at:. Accessed Oct 4, 2010.
19. Zelen M,. A new design for randomized clinical trials. N Engl J Med. 1979; 300: 1242-5. (Pubitemid 9236327)
20. Zelen M,. Randomized consent designs for clinical trials: an update. Stat Med. 1990; 9: 645-56. (Pubitemid 20235037)
21. Likert RA,. A technique for the measurement of attitudes. Arch Psych. 1932; 140: 1-55.
22. Dawes J,. Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point, and 10-point scales. Int J Market Res. 2008; 50: 61-77.
23. Shrout PE, Fleiss JL,. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86: 420-8.
24. Evans WJ, Cayten CG, Green PA,. Determining the generalizability of rating scales in clinical settings. Med Care. 1981; 19: 1211-9.
25. Roebroek Me, Harlaar J, Lankhorst GJ,. Application of generalizability theory to reliability assessment: an illustration using isometric force measurements. Phys Ther. 1993; 73: 386-95.
26. Norman G,. Likert scales, levels of measurement, and the "laws" of statistics. Adv Health Sci Educ Theory Pract. 2010; 15: 625-32.
27. Havlicek LL, Peterson NL,. Robustness of the Pearson correlation against violation of assumptions. Percept Mot Skills. 1976; 43: 1319-34. (Pubitemid 8023254)
28. Windish DM, Huot SJ, Green ML,. Medicine residents' understanding of the biostatistics and results in the medical literature. JAMA. 2007; 298: 1010-22. (Pubitemid 47360812)
29. Hack JB, Bakhtiari P, O'Brien K,. Emergency medicine residents and statistics: what is the confidence? J Emerg Med. 2009; 37: 313-8.
30. Berwick DM,. Disseminating innovations in health care. JAMA. 2003; 289: 1969-75. (Pubitemid 37430229)
31. Cone DC, Lewis RJ,. Should this study change my practice? Acad Emerg Med. 2003; 10: 417-22. (Pubitemid 36532123)
32. Grol R, Wensing M,. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004; 180 (6Suppl): S57-60. (Pubitemid 38372219)
33. Rogers EM,. Diffusion of Innovations. 5th ed. New York, NY: Free Press, 2003.
34. Diner BM, Carpenter CR, O'Connell T, et al., Graduate medical education and knowledge translation: role models, information pipelines, and practice change thresholds. Acad Emerg Med. 2007; 14: 1008-14. (Pubitemid 47628829)
35. BEEM Best Evidence in Emergency Medicine. Homepage. Available at:. Accessed June 16, 2010.
36. Carpenter CR,. The San Francisco Syncope Rule did not accurately predict serious short-term outcome in patients with syncope. Evid Based Med. 2009; 14: 25.
37. Carpenter CR,. Review: adding dexamethasone to standard therapy reduces short-term relapse for acute migraine in the emergency department. Evid Based Med. 2009; 14: 121.
38. Carpenter CR, Keim SM, Crossley J, et al., Post-transient ischemic attack early stroke stratification: the ABCD(2) prognostic aid. J Emerg Med. 2009; 36: 194-200.
39. Carpenter CR, Keim SM, Seupaul RA, et al., Differentiating low-risk and no-risk PE patients: the PERC score. J Emerg Med. 2009; 36: 317-22.
40. Carpenter CR, Keim SM, Upadhye S, et al., Risk stratification of the potentially septic patient in the emergency department: the Mortality in the Emergency Department Sepsis (MEDS) score. J Emerg Med. 2009; 37: 319-27.
41. Worster A, Keim SM, Sahsi R, et al., Do either corticosteroids or antiviral agents reduce the risk of long-term facial paresis in patients with new-onset Bell's palsy? J Emerg Med. 2010; 38: 518-23.
42. Milne WK, Worster A,. Evidence-based emergency medicine/rational clinical examination abstract. Does the clinical examination predict lower exremity peripheral arterial disease? [comment]. Ann Emerg Med. 2009; 54: 748-50.
43. Lokker C, McKibbon KA, McKinlay RJ, et al., Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study. BMJ. 2008; 336: 655-7. (Pubitemid 351481236)