Improving participation and interrater agreement in scoring ambulatory pediatric association abstracts: How well have we succeeded?

Archives of Pediatrics and Adolescent Medicine

Volumn 150, Issue 4, 1996, Pages 380-383

  Kemper, Kathi J ^a,d   McCarthy, Paul L ^b   Cicchetti, Domenic V ^c  

^a UNIVERSITY OF WASHINGTON   (United States)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c VA CONNECTICUT HEALTHCARE SYSTEM   (United States)

^d Swedish Family Medicine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; MEDICAL LITERATURE; MEDICAL RESEARCH; MEDICAL SOCIETY; PEER REVIEW; PRACTICE GUIDELINE; PRIORITY JOURNAL; RELIABILITY; SCORING SYSTEM;

EID: 0029914252     PISSN: 10724710     EISSN: None     Source Type: Journal    
DOI: 10.1001/archpedi.1996.02170290046007     Document Type: Article

References (29)

1. Standards of Reporting Trials Group. A proposal for structured reporting of randomized controlled trials. JAMA. 1994;272:1926-1931
2. Working Group on Recommendations for Reporting Clinical Trials in the Biomedical Literature. Call for comments on a proposal to improve reporting of clinical trials in the biomedical literature. Ann Intern Med. 1994,121:894-895.
3. Haynes RB, Mulrow CD, Huth EJ, Altman DG, Gardner MJ. More informative abstracts revisited. Ann Intern Med. 1990,113:69-76.
4. Purpose and procedure. ACP J Club 1991;115(suppl 2):A-13-A-14.
5. Goodman SN, Berlin J, Fletcher SW, Fletcher RH Manuscript quality before and after peer review and editing at Annals of Internal Medicine. Ann Intern Med. 1994;121:11-21
6. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977,33 159-174
7. Cyr L, Francis K. Measures of clinical agreement for nominal and categorical data, the kappa coefficient. Comput Biol Med. 1992;22:239-246.
8. Cicchetti DV The reliability of peer review for manuscript and grant submissions a cross-disciplinary investigation. Behav Brain Sci. 1991;14:119-186.
9. Garfunkel JM, Ulshen MJ, Hamrick HJ, Lawson EE. Problems identified by secondary review of accepted manuscripts. JAMA. 1990,263:1369-1371.
10. Rubin HR, Redelmeier DA, Wu AW, Steinberg EP How reliable is peer review of scientific abstracts? J Gen Intern Med. 1993,8:255-258.
11. Cicchetti DV, Conn HO. A statistical analysis of reviewer agreement and bias in evaluating medical abstracts Yale J Biol Med. 1976;49:373-383.
12. Gardner MJ, Machin D, Campbell MJ. Use of check lists in assessing the statistical content of medical studies. BMJ. 1986;292:810-812.
13. Oxman AD, Guyatt GH, Singer J, et al. Agreement among reviewers of review articles J Clin Epidemiol. 1991;44:91-98
14. Cho MK, Bero LA. Instruments for assessing the quality of drug studies published in the medical literature JAMA. 1994;272:101-104.
15. Solomon MJ, McLeod RS Clinical studies in surgical journals: have we improved? Dis Colon Rectum. 1993;36:43-48.
16. Cooper GS, Zangwill L. An analysis of the quality of research reports in the Journal of General Internal Medicine. J Gen Intern Med. 1989;4:232-236.
17. Strayhorn J, McDermott JF, Tanguay P. An intervention to improve the reliability of manuscript reviews for the Journal of the American Academy of Child and Adolescent Psychiatry Am J Psychiatry 1993,150:947-952.
18. Taddio A, Pain T, Fassos FF, Boon H, Ilersich AL, Einarson TR. Quality of non-structured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association Can Med Assoc J 1994,150 1611-1615.
19. Cicchetti DV, Volkmar F, Klin A, Showalter D. Diagnosing autism using ICD-10 criteria: a comparison of neural networks and standard multivariate procedures. Child Neuropsychol 1995,1 26-37
20. Fleiss JL Statistical Methods for Rates and Proportions. 2nd ed. New York, NY: John Wiley & Sons Inc, 1981.219-220
21. Fleiss JL, Cicchetti DV Inference about weighted kappa in the non-null case Appl Psychol Meas. 1978;2:113-117.
22. Cicchetti DV, Sparrow SS. Developing criteria for establishing interrater reliability of specific items applications to assessment of adaptive behavior. Am J Ment Retard 1981;86.127-137
23. Cole S, Cole JR, Simon GA Chance and consensus in peer review. Science. 1981;214:881-886.
24. Hutchison BG, Milner R. Reliability of the guide to pregnancy risk grading of the Ontario Antenatal Record in assessing obstetric risk Can Med Assoc J. 1994,150 1983-1987
25. Goldman RL The reliability of peer assessments of quality of care. JAMA. 1992; 267:958-960.
26. Karan LM. The reliability of clinical methods, data and judgments N Engl J Med. 1975;293:624,695.
27. Jako RA, Murphy KR Distributional ratings, judgment decomposition and their impact on interrater agreement and rating accuracy. J Applied Psychol, 1990, 75.500-505.
28. Bennett KJ, Sackett KL, Haynes RB, Neufeld VR, Tugwell P, Roberts R. A controlled trial of teaching critical appraisal of the clinical literature to medical students. JAMA 1987,257 2451-2454.
29. Remington M, Tyrer PJ, Newsom-Smith J, Cicchetti DV Comparative reliability of categorical and analog rating scales in the assessment of psychiatric symptomatology Psychol Med. 1979;9 705-770.