From bayes through marginal utility to effect sizes: A guide to understanding the clinical and statistical significance of the results of autism research findings

Journal of Autism and Developmental Disorders

Volumn 41, Issue 2, 2011, Pages 168-174

  Cicchetti, Domenic V ^a   Koenig, Kathy ^a   Klin, Ami ^a   Volkmar, Fred R ^a   Paul, Rhea ^a   Sparrow, Sara ^a  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Clinical significance in autism research

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; AUTISM; BAYES THEOREM; CLINICAL RESEARCH; EFFECT SIZE; INTERNAL CONSISTENCY; POWER ANALYSIS; PRIORITY JOURNAL; RELIABILITY; SAMPLE SIZE; STATISTICAL SIGNIFICANCE;

ANALYSIS OF VARIANCE; AUTISTIC DISORDER; BAYES THEOREM; BIOMEDICAL RESEARCH; DATA INTERPRETATION, STATISTICAL; HUMANS; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE;

EID: 78751646696     PISSN: 01623257     EISSN: 15733432     Source Type: Journal    
DOI: 10.1007/s10803-010-1035-6     Document Type: Article

References (42)

1. JJ Bartko 1966 The intraclass correlation coefficient as a measure of reliability Psychological Reports 19 3 11 5942109
2. JJ Bartko 1974 Corrective note to "the intraclass correlation coefficient as a measure of reliability" Psychological Reports 34 418
3. Bayes, T. (1763). "An essay, by the late Reverend Mr. Bayes, F.R.S. communicated by Mr. Price, in a letter to John Canton, A.M.F.R.S. Philosophical Transactions, giving some account of the present undertakings, studies and labours of the ingenious in many considerable parts of the world, vol 53, 370-418.
4. Bolanowski, S. J., Jr., & Gescheider, G. A. (Eds.). (1991). Ratio scaling of psychological magnitude: In honor of the memory of S.S. Stevens. Hillsdale, NJ: Lawrence Erlbaum Associates.
5. Borenstein, M. (1998). The shift from significance testing to effect size estimation. In A. S. Bellak & M. Hershen (Series Eds.) & N. Schooler (Vol. Ed.), Research and methods: Comprehensive clinical psychology (Vol. 3, pp. 313-349). New York, NY: Pergamon.
6. Borenstein, M., Rothstein, H., & Cohen, J. (2001). Power and precision: A computer program for statistical power analysis and confidence intervals. Englewood, NJ: Biostat, Inc.
7. DV Cicchetti 1988 When diagnostic agreement is high, but reliability is low: Some paradoxes occurring in joint independent neuropsychology assessments Journal of Clinical and Experimental Neuropsychology 10 605 622 10.1080/01688638808402799 3225317
8. DV Cicchetti 1994 Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology Psychological Assessment 6 284 290 10.1037/1040-3590.6.4.284
9. DV Cicchetti 2001 The precision of reliability and validity estimates re-visited: istinguishing between clinical and statistical significance of sample size requirements Journal of Clinical and Experimental Neuropsychology 23 695 700 10.1076/jcen.23.5.695.1249 11778646 (Pubitemid 34074702)
10. DV Cicchetti 2008 From Bayes to the just noticeable difference to effect sizes: A note to understanding the clinical and statistical significance of oenologic research findings Journal of Wine Economics 3 185 193 10.1080/09571260902891126
11. DV Cicchetti R Bronen S Spencer S Haut A Berg P Oliver P Tyrer 2006 Rating scales, scales of measurement, issues of reliability: Resolving some critical issues for clinicians and researchers Journal of Nervous and Mental Disease 194 557 564 10.1097/01.nmd.0000230392.83607.c5 16909062
12. DV Cicchetti C Lord K Koenig A Klin F Volkmar 2008 Reliability of the ADI-R: Multiple examiners evaluate a single case Journal of Autism and Developmental Disorders 38 764 770 10.1007/s10803-007-0448-3 18058216
13. DV Cicchetti SS Sparrow 1981 Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior American Journal of Mental Deficiency 86 127 137 7315877
14. Cicchetti, D. V., & Sparrow, S. S. (1990). Assessment of adaptive behavior in young children. In J. J. Johnson & J. Goldman (Eds.), Developmental assessment in clinical child psychology: A handbook (chap. 8 (pp. 173-196). New York: Pergamon.
15. J Cohen 1960 A coefficient of agreement for nominal scales Educational and Psychological Measurement 23 37 46 10.1177/001316446002000104
16. Cohen, J. (1965). Some statistical issues in psychological research. In B.B. Wolman (Ed.). Handbook of clinical psychology.
17. J Cohen 1968 Weighted kappa: Nominal scale agreement with provision for partial credit Psychological Bulletin 70 213 220 10.1037/h0026256 19673146
18. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. New York, NY: Academic Press.
19. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Glendale, NJ: Lawrence Erlbaum, Associates.
20. LJ Cronbach 1950 Coefficient alpha and the internal structure of tests Psychometrika 16 297 334 10.1007/BF02310555
21. JA Durlak 2009 How to select, calculate and interpret Effect Sizes Journal of Pediatric Psychology 34 917 928 10.1093/jpepsy/jsp004 19223279
22. Fechner, G. (1907). Elemente der Psychophysik I u. II Leipsig. Germany: Breitkopf & Hartel.
23. S Finch G Cumming 2009 Putting research in context: Understanding, confidence intervals from one or more studies Journal of Pediatric Psychlogy 34 903 916 10.1093/jpepsy/jsn118
24. JL Fleiss 1975 Measuring agreement between two judges on the presence or absence of a trait Biometrics 31 651 659 10.2307/2529549 1174623
25. JL Fleiss J Cohen 1973 The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability Educational and Psychological Measurement 33 613 619 10.1177/001316447303300309
26. A Klin J Lang DV Cicchetti F Volkmar 2000 Inter-rater reliability of clinical diagnosis and DSM-IV criteria for autistic disorder: Results of the DSM-IV autism field trial Journal of Autism and Developmental Disorders 30 163 167 10.1023/A:1005415823867 10832781 (Pubitemid 30331611)
27. HC Kraemer GH Morgan NL Leech JA Gliner JJ Vaske RJ Harmon 2003 Measures of clinical significance Journal of the American Academy of Child and Adolescent Psychiatry 42 1524 1529 10.1097/00004583-200312000-00022 14627890 (Pubitemid 39585985)
28. JR Landis GG Koch 1977 The measurement of observer agreement for categorical data Biometrics 33 159 174 10.2307/2529310 843571
29. A Laupacis DL Sackett RS Roberts 1988 An assessment of clinically useful measures of the consequences of treatment New England Journal of Medicine 318 1728 1733 10.1056/NEJM198806303182605 3374545
30. J Neyman ES Pearson 1928 On the use and interpretation of certain test criteria for purposes of statistical inference Biometrika 20A 175 240 and 263-294
31. J Neyman ES Pearson 1933 On the problem of the most efficient tests of statistical hypotheses Transactions of the Royal Society of London Series A 231 289 337 10.1098/rsta.1933.0009
32. Nunnally, J. C. (1978). Psychometric theory. New York, NY: McGraw-Hill.
33. R Paul K Chawarska D Cicchetti F Volkmar 2008 Language outcomes of toddlers with autism spectrum disorders: A two year follow-up Autism Research 1 2 97 107 10.1002/aur.12 19360656
34. R Paul S Miles-Orlovsky HC Marcinko F Volkmar 2010 Conversational behaviors in youth with high-functioning ASD and Asperger Syndrome Journal of Autism and Developmental Disorders 39 115 125 10.1007/s10803-008-0607-1
35. R Rosenthal 1991 Meta-analytic procedures for social research Applied Social Research Methods Series 6 1 155
36. Sparrow, S. S., Cicchetti, D. V., & Balla, D. A. (2005). Vineland II: A revision of the vineland adaptive behavior scales: I. Survey/caregiver form (2nd edn). Circle Pines, Minnesota: American Guidance Service.
37. Sparrow, S. S., Cicchetti, D. V., & Balla, D. A. (2008). Vineland II: A revision of the vineland adaptive behavior scales: II. Expanded form (2nd edn). Circle Pines, Minnesota: American Guidance Service.
38. SS Stevens 1946 On the theory of scales of measurement Science 10 677 680 10.1126/science.103.2684.677
39. Stevens, S. S. (1951). Mathematics, measurement, and psychophysics. In Stevens, S. S. (Ed.). Handbook of experimental psychology, chap. 1 (pp. 1-49). New York, NY: Wiley.
40. SS Stevens 1968 Measurement, statistics, and the schemapiric view Science 161 849 856 10.1126/science.161.3844.849 5667519
41. Stone, H., & Sidel, J.l. (Eds.). (1993). Sensory evaluation practices (2nd ed.). New York, NY: Academic Press.
42. Von Wieser, F. (1893). Natural value (English ed ed.). New York, NY: MacMillan.