Sample size requirements for the design of reliability study: Review and new results

Statistical Methods in Medical Research

Volumn 13, Issue 4, 2004, Pages 251-271

  Shoukri, M M ^a,b   Asyali, M H ^b   Donner, A ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b KING FAISAL SPECIALIST HOSPITAL AND RESEARCH CENTER   (Saudi Arabia)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; CONFIDENCE INTERVAL; CORRELATION COEFFICIENT; HUMAN; OUTCOMES RESEARCH; RELIABILITY; REVIEW; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL DISTRIBUTION; STATISTICAL SIGNIFICANCE;

EID: 4344700127     PISSN: 09622802     EISSN: None     Source Type: Journal    
DOI: 10.1191/0962280204sm365ra     Document Type: Review

References (34)

1. Dunn G. Design and analysis of reliability studies. Statistical Methods in Medical Research 1992; 1: 123-57.
2. Shoukri MM. Agreement. In Armitage P, Colton T, eds Encyclopedia of biostatistics. New York: John Wiley & Sons, 1999: 117-30.
3. Shoukri MM. Agreement. In Gail MH, Benichou J, eds Encyclopedia of epidemiologic methods. New York: John Wiley & Sons, 2000: 43-49.
4. Haggard ER. Intraclass correlation and the analysis of variance. New York: Dryden Press, 1958.
5. Elston R. Response to query: estimating 'heritability' of a continuous trait. Biometrics 1977; 33: 232-33.
6. Fisher RA. Statistical methods for research workers. London: Oliver & Boyd, 1925.
7. Walter DS, Eliasziw M, Donner A. Sample size and optimal design for reliability studies. Statistics in Medicine 1998; 17: 101-10.
8. Freedman LS, Parmar MKB, Baker SG. The design of observer agreement studies with binary assessments. Statistics in Medicine 1993; 12: 165-79.
9. Awni WM, Skaar DJ, Schwenk MH. Interindividual and intraindividual variability in labetalol pharmacokinetics. Journal of Clinical Pharmacology 1988; 28: 344-49.
10. Donner A, Eliasziw M. Sample size requirements for reliability studies. Statistics in Medicine 1987; 6: 441-48.
11. Eliasziw M, Donner A. A cost-function approach to the design of reliability studies. Statistics in Medicine 1987; 6: 647-55.
12. Giraudeau B, Mary JY. Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 per cent confidence interval of the intraclass correlation coefficient. Statistics in Medicine 2001; 20: 3205-14.
13. Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Statistics in Medicine 2002; 21: 1331-35.
14. Donner A. Sample size requirements for interval estimation of the intraclass kappa statistic. Communications in Statistics - Simulation 1999; 28: 415-29.
15. Shoukri MM, Asyali MH, Walter SD. Issues of cost and efficiency in the design of reliability studies. Biometrics 2003; 59: 1107-12.
16. Rao SS. Optimization: theory and applications. New Delhi: Wiley Eastern Limited, 1984.
17. Flynn NT, Whitley E, Peters T. Recruitment strategy in a cluster randomized trial: cost implications. Statistics in Medicine 2002; 21: 397-405.
18. Sukhatme PV, Sukhatme BV, Sukhatme S, Asok C. Sampling theory of surveys with applications. Ames, IA: Iowa State University Press, 1984.
19. Scheffé H. The analysis of variance. New York: John Wiley & Sons, 1959.
20. Tukey JW. Variance of variance components I: balanced designs. Annals of Mathematical Statistics 1956; 27: 722-36.
21. Kendall M, Stuart A. The advanced theory of statistics, Vol 1. London: Griffin, 1986.
22. Hemmersley IM. The unbiased estimate and standard error of the intraclass variance. Metron 1949; 15: 189-205.
23. Kraemer CH. Ramification of a population model for κ as a coefficient of reliability. Psychometrika 1979; 44: 461-72.
24. Frederic R, Gaspoz JM, Fortune IC, Minini P, Pichot V, Duverney D, Lacow JR and Barthelemy JC. Screening of obstructive sleep apnea syndrome by heart rate variability analysis. Circulation 1999; 100: 1411-15.
25. Donner A, Eliasziw M. Statistical implications of the choice between a dichotomous or continuous trait in studies of interobserver agreement. Biometrics 1994; 50: 550-55.
26. Mak TK. Analyzing intraclass correlation for dichotomous variables. Applied Statistics 1988; 20: 37-46.
27. Haseman JK, Kupper LL. Analysis of dichotomous response data from certain toxicological experiments. Biometrics 1979; 35: 281-93.
28. Bloch DA, Kraemer HC. 2 × 2 Kappa coefficients: measures of agreement or association. Biometrics 1989; 45: 269-87.
29. Donner A, Eliasziw M. The goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance testing, and sample size estimation. Statistics in Medicine 1992; 11: 1511-19.
30. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-74.
31. Cohen JA. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20: 37-46.
32. Fleiss J, Cohen JA. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement 1973; 33: 613-19.
33. Crowder M. Beta-binomial ANOVA for proportions. Applied Statistics 1978; 27: 34-37.
34. Cox DR, Snell EJ. Analysis of binary data. London: Chapman and Hall, 1989.