Accuracy in parameter estimation in cluster randomized designs

Psychological Methods

Volumn 19, Issue 3, 2014, Pages 356-379

  Pornprasertmanit, Sunthud ^a   Schneider, W Joel ^b  

^a TEXAS TECH UNIVERSITY   (United States)

^b ILLINOIS STATE UNIVERSITY   (United States)

Author keywords

Accuracy in parameter estimation; Cluster randomized design; Research design; Sample size planning

Indexed keywords

HUMAN; METHODOLOGY; RANDOMIZED CONTROLLED TRIAL (TOPIC); SAMPLE SIZE; STATISTICS;

HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; SAMPLE SIZE; STATISTICS AS TOPIC;

EID: 84925766726     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0037036     Document Type: Article

References (47)

1. American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
2. Bates, D., Maechler, M., & Bolker, B. (2012). lme4 0.999999-0 (or greater) [Computer software and manual]. Retrieved from http://www.cran.r-project.org/.
3. Bauer, D. J. (2003). Estimating multilevel linear models as structural equation models. Journal of Educational and Behavioral Statistics, 28, 135-167. doi:10.3102/10769986028002135.
4. Boker, S., Neale, M., Maes, H., Wilde, M., Spiegel, M., Brick, T. Fox, J. (2011). OpenMx: An open source extended structural equation modeling framework. Psychometrika, 76, 306-317. doi:10.1007/s11336-010-9200-6.
5. Browne, W. J., Golalizadeh Lahi, M., & Parker, R. M. (2009). A guide to sample size calculations for random effect models via simulation and the MLPowSim software package. Bristol, England: University of Bristol.
6. Cheung, M. W.-L. (2009). Constructing approximate confidence intervals for parameters with structural equation models. Structural Equation Modeling, 16, 267-294. doi:10.1080/10705510902751291.
7. Cochran, W. (1977). Sampling techniques (3rd ed.). New York, NY: Wiley.
8. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New York, NY: Erlbaum.
9. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159. doi:10.1037/0033-2909.112.1.155.
10. Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 997-1003. doi:10.1037/0003-066X.49.12.997.
11. Conduct Problems Prevention Research Group. (2004). The effects of the fast track program on serious problem outcomes at the end of elementary school. Journal of Clinical Child and Adolescent Psychology, 33, 650-661. doi:10.1207/s15374424jccp3304_1.
12. Connor, C. M., Piasta, S. B., Fishman, B., Glasney, S., Schatschneider, C., Crowe, E. Morrison, F. J. (2009). Individualizing student instruction precisely: Effects of Child × Instruction interactions on first graders' literacy development. Child Development, 80, 77-100. doi:10.1111/j.1467-8624.2008.01247.x.
13. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 532-574. doi:10.1177/0013164401614002.
14. Donner, A., & Klar, N. (2000). Design and analysis of cluster randomization trials in health research. London, England: Arnold.
15. Fidler, F., & Cumming, G. (2013). Effect size estimation and confidence intervals. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology: Vol. 2. Research methods in psychology (2nd ed., pp. 142-163). Hoboken, NJ: Wiley.
16. Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Vazire, S., & West, S. G. (2013). Improving the dependability of research in personality and social psychology recommendations for research and educational practice. Personality and Social Psychology Review. Advance online publication. doi:10.1177/1088868313507536.
17. Goldstein, H. (2011). Multilevel statistical models (4th ed.). West Sussex, United Kingdom: Wiley.
18. Hancock, G. R. (2001). Effect size, power, and sample size determination for structured means modeling and MIMIC approaches to betweengroups hypothesis testing of means on a single latent construct. Psychometrika, 66, 373-388. doi:10.1007/BF02294440.
19. Harville, D. A. (2008). Matrix algebra from a statistician's perspective. New York, NY: Springer.
20. Hayes, R. J., & Bennett, S. (1999). Simple sample size calculation for cluster-randomized trails. International Journal of Epidemiology, 28, 319-326. doi:10.1093/ije/28.2.319.
21. Hays, W. L. (1994). Statistics (5th ed.). New York, NY: Harcourt Brace.
22. Hedges, L. V. (2007a). Correcting a significance test for clustering. Journal of Educational and Behavioral Statistics, 32, 151-179. doi:10.3102/1076998606298040.
23. Hedges, L. V. (2007b). Effect sizes in cluster-randomized designs. Journal of Educational and Behavioral Statistics, 32, 341-370. doi:10.3102/1076998606298043
24. Hedges, L. V., & Hedberg, E. C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29, 60-87. doi:10.3102/0162373707299706.
25. Hoogland, J. J., & Boomsma, A. (1998). Robustness studies in covariance structure modeling. Sociological Methods & Research, 26, 329-367. doi:10.1177/0049124198026003003.
26. Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2, e124. doi:10.1371/journal.pmed.0020124.
27. Kelley, K. (2008). Sample size planning for the squared multiple correlation coefficient: Accuracy in parameter estimation via narrow confidence intervals. Multivariate Behavioral Research, 43, 524-555. doi: 10.1080/00273170802490632.
28. Kelley, K., & Maxwell, S. E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods, 8, 305-321. doi:10.1037/1082-989X.8.3.305.
29. Kelley, K., & Rausch, J. R. (2006). Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals. Psychological Methods, 11, 363-385. doi:10.1037/1082-989X.11.4.363.
30. Kelley, K., & Rausch, J. R. (2011). Sample size planning for longitudinal models: Accuracy in parameter estimation for polynomial change parameters. Psychological Methods, 16, 391-405. doi:10.1037/a0023352.
31. Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203-229. doi:10.1037/a0012869.
32. Maxwell, S. E., & Delaney, H. D. (2004). Designing experiments and analyzing data: A model comparison perspective. Mahwah, NJ: Erlbaum.
33. Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537-563. doi:10.1146/annurev.psych.59.103006.093735.
34. Muthén, L. K., & Muthén, B. O. (1998-2013). Mplus user's guide: Statistical analysis with latent variables (7th ed.). Los Angeles, CA: Muthén & Muthén.
35. Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599-620. doi:10.1207/S15328007SEM0904_8.
36. Piasta, S. B., Connor, C. M., Fishman, B. J., & Morrison, F. J. (2009). Teachers' knowledge of literacy concepts, classrooms, practices, and student reading growth. Scientific Studies of Reading, 13, 224-248. doi:10.1080/10888430902851364.
37. Pornprasertmanit, S. (2010). Efficient sample size for power and desired accuracy in Cohen's d estimation in two-group cluster randomized design (Master's thesis). Illinois State University, Normal, IL.
38. Raudenbush, S. W. (1997). Statistical analysis and optimal design for cluster randomized trails. Psychological Methods, 2, 173-185. doi: 10.1037/1082-989X.2.2.173.
39. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
40. Raudenbush, S. W., & Liu, X.-F. (2001). Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. Psychological Methods, 6, 387-401. doi:10.1037/1082-989X.6.4.387.
41. Raudenbush, S. W., Martinez, A., & Spybrook, J. (2007). Strategies for improving precision in group-randomized experiments. Educational Evaluation and Policy Analysis, 29, 5-29. doi:10.3102/0162373707299460.
42. R Development Core Team. (2012). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria: R Foundation for Statistical Computing.
43. Rindskopf, D. (1984). Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika, 49, 37-47. doi:10.1007/BF02294204.
44. Snijders, T. A. B., & Bosker, R. J. (1993). Standard errors and sample sizes for two-level research. Journal of Educational Statistics, 18, 237-259. doi:10.2307/1165134.
45. Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). London, England: Sage.
46. Spybrook, J., Raudenbush, S. W., Congdon, R., & Martinez, A. (2009). Optimal design for longitudinal and multilevel research: Documentation for the "Optimal Design" software. Ann Arbor, MI: University of Michigan.
47. Wilkinson, L., & The Task Force on Statistical Inference. (1999). Statistical methods in psychology journals. American Psychologist, 54, 594-604. doi:10.1037/0003-066X.54.8.594.