Effect Size, Statistical Power, and Sample Size Requirements for the Bootstrap Likelihood Ratio Test in Latent Class Analysis

Structural Equation Modeling

Volumn 21, Issue 4, 2014, Pages 534-552

  Dziak, John J ^a   Lanza, Stephanie T ^a   Tan, Xianming ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

Bayesian information criterion; bootstrap likelihood ratio test; latent class analysis; mixture models; sample size; statistical power

Indexed keywords

LIFE CYCLE; MONTE CARLO METHODS; STATISTICAL TESTS;

BAYESIAN INFORMATION CRITERION; LATENT CLASS ANALYSIS; LIKELIHOOD RATIO TESTS; MIXTURE MODEL; SAMPLE SIZES; STATISTICAL POWER;

SAMPLING;

EID: 84924074384     PISSN: 10705511     EISSN: 15328007     Source Type: Journal    
DOI: 10.1080/10705511.2014.919819     Document Type: Article

References (67)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Second international symposium on information theory (pp. 267–281). Budapest, Hungary: Akademai Kiado.
2. Bauer, D. J., & Curran, P. J. (2003). Distributional assumptions of growth mixture models: Implications for overextraction of latent trajectory classes. Psychological Methods, 8, 338–363.
3. Boos, D. D. (2003). Introduction to the bootstrap world. Statistical Science, 18, 168–174.
4. Bucholz, K., Hesselbrock, V., Heath, A., Kramer, J., & Schuckit, M. (2000). A latent class analysis of antisocial personality disorder symptom data from a multi-centre family study of alcoholism. Addiction, 95, 553–567.
5. Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). New York, NY: Springer-Verlag.
6. Casella, G., & Berger, R. L. (1990). Statistical inference. Belmont, CA: Wadsworth.
7. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
8. Collins, L. M., Fidler, P. L., Wugalter, S. E., & Long, J. D. (1993). Goodness-of-fit testing for latent class models. Multivariate Behavioral Research, 28, 375–389.
9. Collins, L. M., & Lanza, S. T. (2010). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences. New York, NY: Wiley.
10. Dayton, C. M. (1998). Latent class scaling analysis (Sage University Papers Series on Quantitative Applications in the Social Sciences, No. 07–126). Thousand Oaks, CA: Sage.
11. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39, 1–38.
12. Dziak, J. J., Coffman, D. L., Lanza, S. T., & Li, R. (2012). Sensitivity and specificity of information criteria (Tech. Rep. No. 12–119). University Park, PA: The Pennsylvania State University, The Methodology Center. Retrieved from http://methodology.psu.edu
13. Dziak, J. J., Lanza, S. T., & Xu, S. (2011). LcaBootstrap SAS macro users’ guide (Version 1.1.0). University Park, PA: The Methodology Center, The Pennsylvania State University. Retrieved from http://methodology.psu.edu
14. Dziak, J. J., Min, Y. K., & Lanza, S. T. (2009, May). Sample size requirements in latent class analysis: The power of the bootstrap test for detecting a class. Poster presented at the annual meeting of the Society for Prevention Research, Washington, DC.
15. Feng, Z. D., & McCulloch, C. E. (1996). Using bootstrap likelihood ratios in finite mixture models. Journal of the Royal Statistical Society, Series B, 58, 609–617.
16. Ferguson, T. S. (1996). A course in large sample theory. London, UK: Chapman & Hall.
17. Foster, D. P., & George, E. I. (1994). The risk inflation criterion for multiple regression. Annals of Statistics, 22, 1947–1975.
18. Hoenig, J. M., & Heisey, D. M. (2001). The abuse of power: The pervasive fallacy of power calculations in data analysis. The American Statistician, 55, 19–24.
19. Jambunathan, M. V. (1954). Some properties of beta and gamma distributions. The Annals of Mathematical Statistics, 25, 401–405.
20. Johnston, L. D., Bachman, J. G., O’Malley, P. M., & Schulenberg, J. E. (2004). Monitoring the future: A continuing study of American youth (12th-grade survey) [Machine-readable data file and documentation]. Ann Arbor, MI: Inter-University Consortium for Political and Social Research.
21. Keel, P. K., Fichter, M., Quadflieg, N., Bulik, C. M., Baxter, M. G., Thornton, L., Halmi, K. A., Kaplan, A. S., Strober, M., Woodside, D. B., Crow, S. J., Mitchell, J. E., Rotondo, A., Mauri, M., Cassano, G., Treasure, J., Goldman, D., Berrettini, W. H., & Kaye, W. H. (2004). Application of a latent class analysis to empirically define eating disorder phenotypes. Archives of General Psychiatry, 61, 192–200.
22. Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79–86.
23. Lanza, S. T., Collins, L. M., Lemmon, D. R., & Schafer, J. L. (2007). PROC LCA: A SAS procedure for latent class analysis. Structural Equation Modeling, 14, 671–694.
24. Lanza, S. T., Flaherty, B. P., & Collins, L. M. (2003). Latent class and latent transition analysis. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology (Vol. 2, pp. 663–665). Hoboken, NJ: Wiley.
25. Lanza, S. T., Lemmon, D. R., Dziak, J. J., Huang, L., Schafer, J. L., & Collins, L. M. (2010). PROC LCA & PROC LTA user’s guide version 1.2.5. University Park, PA: The Methodology Center, The Pennsylvania State University.
26. Lanza, S. T., Rhoades, B. L., Greenberg, M. T., Cox, M., & The Family Life Project Key Investigators. (2011). Modeling multiple risks during infancy to predict quality of the caregiving environment: Contributions of a person-centered approach. Infant Behavior and Development, 34, 390–406.
27. Lanza, S. T., Savage, J. S., & Birch, L. L. (2010). Identification and prediction of latent classes of weight-loss strategies among women. Obesity, 18, 833–40.
28. Leeb, H., & Pötscher, B. M. (2005). Model selection and inference: Facts and fiction. Econometric Theory, 21, 21–59.
29. Lenth, R. V. (2007). Post hoc power: Tables and commentary (Tech. Rep.). Iowa City, IA: University of Iowa, Department of Statistics and Actuarial Science.
30. Lin, T. H., & Dayton, C. M. (1997). Model selection information criteria for non-nested latent class models. Journal of Educational and Behavioral Statistics, 22, 249–264.
31. Lindsay, B. G. (1995). Mixture models: Theory, geometry, and applications. Hayward, CA: Institute for Mathematical Statistics.
32. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.
33. MacCallum, R. C., Lee, T., & Browne, M. W. (2010). The issue of isopower in power analysis for tests of structural equation models. Structural Equation Modeling, 17, 23–41.
34. MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4, 84–99.
35. McLachlan, G. J. (1987). On bootstrapping the likelihood ratio test statistic for the number of components in a normal mixture. Annals of Statistics, 36, 318–324.
36. McLachlan, G., & Peel, D. (2000). Finite mixture models. New York, NY: Wiley.
37. Muthén, B. O. (2004). Mplus technical appendices. Los Angeles, CA: Muthén & Muthén.
38. Muthén, B. (2008). Latent variable hybrids: Overview of old and new models. In G. R. Hancock, & K. M. Samuelsen (Eds.), Advances in latent variable mixture models (pp. 1–24). Charlotte, NC: Information Age.
39. Muthén, L. K., & Muthén, B. O. (2007). Mplus users guide (5th ed.). Los Angeles, CA: Muthén & Muthén.
40. Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14, 535–569.
41. Preacher, K. J., & MacCallum, R. C. (2002). Exploratory factor analysis in behavior genetics research: Factor recovery with small sample sizes. Behavior Genetics, 32, 153–161.
42. Raftery, A. E. (1995). Bayesian model selection in social research (with discussion). Sociological Methodology, 25, 111–196.
43. Ramaswamy, V., DeSarbo, W. S., Reibstein, D. J., & Robinson, W. T. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124.
44. R Development Core Team. (2010). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org
45. Rindskopf, D., & Rindskopf, W. (1986). The value of latent class analysis in medical diagnosis. Statistics in Medicine, 5, 21–27.
46. Saris, W. E., & Satorra, A. (1993). Power evaluations in structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 181–204). Newbury Park, CA: Sage.
47. Satorra, A., & Saris, W. E. (1985). Power of the likelihood ratio test in covariance structure analysis. Psychometrika, 50, 83–90.
48. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461–464.
49. Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333–343.
50. Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27, 379–423, 623–656. Retrieved from http://cm.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf
51. Shevlin, M., Murphy, J., Dorahy, M. J., & Adamson, G. (2007). The distribution of positive psychosis-like symptoms in the population: A latent class analysis of the National Comorbidity Survey. Schizophrenia Research, 89, 101–109.
52. Teräsvirta, T., & Mellin, I. (1986). Model selection criteria and model selection tests in regression models. Scandinavian Journal of Statistics, 13, 159–171.
53. Udry, J. R. (2003). The National Longitudinal Study of Adolescent Health (Add Health), Waves I & II, 1994–1996; Wave III, 2001–2002 [Machine-readable data file and documentation]. Chapel Hill, NC: Carolina Population Center, University of North Carolina at Chapel Hill.
54. Uebersax, J. S., & Grove, W. M. (1990). Latent class analysis of diagnostic agreement. Statistics in Medicine, 9, 559–572.
55. van der Vaart, A. W. (1998). Asymptotic statistics. Cambridge, UK: Cambridge University Press.
56. Vermunt, J. K., & Magidson, J. (2004). Local independence. In M. Lewis-Beck, A. Bryman, & T. F. Liao (Eds.), The Sage encyclopedia of social sciences research methods (pp. 580–581). Thousand Oaks, CA: Sage. Retrieved from http://arno.uvt.nl/show.cgi?fid=13296
57. Vermunt, J. K., & Magidson, J. (2005). Technical guide for Latent GOLD 4.0: Basic and advanced. Belmont, MA: Statistical Innovations.
58. Wahba, G. (1990). Spline models of observational data. Philadelphia, PA: SIAM.
59. Walters, G. D. (2011). The latent structure of life-course-persistent antisocial behavior: Is Moffitts developmental taxonomy a true taxonomy? Journal of Consulting and Clinical Psychology, 79, 96–105.
60. Wood, S. N. (2003). Thin plate regression splines. Journal of the Royal Statistical Society, Series B, 65, 95–114.
61. Wood, S. N. (2011). Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. Journal of the Royal Statistical Society, Series B, 73, 3–36.
62. Wood, S. N. (2012). Package mgcv. Retrieved from http://cran.r-project.org/web/packages/mgcv/mgcv.pdf
63. Wu, Q. (2009). Class extraction and classification accuracy in latent class models (Unpublished doctoral dissertation). State College, PA: Pennsylvania State University.
64. Xian, H., Scherrer, J. F., Madden P. A., Lyons M. J., Tsuang M., True W. R., & Eisen S. A. (2005). Latent class typology of nicotine withdrawal: Genetic contributions and association with failed smoking cessation and psychiatric disorders. Psychological Medicine, 35, 409–419.
65. Yang, C. (2006). Evaluating latent class analysis in qualitative phenotype identification. Computational Statistics & Data Analysis, 50, 1090–1104.
66. Yuan, K.-H., & Hayashi, K. (2003). Bootstrap approach to inference and power analysis based on three statistics for covariance structure models. British Journal of Mathematical and Statistical Psychology, 56, 93–110.
67. Zucchini, W. (2000). An introduction to model selection. Journal of Mathematical Psychology, 44, 41–61.