Using Data-Dependent Priors to Mitigate Small Sample Bias in Latent Growth Models: A Discussion and Illustration Using Mplus

Journal of Educational and Behavioral Statistics

Volumn 41, Issue 1, 2016, Pages 27-56

  McNeish, Daniel M ^a,b  

^a UNIVERSITY OF MARYLAND   (United States)

^b UTRECHT UNIVERSITY   (Netherlands)

Author keywords

data dependent prior; latent basis model; latent growth models; Mplus; second order growth model; small samples

Indexed keywords

COMPUTER PROGRAM; COVARIANCE; MAXIMUM LIKELIHOOD METHOD; MODEL; NOMENCLATURE; SAMPLE SIZE; SAMPLING BIAS;

EID: 84955483682     PISSN: 10769986     EISSN: 19351054     Source Type: Journal    
DOI: 10.3102/1076998615621299     Document Type: Article

References (80)

1. P.D.Allison (2012, 4). Handling Missing data by maximum likelihood. Statistics and Data Analysis Keynote Presentation at the SAS Global Forum, Orlando, FL.
2. T.AsparouhovB.Muthén (2010). Bayesian analysis of latent variable models using Mplus, version 2. Unpublished manuscript. Retrieved fromhttp://www.statmodel.com
3. S.A.BaldwinG.W.Fellingham (2013). Bayesian methods for the analysis of small sample multilevel data with a complex variance structure. Psychological Methods, 18, 151–164.
4. J.BarnardR.McCullochX.L.Meng (2000). Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage. Statistica Sinica, 10, 1281–1312.
5. M.S.Bartlett (1950). Tests of significance in factor analysis. British Journal of Statistical Psychology, 3, 77–85.
6. D.J.BauerP.J.Curran (2003). Distributional assumptions of growth mixture models: Implications for overextraction of latent trajectory classes. Psychological Methods, 8, 338–363.
7. J.Berger (2006). The case for objective Bayesian analysis. Bayesian Analysis, 1, 385–402.
8. J.C.BiesanzN.Deeb-SossaA.A.PapadakisK.BollenP.Curran (2004). The role of coding time in estimating and interpreting growth curve models. Psychological Methods, 9, 30–52.
9. S.A.BlozisR.Cudeck (1999). Conditionally linear mixed-effects models with latent variable covariates. Journal of Educational and Behavioral Statistics, 24, 245–270.
10. W.J.BrowneD.Draper (2006). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Analysis, 1, 473–514.
11. B.P.CarlinA.E.Gelfand (1990). Approaches for empirical Bayes confidence intervals. Journal of the American Statistical Association, 85, 105–114.
12. B.P.CarlinA.E.Gelfand (1991). A sample reuse method for accurate parametric empirical Bayes confidence intervals. Journal of the Royal Statistical Society. Series B, 53, 189–200.
13. B.P.CarlinT.A.Louis (2000). Empirical Bayes: Past, present and future. Journal of the American Statistical Association, 95, 1286–1289.
14. G.Casella (2001). Empirical Bayes Gibbs sampling. Biostatistics, 2, 485–500.
15. F.Chen (2011). The RANDOM statement and more: Moving on with PROC MCMC. In Proceedings of the SAS Global Forum 2011 Conference. Cary, NC: SAS Institute, Inc.
16. M.W.L.Cheung (2013). Implementing restricted maximum likelihood estimation in structural equation models. Structural Equation Modeling: A Multidisciplinary Journal, 20, 157–167.
17. P.J.Curran (2003). Have multilevel models been structural equation models all along?Multivariate Behavioral Research, 38, 529–569.
18. W.F.Darnieder (2011). Bayesian methods for data-dependent priors (Doctoral dissertation). The Ohio State University, Columbus, OH.
19. S.Depaoli (2014). The impact of inaccurate “informative” priors for growth parameters in Bayesian growth mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal, 21, 239–252.
20. J.de LeeuwE.MeijerH.Goldstein (2008). Handbook of multilevel analysis. New York, NY: Springer.
21. J.J.DeelyD.V.Lindley (1981). Bayes empirical Bayes. Journal of the American Statistical Association, 76, 833–841.
22. D.B.Dunson (2000). Bayesian latent variable models for clustered mixed outcomes. Journal of the Royal Statistical Society: Series B, 62, 355–366.
23. B.Efron (2010). Large-scale inference: empirical Bayes methods for estimation, testing, and prediction. New York, NY: Cambridge University Press.
24. P.Ender (2011, 7). xtmixed and denominator degrees of freedom: Myth or magic. Stata Conference, Chicago, IL.
25. C.K.Enders (2010). Applied missing data analysis. New York, NY: Guilford Publications.
26. D.B.FloraP.J.Curran (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491.
27. R.T.Fouladi (2000). Performance of modified test statistics in covariance and correlation structure analysis under conditions of multivariate nonnormality. Structural Equation Modeling, 7, 356–410.
28. A.Gelman (2006). Prior distributions for variance parameters in hierarchical models. Bayesian Analysis, 1, 515–534.
29. A.GelmanD.B.Rubin (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457–472.
30. J.K.GhoshR.Mukerjee (1992). Non-informative priors (with discussion). In (Eds.), Bayesian statistics4 (pp. 195–2010). Oxford, England: University Press.
31. H.Goldstein (1989). Restricted unbiased iterative generalized least-squares estimation. Biometrika, 76, 622–623.
32. K.J.GrimmN.RamF.Hamagami (2011). Nonlinear growth curves in developmental research. Child Development, 82, 1357–1371.
33. G.R.HancockW.L.KuoF.R.Lawrence (2001). An illustration of second-order latent growth models. Structural Equation Modeling, 8, 470–489.
34. W.HerzogA.Boomsma (2009). Small-sample robust estimators of noncentrality-based and incremental model fit. Structural Equation Modeling: A Multidisciplinary Journal, 16, 1–27.
35. J.J.HooglandA.Boomsma (1998). Robustness studies in covariance structure modeling: An overview and a meta-analysis. Sociological Methods & Research, 26, 329–367.
36. J.Hox (2010). Multilevel analysis: Techniques and applications. Mahwah, NJ: Routledge.
37. J.HoxR.van de SchootS.Matthijsse (2012). How few countries will do? Comparative survey analysis from a Bayesian perspective. Survey Research Methods, 6, 87–93.
38. D.A.KennyD.B.McCoach (2003). Effect of the number of variables on measures of fit in structural equation modeling. Structural Equation Modeling, 10, 333–351.
39. M.G.KenwardJ.H.Roger (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983–997.
40. M.G.KenwardJ.H.Roger (2009). An improved approximation to the precision of fixed effects from restricted maximum likelihood. Computational Statistics & Data Analysis, 53, 2583–2595.
41. J.K.KruschkeH.AguinisH.Joo (2012). The time has come Bayesian methods for data analysis in the organizational sciences. Organizational Research Methods, 15, 722–752.
42. N.M.LairdT.A.Louis (1987). Empirical Bayes confidence intervals based on bootstrap samples. Journal of the American Statistical Association, 82, 739–750.
43. N.M.LairdJ.H.Ware (1982). Random-effects models for longitudinal data. Biometrics, 38, 963–974.
44. P.C.LambertA.J.SuttonP.R.BurtonK.R.AbramsD.R.Jones (2005). How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS. Statistics in Medicine, 24, 2401–2428.
45. S.Y.LeeX.Y.Song (2004). Evaluation of the Bayesian and maximum likelihood approaches in analyzing structural equation models with small sample sizes. Multivariate Behavioral Research, 39, 653–686.
46. D.V.Lindley (1969). Discussion of compound decisions and empirical Bayes, J.B.Copas. Journal of the Royal Statistical Society, Series B, 31, 419–421.
47. D.LunnC.JacksonN.BestA.ThomasD.Spiegelhalter (2013). The BUGS book. Boca Raton, FL: CRC Press.
48. J.J.McArdle (1988). Dynamic but structural equation modeling of repeated measures data. In (Eds.), The handbook of multivariate experimental psychology (pp. 561–614). New York, NY: Plenum Press.
49. J.J.McArdleD.Epstein (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110–133.
50. D.M.McNeishL.M.Stapleton (2014). The effect of small sample size on two level model estimates: A review and illustration. Educational Psychology Review. doi:10.1007/s10648-014-9287-x
51. W.MeredithJ.Tisak (1990). Latent curve analysis. Psychometrika, 55, 107–122.
52. B.Muthén (2010). Bayesian analysis in Mplus: A brief introduction. Unpublished manuscript. Retrieved fromhttp://www.statmodel.com
53. B.O.Muthén (2001). Second-generation structural equation modeling with a combination for categorical and continuous latent variables: New opportunities for latent class/latent curve modeling. In (Eds.), New methods for the analysis of change (pp. 291–322). Washington, DC: American Psychological Association.
54. L.K.MuthénB.O.Muthén (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling: A Multidisciplinary Journal, 9, 599–620.
55. B.MuthénK.Shedden (1999). Finite mixture modeling with mixture outcomes using the EM algorithm. Biometrics, 55, 463–469.
56. D.S.Nagin (1999). Analyzing developmental trajectories: a semiparametric, group-based approach. Psychological Methods, 4, 139–157.
57. J.NevittG.R.Hancock (2004). Evaluating small sample approaches for model test statistics in structural equation modeling. Multivariate Behavioral Research, 39, 439–478.
58. A.J.MalleyA.M.Zaslavsky (2005). Variance-covariance functions for domain means of ordinal survey items. Survey Methodology, 31, 169–182.
59. J.L.PeughC.K.Enders (2005). Using the SPSS mixed procedure to fit cross-sectional and longitudinal multilevel models. Educational and Psychological Measurement, 65, 717–741.
60. R.F.PotthoffS.N.Roy (1964). A generalized multivariate analysis of variance model useful especially for growth curve problems. Biometrika, 51, 313–326.
61. L.R.Price (2012). Small sample properties of Bayesian multivariate autoregressive time series models. Structural Equation Modeling: A Multidisciplinary Journal, 19, 51–64.
62. S.W.RaudenbushA.S.Bryk (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage.
63. H.Robbins (1955). An empirical Bayes approach to statistics. In. (Ed.), Proceedings of the third Berkeley symposium on mathematical statistics and probability (pp. 157–164). Berkeley: University of California Press.
64. C.Robert (2007). The Bayesian choice: A decision-theoretic motivation. New York, NY: Springer.
65. ® 9.2 user’s guide. Cary, NC: Author.
66. F.E.Satterthwaite (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110–114.
67. V.Savalei (2010). Small sample statistics for incomplete nonnormal data: Extensions of complete data formulae and a Monte Carlo comparison. Structural Equation Modeling, 17, 241–264.
68. V.SavaleiS.Kolenikov (2008). Constrained versus unconstrained estimation in structural equation modeling. Psychological Methods, 13, 150–170.
69. G.B.SchaaljeJ.B.McBrideG.W.Fellingham (2002). Adequacy of approximations to distributions of test statistics in complex mixed linear models. Journal of Agricultural, Biological, and Environmental Statistics, 7, 512–524.
70. R.ScheinesH.HoijtinkA.Boomsma (1999). Bayesian estimation and testing of structural equation models. Psychometrika, 64, 37–52.
71. T.M.SoaresF.B.GonçalvesD.Gamerman (2009). An integrated Bayesian model for DIF analysis. Journal of Educational and Behavioral Statistics, 34, 348–377.
72. StataCorp. (2013). Stata 13 base reference manual. College Station, TX: Stata Press.
73. D.Stegmueller (2013). How many countries for multilevel modeling? A comparison of frequentist and Bayesian approaches. American Journal of Political Science, 57, 748–761.
74. A.J.Swain (1975). Analysis of parametric structures for variance matrices (Unpublished doctoral dissertation). Department of Statistics, University of Adelaide, Australia.
75. R.van de SchootJ.J.BroereK.H.PerryckM.Zondervan-ZwijnenburgN.E.Van Loey (2015). Analyzing small data sets using Bayesian estimation: The case of posttraumatic stress symptoms following mechanical ventilation in burn survivors. European Journal of Psychotraumatology, 6, 25216.
76. R.van de SchootD.KaplanJ.DenissenJ.B.AsendorpfF.J.NeyerM.A.Aken (2014). A gentle introduction to Bayesian analysis: Applications to developmental research. Child Development, 85, 842–860.
77. J.Wakefield (2013). Bayesian and frequentist regression methods. New York, NY: Springer.
78. W.WuS.G.WestA.B.Taylor (2009). Evaluating model fit for growth curve models: Integration of fit indices from SEM and MLM frameworks. Psychological Methods, 14, 183–201.
79. K.-H.Yuan (2005). Fit indices versus test statistics. Multivariate Behavioral Research, 40, 115–148.
80. M.J.ZyphurF.L.OswaldD.E.Rupp (2015). Rendezvous Overdue Bayes analysis meets organizational research. Journal of Management, 41, 387–389.