Regularized Structural Equation Modeling

Structural Equation Modeling

Volumn 23, Issue 4, 2016, Pages 555-566

  Jacobucci, Ross ^a   Grimm, Kevin J ^b   McArdle, John J ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

Author keywords

factor analysis; lasso; penalization; regularization; ridge; shrinkage; structural equation modeling

Indexed keywords

FACTOR ANALYSIS; REGRESSION ANALYSIS; SHRINKAGE; TELECOMMUNICATION SERVICES;

LASSO; PENALIZATION; REGULARIZATION; RIDGE; STRUCTURAL EQUATION MODELING;

BEHAVIORAL RESEARCH;

EID: 84963576551     PISSN: 10705511     EISSN: 15328007     Source Type: Journal    
DOI: 10.1080/10705511.2016.1154793     Document Type: Article

References (62)

1. H.Akaike, (1973). Information theory and an extension of the maximum likelihood principle. In B.N.Petrov & F.Csaki (Eds.), Second international symposium on information theory, (pp. 267–281). Budapest, Hungary: Akademiai Kiado.
2. S.Boker,, M.Neale,, & J.Rausch, (2004). Latent differential equation modeling with multivariate multi-occasion indicators. In K.van Montfort et al. (Ed.), Recent developments on structural equation models (pp. 151–174). New york, NY: Springer.
3. M.W.Browne, (2000). Cross-validation methods. Journal of Mathematical Psychology, 44 (1), 108–132.
4. M.W.Browne, (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111–150.
5. J.Choi,, H.Zou,, & G.Oehlert, (2010). A penalized maximum likelihood approach to sparse factor analysis. Statistics and Its Interface, 3, 429–436.
6. C.P.Chou,, & P.M.Bentler, (1990). Model modification in covariance structure modeling: A comparison among likelihood ratio, Lagrange multiplier, and Wald tests. Multivariate Behavioral Research, 25(1), 115–136.
7. C.P.Chou,, & J.Huh, (2012). Model modification in structural equation modeling. In R. Hoyle (Ed.), Handbook of Structural Equation Modeling, (pp. 232–246). New York, NY: Guilford.
8. J.W.Grice, (2001). Computing and evaluating factor scores. Psychological Methods, 6, 430.
9. K.J.Grimm,, & J.J.McArdle, (2005). A note on the computer generation of mean and covariance expectations in latent growth curve analysis. In F. Dansereau & F. J. Yammarino (Eds.), Multi-level issues in strategy and methods (pp. 335–364). Amsterdam: Emerald.
10. K.J.Grimm,, J.S.Steele,, N.Ram,, & J.R.Nesselroade, (2013). Exploratory latent growth models in the structural equation modeling framework. Structural Equation Modeling: A Multidisciplinary Journal, 20, 568–591.
11. T.Hastie,, R.Tibshirani,, & J.Friedman, (2009). The elements of statistical learning. New York, NY:.Springer.
12. T.Hastie,, R.Tibshirani,, & M.Wainwright, (2015). Statistical learning with sparsity: The lasso and generalizations. CRC. Boca Raton, FL:.
13. K.Hayashi,, & G.A.Marcoulides, (2006). Teacher’s corner: Examining identification issues in factor analysis. Structural Equation Modeling, 13, 631–645.
14. K.Hirose,, & M.Yamamoto, (2014a). Estimation of an oblique structure via penalized likelihood factor analysis. Computational Statistics & Data Analysis, 79, 120–132.
15. K.Hirose,, & M.Yamamoto, (2014b). Sparse estimation via nonconcave penalized likelihood in factor analysis model. Statistics and Computing, 25, 1–13.
16. A.E.Hoerl,, & R.W.Kennard, (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55–67.
17. K.J.Holzinger,, & F.Swineford, (1939). A study in factor analysis: The stability of a bi-factor solution. Supplementary Educational Monographs, 48.
18. H.-Y.Hsu,, S.Troncoso Skidmore,, Y.Li,, & B.Thompson, (2014). Forced zero cross-loading misspecifications in measurement component of structural equation models: Beware of even “small” misspecifications. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 10, 138.
19. I.T.Jolliffe,, N.T.Trendafilov,, & M.Uddin, (2003). A modified principal component technique based on the lasso. Journal of Computational and Graphical Statistics, 12, 531–547.
20. K.G.Jöreskog, (1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34, 183–202. doi: 10.1007/bf02289343
21. S.Jung,, & Y.Takane, (2008). Regularized common factor analysis. In K.Shigemasu (Ed.), New trends in psychometrics (pp. 141–149). Tokyo: Universal Academy Press.
22. F.T.Juster,, & R.Suzman, (1995). An overview of the health and retirement study. Journal of Human Resources, 30, S7–S56.
23. D.Kaplan, (1988). The impact of specification error on the estimation, testing, and improvement of structural equation models. Multivariate Behavioral Research, 23(1), 69–86.
24. D.Kaplan,, & S.Depaoli, (2012). Bayesian structural equation modeling. In R.Hoyle (Ed.), Handbook of structural equation modeling (pp. 650–673). New York, NY: Guilford.
25. C.Lam,, & J.Fan, (2009). Sparsistency and rates of convergence in large covariance matrix estimation. Annals of Statistics, 37(6B), 4254.
26. D.N.Lawley, (1940). Vi.—the estimation of factor loadings by the method of maximum likelihood. Proceedings of the Royal Society of Edinburgh, 60(01), 64–82.
27. S.Y.Lee, (2007). Structural equation modeling: A bayesian approach (Vol. 711). New York, NY: John Wiley.
28. W.L.Leite,, I.-C.Huang,, & G.A.Marcoulides, (2008). Item selection for the development of short forms of scales using an ant colony optimization algorithm. Multivariate Behavioral Research, 43, 411–431.
29. R.Levy, (2011). Bayesian data-model fit assessment for structural equation modeling. Structural Equation Modeling, 18, 663–685.
30. R.C.MacCallum, (1986). Specification searches in covariance structure modeling. Psychological Bulletin, 100(1), 107.
31. R.C.MacCallum,, M.Roznowski,, & L.B.Necowitz, (1992). Model modifications in covariance structure analysis: the problem of capitalization on chance. Psychological Bulletin, 111, 490.
32. D.Magis,, F.Tuerlinckx,, & P.D.Boeck, (2014). Detection of differential item functioning using the lasso approach. Journal of Educational and Behavioral Statistics, 40, 111-135. Retrieved from http://dx.doi.org/10.3102/1076998614559747 doi: 10.3102/1076998614559747
33. G.A.Marcoulides,, & Z.Drezner, (2001). Specification searches in structural equation modeling with a genetic algorithm. In G.A.Marcoulides & R.E.Schumacker (Eds.), New developments and techniques in structural equation modeling (p. 247–268). Mahwah, NJ: Erlbaum.
34. G.A.Marcoulides,, & Z.Drezner, (2003). Model specification searches using ant colony optimization algorithms. Structural Equation Modeling, 10(1), 154–164.
35. G.A.Marcoulides,, Z.Drezner,, & R.E.Schumacker, (1998). Model specification searches in structural equation modeling using tabu search. Structural Equation Modeling: A Multidisciplinary Journal, 5, 365–376.
36. G.A.Marcoulides,, & M.Ing, (2012). Automated structural equation modeling strategies. In R.Hoyle (Ed.), Handbook of structural equation modeling (pp. 690–704). New York, NY:.Guilford.
37. H.W.Marsh,, & K.-T.Hau, (1996). Assessing goodness of fit: Is parsimony always desirable? The Journal of Experimental Education, 64, 364–390.
38. J.J.McArdle, (2005). The development of the ram rules for latent variable structural equation modeling. In A. Maydeu-Olivares & J. J. McArdle, (Eds.), Contemporary psychometrics: A festschrift for Roderick P. McDonald, (pp. 225–273). Mahwah, NJ: Lawrence Erlbaum.
39. J.J.McArdle,, & D.Epstein, (1987). Latent growth curves within developmental structural equation models. Child development, 58, 110–133.
40. J.J.McArdle,, & R.P.McDonald, (1984). Some algebraic properties of the reticular action model for moment structures. British Journal of Mathematical and Statistical Psychology, 37, 234–251.
41. D.M.McNeish, (2015). Using lasso for predictor selection and to assuage overfitting: A method long overlooked in behavioral sciences. Multivariate Behavioral Research, 50, 471–484.
42. N.Meinshausen, (2007). Relaxed lasso. Computational Statistics & Data Analysis, 52(1), 374–393.
43. W.Meredith,, & J.Tisak, (1990). Latent curve analysis. Psychometrika, 55(1), 107–122.
44. B.Muthén,, & T.Asparouhov, (2011). Bayesian SEM: A more flexible representation of substantive theory. Psychological Methods, 17, 313–335.
45. B.Muthén,, & T.Asparouhov, (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17, 313–335. doi:10.1037/a0026802
46. L.Ning,, & T.T.Georgiou, (2011). Sparse factor analysis via likelihood and I 1-regularization, 50th IEEE Conference on Decision and Control and European Control Conference (CDCECC), Orlando, FL, USA, December 12–15, 2011 5188–5192.
47. T.Park,, & G.Casella, (2008). The Bayesian lasso. Journal of the American Statistical Association, 103(482), 681–686.
48. H.Pashler,, & E.-J.Wagenmakers, (2012). Editors’ introduction to the special section on replicability in psychological science a crisis of confidence? Perspectives on Psychological Science, 7, 528–530.
49. R Core Team. (2015). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria: Author.
50. T.Raykov,, & G.A.Marcoulides, (1999). On desirability of parsimony in structural equation model selection. Structural Equation Modeling: A Multidisciplinary Journal, 6 (3), 292–300.
51. I.Rish,, & G.Grabarnik, (2014). Sparse modeling: Theory, algorithms, and applications. Boca Raton,FL: CRC.
52. Y.Rosseel, (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
53. G.Schwarz, (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464.
54. L.L.Thurstone, (1935). The vectors of mind. Chicago, IL: University of Chicago Press.
55. L.L.Thurstone, (1947). Multiple factor analysis. Chicago, IL: University of Chicago Press.
56. R.Tibshirani, (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1), 267–288.
57. N.T.Trendafilov,, & K.Adachi, (2014). Sparse versus simple structure loadings. Psychometrika, 1–15.
58. G.Tutz,, & G.Schauberger, (2015). A penalty approach to differential item functioning in rasch models. Psychometrika, 21–43.
59. K.-H.Yuan,, & W.Chan, (2008). Structural equation modeling with near singular covariance matrices. Computational Statistics & Data Analysis, 52, 4842–4858.
60. K.-H.Yuan,, R.Wu,, & P.M.Bentler, (2011). Ridge structural equation modelling with correlation matrices for ordinal and continuous data. British Journal of Mathematical and Statistical Psychology, 64(1), 107–133.
61. H.Zou,, T.Hastie,, & R.Tibshirani, (2006). Sparse principal component analysis. Journal of Computational and Graphical Statistics, 15, 265–286.
62. H.Zou,, T.Hastie,, & R.Tibshirani, (2007). On the “degrees of freedom” of the lasso. The Annals of Statistics, 35, 2173–2192. doi:10.1214/009053607000000127