Balancing Type I error and power in linear mixed models

Journal of Memory and Language

Volumn 94, Issue , 2017, Pages 305-315

  Matuschek, Hannes ^a   Kliegl, Reinhold ^a   Vasishth, Shravan ^a   Baayen, Harald ^b   Bates, Douglas ^c  

^a UNIVERSITY OF POTSDAM   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Hypothesis testing; Linear mixed effect model; Power

Indexed keywords

HUMAN; HUMAN EXPERIMENT; PSYCHOLOGICAL MODEL; SIMULATION; STATISTICAL MODEL; STRUCTURE ACTIVITY RELATION;

EID: 85012050906     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2017.01.001     Document Type: Article

References (29)

1. Akaike, H., Information theory and an extension of the maximum likelihood principle. Parzen, E., Tanabe, K., Kitagawa, G., (eds.) Selected papers of Hirotugu Akaike, 1998, Springer, New York, 199–213, 10.1007/978-1-4612-1694-0_15.
2. Baayen, R.H., Analyzing linguistic data: A practical introduction to statistics using R. 2008, Cambridge University Press, Cambridge.
3. Baayen, R.H., Vasishth, S., Kliegl, R., Bates, D., The cave of shadows: Addressing the human factor with generalized additive mixed models. Journal of Memory and Language 94 (2017), 206–234, 10.1016/j.jml.2016.11.006.
4. Barr, D.J., Levy, R., Scheepers, C., Tily, H.J., Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language 68 (2013), 255–278, 10.1016/j.jml.2012.11.001.
5. Bates, D., Kliegl, R., Vasishth, S., & Baayen, R. H. (2015). Parsimonious mixed models. Available from arXiv: 1506.04967 (stat.ME).
6. Bates, D., Mächler, M., Bolker, B., Walker, S., Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67 (2015), 1–48, 10.18637/jss.v067.i01.
7. Colquhoun, D., An investigation of the false discovery rate and the misinterpretation of p-values. Royal Society Open Science, 1, 2014, 140216.
8. De Groot, A., The meaning of “significance” for different types of research (translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han LJ van der Maas). Acta Psychologica 148 (1956/2014), 188–194, 10.1016/j.actpsy.2014.02.001.
9. Demidenko, E., Mixed models: Theory and applications. 2013, Wiley-Interscience, Hoboken.
10. Gelman, A., Carlin, J., Beyond power calculations: Assessing Type S (sign) and Type M (magnitude) errors. Perspectives on Psychological Science 9 (2014), 641–651.
11. Gelman, A., Hill, J., Data analysis using regression and multilevel/hierarchical models. 2007, Cambridge University Press, Cambridge, UK.
12. González, B., De Boeck, P., Tuerlinckx, F., Linear mixed modelling for data from a double mixed factorial design with covariates: A case-study on semantic categorization response times. Journal of the Royal Statistical Society: Series C (Applied Statistics) 63 (2014), 289–302.
13. Hastie, T.J., Tibshirani, R.J., Generalized additive models. 1990, CRC Press, Boca Raton.
14. Jäger, L.A., Engelmann, F., Vasishth, S., Retrieval interference in reflexive processing: Experimental evidence from Mandarin, and computational modeling. Frontiers in Psychology, 6, 2015, 10.3389/fpsyg.2015.00617.
15. Jäger, L.A., Engelmann, F., Vasishth, S., Similarity-based interference in sentence comprehension: Literature review and Bayesian meta-analysis. Journal of Memory and Language, 2017, 10.1016/j.jml.2017.01.004 (in press).
16. Kliegl, R., Wei, P., Dambacher, M., Yan, M., Zhou, X., Experimental effects and individual differences in linear mixed models: Estimating the relation of spatial, object, and attraction effects in visual attention. Frontiers in Psychology, 1, 2011, 12.
17. Matuschek, H., Kliegl, R., On the ambiguity of interaction and nonlinear main effects in a regime of dependent covariates. Behavior Research Methods, 2016 Available from arXiv: 1506.04967 (stat.AP) (submitted for publication).
18. Nicenboim, B., Vasishth, S., Statistical methods for linguistic research: Foundational ideas – Part II. Language and Linguistics Compass 10 (2016), 591–613.
19. Pinheiro, J.C., Bates, D.M., Mixed-effects models in S and S-PLUS. 2000, Springer-Verlag, New York.
20. R Core Team, R: A language and environment for statistical computing. 2014, R Foundation for Statistical Computing, Vienna, Austria < http://www.r-project.org/>.
21. Schielzeth, H., Forstmeier, W., Conclusions beyond support: Overconfident estimates in mixed models. Behavioral Ecology 20 (2009), 416–420, 10.1093/beheco/arn145.
22. Schwarz, G., Estimating the dimension of a model. The Annals of Statistics 6 (1978), 461–464, 10.1214/aos/1176344136.
23. Sorensen, T., Hohenstein, S., Vasishth, S., Bayesian linear mixed models using Stan: A tutorial for psychologists, linguists, and cognitive scientists. Quantitative Methods for Psychology 12 (2016), 175–200 < http://www.ling.uni-potsdam.de/vasishth/statistics/BayesLMMs.html>.
24. Stan Development Team (2016). Stan modeling language users guide and reference manual, version 2.12. < http://mc-stan.org/>.
25. Stroup, W.W., Generalized linear mixed models: Modern concepts, methods and applications. 2012, CRC Press, Boca Raton.
26. Vandekerckhove, J., Matzke, D., & Wagenmakers, E.-J. (2015). Model comparison and the principle of parsimony. In J. R. Busemeyer, Z. Wang, J. T. Townsend, & A. Eidels (Eds.), The oxford handbook of computational and mathematical psychology (pp. 300–320). New York. < http://www.ejwagenmakers.com/inpress/VandekerckhoveEtAlinpress.pdf>.
27. Vasishth, S., Chen, Z., Li, Q., Guo, G., Processing Chinese relative clauses: Evidence for the subject-relative advantage. PLoS ONE 8 (2013), 1–14, 10.1371/journal.pone.0077006.
28. Westfall, J., Kenny, D.A., Judd, C.M., Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. Journal of Experimental Psychology: General, 143, 2014, 2020.
29. Wood, S.N., Generalized additive models: An introduction with R. 2006, CRC Press, Boca Raton.