Random effects structure for confirmatory hypothesis testing: Keep it maximal

Journal of Memory and Language

Volumn 68, Issue 3, 2013, Pages 255-278

  Barr, Dale J ^a   Levy, Roger ^b   Scheepers, Christoph ^a   Tily, Harry J ^c  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Generalization; Linear mixed effects models; Monte Carlo simulation; Statistics

Indexed keywords

EID: 84871868072     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2012.11.001     Document Type: Article

References (45)

1. Baayen R.H. Statistics in psycholinguistics: A critique of some current gold standards. Mental Lexicon Working Papers 2004, 1:1-45.
2. Baayen R.H. Analyzing linguistic data: A practical introduction to statistics using R 2008, Cambridge University Press, Cambridge.
3. Baayen, R. H. (2011). languageR: Data sets and functions with analyzing linguistic data: A practical introduction to statistics. R package version 1.2.
4. Baayen R.H., Davidson D.J., Bates D.M. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language 2008, 59:390-412.
5. Barr D.J. Analyzing 'visual world' eyetracking data using multilevel logistic regression. Journal of Memory and Language 2008, 59:457-474.
6. Bates, D., Maechler, M., & Bolker, B. (2011). lme4: Linear mixed-effects models using S4 classes. R package version 0.999375-41. http://CRAN.R-Project.org/package=lme4.
7. Bolker B.M., Brooks M.E., Clark C.J., Geange S.W., Poulsen J.R., Stevens, et al. Generalized linear mixed models: A practical guide for ecology and evolution. Trends in Ecology & Evolution 2009, 24:127-135.
8. Clark H.H. The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior 1973, 12:335-359.
9. Davenport J.M., Webster J.T. A comparison of some approximate F-tests. Technometrics 1973, 15:779-789.
10. Dixon P. Models of accuracy in repeated-measures designs. Journal of Memory and Language 2008, 59:447-496.
11. Fisher R.A. Statistical methods for research workers 1925, Oliver & Boyd, Edinburgh.
12. 2, F', and min F'. Journal of Verbal Learning and Verbal Behavior 1976, 15:135-142.
13. Gelman A., Hill J. Data analysis using regression and multilevel/hierarchical models 2007, Cambridge University Press, Cambridge, MA.
14. Goldstein H. Multilevel statistical models. Kendall's library of statistics 1995, vol. 3. Arnold.
15. Hadfield J.D. MCMC methods for multi-response generalized linear mixed models: The MCMCglmm R package. Journal of Statistical Software 2010, 33:1-22.
16. Harrell F.E. Regression modeling strategies: With applications to linear models, logistic regression, and survival analysis 2001, Springer, New York.
17. Jaeger T.F. Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language 2008, 59:434-446.
18. Jaeger, T. F. (2009). Post to HLP/Jaeger lab blog, 14 May 2009. http://hlplab.wordpress.com/2009/05/14/random-effect-structure.
19. Jaeger T.F. Redundancy and reduction: Speakers manage syntactic information density. Cognitive Psychology 2010, 61:23-62.
20. Jaeger, T. F. (2011a). Post to the R-lang mailing list, 20 February 2011. http://pidgin.ucsd.edu/pipermail/r-lang/2011-February/000225.html.
21. Jaeger, T. F. (2011b). Post to HLP/Jaeger lab blog, 25 June 2011. http://hlplab.wordpress.com/2011/06/25/more-on-random-slopes.
22. Jaeger T.F., Graff P., Croft W., Pontillo D. Mixed effect models for genetic and areal dependencies in linguistic typology. Linguistic Typology 2011, 15:281-320.
23. Janssen D.P. Twice random, once mixed: applying mixed models to simultaneously analyze random effects of language and participants. Behavior Research Methods 2012, 44:232-247.
24. Kliegl R. Toward a perceptual-span theory of distributed processing in reading: A reply to Rayner, Pollatsek, Drieghe, Slattery, and Reichle (2007). Journal of Experimental Psychology: General 2007, 136:530-537.
25. Kuperman V., Bertram R., Baayen R.H. Processing trade-offs in the reading of Dutch derived words. Journal of Memory and Language 2010, 62:83-97.
26. Locker L., Hoffman L., Bovaird J. On the use of multilevel modeling as an alternative to items analysis in psycholinguistic research. Behavior Research Methods 2007, 39:723-730.
27. Lunn D.J., Thomas A., Best N., Spiegelhalter D. WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing 2000, 10:325-337.
28. Mirman D., Dixon J.A., Magnuson J.S. Statistical and computational models of the visual world paradigm: Growth curves and individual differences. Journal of Memory and Language 2008, 59:475-494.
29. Pinheiro J.C., Bates D.M. Mixed-effects models in S and S-PLUS 2000, Springer, New York.
30. Plummer, M., 2003. JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. In Proceedings of the 3rd International workshop on distributed statistical computing.
31. Quené H., van den Bergh H. On multi-level modeling of data from repeated measures designs: A tutorial. Speech Communication 2004, 43:103-121.
32. Quené H., van den Bergh H. Examples of mixed-effects modeling with crossed random effects and with binomial data. Journal of Memory and Language 2008, 59:413-425.
33. R Development Core Team (2011). R: A language and environment for statistical computing. Austria: R Foundation for Statistical Computing Vienna. ISBN 3-900051-07-0.
34. Raaijmakers J.G.W., Schrijnemakers J.M.C., Gremmen F. How to deal with the language-as-fixed-effect fallacy: Common misconceptions and alternative solutions. Journal of Memory and Language 1999, 41:416-426.
35. Raudenbush S.W., Bryk A.S. Hierarchical linear models: Applications and data analysis methods 2002, Sage, Thousand Oaks, CA.
36. Roland, D., 2009. Relative clauses remodeled: The problem with mixed-effect models. Poster presentation at the 2009 CUNY sentence processing conference.
37. Santa J.L., Miller J.J., Shaw M.L. Using quasi F to prevent alpha inflation due to stimulus variation. Psychological Bulletin 1979, 86:37-46.
38. Scheffe H. The analysis of variance 1959, Wiley, New York.
39. Schielzeth H., Forstmeier W. Conclusions beyond support: Overconfident estimates in mixed models. Behavioral Ecology 2009, 20:416-420.
40. Snijders T., Bosker R.J. Multilevel analysis: An introduction to basic and advanced multilevel modeling 1999, Sage, Thousand Oaks, CA.
41. Snijders T.A.B., Bosker R.J. Multilevel analysis: An introduction to basic and advanced multilevel modeling 1999, Sage.
42. Tukey J.W. We need both exploratory and confirmatory. The American Statistician 1980, 34:23-25.
43. Wagenmakers E.J., Wetzels R., Borsboom D., van der Maas H.L.J., Kievit R.A. An agenda for purely confirmatory research. Perspectives on Psychological Science 2012, 7:632-638.
44. Wickens T.D., Keppel G. On the choice of design and of test statistic in the analysis of experiments with sampled materials. Journal of Verbal Learning and Verbal Behavior 1983, 22:296-309.
45. Winer B.J. Statistical principles in experimental design 1971, McGraw-Hill, New York. 2nd ed.