Twice random, once mixed: Applying mixed models to simultaneously analyze random effects of language and participants

Behavior Research Methods

Volumn 44, Issue 1, 2012, Pages 232-247

  Janssen, Dirk P ^a,b  

^a UNIVERSITY OF KENT   (United Kingdom)

^b NHTV BREDA UNIVERSITY OF APPLIED SCIENCES   (Netherlands)

Author keywords

ANOVA; Hierarchical linear modeling; Item effects; Language as a fixed effect fallacy; Mixed models

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; HUMAN; LANGUAGE; LINGUISTICS; METHODOLOGY; STATISTICAL MODEL;

ANALYSIS OF VARIANCE; HUMANS; LANGUAGE; MODELS, STATISTICAL; PSYCHOLINGUISTICS; RESEARCH DESIGN;

EID: 84856826887     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-011-0145-1     Document Type: Article

References (43)

1. Abdi, H. (2007). The Bonferonni and Šidák corrections for multiple comparisons. In N. Salkind (Ed.), Encyclopedia of measurement and statistics (pp. 103-107). Thousand Oaks, CA: Sage.
2. Baayen, R. H. (2008). Analyzing linguistic data: A practical introduction to statistics using R. Cambridge: Cambridge University Press.
3. Baayen, R. H., Davidson, D. J., & Bates, D. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59, 390-412.
4. Baayen, R. H., Tweedie, F. J., & Schreuder, R. (2002). The subjects as a simple random effect fallacy: Subject variability and morphological family effects in the mental lexicon. Brain and Language, 81, 55-65.
5. Barr, D. J. (2008). Analyzing 'visual world' eyetracking data using multilevel logistic regression. Journal of Memory and Language, 59, 457-474.
6. Bates, D. (2006). Fitting linear mixed models in R. R News, 5, 27-30.
7. Bates, D. (2008). The lme4 package [Computer software manual]. Retrieved from http://cran. r-project. org/web/packages/lme4/lme4. pdf.
8. Cheng, C.-P., Sheu, C.-F., & Yen, N.-S. (2009). A mixed-effects expectancy-valence model for the Iowa gambling task. Behavior Research Methods, 41, 657-663.
9. Clark, H. H. (1973). The language-as-a-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 12, 335-359.
10. Coleman, E. B. (1964). Generalizing to a language population. Psychological Reports, 14, 219-226.
11. Faraway, J. J. (2006). Extending the linear model with R: Generalized linear, mixed effects and nonparametric regression models. London: Chapman & Hall/CRC.
12. Faraway, J. J. (2009). Changes to the Mixed Effects Models chapters in ELM [Online update to the book by Faraway, 2006]. Retrieved from http://www. maths. bath. ac. uk/jjf23/ELM/mixchange. pdf.
13. Forster, K. I., & Dickinson, R. G. (1976). More on the language-as-fixed-effect fallacy: Monte Carlo estimates of error rates for F1, F2, F, and minF. Journal of Verbal Learning and Verbal Behavior, 15, 135-142.
14. Hox, J. J. (1995). Applied multilevel analysis. Amsterdam: TT-Publikaties.
15. Jackson, S., & Brashers, D. E. (1994). Random factors in ANOVA. Thousand Oaks, CA: Sage.
16. Janssen, D. P., Bickel, B., & Zúñiga, F. (2006). Randomisation test in language typology. Linguistic Typology, 10, 419-440.
17. Keppel, G., & Wickens, T. D. (2004). Design and analysis: A researcher's handbook (4th ed.). Upper Saddle River, NJ: Pearson.
18. Kreft, I., & De Leeuw, J. (1998). Introducing multilevel modeling. Thousand Oaks, CA: Sage.
19. Lee, M. D., & Vanpaemel, W. (2008). Exemplars, prototypes, similarities and rules in category representation: An example of hierarchical Bayesian analysis. Cognitive Science, 32, 1403-1424.
20. Maxwell, S. E., & Bray, J. H. (1986). Robustness of the quasi F statistic to violations of sphericity. Psychological Bulletin, 99, 416-421.
21. Mislevy, R. J. (1987). Exploiting auxiliary information about examinees in the estimation of item parameters. Applied Psychological Measurement, 11, 81-91.
22. Nezlek, J. B. (2008). An introduction to multilevel modeling for social and personality psychology. Social and Personality Psychology Compass, 2, 842-860.
23. O'Connor, M. I., Bruno, J. F., Gaines, S. D., Halpern, B. S., Lester, S. E., Kinlan, B. P., et al. (2007). Temperature control of larval dispersal and the implications for marine ecology, evolution, and conservation. Proceedings of the National Academy of Sciences, 104, 1266-1271.
24. Piñheiro, J. C., & Bates, D. M. (2000). Mixed-effects models in S and S-plus. New York: Springer.
25. Quené, H., & van den Bergh, H. (2008). Examples of mixed-effects modeling with crossed random effects and with binomial data. Journal of Memory and Language, 59, 413-425.
26. Raaijmakers, J., Schrijnemakers, J., & Gremmen, F. (1999). How to deal with the "language-as-a-fixed-effect fallacy": Common misconceptions and alternative solutions. Journal of Memory and Language, 41, 416-426.
27. Rasbash, J., & Goldstein, H. (1994). Efficient analysis of mixed hierarchical and cross-classified random structures using a multilevel model. Journal of Educational and Behavioral Statistics, 194, 337-350.
28. Raudenbush, S. W. (1993). A crossed random effects model for unbalanced data with applications in cross-sectional and longitudinal research. Journal of Educational Statistics, 18, 4.
29. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
30. Richter, T. (2006). What is wrong with ANOVA and multiple regression? Analyzing sentence reading times with hierarchical linear models. Discourse Processes, 41, 221-250.
31. Rijmen, F., Tuerlinckx, F., De Boeck, P., & Kuppens, P. (2003). A nonlinear mixed model framework for item response theory. Psychological Methods, 8, 185-205.
32. Rouder, J. N., & Lu, J. (2005). An introduction to Bayesian hierarchical models with an application in the theory of signal detection. Psychonomic Bulletin & Review, 12, 573-604.
33. Rouder, J. N., Tuerlinckx, F., Speckman, P., Lu, J., & Gomez, P. (2008). A hierarchical approach for fitting curves to response time measurements. Psychonomic Bulletin & Review, 15, 1201-1208.
34. Santa, J. L., Miller, J. J., & Shaw, M. L. (1979). Using quasi F to prevent alpha inflation due to stimulus variation. Psychological Bulletin, 86, 37-46.
35. Shiffrin, R. M., Lee, M. D., Kim, W., & Wagenmakers, E. J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32, 1248-1284.
36. Singer, J. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 24, 323-355. Retrieved from http://gseweb. harvard. edu/%7Efaculty/singer/Papers/Using%20Proc%20Mixed. pdf.
37. Snijders, T., & Bosker, R. (1999). Multilevel analysis. Thousand Oaks, CA: Sage.
38. Stram, D. O., & Lee, J. W. (1994). Variance components testing in the longitudinal mixed effects model. Biometrics, 50, 1171-1177.
39. van Breukelen, G. J. P. (2005). Psychometric modeling of response speed and accuracy with mixed and conditional regression. Psychometrika, 70, 359-376.
40. Venables, W. N. (1998, October). Exegeses on linear models. Paper presented to the S-PLUS User's Conference. Washington, DC. Retrieved from http://www. stats. ox. ac. uk/pub/MASS3/Exegeses. pdf on 18 Nov 2008.
41. Verbeke, G., & Molenberghs, G. (2001). Linear mixed models for longitudinal data. New York: Springer.
42. Wickens, T. D., & Keppel, G. (1983). On the choice of design and of test statistic in the analysis of experiments with sampled materials. Journal of Verbal Behavior and Verbal Behavior, 20, 296-309.
43. Wike, E. L., & Church, J. D. (1976). Comments on Clark's "The language-as-fixed-effect fallacy. Journal of Verbal Learning and Verbal Behavior, 15, 249-255.