The cave of shadows: Addressing the human factor with generalized additive mixed models

Journal of Memory and Language

Volumn 94, Issue , 2017, Pages 206-234

  Baayen, Harald ^a   Vasishth, Shravan ^b   Kliegl, Reinhold ^b   Bates, Douglas ^c  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b UNIVERSITY OF POTSDAM   (Germany)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Autocorrelation; Confirmatory versus exploratory data analysis; Experimental time series; Generalized additive mixed models; Model selection; Within experiment adaptation

Indexed keywords

CAVE; DATA ANALYSIS; HUMAN; MODEL; TIME SERIES ANALYSIS;

EID: 85008333265     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2016.11.006     Document Type: Article

References (76)

1. Arnon, I., Ramscar, M., Granularity and the acquisition of grammatical gender: How order-of-acquisition affects what gets learned. Cognition 122:3 (2012), 292–305.
2. Baayen, R.H., Milin, P., Ramscar, M., Frequency in lexical processing. Aphasiology, 2016, 1174–1220, 10.1080/02687038.2016.1147767.
3. Baayen, R.H., Milin, P., Analyzing reaction times. International Journal of Psychological Research 3 (2010), 12–28.
4. Baayen, R.H., Tomaschek, F., Gahl, S., Ramscar, M., The Ecclesiastes principle in language change. Hundt, M., Mollin, S., Pfenninger, S., (eds.) The changing English language: Psycholinguistic perspectives, 2017, Cambridge University Press, Cambridge, UK in press.
5. Baayen, R.H., van Rij, J., de Cat, C., Wood, S.N., Autocorrelated errors in experimental data in the language sciences: Some solutions offered by generalized additive mixed models. Speelman, D., Heylen, K., Geeraerts, D., (eds.) Mixed effects regression models in linguistics, 2017, Springer, Berlin in press.
6. Balling, L., Baayen, R.H., Morphological effects in auditory word recognition: Evidence from Danish. Language and Cognitive Processes 23 (2008), 1159–1190.
7. Balling, L., Baayen, R.H., Probability and surprisal in auditory comprehension of morphologically complex words. Cognition 125 (2012), 80–106.
8. Barr, D.J., Levy, R., Scheepers, C., Tily, H.J., Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language 68:3 (2013), 255–278.
9. Bates, D., Kliegl, R., Vasishth, S., & Baayen, R. H. (2015). Parsimonious mixed models. arXiv:1506.04967.
10. Box, G.E.P., Science and statistics. Journal of the American Statistical Association 71 (1976), 791–799.
11. Box, G.E.P., Robustness in the strategy of scientific model building. Launer, R.L., Wilkinson, G.N., (eds.) Robustness in statistics, 1979, Academic Press, 201–236.
12. Box, G.E.P., Cox, D.R., An analysis of transformations (with discussion). Journal of the Royal Statistical Society B 26 (1964), 211–252.
13. Breiman, L., Random forests. Machine Learning 45 (2001), 5–32.
14. Broadbent, D., Decision and Stress. 1971, Accademic Press, New York.
15. Button, K.S., Ioannidis, J.P., Mokrysz, C., Nosek, B.A., Flint, J., Robinson, E.S., Munafo, M.R., Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience 14:5 (2013), 365–376.
16. Chen, T., He, T., & Benesty, M. (2015). xgboost: eXtreme Gradient Boosting. (R package version 0.4-0).
17. Cleveland, W.S., Robust locally weighted regression and smoothing scatterplots. Journal of the American Statistical Association 74 (1979), 829–836.
18. Dery, J. E. & Pearson, H. (2015). On experience-driven semantic judgments: A case study on the oneiric reference constraint. In Proceedings of quantitative investigations in theoretical linguistics, Tübingen, 2015.
19. De Vaan, L., Schreuder, R., Baayen, R.H., Regular morphologically complex neologisms leave detectable traces in the mental lexicon. The Mental Lexicon 2 (2007), 1–23.
20. Egly, R., Driver, J., Rafal, R.D., Shifting visual attention between objects and locations: Evidence from normal and parietal lesion subjects. Journal of Experimental Psychology: General 123 (1994), 161–177.
21. Ernestus, M., Cutler, A., BALDEY: A database of auditory lexical decisions. The Quarterly Journal of Experimental Psychology 68 (2015), 1469–1488.
22. Forster, K., The potential for experimenter bias effects in word recognition experiments. Memory & Cognition 28 (2000), 1109–1115.
23. 2, F′, and F′. Journal of Verbal Learning and Verbal Behavior 15 (1976), 135–142.
24. Francis, G., Publication bias and the failure of replication in experimental psychology. Psychonomic Bulletin & Review 19:6 (2012), 975–991.
25. Francis, G., Publication bias in “Red, Rank, and Romance in Women Viewing Men” by Elliot et al. (2010). Journal of Experimental Psychology: General 142:1 (2013), 292–296.
26. Friedman, J.H., Greedy function approximation: A gradient boosting machine. Annals of Statistics 29:5 (2001), 1189–1232.
27. Gałecki, A., Burzykowski, T., Linear mixed-effects models using R: A step-by-step approach. 2013, Springer Science & Business Media.
28. Gilden, D.L., Cognitive emissions of 1/f noise. Psychological Review 108 (2001), 33–56.
29. Gilden, D.L., Thornton, T., Mallon, M.W., 1/f noise in human cognition. Science 267 (1995), 1837–1839.
30. González, B., De Boeck, P., Tuerlinckx, F., Linear mixed modelling for data from a double mixed factorial design with covariates: A case-study on semantic categorization response times. Journal of the Royal Statistical Society: Series C (Applied Statistics) 63:2 (2014), 289–302.
31. Harrell, F., Regression modeling strategies: With applications to linear models, logistic and ordinal regression, and survival analysis. 2015, Springer.
32. Hastie, T., Tibshirani, R., Generalized additive models. 1990, Chapman & Hall, London.
33. James, G., Witten, D., Hastie, T., Tibshirani, R., An introduction to statistical learning, Vol. 6, 2013, Springer.
34. Kimura, D., Sex and cognition. 2000, The MIT Press, Cambridge, MA.
35. Kleinschmidt, D.F., Jaeger, T.F., Robust speech perception: Recognize the familiar, generalize to the similar, and adapt to the novel. Psychological Review, 122(2), 2015, 148.
36. Kliegl, R., Kuschela, J., Laubrock, J., Object orientation and target size modulate the speed of visual attention. Manuscript. 2015, University of Potsdam.
37. Kliegl, R., Wei, P., Dambacher, M., Yan, M., Zhou, X., Experimental effects and individual differences in Linear Mixed Models: Estimating the relationship between spatial, object, and attraction effects in visual attention. Frontiers in Psychology 1 (2011), 1–12.
38. Koch, S.E., Psychology: A study of a science. 1959, McGraw-Hill.
39. Lele, S.R., Nadeem, K., Schmuland, B., Estimability and likelihood inference for generalized linear mixed models using data cloning. Journal of the American Statistical Association, 105(492), 2010, 10.1198/jasa.2010.tm09757 Theory and Methods.
40. Lin, X., Zhang, D., Inference in generalized additive mixed models using smoothing splines. JRSSB 61 (1999), 381–400.
41. Marra, G., Wood, S.N., Coverage properties of confidence intervals for generalized additive model components. Scandinavian Journal of Statistics 39 (2012), 53–74.
42. Marsolek, C.J., What antipriming reveals about priming. Trends in Cognitive Science 12:5 (2008), 176–181.
43. Masson, M.E., Kliegl, R., Modulation of additive and interactive effects in lexical decision by trial history. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(3), 2013, 898.
44. Matuschek, H., Kliegl, R., Holschneider, M., Smoothing spline ANOVA decomposition of arbitrary splines: An application to eye movements in reading. PLoS One, 10(3), 2015.
45. Matuschek, H., Kliegl, R., Vasishth, S., Baayen, R.H., Bates, D., Balancing type I error and power in linear mixed models. Journal of Memory and Language, 2016 submitted for publication.
46. Mulder, K., Dijkstra, T., Schreuder, R., Baayen, R.H., Effects of primary and secondary morphological family size in monolingual and bilingual word processing. Journal of Memory and Language 72 (2014), 59–84.
47. Nychka, D., Bayesian confidence intervals for smoothing splines. Journal of the American Statistical Association 83 (1988), 1134–1143.
48. Open Science Collaboration, Estimating the reproducibility of psychological science. Science, 349(6251), 2015, aac4716.
49. Pham, H., Baayen, R.H., Vietnamese compounds show an anti-frequency effect in visual lexical decision. Language, Cognition, and Neuroscience 30:9 (2015), 1077–1095.
50. Pinheiro, J.C., Bates, D.M., Mixed-effects models in S and S-PLUS. Statistics and computing. 2000, Springer, New York.
51. Posner, M.I., Orienting of attention. Quarterly Journal of Experimental Psychology 32 (1980), 3–25.
52. Ramscar, M., Hendrix, P., Love, B., Baayen, R.H., Learning is not decline: The mental lexicon as a window into cognition across the lifespan. The Mental Lexicon 8 (2013), 450–481.
53. Ramscar, M., Shaoul, C., Baayen, R.H., Why many priming results don't (and won't) replicate: A quantitative analysis. Manuscript. 2015, University of Tübingen.
54. Ramscar, M., Yarlett, D., Dye, M., Denny, K., Thorpe, K., The effects of feature-label-order and their implications for symbolic learning. Cognitive Science 34:6 (2010), 909–957.
55. R Core Team (2015). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
56. Sanders, A., Elements of human performance: Reaction processes and attention in human skill. 1998, Lawrence Erlbaum, Mahwah, New Jersey.
57. Sander, P., Sanders, L., Rogue males: Sex differences in psychology students. Electronic Journal of Research in Educational Psychology 8:4 (2006), 85–108.
58. Segalowitz, N. and Hulstijn, J. (2009). Automaticity in bilingualism and second language learning. Handbook of bilingualism: Psycholinguistic approaches, pages 371–388.
59. Segalowitz, N., Poulsen, C., Segalowitz, S., Rt coefficient of variation is differentially sensitive to executive control involvement in an attention switching task. Brain and Cognition 40:1 (1999), 255–258.
60. Segalowitz, N.S., Segalowitz, S.J., Skilled performance, practice, and the differentiation of speed-up from automatization effects: Evidence from second language word recognition. Applied Psycholinguistics 14:03 (1993), 369–385.
61. Strobl, C., Malley, J., Tutz, G., An introduction to recursive partitioning: rationale, application, and characteristics of classification and regression trees, bagging, and random forests. Psychological Methods, 14(4), 2009, 26.
62. Tabak, W., Schreuder, R., Baayen, R.H., Lexical statistics and lexical processing: Semantic density, information complexity, sex, and irregularity in Dutch. Kepser, S., Reis, M., (eds.) Linguistic evidence – Empirical, theoretical, and computational perspectives, 2005, Mouton de Gruyter, Berlin, 529–555.
63. Tabak, W., Schreuder, R., Baayen, R.H., Producing inflected verbs: A picture naming study. The Mental Lexicon 5:1 (2010), 22–46.
64. Taylor, T.E., Lupker, S.J., Sequential effects in naming: A time-criterion account. Journal of Experimental Psychology: Learning, Memory and Cognition 27 (2001), 117–138.
65. Ullman, M.T., Estabrooke, I.V., Steinhauer, K., Brovetto, C., Pancheva, R., Ozawa, K. Maki, P., Sex differences in the neurocognition of language. Brain and Language 83 (2002), 141–143.
66. van Rij, J., Wieling, M., Baayen, R. H., & van Rijn, H. (2016). itsadug: Interpreting time series and autocorrelated data using GAMMs. R package version 2.2.
67. Welford, A., Choice reaction time: Basic concepts. Welford, A., (eds.) Reaction times, 1980, Accademic Press, New York, 73–128.
68. Westfall, J., Kenny, D.A., Judd, C.M., Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. Journal of Experimental Psychology: General, 143(5), 2014, 2020.
69. Wood, S.N., Generalized additive models. 2006, Chapman & Hall/CRC, New York.
70. Wood, S.N., Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. Journal of the Royal Statistical Society (B) 73 (2011), 3–36.
71. Wood, S.N., On p-values for smooth components of an extended generalized additive model. Biometrika 100 (2013), 221–228.
72. Wood, S.N., A simple test for random effects in regression models. Biometrika 100 (2013), 1005–1010.
73. Wood, S. N. (2016). Just another gibbs additive modeller: Interfacing JAGS and mgcv. arXiv:1602.02539v1.
74. Wood, S.N., Goude, Y., Shaw, S., Generalized additive models for large data sets. Journal of the Royal Statistical Society: Series C (Applied Statistics) 64:1 (2015), 139–155.
75. Wurm, L.H., Fisicaro, S.A., What residualizing predictors in regression analyses does (and what it does not do). Journal of Memory and Language 72 (2014), 37–48.
76. Zhou, X., Chu, H., Li, X., Zhan, Y., Center of mass attracts attention. Neuroreport 17 (2006), 85–88.