Statistical methods for linguistic research: Foundational Ideas—Part II

Language and Linguistics Compass

Volumn 10, Issue 11, 2016, Pages 591-613

  Nicenboim, Bruno ^a   Vasishth, Shravan ^a  

^a UNIVERSITY OF POTSDAM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84997498757     PISSN: None     EISSN: 1749818X     Source Type: Journal    
DOI: 10.1111/lnc3.12207     Document Type: Article

References (86)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723.
2. Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278.
3. Bates, D., & Sarkar, D. (2007). lme4: Linear mixed-effects models using S4 classes [computer software manual]. (R package version 0.9975-11)
4. Bates, D., Kliegl, R., Vasishth, S., & Baayen, H. (2015). Parsimonious mixed models. Retrieved from http://arxiv.org/abs/1506.04967 (ArXiv e-print)
5. Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software. (In Press)
6. Box, G. E., & Tiao, G. C. (1992). Bayesian inference in statistical analysis (First ed.). John Wiley & Sons.
7. Brown, S. D., & Heathcote, A. (2005). A ballistic model of choice response time. Psychological Review, 112(1), 117.
8. Brown, S. D., & Heathcote, A. (2008). The simplest complete model of choice response time: Linear ballistic accumulation. Cognitive Psychology, 57(3), 153–178.
9. Buerkner, P.-C. (2015). brms: Bayesian regression models using Stan [computer software manual]. Retrieved from http://CRAN.R-project.org/package=brms (R package version 0.6.0)
10. Carlin, B. P., & Louis, T. A. (2008). Bayesian methods for data analysis CRC Press.
11. Chung, Y., Gelman, A., Rabe-Hesketh, S., Liu, J., & Dorie, V. (2013). Weakly informative prior for point estimation of covariance matrices in hierarchical models. Manuscript submitted for publication.
12. Dickey, J. M., & Lientz, B. P. (1970). The weighted likelihood ratio, sharp hypotheses about chances, the order of a Markov chain. The Annals of Mathematical Statistics, 41(1), 214–226.
13. Dienes, Z. (2011). Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science, 6(3), 274–290.
14. Donkin, C., Averell, L., Brown, S., & Heathcote, A. (2009). Getting more from accuracy and response time data: Methods for fitting the linear ballistic accumulator. Behavior Research Methods, 41(4), 1095–1110.
15. Frank, S. L., Trompenaars, T., & Vasishth, S. (2015). Cross-linguistic differences in processing double-embedded relative clauses: Working-memory constraints or language statistics? Cognitive Science, n/a.
16. Gabry, J., & Goodrich, B. (2016). rstanarm: Bayesian applied regression modeling via stan [computer software manual]. Retrieved from http://CRAN.R-project.org/ package=rstanarm (R package version 2.9.0-1)
17. Gallistel, C. R. (2009). The importance of proving the null. Psychological Review, 116(2), 439–453. DOI:10.1037/a0015251. Retrieved from http://dx.doi.org/10.1037/a0015251
18. Geisser, S., & Eddy, W. F. (1979). A predictive approach to model selection. Journal of the American Statistical Association, 74(365), 153–160.
19. Gelman, A. (2006). Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper). Bayesian Analysis, 1(3), 515–534.
20. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge, UK: Cambridge University Press.
21. Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S. (2008). A weakly informative default prior distribution for logistic and other regression models. Annals of Applied Statistics, 1360–1383.
22. Gelman, A., Hill, J., & Yajima, M. (2012). Why we (usually) don't have to worry about multiple comparisons. Journal of Research on Educational Effectiveness, 5(2), 189–211. DOI:10.1080/19345747.2011.618213 Retrieved from http://dx.doi.org/10.1080/19345747.2011.618213
23. Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2014). Bayesian data analysis (Third ed.). Chapman and Hall/CRC.
24. Gelman, A., Hwang, J., & Vehtari, A. (2014). Understanding predictive information criteria for Bayesian models. Statistics and Computing, 24(6), 997–1016.
25. Ghosh, J., Li, Y., & Mitra, R. (2015). On the use of Cauchy prior distributions for Bayesian logistic regression. ArXiv e-prints.
26. Gibson, E., & Wu, H.-H. I. (2013). Processing Chinese relative clauses in context. Language and Cognitive Processes, 28(1–2), 125–155.
27. Gordon, P. C., Hendrick, R., & Johnson, M. (2001). Memory interference during language processing. Journal of Experimental Psychology: Learning, Memory and Cognition, 27(6), 1411–1423.
28. Grodner, D., & Gibson, E. (2005). Consequences of the serial nature of linguistic input. Cognitive Science, 29, 261–290.
29. Haller, H., & Krauss, S. (2002). Misinterpretations of significance: A problem students share with their teachers. Methods of Psychological Research, 7(1), 1–20.
30. Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014). Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review, 21(5), 1157–1164. DOI:10.3758/s13423-013-0572-3 Retrieved from http://dx.doi.org/10.3758/s13423-013-0572-3
31. Hofmeister, P., & Vasishth, S. (2014). Distinctiveness and encoding effects in online sentence comprehension. Frontiers in Psychology, 5, 1–13. DOI:10.3389/fpsyg.2014.01237 Article 1237
32. Hsiao, F. P.-F., & Gibson, E. (2003). Processing relative clauses in Chinese. Cognition, 90, 3–27.
33. Husain, S., Vasishth, S., & Srinivasan, N. (2014). Strong expectations cancel locality effects: Evidence from Hindi. PloS One, 9(7), 1–14.
34. Jäger, L. A., Engelmann, F., & Vasishth, S. (2016). Similarity-based interference in sentence comprehension: Literature review and Bayesian meta-analysis. (Submitted)
35. Jeffreys, H. (1961). Theory of probability. Oxford: Clarendon Press.
36. King, J., & Just, M. A. (1991). Individual differences in syntactic processing: The role of working memory. Journal of Memory and Language, 30(5), 580–602.
37. Kleinschmidt, D., Fine, A. B., & Jaeger, T. F. (2012). A belief-updating model of adaptation and cue combination in syntactic comprehension. In Proceedings of the 34rd Annual Meeting of the Cognitive Science Society (CogSci12)605–610.
38. Kruschke, J. K. (2015). Doing Bayesian data analysis (Second ed.). Boston: Academic Press. doi: http://dx.doi.org/10.1016/B978-0-12-405888-0.09999-2
39. Kruschke, J. K., Aguinis, H., & Joo, H. (2012). The time has come: Bayesian methods for data analysis in the organizational sciences. Organizational Research Methods, 15(4), 722–752. DOI:10.1177/1094428112457829 Retrieved from http://dx.doi.org/10.1177/1094428112457829
40. Lecoutre, M.-P., Poitevineau, J., & Lecoutre, B. (2003). Even statisticians are not immune to misinterpretations of null hypothesis significance tests. International Journal of Psychology, 38(1), 37–45.
41. Lee, M. D. (2011). How cognitive modeling can benefit from hierarchical Bayesian models. Journal of Mathematical Psychology, 55(1), 1–7. DOI:10.1016/j.jmp.2010.08.013 Retrieved from http:// dx.doi.org/10.1016/j.jmp.2010.08.013
42. Lee, M. D., & Wagenmakers, E.-J. (2014). Bayesian cognitive modeling: A practical course. Cambridge University Press.
43. Levshina, N. (2016). A Bayesian mixed-effect multinomial model of English permissive constructions reveals a remarkable alignment of linguistic, cognitive, social and collostructional distances. Cognitive Linguistics, In Press.
44. Liu, C. C., & Aitkin, M. (2008). Bayes factors: Prior sensitivity and model generalizability. Journal of Mathematical Psychology, 52(6), 362–375. DOI:10.1016/j.jmp.2008.03.002 Retrieved from http://dx.doi.org/10.1016/j.jmp.2008.03.002
45. Liu, Y., Gelman, A., & Zheng, T. (2013). Simulation-efficient shortest probability intervals. arXiv preprint arXiv:1302.2142.
46. Logacev, P., & Vasishth, S. (2016). Understanding underspecification: A comparison of two computational implementations. Quarterly Journal of Experimental Psychology, 69(5), 996–1012. http://dx.doi.org/10.1080/17470218.2015.1134602.
47. Love, J., Selker, R., Marsman, M., Jamil, T., Dropmann, D., Verhagen, A. J.,.. Wagenmakers, E. J. (2015). JASP (version 0.7)[computer software].
48. Lunn, D., Thomas, A., Best, N., & Spiegelhalter, D. (2000). WinBUGS-a Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10(4), 325–337.
49. Lynch, S. M. (2007). Introduction to applied Bayesian statistics and estimation for social scientists. Springer.
50. Mahowald, K., Graff, P., Hartman, J., & Gibson, E. (2016). Snap judgments: A small n acceptability paradigm (snap) for linguistic acceptability judgments. Unpublished manuscript.Retrieved from http://web.mit.edu/kylemaho/www/assets/pdf/SNAP.pdf
51. McElreath, R. (2015). Statistical rethinking: A Bayesian course with r examples. Chapman and Hall/CRC.
52. Morey, R. D., & Rouder, J. (2015). Bayes factor: An r package for Bayesian analysis in common research designs. Retrieved from https://cran.r-project.org/web/packages/BayesFactor/index.html
53. Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2015). The fallacy of placing confidence in confidence intervals. Psychonomic Bulletin & Review. DOI: 10.3758/s13423-015-0947-8 Retrieved from http://dx.doi.org/10.3758/s13423-015-0947-8
54. Myslín, M., & Levy, R. (2016). Comprehension priming as rational expectation for repetition: Evidence from syntactic processing. Cognition, 147, 29–56.
55. Nicenboim, B., Logačev, P., Gattei, C., & Vasishth, S. (2016). When High-Capacity Readers Slow Down and Low-Capacity Readers Speed Up: Working Memory and Locality Effects. Frontiers in Psychology, 7, 280. DOI:10.3389/fpsyg.2016.00280
56. O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., … Rakow, T. (2006). Uncertain judgements: Eliciting experts' probabilities. John Wiley & Sons.
57. Papaspiliopoulos, O., Roberts, G. O., & Sköld, M. (2007). A general framework for the parametrization of hierarchical models. Statistical Science, 59–73.
58. Piironen, J., & Vehtari, A. (2015). Comparison of Bayesian predictive methods for model selection. arXiv preprint arXiv:1503.08650.
59. Plummer, M. (2012). JAGS version 3.3.0 manual. Lyon, France: International Agency for Research on Cancer.
60. Ratcliff, R. (1993). Methods for dealing with reaction time outliers. Psychological Bulletin, 114(3), 510.
61. Ratcliff, R., & Rouder, J. N. (1998). Modeling response times for two-choice decisions. Psychological Science, 9(5), 347–356. DOI:10.1111/1467-9280.00067 Retrieved from http://dx.doi.org/10.1111/1467-9280.00067
62. Rouder, J. N. (2005). Are unshifted distributional models appropriate for response time? Psychometrika, 70(2), 377–381. DOI:10.1007/s11336-005-1297-7 Retrieved from http://dx.doi.org/10.1007/ s11336-005-1297-7
63. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16(2), 225–237. DOI:10.3758/pbr.16.2.225 Retrieved from http://dx.doi.org/10.3758/PBR.16.2.225
64. Rouder, J. N., Province, J. M., Morey, R. D., Gomez, P., & Heathcote, A. (2014). The lognormal race: A cognitive-process model of choice and latency with desirable psychometric properties. Psychometrika, 1–23.
65. Schielzeth, H., & Forstmeier, W. (2009). Conclusions beyond support: Overconfident estimates in mixed models. Behavioral Ecology, 20(2), 416–420. DOI:10.1093/beheco/arn145
66. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464.
67. Shiffrin, R., Lee, M., Kim, W., & Wagenmakers, E.-J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. HCOG, 32(8), 1248–1284. DOI:10.1080/03640210802414826 Retrieved from http://dx.doi.org/10.1080/03640210802414826
68. Sorensen, T., Hohenstein, S., & Vasishth, S. (2016). Bayesian linear mixed models using Stan: A tutorial for psychologists, linguists, and cognitive scientists. In Press, Quantitative Methods for Psychology.
69. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(4), 583–639.
70. Stan Development Team. (2015). Stan: A C++ library for probability and sampling, version 2.7.0. Retrieved from http://mc-stan.org/
71. Stan Development Team. (2016). Stan modeling language users guide and reference manual, version 2.9 [Computer software manual]. Retrieved from http://mc-stan.org/
72. Staub, A. (2010). Eye movements and processing difficulty in object relative clauses. Cognition, 116(1), 71–86.
73. Traxler, M. J. (2014). Trends in syntactic parsing: Anticipation, Bayesian estimation, and good-enough parsing. Trends in Cognitive Sciences, 18(11), 605–611.
74. Traxler, M. J., Morris, R. K., & Seely, R. E. (2002). Processing subject and object relative clauses: Evidence from eye movements. Journal of Memory and Language, 47(1).
75. Vandekerckhove, J., Tuerlinckx, F., & Lee, M. D. (2011). Hierarchical diffusion models for two-choice response times. Psychological Methods, 16(1), 44.
76. Vasishth, S. (2015). A meta-analysis of relative clause processing in Mandarin Chinese using bias modelling. Sheffield, UK: Retrieved from http://www.ling.uni-potsdam.de/~vasishth/pdfs/VasishthMScStatistics.pdf
77. Vasishth, S., Chen, Z., Li, Q., & Guo, G. (2013, 10). Processing Chinese relative clauses: Evidence for the subject-relative advantage. PloS One, 8(10), 1–14.
78. Vehtari, A., & Gelman, A. (2015). Pareto smoothed importance sampling. arXiv preprint arXiv:1507.02646.
79. Vehtari, A., & Ojanen, J. (2012). A survey of Bayesian predictive methods for model assessment, selection and comparison. Statistics Survey, 6(0), 142–228. DOI:10.1214/12-ss102. Retrieved from http://dx.doi.org/10.1214/12-SS102
80. Vehtari, A., Gelman, A., & Gabry, J. (2015a). Efficient implementation of leave-oneout cross-validation and waic for evaluating fitted bayesian models. arXiv preprint arXiv:1507.04544v2.
81. Vehtari, A., Gelman, A., & Gabry, J. (2015b). loo: Efficient leave-one-out cross-validation and WAIC for Bayesian models [Computer software manual]. Retrieved from https://github.com/jgabry/loo (R package version 0.1.3)
82. Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H., & Grasman, R. (2010). Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method. Cognitive Psychology, 60(3), 158–189. DOI:10.1016/j.cogpsych.2009.12.001 Retrieved from http://dx.doi.org/10.1016/j.cogpsych.2009.12.001
83. Wang, W., & Gelman, A. (2014). Difficulty of selecting among multilevel models using predictive accuracy. Statistics at its Interface, 7, 1–8.
84. Watanabe, S. (2009). Algebraic geometry and statistical learning theory (Vol. 25). Cambridge University Press.
85. Watanabe, S. (2010). Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory. The Journal of Machine Learning Research, 11, 3571–3594.
86. Xu, F., & Tenenbaum, J. B. (2007). Sensitivity to sampling in Bayesian word learning. Developmental Science, 10(3), 288–297.