Word knowledge in the crowd: Measuring vocabulary size and word prevalence in a massive online experiment

Quarterly Journal of Experimental Psychology

Volumn 68, Issue 8, 2015, Pages 1665-1692

  Keuleers, Emmanuel ^a   Stevens, Michaël ^a   Mandera, Paweł ^a   Brysbaert, Marc ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Ageing; Bilingualism; Crowdsourcing; Frequency; Herdan's law; Prevalence

Indexed keywords

ADULT; AGING; CROWDSOURCING; EDUCATIONAL STATUS; FEMALE; HEMISPHERIC DOMINANCE; HUMAN; KNOWLEDGE; LINGUISTICS; MALE; MIDDLE AGED; MULTILINGUALISM; ONLINE SYSTEM; PATTERN RECOGNITION; PHYSIOLOGY; PREVALENCE; REACTION TIME; SEX DIFFERENCE; YOUNG ADULT;

ADULT; AGING; CROWDSOURCING; EDUCATIONAL STATUS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; KNOWLEDGE; MALE; MIDDLE AGED; MULTILINGUALISM; ONLINE SYSTEMS; PATTERN RECOGNITION, VISUAL; PREVALENCE; PSYCHOLINGUISTICS; REACTION TIME; SEX FACTORS; VOCABULARY; YOUNG ADULT;

EID: 84936846733     PISSN: 17470218     EISSN: 17470226     Source Type: Journal    
DOI: 10.1080/17470218.2015.1022560     Document Type: Article

References (36)

1. J.S.Adelman,, G.D.A.Brown,, & J.F.Quesada, (2006). Contextual diversity, not word frequency, determines word-naming and lexical decision times. Psychological Science, 17(9), 814–823. doi:10.1111/j.1467-9280.2006.01787.x
2. D.A.Balota,, M.J.Cortese,, S.D.Sergent-Marshall,, D.H.Spieler,, & M.Yap, (2004). Visual word recognition of single-syllable words. Journal of Experimental Psychology: General, 133(2), 283–316. doi:10.1037/0096-3445.133.2.283
3. D.A.Balota,, M.J.Yap,, K.A.Hutchison,, M.J.Cortese,, B.Kessler,, B.Loftis,, … R.Treiman, (2007). The English lexicon project. Behavior Research Methods, 39(3), 445–459. doi: 10.3758/BF03193014
4. T.D.Boon, T. den, & D.Geeraerts, (2005). Van Dale: groot woordenboek van de Nederlandse taal. Utrecht: Van Dale Lexicografie.
5. Bootstrap. (n.d.). Retrieved May 26, 2014, from http://getbootstrap.com/
6. M.Brysbaert,, & B.New, (2009). Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41(4), 977–990. doi:10.3758/BRM.41.4.977
7. M.Brysbaert,, A.B.Warriner,, & V.Kuperman, (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behavior Research Methods, 46, 904–911. doi: 10.3758/s13428-013-0403-5
8. J.De Caluwe, (2012). Dutch in Belgium: facing multilingualism in a context of regional monolingualism and standard language ideology. In M. Hüning, U. Vogl, & O. Moliner (Eds.), Standard languages and multilingualism in European history (Vol. 1, pp. 259–282). Philadelphia: John Benjamins Publishing Company. Retrieved from http://benjamins.com/catalog/mdm.1
9. H.Doran,, D.Bates,, P.Bliese,, & M.Dowling, (2007). Estimating the multilevel Rasch model: With the lme4 package. Journal of Statistical Software, 20(2), 1–18.
10. S.Dufau,, J.A.Duñabeitia,, C.Moret-Tatay,, A.McGonigal,, D.Peeters,, F.-X.Alario,, … J.Grainger, (2011). Smart phone, smart science: How the use of smartphones can revolutionize research in cognitive science. PLoS ONE, 6(9), e24974. doi:10.1371/journal.pone.0024974
11. E.Gibson,, S.Piantadosi,, & K.Fedorenko, (2011). Using mechanical turk to obtain and analyze English acceptability judgments. Language and Linguistics Compass, 5(8), 509–524. doi:10.1111/j.1749-818X.2011.00295.x
12. T.H.Gollan,, R.I.Montoya,, C.Cera,, & T.C.Sandoval, (2008). More use almost always means a smaller frequency effect: Aging, bilingualism, and the weaker links hypothesis. Journal of Memory and Language, 58(3), 787–814. doi:10.1016/j.jml.2007.07.001
13. G.Herdan, (1960). Type-token mathematics: A textbook of mathematical linguistics. The Hague: Mouton.
14. E.Keuleers,, & M.Brysbaert, (2010). Wuggy: A multilingual pseudoword generator. Behavior Research Methods, 42(3), 627–633. doi:10.3758/BRM.42.3.627
15. E.Keuleers,, M.Brysbaert,, & B.New, (2010). SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles. Behavior Research Methods, 42(3), 643–650. doi:10.3758/BRM.42.3.643
16. E.Keuleers,, K.Diependaele,, & M.Brysbaert, (2010). Practice effects in large-scale visual word recognition studies: A lexical decision study on 14,000 dutch mono- and sisyllabic words and nonwords. Frontiers in Psychology, 1. doi:10.3389/fpsyg.2010.00174
17. V.Kuperman,, H.Stadthagen-Gonzalez,, & M.Brysbaert, (2012). Age-of-acquisition ratings for 30,000 English words. Behavior Research Methods, 44(4), 978–990. doi:10.3758/s13428-012-0210-4
18. V.Kuperman,, & J.A.Van Dyke, (2013). Reassessing word frequency as a determinant of word recognition for skilled and unskilled readers. Journal of Experimental Psychology: Human Perception and Performance, 39(3), 802–823. doi:10.1037/a0030859
19. K.Lemhöfer,, & M.Broersma, (2012). Introducing LexTALE: A quick and valid Lexical Test for Advanced Learners of English. Behavior Research Methods, 44(2), 325–343. doi:10.3758/s13428-011-0146-0
20. B.C.Love,, D.L.Medin,, & T.M.Gureckis, (2004). SUSTAIN: A network model of category learning. Psychological Review, 111(2), 309–332. doi:10.1037/0033-295X.111.2.309
21. D.P.McCabe,, H.L.Roediger,, M.A.McDaniel,, D.A.Balota,, & D.Z.Hambrick, (2010). The relationship between working memory capacity and executive functioning: Evidence for a common executive attention construct. Neuropsychology, 24(2), 222–243. doi:10.1037/a0017619
22. M.R.Mehl,, S.Vazire,, N.Ramirez-Esparza,, R.B.Slatcher,, & J.W.Pennebaker, (2007). Are women really more talkative than men? Science, 317(5834), 82–82. doi:10.1126/science.1139940
23. I.S.P.Nation,, & D.Beglar, (2007). A vocabulary size test. The Language Teacher, 31(7), 9–13.
24. D.C.Park,, G.Lautenschlager,, T.Hedden,, N.S.Davidson,, A.D.Smith,, & P.K.Smith, (2002). Models of visuospatial and verbal memory across the adult life span. Psychology and Aging, 17(2), 299–320. doi:10.1037//0882-7974.17.2.299 doi: 10.1037/0882-7974.17.2.299
25. M.Ramscar,, P.Hendrix,, B.Love,, & R.H.Baayen, (2013). Learning is not decline: The mental lexicon as a window into cognition across the lifespan. The Mental Lexicon, 8(3), 450–481. doi: 10.1075/ml.8.3.08ram
26. M.Ramscar,, P.Hendrix,, C.Shaoul,, P.Milin,, & H.Baayen, (2014). The myth of cognitive decline: Non-linear dynamics of lifelong learning. Topics in Cognitive Science, 6(1), 5–42. doi:10.1111/tops.12078
27. J.C.Raven, (1965). Guide to using the Mill Hill vocabulary test with progressive matrices. London: HK Lewis.
28. J.Schepens,, T.Dijkstra,, & F.Grootjen, (2012). Distributions of cognates in Europe as based on Levenshtein distance. Bilingualism: Language and Cognition, 15(1), 157–166. doi:10.1017/S1366728910000623
29. A.Singh-Manoux,, M.Kivimaki,, M.M.Glymour,, A.Elbaz,, C.Berr,, K.P.Ebmeier,, … A.Dugravot, (2012). Timing of onset of cognitive decline: Results from Whitehall II prospective cohort study. BMJ, 344, d7622–d7622. doi:10.1136/bmj.d7622
30. R.Stubbe, (2012). Do pseudoword false alarm rates and overestimation rates in Yes/No vocabulary tests change with Japanese university students’ English ability levels? Language Testing, 29(4), 471–488. doi:10.1177/0265532211433033
31. S.Srivastava,, O.P.John,, S.D.Gosling,, & J.Potter, (2003). Development of personality in early and middle adulthood: Set like plaster or persistent change? Journal of Personality and Social Psychology, 84, 1041–1053. doi: 10.1037/0022-3514.84.5.1041
32. W.J.B.Van Heuven,, P.Mandera,, E.Keuleers,, & M.Brysbaert, (2014). SUBTLEX-UK: A new and improved word frequency database for British English. The Quarterly Journal of Experimental Psychology, 67(6), 1176–1190. doi:10.1080/17470218.2013.850521
33. A.B.Warriner,, V.Kuperman,, & M.Brysbaert, (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior Research Methods, 45(4), 1191–1207. doi:10.3758/s13428-012-0314-x
34. M.J.Yap,, D.A.Balota,, D.E.Sibley,, & R.Ratcliff, (2012). Individual differences in visual word recognition: Insights from the English lexicon project. Journal of Experimental Psychology: Human Perception and Performance, 38(1), 53–79. doi:10.1037/a0024177
35. T.Yarkoni,, D.Balota,, & M.Yap, (2008). Moving beyond Coltheart's N: A new measure of orthographic similarity. Psychonomic Bulletin & Review, 15(5), 971–979. doi:10.3758/PBR.15.5.971
36. R.A.Zachary,, & W.C.Shipley, (1986). Shipley institute of living scale: Revised manual. Los Angeles, CA: Western Psychological Services.