Social Media and Language Processing: How Facebook and Twitter Provide the Best Frequency Estimates for Studying Word Recognition

Cognitive Science

Volumn 41, Issue 4, 2017, Pages 976-995

  Herdağdelen, Amaç ^a   Marelli, Marco ^b  

^a FACEBOOK   (United States)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

Frequency effects; Lexical decision; Social media; Text corpora

Indexed keywords

HUMAN; LANGUAGE; REACTION TIME; RECOGNITION; SOCIAL MEDIA; VOCABULARY;

HUMANS; LANGUAGE; REACTION TIME; RECOGNITION (PSYCHOLOGY); SOCIAL MEDIA; VOCABULARY;

EID: 84989246438     PISSN: 03640213     EISSN: 15516709     Source Type: Journal    
DOI: 10.1111/cogs.12392     Document Type: Article

References (37)

1. Baayen, R. H. (2010). Demythologizing the word frequency effect: A discriminative learning perspective. The Mental Lexicon, 5(3), 436–461.
2. Baayen, R. H., Milin, P., Đurđević, D. F., Hendrix, P., & Marelli, M. (2011). An amorphous model for morphological processing in visual comprehension based on naive discriminative learning. Psychological Review, 118(3), 438.
3. Baayen, R. H., Piepenbrock, R., & Gulikers, L. (1995). The CELEX lexical database (CD-ROM). Philadelphia, PA: University of Pennsylvania; Linguistic Data Consortium.
4. Balota, D. A., Pilotti, M., & Cortese, M. J. (2001). Subjective frequency estimates for 2,938 monosyllabic. Memory & Cognition, 29 (4), 639–647.
5. Balota, D. A., Yap, M. J., Cortese, M. J., Hutchison, K. I., Kessler, B., Loftis, B., & Treiman, R. (2007). The English Lexicon Project. Behavior Research Methods, 39(3), 445–459.
6. Blume, C., & Herbert, C. (2014). The HisMine-Paradigm: A new paradigm to investigate self-awareness employing pronouns. Social Neuroscience, 9(3), 289–299.
7. Brysbaert, M., Buchmeier, M., Conrad, M., Jacobs, A. M., Bölte, J., & Böhl, A. (2011). The word frequency effect: A review of recent developments and implications for the choice of frequency estimates in German. Experimental Psychology, 58(5), 412.
8. Brysbaert, M., & New, B. (2009). Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41(4), 977–990.
9. Burgess, C., & Livesay, K. (1998). The effect of corpus size in predicting reaction time in a basic word recognition task: Moving on from Kučera and Francis. Behavior Research Methods, Instruments, & Computers, 30(2), 272–277.
10. Cai, Q., & Brysbaert, M. (2010). SUBTLEX-CH: Chinese word and character frequencies based on film subtitles. PLoS ONE, 5(6), e10729.
11. Carroll, J. B., & White, M. N. (1973). Word frequency and age of acquisition as determiners of picture-naming latency. The Quarterly Journal of Experimental Psychology, 25 (1), 85–95.
12. Chee, M. W., Venkatraman, V., Westphal, C., & Siong, S. C. (2003). Comparison of block and event-related fMRI designs in evaluating the word-frequency effect. Human Brain Mapping, 18 (3), 186–193.
13. 2. Proceedings of the 18th Conference on Computational Linguistics. Morristown, New Jersey, USA.
14. Dimitropoulou, M., Duñabeitia, J. A., Avilés, A., Corral, J., & Carreiras, M. (2010). Subtitle-based word frequencies as the best estimate of reading behavior: The case of Greek. Frontiers in Psychology, 1, 218.
15. Dunning, T. (1993). Accurate methods for the statistics of surprise and coincidence accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1), 61–74.
16. Eisenstein, J., O'Connor, B., Smith, N. A., & Xing, E. P. (2014). Diffusion of lexical change in social media diffusion of lexical change in social media. PLoS One, 9(11), e113–114.
17. Gimenes, M., & New, B. (in press). Worldlex: Twitter and blog word frequencies for 66 languages. Behavior Research Methods.
18. Herbert, C., Herbert, B. M., Ethofer, T., & Pauli, P. (2011). His or mine? The time course of self-other discrimination in emotion processing. Social Neuroscience, 6(3), 277–288.
19. Herdağdelen, A. (2013). Twitter n-gram corpus with demographic metadata. Language Resources and Evaluation, 47(4), 1127–1147.
20. van Heuven, W. J., Mandera, P., Keuleers, E., & Brysbaert, M. (2014). SUBTLEX-UK: A new and improved word frequency database for British English. The Quarterly Journal of Experimental Psychology, 67(6), 1176–1190.
21. Howes, D. H., & Solomon, R. L. (1951). Visual duration threshold as a function of word-probability. Journal of Experimental Psychology, 41 (6), 401.
22. Juhasz, B. J., & Rayner, K. (2006). The role of age of acquisition and word frequency in reading: Evidence from eye fixation durations. Visual Cognition, 13 (7–8), 846–863.
23. Keuleers, E., & Balota, D. A. (2015). Megastudies, crowdsourcing, and large datasets in psycholinguistics: An overview of recent developments. The Quarterly Journal of Experimental Psychology, 68(8), 1457–1468.
24. Keuleers, E., Brysbaert, M., & New, B. (2010). SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles. Behavior Research Methods, 42(3), 643–650.
25. Keuleers, E., Lacey, P., Rastle, K., & Brysbaert, M. (2012). The British Lexicon Project: Lexical decision data for 28,730 monosyllabic and disyllabic English words. Behavior Research Methods, 44(1), 287–304.
26. Keuleers, E., Stevens, M., Mandera, P., & Brysbaert, M. (2015). Word knowledge in the crowd: Measuring vocabulary size and word prevalence in a massive online experiment. Quarterly Journal of Experimental Psychology, 68(8), 1665–1692.
27. Kučera, H., & Francis, W. N. (1967). Computational analysis of present-day American English. Providence, RI: Brown University Press.
28. Mandera, P., Keuleers, E., Wodniecka, Z., & Brysbaert, M. (2014). SUBTLEX-PL: Subtitle-based word frequency estimates for Polish. Behavior Research Methods, 47(2), 471–483.
29. Marelli, M., Amenta, S., & Crepaldi, D. (2015). Semantic transparency in free stems: The effect of Orthography-Semantics Consistency on word recognition. The Quarterly Journal of Experimental Psychology, 68(8), 1571–1583.
30. Marelli, M., & Baroni, M. (2015). Affixation in semantic space: Modeling morpheme meanings with compositional distributional semantics. Psychological Review, 122(3), 485.
31. Pennebaker, J., Francis, M., & Booth, R. (2001). Linguistic inquiry and word count: A computerized text analysis program. Mahwah, New Jersey, USA.
32. Rosenthal, S., Nakov, P., Ritter, A., & Stoyanov, V. (2014). Semeval-2014 task 9: Sentiment analysis in Twitter. Proceedings of the SemEval Workshop. Dublin, Ireland.
33. Shaoul, C., & Westbury, C. (2010). Exploring lexical co-occurrence space using HiDEx. Behavior Research Methods, 42(2), 393–413.
34. Vega, F. C., Nosti, M. G., Gutiérrez, A. B., & Brysbaert, M. (2011). SUBTLEX-ESP: Spanish word frequencies based on film subtitles. Psicológica: Revista de Metodología y Psicología Experimental, 32 (2), 133–143.
35. Xu, W., Callison-Burch, C., & Dolan, B. (2015). SemEval-2015 Task 1: Paraphrase and Semantic Similarity in Twitter SemEval-2015. Proceedings of the SemEval Workshop. Denver, Colorado, USA.
36. Yap, M. J., Balota, D. A., Sibley, D. E., & Ratcliff, R. (2012). Individual differences in visual word recognition: Insights from the English Lexicon Project. Journal of Experimental Psychology: Human Perception and Performance, 38(1), 53.
37. Yarkoni, T., Balota, D., & Yap, M. (2008). Moving beyond Colthearts N: A new measure of orthographic similarity. Psychonomic Bulletin & Review, 15(5), 971–979.