A Practical Approach to Language Complexity: A Wikipedia Case Study

PLoS ONE

Volumn 7, Issue 11, 2012, Pages

  Yasseri, Taha ^a   Kornai, András ^b   Kertész, János ^a,c  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^b INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^c CENTRAL EUROPEAN UNIVERSITY   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; GRAMMAR; INFORMATION SERVICE; LANGUAGE; LANGUAGE COMPLEXITY; LINGUISTICS; NATURAL LANGUAGE PROCESSING; READING; ROBOTICS; SEMANTICS;

COMPREHENSION; ENCYCLOPEDIAS AS TOPIC; HUMANS; LANGUAGE; MODELS, STATISTICAL; SPEECH; VOCABULARY;

EID: 84868674734     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0048386     Document Type: Article

References (62)

1. Paasche-Orlow MK, Taylor HA, Brancati FL, (2003) Readability standards for informed-consent forms as compared with actual readability. New England Journal of Medicine 348: 721-726.
2. Klare GR, (1974) Assessing readability. Reading Research Quarterly 10: 62-102.
3. Kanungo T, Orr D (2009) Predicting the readability of short web summaries. In: Proceedings of the Second ACM International Conference on Web Search and Data Mining (WSDM '09). New York: ACM Press. 202-211.
4. Karmakar S, Zhu Y (2010) Visualizing multiple text readability indexes. In: 2010 International Conference on Education and Management Technology (ICEMT). Washington, DC: IEEE. 133-137.
5. Lambiotte R, Ausloos M, Thelwall M, (2007) Word statistics in blogs and rss feeds: Towards empirical universal evidence. Journal of Informetrics 1: 277-286.
6. Serrano M, Flammini A, Menczer F, (2009) Modeling statistical properties of written text. PLoS ONE 4: e5372.
7. Altmann EG, Pierrehumbert JB, Motter AE, (2009) Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words. PLoS ONE 4: e7678.
8. Altmann EG, Pierrehumbert JB, Motter AE, (2011) Niche as a determinant of word fate in online groups. PLoS ONE 6: e19009.
9. Wikipedia. Available: http://www.wikipedia.org. Accessed 2012 Jul 8.
10. Voss J (2005) Measuring Wikipedia. 10th International Conference of the International Society for Scientometrics and Informetrics, Stockholm, Sweden, 24-28 July 2005.
11. Ortega F, Gonzalez Barahona JM (2007) Quantitative analysis of the Wikipedia community of users. In: Proceedings of the 2007 international symposium on Wikis (WikiSym '07). New York: ACM Press. 75-86.
12. Halavais A, Lackaff D, (2008) An analysis of topical coverage of Wikipedia. Journal of Computer-Mediated Communication 13: 429-440.
13. Javanmardi S, Lopes C, Baldi P, (2010) Modeling user reputation in wikis. Statistical Analysis and Data Mining 3: 126-139.
14. Laniado D, Tasso R (2011) Co-authorship 2.0: patterns of collaboration in Wikipedia. In: Proceedings of the 22nd ACM conference on Hypertext and hypermedia (HT '11). New York: ACM Press. 201-210.
15. Massa P (2011) Social networks of Wikipedia. In: Proceedings of the 22nd ACM conference on Hypertext and hypermedia (HT '11). New York: ACM Press. 221-230.
16. Kimmons R (2011) Understanding collaboration in Wikipedia. First Monday 16.
17. Yasseri T, Sumi R, Kertész J, (2012) Circadian patterns of Wikipedia editorial activity: A demographic analysis. PLoS ONE 7: e30091.
18. Yasseri T, Sumi R, Rung A, Kornai A, Kertész J, (2012) Dynamics of conicts in Wikipedia. PLoS ONE 7: e38869.
19. Wikipedia. Simple english Wikipedia. Available: http://simple.wikipedia.org. Accessed 2012 Jul 8.
20. Wikipedia. English Wikipedia. Available: http://www.en.wikipedia.org. Accessed 2012 Jul 8.
21. Baumann J (2005) Vocabulary-comprehension relationships. In: Maloch B, Hoffman JV, Schallert DL, Fairbanks CM, Worthy J, editors. Fifty-fourth yearbook of the National Reading Conference. Oak Creek, WI: National Reading Conference. p.117131.
22. Roberts JC, Fletcher RH, Fletcher SW, (1994) Effects of peer review and editing on the readability of articles published in annals of internal medicine. JAMA: The Journal of the American Medical Association 272: 119-121.
23. Medelyan O, Milne D, Legg C, Witten IH, (2009) Mining meaning from Wikipedia. International Journal of Human-Computer Studies 67: 716-754.
24. Gabrilovich E, Markovitch S (2007) Computing semantic relatedness using Wikipedia-based explicit semantic analysis. In: Proceedings of the 20th international joint conference on artifical intelligence (IJCAI '07). San Francisco, CA: Morgan Kaufmann Publishers Inc. 1606-1611.
25. Zesch T, Müller C, Gurevych I (2008) Extracting lexical semantic knowledge from Wikipedia and Wiktionary. In: Proc. of the 6th Conference on Language Resources and Evaluation (LREC 2008). Marrakech, Morocco.
26. Wang P, Domeniconi C (2008) Building semantic kernels for text classification using Wikipedia. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD '08). New York: ACM Press. 713-721.
27. Gabrilovich E, Markovitch S, (2009) Wikipedia-based semantic interpretation for natural language processing. J Artif Int Res 34: 443-498.
28. Medelyan O, Witten IH, Milne D (2008) Topic indexing with Wikipedia. In: Proceedings of the AAAI 2008 Workshop on Wikipedia and Artificial Intelligence (WIKIAI 2008). 19-24. Available: http://www.aaai.org/Papers/Workshops/2008/WS-08-15/WS08-15-004.pdf. Accessed 2012 Oct 13.
29. Tan B, Peng F (2008) Unsupervised query segmentation using generative language models and Wikipedia. In: Proceedings of the 17th international conference on World Wide Web (WWW '08). New York: ACM Press. 347-356.
30. Tyers F, Pienaar J (2008) Extracting bilingual word pairs from Wikipedia. In: Proceedings of the SALTMIL Workshop at Language Resources and Evaluation Conference (LREC 2008). Marrakech, Morocco.
31. Sharoff SKS, Hartley A (2008) Seeking needles in the web haystack: Finding texts suitable for language learners. In: 8th Teaching and Language Corpora Conference (TaLC-8).
32. Besten MD, Dalle J, (2008) Keep it simple: A companion for simple Wikipedia? Industry & Innovation 15: 169-178.
33. Flesch R (1979) How to Write Plain English. New York: Harper and Row.
34. Napoles C, Dredze M (2010) Learning simple Wikipedia: A cogitation in ascertaining abecedarian language. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Linguistics and Writing. Stroudsburg, PA: Association for Computational Linguistics. 42-50.
35. Yatskar M, Pang B, Danescu-Niculescu-Mizil C, Lee L (2010) For the sake of simplicity: unsupervised extraction of lexical simplifications from Wikipedia. In: Human Language Technologies 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, PA: Association for Computational Linguistics. 365-368.
36. Coster W, Kauchak D (2011) Simple English Wikipedia: a new text simplification task. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA: Association for Computational Linguistics. 665-669.
37. Wikimedia. Wikimedia downloads. Available: http://dumps.wikimedia.org. Accessed 2012 Jul 8.
38. Porter M. The Porter Stemming Algorithm. Available: http://tartarus.org/\sim$martin/PorterStemmer/. Accessed 2012 Jul 8.
39. Mikheev A, (2002) Periods, capitalized words, etc. Computational Linguistics 28: 289-318.
40. Gunning R (1952) The technique of clear writing. New York: McGraw-Hill International Book Co.
41. Gunning R, (1969) The fog index after twenty years. Journal of Business Communication 6: 3-13.
42. Kincaid JP, Fishburn RP, Rogers RL, Chissom BS (1975) Derivation of new redability formulas for navy enlisted personnel. Technical Report Research Branch Report 8-75. Naval Air Station, Milington, TN.
43. Collins-Thompson K, Callan J (2004) A language modeling approach to predicting reading difficulty. In: Proceedings of HLT/NAACL. Available: http://acl.ldc.upenn.edu/hlt-naacl2004/main/pdf/111_Paper.pdf. Accessed 2012 Oct 13.
44. DuBay WH (2007) Smart Language: Readers, Readability, and the Grading of Text. Costa Mesa, California: BookSurge Publishing.
45. Tweedie F, Baayen RH, (1998) How variable may a constant be? Measures of lexical richness in perspective. Computers and the Humanities 32: 323-352.
46. Kornai A, (2002) How many words are there? Glottometrics 4: 61-86.
47. Herdan G (1964) Quantitative linguistics. Washington: Butterworths.
48. Heaps HS (1978) Information Retrieval: Computational and Theoretical Aspects. Orlando, FL: Academic Press, Inc.
49. Zipf GK (1935) The psycho-biology of language: an introduction to dynamic philology. Cambridge, MA: The MIT Press.
50. Kornai A (1999) Zipf's law outside the middle range. In: Rogers J, editor. Proceedings of the Sixth Meeting on Mathematics of Language. Orlando, FL: University of Central Florida. 347-356.
51. Baeza Yates R, Navarro G, (2000) Block addressing indices for approximate text retrieval. Journal of the American Society for Information Science 51: 69-82.
52. van Leijenhorst D, van der Weide TP, (2005) A formal derivation of Heaps' Law. Information Sciences 170: 263-272.
53. Wikipedia. How to write simple english pages. Available: http://simple.wikipedia.org/wiki/Wikipedia: How_to_write_Simple_English_pages. Accessed 2012 Jul 8.
54. Sproat R (2010) Language, Technology, and Society. Oxford: Oxford University Press.
55. The University of Pennsylvania (Penn) treebank tag-set. Available: http://www.comp.leeds.ac.uk/ccalas/tagsets/upenn.html. Accessed 2012 Jul 8.
56. Chinchor NA (1998) Proceedings of the Seventh Message Understanding Conference (MUC-7) named entity task definition. In: Proceedings of the Seventh Message Understanding Conference (MUC-7), Fairfax, VA. 21 pp. Version 3.5. Available: http://acl.ldc.upenn.edu/muc7/ne_task.html. Accessed 2012 Oct 13.
57. Varga D, Simon E, (2007) Hungarian named entity recognition with a maximum entropy approach. Acta Cybern 18: 293-301.
58. Sumi R, Yasseri T, Rung A, Kornai A, Kertész J (2011) Characterization and prediction of Wikipedia edit wars. In: Proceedings of the ACM WebSci '11: 1-3. Available: http://www.websci11.org/fileadmin/websci/Posters/58_paper.pdf. Accessed 2012 Oct 13.
59. Sumi R, Yasseri T, Rung A, Kornai A, Kertész J (2011) Edit wars in Wikipedia. In: 2011 IEEE International Conference on Social Computing/IEEE International Conference on Privacy, Security, Risk and Trust (Socialcom '11). Los Alamitos, CA. Washington, DC: IEEE Computer Society. 724-727.
60. Wikipedia. Help:using talk pages. Available: http://en.wikipedia.org/wiki/Help:Using_talk_pages. Accessed 2012 Jul 8.
61. Deutsch M (1973) The resolution of conflict: Constructive and destructive processes. New Haven, CT: Yale University Press.
62. Samson K, Nowak A (2010) Linguistic signs of destructive and constructive processes in conflict. IACM 23rd Annual Conference Paper. Available: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1615028. Accessed 2012 Oct 13.