Modeling statistical properties of written text

PLoS ONE

Volumn 4, Issue 4, 2009, Pages

  Serrano, Marian Ángeles ^a   Flammini, Alessandro ^b   Menczer, Filippo ^b,c  

^a UNIVERSITY OF BARCELONA   (Spain)

^b INDIANA UNIVERSITY   (United States)

^c ISI FOUNDATION   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DOCUMENTATION; DYNAMIC RANKING MODEL; EMPIRICISM; LINGUISTICS; PROBABILITY; RANDOM NULL MODEL; STATISTICAL ANALYSIS; STATISTICAL DISTRIBUTION; STATISTICAL MODEL; WRITTEN LANGUAGE; ZIPF MODEL; ALGORITHM; FACTUAL DATABASE; HUMAN; INTERNET; LANGUAGE; VALIDATION STUDY; WRITING;

ALGORITHMS; DATABASES, FACTUAL; HUMANS; INTERNET; LANGUAGE; MODELS, STATISTICAL; WRITING;

EID: 65549163086     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0005372     Document Type: Article

References (50)

1. Hauser MD, Chomsky N, Fitch WT (2002) The faculty of language: What is it, who has it, and how did it evolve? Science 298: 1569-1579.
2. Joshi AK (1991) Natural language processing. Science 253: 1242-1249.
3. Manning C, Schütze H (1999) Foundations of statistical natural language processing. Cambridge: MIT press.
4. Nowak MA, Komarova NL, Niyogi P (2002) Computational and evolutionary aspects of Language. Nature 417: 611-617.
5. Chomsky N (2006) Language and Mind. Cambridge: Cambridge University Press, 3rd ed.
6. Zipf GK (1949) Human Behaviour and the Principle of Least Effort. Cambridge: Addison-Wesley.
7. Baayen RH (2001) Word Frequency Distributions. Dordrecht, Boston, London: Kluwer Academic Publishers.
8. Saichev A, Malevergne Y, Sornette D (2008) Theory of Zipf's Law and of General Power Law Distributions with Gibrat's Law of Proportional Growth, Lecture Notes in Economics and Mathematical Systems. Berlin, Heidelberg, New York: Springer.
9. Heaps HS (1978) Information Retrieval: Computational and Theoretical Aspects. Orlando: Academic Press.
10. Cattuto C, Loreto V, Pietronero L (2007) Semiotic dynamics and collaborative tagging. Proc Natl Acad Sci U S A 104: 1461-1464.
11. Church KW, Gale WA (1995) Poisson mixtures. Natural Language Engineering. pp 163-190.
12. Katz SM (1996) Distribution of content words and phrases in text and language modelling. Natural Language Engineering 2: 15-59.
13. Kleinberg J (2002) Bursty and hierarchical structure in streams. In: Proc 8th ACM SIGKDD Intl Conf on Knowledge Discovery and Data Mining.
14. Chakrabarti S (2003) Mining the Web: Discovering knowledge from hypertext data. San Francisco: Morgan Kaufmann.
15. Liu B (2007) Web Data Mining: Exploring Hyperlinks, Contents and Usage Data. Berlin, Heidelberg, New York: Springer.
16. Ananiadou S, Mcnaught J, eds (2005) Text Mining for Biology And Biomedicine. Norwood: Artech House Publishers.
17. Feldman R, Sanger J (2006) The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data. Cambridge: Cambridge University Press.
18. Allan J, Papka R, Lavrenko V (1998) On-line new event detection and tracking. In: Proc SIGIR. pp 37-45.
19. Yang Y, Pierce T, Carbonell JG (1998) A study of retrospective and on-line event detection. In: Proc SIGIR. pp 28-36.
20. Chen H (2006) Intelligence and Security Informatics for International Security Information Sharing and Data Mining. Berlin, Heidelberg, New York: Springer.
21. Newman D, Chemudugunta C, Smyth P, Steyvers M (2006) Analyzing entities and topics in news articles using statistical topic models. Lecture Notes in Computer Science (Intelligence and Security Informatics) 3975: 93-104.
22. Pennebaker J, Chung C (2008) Computerized text analysis of al-qaeda transcripts. In: Krippendor K, Bock M, eds (2008) A content analysis reader. Thousand Oaks: Sage.
23. Menczer F (2004) The evolution of document networks. Proc Natl Acad Sci U S A 101: 5261-5265.
24. Menczer F (2002) Growing and navigating the small world Web by local content Proc Natl Acad Sci U S A 99: 14014-14019.
25. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. Journal of Machine Learning Research 3: 993-1022.
26. Griffiths T, Steyvers (2004) Finding scientific topics. Proc Natl Acad Sci U S A. pp 5228-5235.
27. Elkan C (2006) Clustering documents with an exponential-family approximation of the dirichlet compound multinomial distribution. In: Proc 23rd Intl Conf on Machine Learning (ICML).
28. Goh K-I, Kahng B, Kim D (2001) Universal behavior of load distribution in scale-free networks. Phys Rev Lett 87: 278701.
29. Fortunato S, Flammini A, Menczer F (2006) Scale-free network growth by ranking. Phys Rev Lett 96: 218701.
30. Dolby JL (1971) Programming languages in mechanized documentation. Journal of Documentation 27: 136-155.
31. Maslov VP, Maslova TV (2006) On zipf's law and rank distributions in linguistics and semiotics. Mathematical Notes 80: 679-691.
32. Clauset A, Shalizi R, Newman MEJ (2009) Power-law distributions in empirical data. SIAM Review, to appear.
33. Baeza-Yates R, Ribeiro-Neto B (1999) Modern Information Retrieval. Wokingham: Addison-Wesley.
34. Salton G, McGill M (1983) An Introduction to Modern Information Retrieval. New York: McGraw-Hill.
35. Jansche M (2003) Parametric models of linguistic count data. In: Proc 41st Annual Meeting of the Association for Computational Linguistics. pp 288-295.
36. Sarkar A, Garthwaite P, De Roeck A (2005) A Bayesian mixture model for term reoccurrence and burstiness. In: Proc 9th Conference on Computational Natural Language Learning. pp 48-55.
37. Hofmann T (1999) Probabilistic latent semantic indexing. In: Proc 22th Annual Intl. ACM SIGIR Conf. on Research and Development in Information Retrieval. pp 50-57.
38. Li W, McCallum A (2006) Pachinko allocation: DAG-structured mixture models of topic correlations. In: Proc 23rd Intl Conf on Machine Learning (ICML). pp 577-584.
39. Griffiths TL, Steyvers M, Blei DM, Tenenbaum JB (2005) Integrating topics and Syntax. In: Advances in Neural Information Processing Systems. Cambridge: MIT Press. vol. 17. pp 537-544.
40. Madsen R, Kauchak D, Elkan C (2005) Modeling word burstiness using the dirichlet distribution. In Proc 22nd Intl Conf on Machine Learning (ICML). pp 545-552.
41. Simon HA (1955) On a class of skew distribution functions. Biometrika 42: 425-440.
42. de Solla Price D (1976) A general theory of bibliometric and other cumulative advantage processes. J Amer Soc Inform Sci 27: 292-306.
43. Albert R, Barabási A-L (2002) Statistical mechanics of complex networks. Reviews of Modern Physics 74: 47-97.
44. Barabási A-L (2005) The origin of bursts and heavy tails in human dynamics. Nature 435: 207-211.
45. Atkinson QD, Meade A, Venditti C, Greenhill SJ, Pagel M (2008) Languages evolve in punctuational bursts. Science 319: 588.
46. Kleinberg J (2004) Analysing the scientific literature in its online context. Nature Web Focus on Access to the Literature.
47. Alvarez-Lacalle E, Dorow B, Eckmann J-P, Moses E (2006) Hierarchical structures induce long-range dynamical correlations in written texts. Proc Natl Acad Sci U S A 103: 7956-7961.
48. Murray WS, Forster KI (2004) Seriel mechanisms in lexical access: The Rank Hypothesis Psychological Review 111: 721-756.
49. Adelman JS, Brown GDA, Quesada JF (2006) Contextual diversity, not word frequency, determines word naming and lexical decision times. Psychological Science 17: 814-823.
50. Porter M (1980) An algorithm for suffix stripping. Program 14: 130-137.