Interpolating between types and tokens by estimating power-law generators

Advances in Neural Information Processing Systems

Volumn , Issue , 2005, Pages 459-466

  Goldwater, Sharon ^a   Griffiths, Thomas L ^a   Johnson, Mark ^a  

^a BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FORMAL ANALYSIS; GENERATIVE MODEL; NATURAL LANGUAGES; POWER LAW DISTRIBUTION; POWER-LAW; STATISTICAL MODELS;

RANDOM PROCESSES;

EID: 33749240868     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. G. Zipf. Selective Studies and the Principle of Relative Frequency in Language. Harvard University Press, Cambridge, MA, 1932.
2. M. Mitzenmacher. A brief history of generative models for power law and lognormal distributions. Internet Mathematics, 1(2):226-251, 2003.
3. H.A. Simon. On a class of skew distribution functions. Biometrika, 42(3/4):425-440, 1955.
4. J. Pitman. Exchangeable and partially exchangeable random partitions. Probability Theory and Related Fields, 102:145-158, 1995.
5. J. Pitman and M. Yor. The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. Annals of Probability, 25:855-900, 1997.
6. H. Ishwaran and L. F. James. Generalized weighted Chinese restaurant processes for species sampling mixture models. Statistica Sinica, 13:1211-1235, 2003.
7. J. B. Pierrehumbert. Probabilistic phonology: discrimination and robustness. In R. Bod, J. Hay, and S. Jannedy, editors, Probabilistic linguistics. MIT Press, Cambridge, MA, 2003.
8. J. Goldsmith. Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27:153-198, 2001.
9. H. Ney, U. Essen, and R. Kneser. On structuring probabilistic dependences in stochastic language modeling. Computer, Speech, and Language, 8:1-38, 1994.
10. R. Kneser and H. Ney. Improved backing-off for n-gram language modeling. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, 1995.
11. S. F. Chen and J. Goodman. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Center for Research in Computing Technology, Harvard University, 1998.
12. D. Aldous. Exchangeability and related topics. In École d'été de probabilités de Saint-Flour, XIII-1983, pages 1-198. Springer, Berlin, 1985.
13. R. M. Neal. Markov chain sampling methods for Dirichlet process mixture models. Journal of Computational and Graphical Statistics, 9:249-265, 2000.
14. L. Larkey, L. Ballesteros, and M. Connell. Improving stemming for arabic information retrieval: Light stemming and co-occurrence analysis. In Proceedings of the 25th International Conference on Research and Development in Information Retrieval (SIGIR), 2002.
15. W.R. Gilks, S. Richardson, and D. J. Spiegelhalter, editors. Markov Chain Monte Carlo in Practice. Chapman and Hall, Suffolk, 1996.