Power-law distributions in empirical data

SIAM Review

Volumn 51, Issue 4, 2009, Pages 661-703

  Clauset, Aaron ^a,b   Shalizi, Cosma Rohilla ^c   Newman, M E J ^d  

^a SANTA FE INSTITUTE   (United States)

^b MSC01 1070   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

^d UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Heavy tailed distributions; Likelihood ratio test; Maximum likelihood; Model selection; Pareto; Power law distributions; Zipf

Indexed keywords

HEAVY-TAILED DISTRIBUTION; LIKELIHOOD RATIO TEST; LIKELIHOOD RATIO TESTS; MODEL SELECTION; POWER LAW DISTRIBUTION;

COMPUTATIONAL COMPLEXITY; SPEECH RECOGNITION;

MAXIMUM LIKELIHOOD ESTIMATION;

EID: 65549085067     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/070710111     Document Type: Review

References (69)

1. J. ABELLO, A. L. BUCHSBAUM, AND J. WESTBROOK, A functional approach to external graph algorithms, Algorithmica, 32 (2002), pp. 437-458.
2. D. ACHLIOPTAS, A. CLAUSET, D. KEMPE, AND C. MOORE, On the bias of traceroute sampling: or, power-law degree distributions in regular graphs, J. ACM, 56 (4) (2009), article 21.
3. L. A. ADAMIC AND B. A. HUBERMAN, The nature of markets in the World Wide Web, Quart. J. Electronic Commerce, 1 (2000), pp. 5-12.
4. R. J. ADLER, R. E. FELDMAN, AND M. S. TAQQU, EDS., A Practical Guide to Heavy Tails: Statistical Techniques and Applications, Birkhäuser, Boston, 1998.
5. W. AIELLO, F. CHUNG, AND L. LU, A random graph model for massive graphs, in Proceedings of the 32nd Annual ACM Symposium on Theory of Computing, ACM, New York, 2000, pp. 171-180.
6. B. C. ARNOLD, Pareto Distributions, International Cooperative Publishing House, Fairland, MD, 1983.
7. O. E. BARNDORFF-NIELSEN AND D. R. Cox, Inference and Asymptotics, Chapman and Hall, London, 1995.
8. H. BAUKE, Parameter estimation for power-law tail distributions by maximum likelihood methods, Eur. Phys. J. B, 58 (2007), pp. 167-173.
9. I. BHATTACHARYA AND L. GETOOR, Collective entity resolution in relational data, ACM Trans. Knowledge Discovery from Data, 1 (1) (2007), article 5.
10. A. BRODER, R. KUMAR, F. MAGHOUL, P. RAGHAVAN, S. RAJAGOPALAN, R. STATA, A. TOMKINS, AND J. WIENER, Graph structure in the web, Comput. Networks, 33 (2000), pp. 309-320.
11. A. CLAUSET, M. YOUNG, AND K. S. GLEDITSCH, On the frequency of severe terrorist events, J. Conflict Resolution, 51 (2007), pp. 58-87.
12. H. CRAMÉR, Mathematical Methods of Statistics, Almqvist and Wiksells, Uppsala, 1945.
13. R. B. D'AGOSTINO AND M. A. STEPHENS, EDS., Goodness-of-Fit Techniques, Marcel Dekker, New York, 1986.
14. L. DE HANN AND A. FERREIRA, Extreme Value Theory: An Introduction, Springer-Verlag, New York, 2006.
15. X. DlMITROPOULOS, D. KRIOUKOV, M. FOMENKOV, B. HUFFAKER, Y. HYUN, K. CLAFFY, AND G. RILEY, AS relationships: Inference and validation, ACM SIGCOMM Comput. Comm. Rev., 37 (2007), pp. 29-40.
16. B. EFRON AND R. J. TIBSHIRANI, An Introduction to the Bootstrap, Chapman and Hall, New York, 1993.
17. J. D. FARMER, L. GILLEMOT, F. LILLO, S. MIKE, AND A. SEN, What really causes large price changes?, Quant. Finance, 4 (2004), pp. 383-397.
18. R. A. FISHER, On the mathematical foundations of theoretical statistics, Philos. Trans. Roy. Soc. London Ser. A, 222 (1922), pp. 309-368.
19. M. L. GOLDSTEIN, S. A. MORRIS, AND G. G. YEN, Problems with fitting to the power-law distribution, Eur. Phys. J. B, 41 (2004), pp. 255-258.
20. P. D. GRÜNWALD, The Minimum Description Length Principle, MIT Press, Cambridge, MA, 2007.
21. A. P. HACKETT, 70 Years of Best Sellers, 1895-1965, R. R. Bowker Company, New York, 1967.
22. P. HALL, On some simple estimates of an exponent of regular variation, J. Roy. Statist. Soc. Ser. B, 44 (1982), pp. 37-42
23. M. S. HANDCOCK AND J. H. JONES, Likelihood-based inference for stochastic models of sexual network formation, Theoret. Population Biol., 65 (2004), pp. 413-422.
24. B. M. HILL, A simple general approach to inference about the tail of a distribution, Ann. Statist., 3 (1975), pp. 1163-1174.
25. P. HOLME, J. KARLIN, AND S. FORREST, Radial structure of the Internet, Proc. Roy. Soc. London Ser. A, 463 (2007), pp. 1231-1246.
26. M. HUSS AND P. HOLME, Currency and commodity metabolites: Their identification and relation to the modularity of metabolic networks, IET Systems Biol., 1 (2007), pp. 280-285.
27. Y. IJIRI AND H. A. SIMON, Skew Distributions and the Sizes of Business Firms, North-Holland, Amsterdam, 1977.
28. T. ITO, K. TASHIRO, S. MUTA, R. OZAWA, T. CHIBA, M. NISHIZAWA, K. YAMAMOTO, S. KUHARA, AND Y. SAKAKI, Toward a protein-protein interaction map of the budding yeast: A comprehensive system to examine two-hybrid interactions in all possible combinations between the yeast proteins, Proc. Natl. Acad. Sci. USA, 97 (2000), pp. 1143-1147.
29. H. JEFFREYS, Some tests of significance treated by the theory of probability, Proc. Cambridge Philos. Soc., 31 (1935), pp. 203-222.
30. N. L. JOHNSON, S. KOTZ, AND N. BALAKRISHNAN, Continuous Univariate Distributions, John Wiley, New York, 1994.
31. R. E. KASS AND A. E. RAFTERY, Bayes factors, J. Amer. Statist. Assoc, 90 (1994), pp. 773-795.
32. P. L. KRAPIVSKY, S. REDNER, AND F. LEYVRAZ, Connectivity of growing random networks, Phys. Rev. Lett., 85 (2000), pp. 4629-4632.
33. M. KRATZ AND S. I. RESNICK, The qq-estimator and heavy tails, Stoch. Models, 12 (1996), pp. 699-724.
34. D. J. C. MACKAY, Information Theory, Inference, and Learning Algorithms, Cambridge University Press, Cambridge, UK, 2003.
35. Y. MALEVERGNE, V. F. PISARENKO, AND D. SORNETTE, Empirical distributions of log-returns: Between the stretched exponential and the power law?, Quant. Finance, 5 (2005), pp. 379-401.
36. N. M. MARKOVITCH AND U. R. KRIEGER, Nonparametric estimation of long-tailed density functions and its application to the analysis of World Wide Web traffic, Performance Eval., 42 (2000), pp. 205-222.
37. D. MASON, Laws of large numbers for sums of extreme values, Ann. Probab., 10 (1982), pp. 754-764.
38. D. G. MAYO, Error and the Growth of Experimental Knowledge, University of Chicago Press, Chicago, 1996.
39. D. G. MAYO AND D. R. Cox, Frequentist statistics as a theory of inductive inference, in Optimally: The Second Erich L. Lehmann Symposium, J. Rojo, ed., Institute of Mathematical Statistics, Bethesda, MD, 2006, pp. 77-97.
40. M. MITZENMACHER, A brief history of generative models for power law and lognormal distributions, Internet Math., 1 (2004), pp. 226-251.
41. M. MITZENMACHER, The future of power law research, Internet Math., 2 (2006), pp. 525-534.
42. A. N. M. MUNIRUZZAMAN, On measures of location and dispersion and tests of hypotheses in a Pareto population, Bull. Calcutta Statist. Assoc, 7 (1957), pp. 115-123.
43. M. E. J. NEWMAN, Power laws, Pareto distributions and Zipf's law, Contemp. Phy., 46 (2005), pp. 323-351.
44. M. E. J. NEWMAN, S. FORREST, AND J. BALTHROP, Email networks and the spread of computer viruses, Phys. Rev. E, 66 (2002), article 035101.
45. E. J. G. PITMAN, Some Basic Theory for Statistical Inference, Chapman and Hall, London, 1979.
46. W. H. PRESS, S. A. TEUKOLSKY, W. T. VETTERLING, AND B. P. FLANNERY, Numerical Recipes in C: The Art of Scientific Computing, 2nd ed., Cambridge University Press, Cambridge, UK, 1992.
47. S. REDNER, HOW popular is your paper? An empirical study of the citation distribution, Eur. Phys. J. B, 4 (1998), pp. 131-134.
48. S. I. RESNICK, Heavy-Tail Phenomena: Probabilistic and Statistical Modeling, Springer-Verlag, New York, 2006.
49. D. C. ROBERTS AND D. L. TURCOTTE, Fractality and self-organized criticality of wars, Fractals, 6 (1998), pp. 351-357.
50. G. SCHWARZ, Estimating the dimension of a model, Ann. Statist., 6 (1978), pp. 461-464.
51. H. L. SEAL, The maximum likelihood fitting of the discrete Pareto law, J. Inst. Actuaries, 78 (1952), pp. 115-121.
52. C. R. SHALIZI, Dynamics of Bayesian Updating with Dependent Data and Misspecified Models, Preprint, 2009; available at http://arxiv.org/abs/0901.1342
53. M. SMALL AND J. D. SINGER, Resort to Arms: International and Civil Wars, 1816-1980, Sage Publications, Beverley Hills, CA, 1982.
54. F. A. SMITH, S. K. LYONS, S. K. M. ERNEST, K. E. JONES, D. M. KAUFMAN, T. DAYAN, P. A. MARQUET, J. H. BROWN, AND J. P. HASKELL, Body mass of late Quaternary mammals, Ecology, 84 (2003), p. 3403.
55. D. SORNETTE, Critical Phenomena in Natural Sciences, 2nd ed., Springer-Verlag, Berlin, 2006.
56. E. SPRINZAK, S. SATTATH, AND H. MARGALIT, HOW reliable are experimental protein-protein interaction data, J. Molecular Biol., 327 (2003), pp. 919-923.
57. S. A. STOEV, G. MICHAILIDIS, AND M. S. TAQQU, Estimating Heavy-Tail Exponents through Max Self-Similarity, Preprint, 2006; available at http://arxiv.org/abs/math.ST/0609163
58. M. STONE, Cross-validatory choice and assessment of statistical predictions, J. Roy. Statist. Soc. Ser. B, 36 (1974), pp. 111-133.
59. D. B. STOUFFER, R. D. MALMGREN, AND L. A. N. AMARAL, Comment on Barabdsi, Nature, 435, 207 (2005), Preprint, 2005; available at http://arxiv.org/abs/ physics/0510216
60. L. TIERNEY, R. E. KASS, AND J. B. KADANE, Fully exponential Laplace approximations to expectations and variances of nonpositive functions, J. Amer. Statist. Assoc, 84 (1989), pp. 710-716.
61. C. TSALLIS AND M. P. DE ALBUQUERQUE, Are citations of scientific papers a case of nonextensivity?, Eur. Phys. J. B, 13 (1999), pp. 777-780.
62. Q. H. VUONG, Likelihood ratio tests for model selection and non-nested hypotheses, Economet-rica, 57 (1989), pp. 307-333.
63. L. WASSERMAN, All of Statistics: A Concise Course in Statistical Inference, Springer-Verlag, Berlin, 2003.
64. L. WASSERMAN, Frequentist Bayes is objective, Bayesian Anal., 1 (2006), pp. 451-456.
65. S. WEISBERG, Applied Linear Regression, 2nd ed., Wiley, New York, 1985.
66. M. S. WHEATLAND, A Bayesian approach to solar flare prediction, Astrophys. J., 609 (2004), pp. 1134-1139.
67. S. S. WILKS, The large sample distribution of the likelihood ratio for testing composite hypotheses, Ann. Math. Statist., 9 (1938), pp. 60-62.
68. W. WILLINGER AND V. PAXSON, Where mathematics meets the Internet, Notices Amer. Math. Soc., 45 (1998), pp. 961-970.
69. S.-H. YOOK, Z. N. OLTVAI, AND A.-L. BARABÁSI, Functional and topological characterization of protein interaction networks, Proteomics, 4 (2004), pp. 928-942.