Equitability, mutual information, and the maximal information coefficient

Proceedings of the National Academy of Sciences of the United States of America

Volumn 111, Issue 9, 2014, Pages 3354-3359

  Kinney, Justin B ^a   Atwal, Gurinder S ^a  

^a Howard Hughes Medical Institute Cold Spring Harbor Laboratory Cold Spring Harbor   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFACT; DATA PROCESSING; INFORMATION SCIENCE; MUTUAL INFORMATION; PRIORITY JOURNAL; SIMULATION;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; INFORMATION THEORY; MATHEMATICS; STATISTICS AS TOPIC;

EID: 84895815806     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1309933111     Document Type: Article

References (29)

1. Reshef DN, et al. (2011) Detecting novel associations in large data sets. Science 334(6062):1518-1524.
2. Reshef DN, Reshef Y, Mitzenmacher M, Sabeti P (2013) Equitability analysis of the maximal information coefficient with comparisons. arXiv:1301.6314v1 [cs.LG].
3. Speed T (2011) Mathematics. A correlation for the 21st century. Science 334(6062): 1502-1503.
4. Anonymous (2012) Finding correlations in big data. Nat Biotechnol 30(4):334-335.
5. Shannon CE, Weaver W (1949) The Mathematical Theory of Communication. (Univ of Illinois, Urbana, IL).
6. Cover TM, Thomas JA (1991) Elements of Information Theory (Wiley, New York).
7. Kullback S (1959) Information Theory and Statistics (Dover, Mineola, NY).
8. Kinney JB, Atwal GS (2013) Parametric inference in the large data limit using maximally informative models. Neural Comput, 10.1162/NECO-a-00568.
9. Miller G (1955) Note on the bias of information estimates. Information Theory in Psychology II-B, ed Quastler H (Free Press, Glencoe, IL), pp 95-100.
10. Treves A, Panzeri S (1995) The upward bias in measures of information derived from limited data samples. Neural Comput 7(2):399-407.
11. Khan S, et al. (2007) Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. Phys Rev E Stat Nonlin Soft Matter Phys 76(2 Pt 2):026209.
12. Panzeri S, Senatore R, Montemurro MA, Petersen RS (2007) Correcting for the sampling bias problem in spike train information measures. J Neurophysiol 98(3): 1064-1072.
13. Hyvärinen A, Oja E (2000) Independent component analysis: Algorithms and applications. Neural Netw 13(4-5):411-430.
14. Sharpee T, Rust NC, Bialek W (2004) Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Comput 16(2):223-250.
15. Sharpee TO, et al. (2006) Adaptive filtering enhances information transmission in visual cortex. Nature 439(7079):936-942.
16. Kinney JB, Tkacik G, Callan CG, Jr. (2007) Precise physical models of protein-DNA interaction from high-throughput data. Proc Natl Acad Sci USA 104(2):501-506.
17. Kinney JB, Murugan A, Callan CG, Jr., Cox EC (2010) Using deep sequencing to characterize the biophysical mechanism of a transcriptional regulatory sequence. Proc Natl Acad Sci USA 107(20):9158-9163.
18. Kraskov A, Stögbauer H, Grassberger P (2004) Estimating mutual information. Phys Rev E Stat Nonlin Soft Matter Phys 69(6 Pt 2):066138.
19. Szekely G, Rizzo M (2009) Brownian distance covariance. Ann Appl Stat 3(4): 1236-1265.
20. Hoeffding W (1948) A non-parametric test of independence. Ann Math Stat 19(4): 546-557.
21. Neyman J, Pearson ES (1933) On the problem of the most efficient tests of statistical hypotheses. Philos Trans R Soc A 231:289-337.
22. Paninski L (2003) Estimation of entropy and mutual information. Neural Comput 15(6):1191-1253.
23. Albanese D, et al. (2013) Minerva and minepy: A C engine for the MINE suite and its R, Python and MATLAB wrappers. Bioinformatics 29(3):407-408.
24. Simon N, Tibshirani R (2011) Comment on 'Detecting novel associations in large data sets' by Reshef et al., Science Dec 16, 2011. arXiv:1401.7645.
25. Rieke F, Warland D, de Ruyter van Steveninck R, BialekW (1997) Spikes: Exploring the Neural Code (MIT Press, Cambridge, MA).
26. Elemento O, Slonim N, Tavazoie S (2007) A universal framework for regulatory element discovery across all genomes and data types. Mol Cell 28(2):337-350.
27. Goodarzi H, et al. (2012) Systematic discovery of structural elements governing stability of mammalian messenger RNAs. Nature 485(7397):264-268.
28. Margolin AA, et al. (2006) ARACNE: An algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC Bioinformatics 7(Suppl 1):S7.
29. Pluim JPW, Maintz JBA, Viergever MA (2003) Mutual-information-based registration of medical images: A survey. IEEE Trans Med Imaging 22(8):986-1004.