Parametric inference in the large data limit using maximally informative models

Neural Computation

Volumn 26, Issue 4, 2014, Pages 637-653

  Kinney, Justin B ^a   Atwal, Gurinder S ^a  

^a Howard Hughes Medical Institute Cold Spring Harbor Laboratory Cold Spring Harbor   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTICLE; GENE REGULATORY NETWORK; HUMAN; STATISTICAL MODEL;

ALGORITHMS; ANIMALS; GENE REGULATORY NETWORKS; HUMANS; LIKELIHOOD FUNCTIONS; MODELS, STATISTICAL;

EID: 84896855185     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00568     Document Type: Article

References (23)

1. Bialek, W., Callan, C., & Strong, S. (1996). Field theories for learning probability distributions. Phys. Rev. Lett., 77(23), 4693-4697
2. Bintu, L., Buchler, N., Garcia, H., Gerland, U., Hwa, T., Kondev, J., & Phillips, R. (2005). Transcriptional regulation by the numbers: Models. Curr. Opin. Genet Dev., 15(2), 116-124
3. Bishop, C. (2006). Pattern recognition and machine learning. New York: Springer
4. Cover, T., & Thomas, J. (1991). Elements of information theory. New York:Wiley
5. Csiszár, I., & Shields, P. C. (2004). Information theory and statistics: A tutorial. Hanover, MA: Now Publishers
6. Elemento, O., Slonim, N.,&Tavazoie, S. (2007).Auniversal framework for regulatory element discovery across all genomes and data types. Mol. Cell, 28(2), 337-350
7. Elowitz, M. B., Levine, A. J., Siggia, E. D., & Swain, P. S. (2002). Stochastic gene expression in a single cell. Science, 297(5584), 1183-1186
8. Khan, S., Bandyopadhyay, S., Ganguly, A., Saigal, S., Erickson III, D., Protopopescu, V., & Ostrouchov, G. (2007). Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. Phys Rev. E, 76(2), 026209
9. Kinney, J. B. (2008). Biophysical models of transcriptional regulation from sequence data Doctoral dissertation, Princeton University
10. Kinney, J. B., & Atwal, G. S. (2013). Equitability, mutual information, and the maximal information coefficient. arXiv:1301.7745
11. Kinney, J. B., Murugan, A., Callan, C. G., & Cox, E. (2010). Using deep sequencing to characterize the biophysicalmechanism of a transcriptional regulatory sequence Proc. Natl. Acad. Sci. USA, 107(20), 9158-9163
12. Kinney, J. B., Tkačik, G., & Callan, C. G. (2007). Precise physical models of protein-DNA interaction from high-throughput data. Proc. Natl. Acad. Sci. USA, 104(2), 501-506
13. Kouh, M., & Sharpee, T. (2009). Estimating linear-nonlinear models using Rényi divergences. Network, 20(2), 49-68
14. Melnikov, A., Murugan, A., Zhang, X., Tesileanu, T., Wang, L., Rogov, P. Mikkelsen, T. S. (2012). Systematic dissection and optimization of inducible enhancers in human cells using a massively parallel reporter assay. Nat. Biotechnol., 30(3), 271-277
15. Paninski, L. (2003). Convergence properties of three spike-triggered analysis techniques Network, 14(3), 437-464
16. Panzeri, S., Senatore, R., Montemurro, M. A., & Petersen, R. S. (2007). Correcting for the sampling bias problem in spike train information measures. J. Neurophysiol., 98(3), 1064-1072
17. Pillow, J. W., & Simoncelli, E. P. (2006). Dimensionality reduction in neural models: An information-theoretic generalization of spike-triggered average and covariance analysis. J. Vis., 6(4), 414-428
18. Rajan, K., Marre, O., & Tkačik, G. (2013). Learning quadratic receptive fields from neural responses to natural stimuli. Neural Comput., 25(7), 1661-1692
19. Rényi, A. (1961). Onmeasures of entropy and information. In Proc. 4th Berkeley Symp Math. Statist. and Prob. 1 (pp. 547-561). Berkeley: University of California Press
20. Schwartz, O., Pillow, J., Rust, N., & Simoncelli, E. (2006). Spike-triggered neural characterization. J. Vis., 6(4), 484-507
21. Sharpee, T., Rust, N., & Bialek, W. (2004). Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Comput., 16(2), 223-250
22. Sharpee, T., Sugihara, H., Kurgansky, A., Rebrik, S., Stryker, M., & Miller, K. (2006) Adaptive filtering enhances information transmission in visual cortex. Nature, 439(7079), 936-942
23. Stormo, G. D. (2013). Introduction to protein-DNA interactions: Structure, thermodynamics, and bioinformatics. New York: Cold Spring Harbor Laboratory Press