Optimizing information flow in small genetic networks

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 80, Issue 3, 2009, Pages

  Tkačik, Gašper ^a   Walczak, Aleksandra M ^b   Bialek, William ^b,c  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b PRINCETON UNIVERSITY   (United States)

^c ROCKEFELLER UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROL POWER; DYNAMIC RANGE; GENETIC NETWORKS; GENETIC REGULATORY NETWORKS; INFORMATION FLOWS; MOLECULAR EVENTS; MULTICELLULAR ORGANISMS; OPTIMAL SOLUTIONS; PHYSICAL CONSTRAINTS; PHYSICAL LIMITS; REGULATORY NETWORK; STEADY STATE; TARGET GENES;

GENES; NUCLEIC ACIDS; OPTIMAL SYSTEMS; OPTIMIZATION; TRANSCRIPTION; TRANSCRIPTION FACTORS;

BIOINFORMATICS;

EID: 70349976815     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.80.031920     Document Type: Article

References (82)

1. F. Rieke, D. Warland, R. de Ruyter van Steveninck, and W. Bialek, Spikes: Exploring the Neural Code (MIT Press, Cambridge, 1997).
2. M. Ptashne and A. Gann, Genes and Signals (Cold Spring Harbor Press, New York, 2002).
3. L. Wolpert, J. Theor. Biol. 25, 1 (1969). 10.1016/S0022-5193(69)80016-0
4. P. A. Lawrence, The Making of a Fly: The Genetics of Animal Design (Blackwell, Oxford, 1992).
5. M. B. Elowitz, A. J. Levine, E. D. Siggia, and P. D. Swain, Science 297, 1183 (2002). 10.1126/science.1070919
6. E. Ozbudak, M. Thattai, I. Kurtser, A. D. Grossman, and A. van Oudenaarden, Nat. Genet. 31, 69 (2002). 10.1038/ng869
7. W. J. Blake, M. Kaern, C. R. Cantor, and J. J. Collins, Nature (London) 422, 633 (2003). 10.1038/nature01546
8. Y. Setty, A. E. Mayo, M. G. Surette, and U. Alon, Proc. Natl. Acad. Sci. U.S.A. 100, 7702 (2003). 10.1073/pnas.1230759100
9. J. M. Raser and E. K. O'Shea, Science 304, 1811 (2004). 10.1126/science.1098641
10. N. Rosenfeld, J. W. Young, U. Alon, P. S. Swain, and M. B. Elowitz, Science 307, 1962 (2005). 10.1126/science.1106914
11. J. M. Pedraza and A. van Oudenaarden, Science 307, 1965 (2005). 10.1126/science.1109090
12. I. Golding, J. Paulsson, S. M. Zawilski, and E. C. Cox, Cell 123, 1025 (2005). 10.1016/j.cell.2005.09.031
13. J. R. S. Newman, S. Ghaemmaghami, J. Ihmels, D. K. Breslow, M. Noble, L. DeRisi, and J. S. Weissman, Nature (London) 441, 840 (2006). 10.1038/nature04785
14. A. Bar-Even, J. Paulsson, N. Maheshri, M. Carmi, E. O'Shea, Y. Pilpel, and N. Barkai, Nat. Genet. 38, 636 (2006). 10.1038/ng1807
15. T. Kuhlman, Z. Zhang, M. H. Saier, Jr., and T. Hwa, Proc. Natl. Acad. Sci. U.S.A. 104, 6043 (2007). 10.1073/pnas.0606717104
16. T. Gregor, E. F. Wieschaus, A. P. McGregor, W. Bialek, and D. W. Tank, Cell 130, 141 (2007). 10.1016/j.cell.2007.05.026
17. T. Gregor, D. W. Tank, E. F. Wieschaus, and W. Bialek, Cell 130, 153 (2007). 10.1016/j.cell.2007.05.025
18. A. Arkin, J. Ross, and H. H. McAdams, Genetics 149, 1633 (1998).
19. T. Kepler and T. Elston, Biophys. J. 81, 3116 (2001). 10.1016/S0006-3495(01)75949-8
20. P. S. Swain, M. B. Elowitz, and E. D. Siggia, Proc. Natl. Acad. Sci. U.S.A. 99, 12795 (2002). 10.1073/pnas.162041399
21. W. Bialek and S. Setayeshgar, Proc. Natl. Acad. Sci. U.S.A. 102, 10040 (2005) 10.1073/pnas.0504321102
22. J. Paulsson, Nature (London) 427, 415 (2004). 10.1038/nature02257
23. A. M. Walczak, M. Sasai, and P. G. Wolynes, Biophys. J. 88, 828 (2005). 10.1529/biophysj.104.050666
24. N. E. Buchler, U. Gerland, and T. Hwa, Proc. Natl. Acad. Sci. U.S.A. 102, 9559 (2005). 10.1073/pnas.0409553102
25. S. Tanase-Nicola, P. B. Warren, and P. R. ten Wolde, Phys. Rev. Lett. 97, 068102 (2006). 10.1103/PhysRevLett.97.068102
26. G. Tkačik and W. Bialek, Phys. Rev. E 79, 051901 (2009). 10.1103/PhysRevE.79.051901
27. M. J. Morelli, R. J. Allen, S. Tanase-Nicola, and P. R. ten Wolde, Biophys. J. 94, 3413 (2008). 10.1529/biophysj.107.116699
28. W. Bialek and S. Setayeshgar, Phys. Rev. Lett. 100, 258101 (2008) 10.1103/PhysRevLett.100.258101
29. e-print arXiv:q-bio.MN/0601001.
30. G. Tkačik, T. Gregor, and W. Bialek, PLoS ONE 3, e2774 (2008) 10.1371/journal.pone.0002774
31. e-print arXiv:q-bio.MN/0701002.
32. C. E. Shannon, Bell Syst. Tech. J. 27, 379 (1948)
33. reprinted in C. E. Shannon and W. Weaver, The Mathematical Theory of Communication (University of Illinois Press, Urbana, 1949).
34. T. M. Cover and J. A. Thomas, Elements of Information Theory (John Wiley, New York, 1991).
35. F. Attneave, Psychol. Rev. 61, 183 (1954). 10.1037/h0054663
36. H. B. Barlow, Sensory Mechanisms, the Reduction of Redundancy, and Intelligence, in Proceedings of the Symposium on the Mechanization of Thought Processes Vol. 2, edited by, D. V. Blake, and, A. M. Uttley, (HM Stationery Office, London, 1959), pp. 537-574.
37. S. B. Laughlin, Z. Naturforsch. C 36c, 910 (1981).
38. J. J. Atick and A. N. Redlich, Neural Comput. 2, 308 (1990). 10.1162/neco.1990.2.3.308
39. S. Smirnakis, M. J. Berry II, D. K. Warland, W. Bialek, and M. Meister, Nature (London) 386, 69 (1997). 10.1038/386069a0
40. N. Brenner, W. Bialek, and R. de Ruyter van Steveninck, Neuron 26, 695 (2000). 10.1016/S0896-6273(00)81205-2
41. A. L. Fairhall, G. D. Lewen, W. Bialek, and R. R. de Ruyter van Steveninck, Nature (London) 412, 787 (2001). 10.1038/35090500
42. M. Maravall, R. S. Petersen, A. L. Fairhall, E. Arabzadeh, and M. E. Diamond, PLoS Biol. 5, e19 (2007). 10.1371/journal.pbio.0050019
43. B. Wark, B. N. Lundstrom, and A. Fairhall, Curr. Opin. Neurobiol. 17, 423 (2007). 10.1016/j.conb.2007.07.001
44. G. Tkačik, C. G. Callan, Jr., and W. Bialek, Phys. Rev. E 78, 011910 (2008) 10.1103/PhysRevE.78.011910
45. G. Tkačik, C. G. Callan, Jr., and W. Bialek, Proc. Natl. Acad. Sci. U.S.A. 105, 12265 (2008) 10.1073/pnas.0806077105
46. E. Ziv, I. Nemenman, and C. H. Wiggins, PLoS One 2, e1077 (2007) 10.1371/journal.pone.0001077
47. e-print arXiv:q-bio/0612041.
48. E. Emberly, Phys. Rev. E 77, 041903 (2008). 10.1103/PhysRevE.77.041903
49. F. Tostevin and P. R. ten Wolde, Phys. Rev. Lett. 102, 218101 (2009). 10.1103/PhysRevLett.102.218101
50. Strictly speaking, Shannon considered the question "how much does the output tell us about the input?" which is almost the same as the question about control power posed here.
51. In general, if we allow for interactions, P ({ gi } c) = 1 (2π) M/2 exp { 1 2 lndet (K) - 1 2 ∑ i,j=1 M [gi - ḡ i (c)] Kij [gj - ḡ j (c)] }, where K measures the (inverse) covariance of the fluctuations or noise in the expression levels at fixed input,[gi - ḡ i (c)] [gj - ḡ j (c)] = (K-1) ij. In the present paper we restrict the discussion to independent genes Kij = δij / σi2.
52. We are being a bit sloppy here, since the input c is a continuous variable, but the intuition is correct.
53. L. Bintu, N. E. Buchler, H. Garcia, U. Gerland, T. Hwa, J. Kondev, and R. Phillips, Curr. Opin. Genet. Dev. 15, 116 (2005). 10.1016/j.gde.2005.02.007
54. L. Bintu, N. E. Buchler, H. Garcia, U. Gerland, T. Hwa, J. Kondev, T. Kuhlman, and R. Phillips, Curr. Opin. Genet. Dev. 15, 125 (2005). 10.1016/j.gde.2005.02.006
55. A. V. Hill, J. Physiol. 40, iv (1910).
56. The assumption that such nonfundamental noise sources are negligible is supported by a detailed quantitative analysis of the transformation between Bicoid and Hunchback in the early Drosophila embryo, although it is not known whether this is true more generally.
57. M. B. Elowitz, M. G. Surette, P.-E. Wolf, J. B. Stock, and S. Leibler, J. Bacteriol. 181, 197 (1999).
58. I. Golding and E. C. Cox, Phys. Rev. Lett. 96, 098102 (2006). 10.1103/PhysRevLett.96.098102
59. J. Elf, G.-W. Li, and X. S. Xie, Science 316, 1191 (2007). 10.1126/science.1141967
60. This normalization of the mean expression levels is not exactly the same as fixing an absolute maximum, but in the small noise limit the difference is not significant.
61. P. V. Pedone, R. Ghirlando, G. M. Clore, A. M. Gronenborn, G. Felsenfeld, and J. G. Omichinski, Proc. Natl. Acad. Sci. U.S.A. 93, 2822 (1996). 10.1073/pnas.93.7.2822
62. S. Oehler, M. Amouyal, P. Kolkhof, B. von Wilcken-Bergmann, and B. Müller-Hill, EMBO J. 13, 3348 (1994).
63. Y. Wang, L. Guo, I. Golding, E. C. Cox, and N. P. Ong, Biophys. J. 96, 609 (2009). 10.1016/j.bpj.2008.09.040
64. Nmax is the maximum number of independent molecular events, which is not the same as the maximum number of protein molecules expressed, but they are proportional.
65. Most transcription factors act either as activators or repressors, but not both. Thus, we should not take the existence of locally optimal solutions with "mixed" functions for the input molecule too literally. We think the important lesson here is that even simple formulations of our optimization problem have many solutions, so we expect that a realistic formulation, with multiple interacting targets, will also have multiple solutions. This is crucial if we want a theory based on optimization to predict the diversity of biological mechanisms.
66. Our discussion here has been in the limit where expression levels are in steady state. A complementary view of why tiling of the concentration axis is important is that, as the transcription factor concentration changes over time, the cell would cross the thresholds for activation or repression of different genes in sequence generating a temporal program of expression in which different proteins are synthesized at different times. See, for example, Refs..
67. C. Waters and B. L. Bassler, Genes Dev. 20, 2754 (2006). 10.1101/gad.1466506
68. V. Molle, M. Fujita, S. T. Jensen, P. Eichenberger, J. E. González-Pastor, J. S. Liu, and R. Losick, Mol. Microbiol. 50, 1683 (2003). 10.1046/j.1365-2958.2003.03818.x
69. M. Fujita, J. E. González-Pastor, and R. Losick, J. Bacteriol. 187, 1357 (2005). 10.1128/JB.187.4.1357-1368.2005
70. F. H. Lam, D. J. Steger, and E. K. O'Shea, Science 453, 246 (2008). 10.1038/nature06867
71. W. Driever and C. Nüsslein-Vollhard, Cell 54, 83 (1988). 10.1016/0092-8674(88)90182-1
72. W. Driever and C. Nüsslein-Vollhard, Cell 54, 95 (1988). 10.1016/0092-8674(88)90183-3
73. W. Driever and C. Nüsslein-Vollhard, Nature (London) 337, 138 (1989). 10.1038/337138a0
74. G. Struhl, K. Struhl, and P. M. Macdonald, Cell 57, 1259 (1989). 10.1016/0092-8674(89)90062-7
75. D. S. Burz, R. Rivera-Pomar, H. Jäckle, and S. D. Hanes, EMBO J. 17, 5998 (1998). 10.1093/emboj/17.20.5998
76. For a sampling of the evidence and models that describe these interactions, see Refs..
77. M. Ronen, R. Rosenberg, B. Shraiman, and U. Alon, Proc. Natl. Acad. Sci. U.S.A. 99, 10555 (2002). 10.1073/pnas.152046799
78. A. Zaslaver, A. E. Mayo, R. Rosenberg, P. Bashkin, H. Sberro, M. Tsalyuk, M. G. Surette, and U. Alon, Nat. Genet. 36, 486 (2004). 10.1038/ng1348
79. H. Jäckle, D. Tautz, R. Schuh, E. Seifert, and R. Lehmann, Nature (London) 324, 668 (1986). 10.1038/324668a0
80. R. Rivera-Pomar and H. Jäckle, Trends Genet. 12, 478 (1996). 10.1016/0168-9525(96)10044-5
81. L. Sanchez and D. Thieffry, J. Theor. Biol. 211, 115 (2001). 10.1006/jtbi.2001.2335
82. D. Yu and S. Small, Curr. Biol. 18, 868 (2008). 10.1016/j.cub.2008.05.050