Information theory and signal transduction systems: From molecular information processing to network inference

Seminars in Cell and Developmental Biology

Volumn 35, Issue , 2014, Pages 98-108

  Mc Mahon, Siobhan S ^a   Sim, Aaron ^a   Filippi, Sarah ^a   Johnson, Robert ^a   Liepe, Juliane ^a   Smith, Dominic ^a   Stumpf, Michael P H ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Experimental design; Mutual information; Network inference; Noise; Signal processing

Indexed keywords

BIOINFORMATICS; CELL FATE; CELL FUNCTION; CYTOLOGY; DEVELOPMENTAL BIOLOGY; EXPERIMENTAL STUDY; GENE CONSTRUCT; GENE REGULATORY NETWORK; HUMAN; MOLECULAR BIOLOGY; MOLECULAR DYNAMICS; MOLECULAR INTERACTION; MOLECULAR PATHOLOGY; MOLECULAR SYSTEMATICS; NONHUMAN; REVIEW; SIGNAL TRANSDUCTION; SYSTEMS BIOLOGY; THEORETICAL STUDY; ALGORITHM; ANIMAL; BIOLOGICAL MODEL; COMPUTER SIMULATION; INFORMATION SCIENCE;

ALGORITHMS; ANIMALS; COMPUTER SIMULATION; GENE REGULATORY NETWORKS; HUMANS; INFORMATION THEORY; MODELS, BIOLOGICAL; SIGNAL TRANSDUCTION;

EID: 84908897496     PISSN: 10849521     EISSN: 10963634     Source Type: Journal    
DOI: 10.1016/j.semcdb.2014.06.011     Document Type: Review

References (71)

1. Wodarz A., Nusse R. Mechanisms of wnt signaling in development. Annu Rev Cell Dev Biol 1998, 14(1):59-88.
2. Artavanis-Tsakonas S., Rand M.D., Lake R.J. Notch signaling: cell fate control and signal integration in development. Science 1999, 284(5415):770-776.
3. Lenski R.E., Travisano M. Dynamics of adaptation and diversification: a 10,000 generation experiment with bacterial populations. Proc Natl Acad Sci U S A 1994, 91(15):6808-6814.
4. Brennan M.D., Cheong R., Levchenko A. How information theory handles cell signaling and uncertainty. Science 2012, 338(6105):334-335.
5. Rhee A., Cheong R., Levchenko A. The application of information theory to biochemical signaling systems. Phys Biol 2012, 9(4):045011.
6. Christian Waltermann E.K. Information theory based approaches to cellular signalling. Biochim Biophy Acta 2011, 1810:924-932.
7. Fujita K., Toyoshima Y., Uda S., Ozaki Y., Kubota H., Kuroda S. Decoupling of receptor and downstream signals in the akt pathway by its low-pass filter characteristics. Sci Signal 2010, 3(132):ra56.
8. Bowsher C.G., Swain P.S. Identifying sources of variation and the flow of information in biochemical networks. Proc Natl Acad Sci U S A 2012, 109(20):E1320-E1328.
9. Tostevin F., Ten Wolde P.R. Mutual information between input and output trajectories of biochemical networks. Phys Rev Lett 2009, 102(21):218101.
10. Tostevin F., Ten Wolde P.R. Mutual information in time-varying biochemical systems. Phys Rev E 2010, 81(6):061917.
11. Tkăcik G., Walczak A.M. Information transmission in genetic regulatory networks: a review. J Phys Condens Matter 2011, 23(15):153102.
12. Tkăcik G., Walczak A.M., Bialek W. Optimizing information flow in small genetic networks. Phys Rev E 2009, 80(3):031920.
13. Dubuis J.O., Tkăcik G., Wieschaus E.F., Gregor T., Bialek W. Positional information, in bits. Proc Natl Acad Sci U S A 2013, 110(41):16301-16308.
14. Steuer R., Kurths J., Daub C.O., Weise J., Selbig J. The mutual information: detecting and evaluating dependancies between variables. Bioinformatics 2002, 18:S231-S240.
15. Iglesias P.A. Systems biology: the role of engineering in the reverse engineering of biological signaling. Cells 2013, 2(2):393-413.
16. Basso K., Margolin A.A., Stolovitzky G., Klein U., Dalla-Favera R., Califano A. Reverse engineering of regulatory networks in human b cells. Nat Genet 2005, 37(4):382-390.
17. Ziv E., Nemenman I., Wiggins C.H. Optimal signal processing in small stochastic biochemical networks. PLoS ONE 2007, 2(10):e1077.
18. Liepe J., Filippi S., Komorowski M., Stumpf M.P.H. Maximizing the information content of experiments in systems biology. PLoS Comput Biol 2000, 9(1):e1002888.
19. Shannon C. A mathematical theory of communication. Bell Systems Tech J 1948, 379-423.
20. Pereda E., Quiroga R.Q., Bhattacharya J. Nonlinear multivariate analysis of neurophysiological signals. Prog Neurobiol 2005, 77(1):1-37.
21. Tkăcik G., Callan C.G., Bialek W. Information flow and optimization in transcriptional regulation. Proc Natl Acad Sci U S A 2008, 105(34):12265-12270.
22. Peng H., Long F., Ding C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 2005, 27(8):1226-1238.
23. Maasoumi E., Racine J. Entropy and predictability of stock market returns. J Econom 2002, 107(1):291-312.
24. Maasoumi E. A compendium to information theory in economics and econometrics. Econom Rev 1993, 12(2):137-181.
25. Bloch M., Barros J., Rodrigues M.R., McLaughlin S.W. Wireless information theoretic security. IEEE Trans Inform Theory 2008, 54(6):2515-2534.
26. Lin J. Divergence measures based on the Shannon entropy. IEEE Trans Inform Theory 1991, 37(1):145-151.
27. MacKay D.J. Information theory, inference, and learning algorithms 2003, Cambridge University Press.
28. Cover T.M., Thomas J.A. Elements of information theory 2012, John Wiley & Sons.
29. Fernandes A.D., Gloor G.B. Mutual information is critically dependant on prior assumptions: would the correct estimate of mutual information please identify itself?. Bioinform Discov Note 2010, 26:1135-1139.
30. Mitra P.P., Stark J.B. Nonlinear limits to the information capacity of optical fibre communications. Nature 2001, 411(6841):1027.
31. Wilkinson D.J. Stochastic modelling for systems biology 2006, Chapman & Hall.
32. Murphy K.P. Machine learning: a probabilistic perspective 2012, The MIT Press.
33. Cellucci C.J., Albano A.M., Rapp P.E. Statistical validation of mutual information calculations: comparison of alternative numerical algorithms. Phys Rev E 2005, 71:066208.
34. Kraskov A., Stogbauer H., Grassberger P. Estimating mutual information. Phys Rev E 2004, 69(6):066138.
35. Butte A.J., Kohane I.S. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. Pac Symp Biocomput 2000, 5:418-429.
36. Herzel H., Schmitt A.O., Ebeling W. Finite sample effects in sequence analysis. Choas Solitons Fractals 1994, 4:97-113.
37. Fraser A., Swinney H. Independent coordinates for strange attractors from mutual information. Phys Rev A 1986, 33:1134-1140.
38. Moon Y.-I., Rajagopalan B., Lall U. Estimation of mutual information using kernel density estimators. Phys Rev E 1995, 52(3):2318.
39. Silverman B.W. Density estimation for statistics and data analysis 1986, Chapman & Hall.
40. Jones M.C., Marron J.S., Sheather S.J. A brief survey of bandwidth selection for density estimation. J Am Statist Assoc 1996, 91(433):401-407.
41. Elowitz M.B., Levine A.J., Siggia E.D., Swain P.S. Stochastic gene expression in a single cell. Science 2002, 297(5584):1183-1186.
42. Sturrock M., Hellander A., Aldakheel S., Petzold L., Chaplain M.A. The role of dimerisation and nuclear transport in the hes1 gene regulatory network. Bull Math Biol 2013, 1-33.
43. Silk D., Kirk P.D.W., Barnes C.P., Toni T., Rose A., Moon S., et al. Designing attractive models via automated identification of chaotic and oscillatory dynamical regimes. Nat Commun 2011, 2:489.
44. Cheong R., Rhee A., Wang C.J., Nemenman I., Levchenko A. Information transduction capacity of noisy biochemical signaling networks. Science 2011, 334:354-357.
45. Mc Mahon SS, Stumpf MPH. Unpublished results.
46. Miller M.L., Jensen L.J., Diella F., Jorgensen C., Tinti M., Li L., et al. Linear motif atlas for phosphorylation-dependent signaling. Sci Signal 2008, 1(35):ra2.
47. Alon U. Network motifs: theory and experimental approaches. Nat Rev Genet 2007, 8:450-461.
48. Mangan S., Alon U. Structure and function of the feed-forward loop network motif. Proc Natl Acad Sci U S A 2003, 100(21):11980-11985.
49. Van Kampen N.G. Stochastic processes in physics and chemistry 2007, North-Holland Personal Library, North Holland.
50. Komorowski M., Costa M.J., Rand D.A., Stumpf M.P.H. Sensitivity, robustness, and identifiability in stochastic chemical kinetics models. Proc Natl Acad Sci U S A 2011, 108(21):8645-8650.
51. Wallace E.W.J., Gillespie D.T., Sanft K.R., Petzold L.R. Linear noise approximation is valid over limited times for any chemical system that is sufficiently large. IET Syst Biol 2012, 6(4):102-115.
52. Munakata T., Kamiyabu M. Stochastic resonance in the Fitzhugh-Nagumo model from a dynamic mutual information point of view. Eur Phys J B: Condens Matter Complex Syst 2006, 53(2):239-243.
53. Wang L.D., Wagers A.J. Dynamic niches in the origination and differentiation of haematopoietic stem cells. Nat Rev Mol Cell Biol 2011, 12(10):643-655.
54. Berg H.C. Chemotaxis in bacteria. Ann Rev Biophys Bioeng 1975, 4(00):119-136.
55. Yuan J., Branch R.W., Hosu B.G., Berg H.C. Adaptation at the output of the chemotaxis signalling pathway. Nature 2012, 484(7393):233-236.
56. Feliu E., Wiuf C. Enzyme-sharing as a cause of multi-stationarity in signalling systems. J R Soc Interface 2012, 9(71):1224-1232.
57. Harrington H.A., Feliu E., Wiuf C., Stumpf M.M.P. Cellular compartments cause multistability in biochemical reaction networks and allow cells to process more information. Biophys J 2013, 104:1824-1831.
58. Chaidos A., Barnes C.P., Cowan G., May P.C., Melo V., Hatjiharissi E., et al. Clinical drug resistance linked to interconvertible phenotypic and functional states of tumor-propagating cells in multiple myeloma. Blood 2013, 121(2):318-328.
59. Tyson J.J., Chen K.C., Novak B. Sniffers, buzzers, toggles and blinkers: dynamics of regulatory and signaling pathways in the cell. Curr Opin Cell Biol 2003, 15(2):221-231.
60. Latchman D. Gene control 2010, Garland Science, New York.
61. Werhli A., Grzegorczyk M., Husmeier D. Comparative evaluation of reverse engineering gene regulatory networks with relevance networks, graphical Gaussian models and Bayesian networks. Bioinformatics 2006, 22(20):2523-2531.
62. Opgen-Rhein R., Strimmer K. From correlation to causation networks: a simple approximate learning algorithm and its application to high-dimensional plant gene expression data. BMC Syst Biol 2007, 1(1):37.
63. Sachs K., Perez O., Pe'er D., Lauffenburger D., Nolan G. Causal protein-signaling networks derived from multiparameter single-cell data. Science 2005, 308(5721):523-529.
64. Thorne T., Stumpf M.P.H. Inference of temporally varying Bayesian networks. Bioinformatics 2012, 28(24):3298-3305.
65. Margolin A., Nemenman I., Basso K., Wiggins C., Stolovitzky G., Favera R., et al. ARACNE: an algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC Bioinform 2006, 7(Suppl. 1):S7.
66. Smith D, Filippi S, Stumpf MPH. Unpublished results.
67. Chaloner K., Verdinelli I. Bayesian experimental design: a review. Stat Sci 1995, 10(3):273-304.
68. Stumpf M.P.H., Balding D.J., Girolami M. Handbook of statistical systems biology 2011, Wiley.
69. Munsky B., Trinh B., Khammash M. Listening to the noise: random fluctuations reveal gene network parameters. Mol Syst Biol 2009, 5(1).
70. Komorowski M., Miekisz J., Stumpf M.P.H. Decomposing noise in biochemical signaling systems highlights the role of protein degradation. Biophys J 2013, 104(8):1783-1793.
71. Toni T., Tidor B. Combined model of intrinsic and extrinsic variability for computational network design with application to synthetic biology. PLoS Comput Biol 2013, 9(3):e1002960.