Information-theoretic sensitivity analysis: A general method for credit assignment in complex networks

Journal of the Royal Society Interface

Volumn 5, Issue 19, 2008, Pages 223-235

  Lüdtke, Niklas ^a   Panzeri, Stefano ^a   Brown, Martin ^a   Broomhead, David S ^a   Knowles, Joshua ^a   Montemurro, Marcelo A ^a   Kell, Douglas B ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Communication channel; Entropy; Information theory; Mutual information; NF B; Sensitivity analysis

Indexed keywords

IMMUNOGLOBULIN ENHANCER BINDING PROTEIN;

ANALYSIS OF VARIANCE; ANALYTICAL PARAMETERS; ARTICLE; CORRELATION ANALYSIS; ENTROPY; INFORMATION SCIENCE; QUANTITATIVE ANALYSIS; SENSITIVITY ANALYSIS;

EID: 37249079144     PISSN: 17425689     EISSN: 17425662     Source Type: Journal    
DOI: 10.1098/rsif.2007.1079     Document Type: Article

References (42)

1. Adelman, T. L., Bialek, W. & Olberg, R. M. 2003 The information content of receptive fields. Neuron 40, 823-833. (doi:10.1016/S0896-6273(03)00680-9)
2. Alon, U. 2006 An introduction to systems biology: design principles of biological circuits. London, UK: Chapman and Hall/CRC.
3. Amari, S. 2001 Information geometry on hierarchy of probability distributions. IEEE Trans. Inf. Theory 47, 1701-1711. (doi:10.1109/18.930911)
4. Barabási, A.-L. & Oltvai, Z. N. 2004 Network biology: understanding the cell's functional organization. Nat. Rev. Genet. 5, 101-113. (doi:10.1038/nrg1272)
5. Box, G. E. P., Hunter, W. G. & Hunter, J. S. 1978 Statistics for experimenters. New York, NY: Wiley.
6. Cover, T. M. & Thomas, J. A. 2006 Elements of information theory. New York, NY: Wiley.
7. Critchfield, G. C., Willard, K. E. & Connelly, D. P. 1986 Probabilistic sensitivity analysis methods for general decision models. Comp. Biomed. Res. 19, 254-265. (doi:10.1016/0010-4809(86)90020-0)
8. Csete, M. & Doyle, J. 2004 Bow ties, metabolism and disease. Trends Biotechnol 22, 446-450. (doi:10.1016/j.tibtech.2004.07.007)
9. Dalle Molle, J. W. & Morris, D. J. 1993 An information theoretic approach to computer simulation sensitivity analysis. In Proc. 1993 Winter Simulation Conference (eds G. W. Evans, M. Mollaghasemi, E. C. Russell & W. E. Biles), pp. 402-407. New York, NY: ACM Press.
10. Davidson, E. H. 2006 The regulatory genome: gene regulatory networks in development and evolution. Amsterdam, The Netherlands: Academic Press.
11. Doyle III, F. J. & Stelling, J. 2006 Systems interface biology. J. R. Soc. Interface 3, 603-616. (doi:10.1098/rsif.2006.0143)
12. Fano, R. M. 1961 Transmission of information. Boston, MA: MIT Press.
13. Gerondakis, S., Grossmann, M., Nakamura, Y., Pohl, T. & Grumont, R. 1999 Genetic approaches in mice to understand Rel=NF-kB and IkB function: transgenics and knockouts. Oncogene 18, 6888-6895. (doi:10.1038/sj.onc.1203236)
14. Hoffmann, A., Levchenko, A., Scott, M. L. & Baltimore, D. 2002 The IkB-NF-kB signaling module: temporal control and selective gene activation. Science 298, 1241-1245. (doi:10.1126/science.1071914)
15. Hwang, D. et al. 2005 A data integration methodology for systems biology. Proc. Natl Acad. Sci. USA 102, 17 296-17 301. (doi:10.1073/pnas.0508647102)
16. Ihekwaba, A. E. C., Broomhead, D. S., Grimley, R., Benson, N. & Kell, D. B. 2004 Sensitivity analysis of parameters controlling oscillatory signalling in the NF-kB pathway: the roles of IKK and IκBα. Syst. Biol. 1, 93-103. (doi:10.1049/sb:20045009)
17. Ihekwaba, A. E. C., Broomhead, D. S., Grimley, R., Benson, N., White, M. R. H. & Kell, D. B. 2005 Synergistic control of oscillations in the NF-kB signalling pathway. IEE Syst. Biol. 152, 153-160. (doi:10.1049/ip-syb:20050050)
18. Jaynes, E. T. 1957 Information theory and statistical mechanics. Phys. Rev. 106, 62-79. (doi:10.1103/Phys-Rev.106.620)
19. Kell, D. B. 2006a Metabolomics, modelling and machine learning in systems biology: towards an understanding of the languages of cells. The 2005 Theodor Bücher lecture. FEBS J. 273, 873-894. (doi:10.1111/j.1742-4658.2006.05136.x)
20. Kell, D. B. 2006b Systems biology, metabolic modelling and metabolomics in drug discovery and development. Drug Disc. Today 11, 1085-1092. (doi:10.1016/j.drudis.2006.10.004)
21. Kitano, H., Funahashi, A., Matsuoka, Y. & Oda, K. 2005 Using process diagrams for the graphical representation of biological networks. Nat. Biotechnol. 23, 961-966. (doi:10.1038/nbt1111)
22. Klipp, E., Herwig, R., Kowald, A., Wierling, C. & Lehrach, H. 2005 Systems biology in practice: concepts, implementation and clinical application. Berlin, Germany: Wiley/VCH.
23. McGill, W. J. 1954 Multivariate information transmission. Psychometrika 19, 97-116. (doi:10.1007/BF02289159)
24. Miller, G. A. 1955 Note on the bias on information estimates. In Information theory in psychology; problems and methods II-B (ed. H. Quastler), pp. 95-100. Glencoe, IL: Free Press.
25. Montemurro, M. A., Senatore, R. & Panzeri, S. In press. Tight data-robust bounds to mutual information combining shuffling and model selection techniques. Neural Computat.
26. Nelson, D. E. et al. 2004 Oscillations in NF-kB signalling control the dynamics of target gene expression. Science 306, 704-708. (doi:10.1126/science.1099962)
27. Nemenman, I., Bialek, W. & van Steveninck, R. D. 2004 Entropy and information in neural spike trains: progress on the sampling problem. Phys. Rev. E 69, 056 111. (doi:10.1103/PhysRevE.69.056111)
28. Palsson, B. Ø. 2006 Systems biology: properties of reconstructed networks. Cambridge, UK: Cambridge University Press.
29. Panzeri, S. & Treves, A. 1996 Analytical estimates of limited sampling biases in different information measures. Network 7, 87-107.
30. Panzeri, S., Schultz, S. R., Treves, A. & Rolls, E. T. 1999 Correlations and the encoding of information in the nervous system. Proc. R. Soc. B 266, 1001-1012. (doi:10.1098/rspb.1999.0736)
31. Rabitz, H. & Aliş, Ö. F. 1999 General foundations of high-dimensional model representations. J. Math. Chem. 25, 197-233. (doi:10.1023/A:1019188517934)
32. Saltelli, A., Tarantola, S. & Campolongo, F. 2000 Sensitivity analysis as an ingredient of modeling. Stat. Sci. 15, 377-395. (doi:10.1214/ss/1009213004)
33. Saltelli, A., Tarantola, S., Campolongo, F. & Ratt, M. 2004 Sensitivity analysis in practice: a guide to assessing scientific models. New York, NY: Wiley.
34. Saltelli, A., Ratto, M., Tarantola, S. & Campolongo, F. 2005 Sensitivity analysis for chemical models. Chem. Rev. 105, 2811-2827. (doi:10.1021/cr040659d)
35. Schneidman, E., Berry II, M. J., Segev, R. & Bialek, W. 2006 Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440, 1007-1012. (doi:10.1038/nature04701)
36. Shannon, C. E. & Weaver, W. 1949 The mathematical theory of communication. Urbana, IL: University of Illinois Press.
37. Sobol, I. M. 2001 Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates. Math. Comp. Simul. 55, 271-280. (doi:10.1016/S0378-4754(00)00270-6)
38. Wagner, A. 2005 Robustness and evolvability in living systems. Princeton, NJ: Princeton University Press.
39. Wagner, A. & Fell, D. A. 2001 The small world inside large metabolic networks. Proc. R. Soc. B 268, 1803-1810. (doi:10.1098/rspb.2001. 1711)
40. Watanabe, S. 1960 Information theoretical analysis of multivariate correlation. IBM J. Res. Dev. 4, 66-82.
41. Wilkinson, D. J. 2006 Stochastic modelling for systems biology. London, UK: Chapman and Hall/CRC.
42. Yue, H., Brown, M., Knowles, J., Wang, H., Broomhead, D. S. & Kell, D. B. 2006 Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF-κB signalling pathway. Mol. Biosyst. 2, 640-649. (doi:10.1039/ b609442b)