Systems biology: Experimental design

FEBS Journal

Volumn 276, Issue 4, 2009, Pages 923-942

  Kreutz, Clemens ^a   Timmer, Jens ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Confounding; Experimental design; Mathematical modeling; Model discrimination; Monte Carlo method; Parameter estimation; Sampling; Systems biology

Indexed keywords

CYTOLOGY; EXPERIMENTAL DESIGN; HUMAN; MATHEMATICAL MODEL; NONHUMAN; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; SHORT SURVEY; SYSTEMS BIOLOGY;

COMPUTER SIMULATION; KINETICS; MODELS, BIOLOGICAL; RESEARCH DESIGN; SYSTEMS BIOLOGY;

EID: 58849137994     PISSN: 1742464X     EISSN: 17424658     Source Type: Journal    
DOI: 10.1111/j.1742-4658.2008.06843.x     Document Type: Short Survey

References (109)

1. Asprey S Macchietto S (2000) Statistical tools for optimal dynamic model building. Comput Chem Eng 24, 1261 1267.
2. Montgomery DC (1991) Design and Analysis of Experiments, 3rd edn. John Wiley & Sons, New York, NY.
3. Mead R (1988) The Design of Experiments: Statistical Principles for Practical Applications. Cambridge University Press, Cambridge.
4. Black MA Doerge RW (2002) Calculation of the minimum number of replicate spots required for detection of significant gene expression fold change in microarray experiments. Bioinformatics 18, 1609 1616.
5. Churchill GA (2002) Fundamentals of experimental design for cDNA microarrays. Nat Genet 32, 490 495.
6. Kerr MK (2003) Design considerations for efficient and effective microarray studies. Biometrics 59, 822 828.
7. Kerr MK Churchill GA (2001) Experimental design for gene expression microarrays. Biostatistics 2, 183 201.
8. Kerr MK Churchill GA (2001) Statistical design and the analysis of gene expression microarray data. Genet Res 77, 123 128.
9. Simon RM Dobbin K (2003) Experimental design of DNA microarray experiments. Biotechniques, Suppl. 16 21.
10. Eriksson J Fenyö D (2007) Improving the success rate of proteome analysis by modeling protein-abundance distributions and experimental designs. Nat Biotechnol 25, 651 655.
11. Boleda MD, Briones P, Farrs J, Tyfield L Pi R (1996) Experimental design: a useful tool for PCR optimization. Biotechniques 21, 134 140.
12. Freeman WM, Walker SJ Vrana KE (1999) Quantitative RT-PCR: pitfalls and potential. Biotechniques 26, 112 122, 124 125.
13. Ginzinger DG (2002) Gene quantification using real-time quantitative PCR: an emerging technology hits the mainstream. Exp Hematol 30, 503 512.
14. Ideker TE, Thorsson V Karp RM (2000) Discovery of regulatory interactions through perturbation: inference and experimental design. Pacific Symposium on Biocomputing, pp. 305 316.
15. Page D Ong IM (2006) Experimental design of time series data for learning from dynamic Bayesian networks. Pac Symp Biocomput 11, 267 278.
16. Pournara I Wernisch L (2004) Reconstruction of gene networks using Bayesian learning and manipulation experiments. Bioinformatics 20, 2934 2942.
17. Vatcheva I, Bernard O, de Jong H Mars N (2006) Experiment selection for the discrimination of semi-quantitative models of dynamical systems. Technical report, Institute National de Recherche en Informatique et en Automatique. 170, 472 506.
18. Yoo C Cooper GF (2003) A computer-based microarray experiment design-system for gene-regulation pathway discovery. AMIA Annu Symp Proc, 733 737.
19. Atkinson A, Bogacka B Zhigljavsky A (2000) Optimum Design 2000. Kluwer Publishers, Dordrecht.
20. Atkinson AC (1982) Developments in the design of experiments. Int Statist Rev 50, 161 177.
21. Herzberg AM Cox DR (1969) Recent work on the design of experiments: a bibliography and a review. J R Statist Soc A 132, 29 67.
22. Chaloner K Verdinelli I (1995) Bayesian experimental design: a review. Stat Sci 10, 273 304.
23. Preece DA (1990) R. A. Fisher and experimental design: a review. Biometrics 46, 925 935.
24. Dette H, Melas VB Strigul N (2003) Design of experiments for microbiological models. Technical report, Ruhr University Bochum, Bochum.
25. Jacobsen M, Repsilber D, Gutschmidt A, Neher A, Feldmann K, Mollenkopf HJ, Kaufmann SHE Ziegler A (2006) Deconfounding microarray analysis - independent measurements of cell type proportions used in a regression model to resolve tissue heterogeneity bias. Methods Inf Med 45, 557 563.
26. Kirk R (1989) Experimental Design: Procedures for the Behavioral Science. Brooks/Cole Publishing Company, Belmont, CA.
27. Goulden CH (1956) Methods of Statistical Analysis. Wiley, New York, NY.
28. Greenland S Morgenstern H (2001) Confounding in health research. Annu Rev Public Health 22, 189 212.
29. Atkinson AC Donev AN (1996) Experimental designs optimally balanced for trend. Technometrics 38, 333 341.
30. Bailey RA, Cheng C-S Kipnis P (1992) Construction of trend resistant factorial designs. Stat Sin 2, 393 411.
31. Fisher RA (1950) Statistical Methods for Research Workers, 11 edn. Oliver and Boyd, Edingburgh.
32. Schilling M, Maiwald T, Bohl S, Kollmann M, Kreutz C, Timmer J Klingmller U (2005) Computational processing and error reduction strategies for standardized quantitative data in biological networks. FEBS J 272, 6400 6411.
33. Schilling M, Maiwald T, Bohl S, Kollmann M, Kreutz C, Timmer J Klingmüller U (2005) Quantitative data generation for Systems Biology: the impact of randomization, calibrators and normalizers. IEE Proc - Syst Biol 152, 193 200.
34. Kendziorski C, Irizarry RA, Chen K-S, Haag JD Gould MN (2005) On the utility of pooling biological samples in microarray experiments. PNAS 102, 4252 4257.
35. Quinn GP Keough MJ (2002) Experimental Design and Data Analysis for Biologists. Cambridge University Press, Cambridge.
36. Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd edn. Erlbaum, Hillsdale, NJ.
37. Lee M-LT Whitmore GA (2002) Power and sample size for DNA microarray studies. Stat Med 21, 3543 3570.
38. Eng J (2003) Sample size estimation: how many individuals should be studied Radiology 227, 309 313.
39. Whitley E Ball J (2002) Statistics review 4: sample size calculations. Crit Care 6, 335 341.
40. Cilek JE Mulrennan JA (1997) Pseudoreplication: what does it mean, and how does it relate to biological experiments J Am Mosq Control Assoc 13, 102 103.
41. Hurlbert SH (1984) Pseudoreplication and the design of ecological field experiments. Ecol Monogr 54, 187 211.
42. Balsa-Canto E, Alonso AA Banga JR (1998) Dynamic Optimization of Bioprocesses: Deterministic and Stochastic Strategies. Automatic Control of Food & Biological Processes.
43. Banga JR, Balsa-Canto E, Moles CG Alonso AA (2005) Dynamic optimization of bioprocesses: efficient and robust numerical strategies. J Biotechnol 117, 407 419.
44. Asprey S Macchietto S (2002) Designing robust optimal dynamic experiments. J Process Control 12, 545 556.
45. Cooney MJ McDonald K (1995) Optimal dynamic experiments for bioreactor model discrimination. Appl Microbiol Biotechnol 43, 826 837.
46. Espie D Macchietto S (1989) The optimal design of dynamic experiments. AIChE J 35, 223 229.
47. Galvanin F, Macchietto S Bezzo F (2007) Model-based design of parallel experiments. Ind Eng Chem Res 46, 871 882.
48. Maiwald T, Kreutz C, Pfeifer AC, Bohl S, Klingmüller U Timmer J (2007) Feasibility analysis and optimal experimental design. Ann N Y Acad Sci 1115, 212 220.
49. Kremling A, Fischer S, Gadkar K, Doyle FJ, Sauter T, Bullinger E, Allgoewer F Gilles ED (2004) A benchmark for methods in reverse engineering and model discrimination: Problem formulation and solutions. Genome Res 14, 1773 1765.
50. Chen BH Asprey SP (2003) On the design of optimally informative experiments for model discrimination among dynamic crystallization process models. Proceedings Foundations of Computer-Aided Process Operations, pp. 455 458.
51. Baltes M, Schneider R, Sturm C Reuss M (1994) Optimal experimental design for parameter estimation in unstructured growth models. Biotechnol. Prog. 10, 480 488.
52. Kutalik Z, Cho K-H Wolkenhauer O (2004) Optimal sampling time selection for parameter estimation in dynamic pathway modeling. Biosystems 75, 43 55.
53. Cho K-H, Kolch W Wolkenhauer O (2003) Experimental design in Systems Biology, based on parameter sensitivity analysis using a Monte Carlo method: a case study for the TNFα-mediated NF-κB signal transduction pathway. Simulation 79, 726 739.
54. Dette H Biedermann S (2003) Robust and efficient designs for the Michaelis-Menten model. J Am Stat Assoc 98, 679 686.
55. Johnson PD Besselsen DG (2002) Practical aspects of experimental design in animal research. ILAR J 43, 202 206.
56. Kiefer J (1959) Optimum experimental designs. J R Stat Soc Ser B 21, 272 319.
57. Swameye I, Müller T, Timmer J, Sandra O Klingmüller U (2003) Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by data-based modeling. Proc Natl Acad Sci USA 100, 1028 1033.
58. Cho K-H Wolkenhauer O (2003) Analysis and modeling of signal transduction pathways in systems biology. Biochem Soc Trans 31, 1503 1509.
59. Mendes P Kell D (1998) Non-linear optimization of biochemical pathways: application to metabolic engineering and parameter estimation. Bioinformatics 14, 869 883.
60. Rodriguez-Fernandez M, Mendes P Banga JR (2006) A hybrid approach for efficient and robust parameter estimation in biochemical pathways. Biosystems 83, 248 265.
61. Honerkamp J (1993) Stochastic Dynamical Systems. VCH, New York, NY.
62. Tarantola A (2005) Inverse Problem Theory. SIAM, Philadelphia, PA.
63. Horbelt W (2001) Maximum likelihood estimation in dynamical systems. PhD thesis, University of Freiburg, Freiburg.
64. Hidalgo ME Ayesa E (2001) Numerical and graphical description of the information matrix in calibration experiments for state-space models. Water Res 35, 3206 3214.
65. Silvey SD (1970) Statistical Inference. Penguin Books Ltd, Harmondsworth, Middlesex, England.
66. Faller D, Klingmüller U Timmer J (2003) Simulation methods for optimal experimental design in Systems Biology. Simul: Trans Soc Model Comput Simul 79, 717 725.
67. Dette H, Melas VB Pepelyshev A (2003) Standardized maximum E-optimal designs for the Michaelis-Menten model. Stat Sin 13, 1147 1167.
68. John RCS Draper NR (1975) D-optimality for regression designs: a review. Technometrics 17, 15 23.
69. Balsa-Canto JBE Rodriguez-Fernandez M (2007) Optimal design of dynamic experiments for improved estimation of kinetic parameters of thermal degradation. J Food Eng 82, 178 188.
70. Atkinson AC Donev AN (1992) Optimum Experimental Designs. Clarendon Press, Oxford.
71. Kiefer J Wolfowitz J (1960) The equivalence of two extremum problems. Can J Math 12, 363 366.
72. Kiefer J (1975) Optimal design: variation in structure and performance under change of criterion. Biometrika 62, 277 288.
73. Chappell M, Godfrey K Vajda S (1990) Global identifiability of the parameters of nonlinear systems with specified inputs: a comparison of methods. Math Biosci 102, 41 73.
74. Ljung L Glad T (1994) On global identifiability for arbitrary model parameterizations. Automatica 30, 265 276.
75. Hengl S, Kreutz C, Timmer J Maiwald T (2007) Data-based identifiability analysis of non-linear dynamical models. Bioinformatics 23, 2612 2618.
76. Timmer J, Müller T Melzer W (1998) Numerical methods to determine calcium release flux from calcium transients in muscle cells. Biophys J 74, 1694 1707.
77. Titterington DM (1975) Optimal design: some geometrical aspects of D-optimality. Biometrika 2, 313 320.
78. Atkinson AC (1988) Recent developments in the methods of optimum and related experimental designs. Int Stat Rev 56, 99 115.
79. s-optimal designs for polynomial regression using continued fractions. Ann Stat 8, 1132 1141.
80. DeFeo P Myers RH (1992) A new look at experimental design robustness. Biometrika 79, 375 380.
81. Goos P, Kobilinsky A O'Brien TE (2005) Model-robust and model-sensitive designs. Comput Stat Data Anal 49, 201 216.
82. Rojas CR, Welsh JS, Goodwin GC Feuer A (2007) Robust optimal experiment design for system identification. Automatica 43, 993 1008.
83. Sacks J Ylvisaker D (1984) Some model robust designs in regression. Ann Stat 12, 1324 1348.
84. Yue R-X Hickernell FJ (1999) Robust designs for fitting linear models with misspecification. Stat Sin 9, 1053 1069.
85. Casey FP, Baird D, Feng Q, Gutenkunst RN, Waterfall JJ, Myers CR, Brown KS, Cerione RA Sethna JP (2006) Optimal experimental design in an EGFR signaling and down-regulation model. Technical report, Center for Applied Mathematics, Cornell University, Ithaca, NY.
86. Munack A (1989) Design of optimal dynamical experiments for parameter estimation. Proceedings of the American Control Conference, ACC89, Pittsburgh, PA, pp. 2011 2016.
87. Gadkar KG, Gunawan R Doyle FJ III (2005) Iterative approach to model identification of biological networks. BMC Bioinformatics 6, 1 20.
88. Steward WE, Henson TL Box GEP (1996) Model discrimination and criticism with single-response data. AIChE J 42, 3055 3062.
89. Steward WE, Shon Y Box GEP (1998) Discrimination and goodness of fit of multiresponse mechanistic models. AIChE J, 66, 1404 1412.
90. Timmer J, Müller T, Sandra O, Swameye I Klingmüller U (2004) Modeling the non-linear dynamcis of cellular signal transduction. Int J Bif Chaos 14, 2069 2079.
91. Akaike H (1974) A new look at the statistical model identification. IEEE Trans Automat Contr AC-19, 716 723.
92. Sakamoto Y, Ishiguro M Kitagawa G (1986) Akaike Information Criterion Statistics. D. Reidel Publishing Company, Dordrecht.
93. Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6, 461 464.
94. Rissanen J (1983) A universal prior for integers and estimation by minimum description length. Ann Stat 11, 416 431.
95. Cox D (1961) Tests of separate families of hypotheses. In Proceedings of Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1, pp. 105 123. University of California Press, Berkeley, CA.
96. Honerkamp J (2002) Statistical Physics. An Advanced Approach with Applications. Springer-Verlag, Heidelberg.
97. Self SG Liang KY (1987) Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions. J Am Stat Assoc 82, 605 610.
98. Hunter WG Reiner AM (1965) Designs for discriminating between two rival models. Technometrics 7, 307 323.
99. Atkinson AC Fedorov VV (1975) Optimal design: experiments for discriminating between two rival models. Biometrika 62, 57 70.
100. Atkinson AC Fedorov VV (1975) The design of experiments for discriminating between several models. Biometrika 62, 289 303.
101. Box GEP Hill WJ (1967) Discrimination among mechanistic models. Technometrics 9, 57 71.
102. Buzzi Ferraris G Forzatti P (1984) Sequential experimental design for model discrimination in the case of multiple responses. Chem Eng Sci 39, 81 85.
103. Buzzi Ferraris G, Forzatti P, Emig G Hofmann H (1983) New sequential experimental design procedure for discriminating among rival models. Chem Eng Sci 38, 225 232.
104. Hsiang T Reilly PM (1971) A practical method for discriminating among mechanistic models. Can J Chem Eng 38, 225.
105. Reilly PM (1970) Statistical methods in model discrimination. Can J Chem Eng 48, 168 173.
106. Atkinson AC (1981) A comparison of two criteria for the design of experiments for discriminating between models. Technometrics 23, 301 305.
107. Burke AL, Duever TA Penlidis A (1994) Model discrimination via designed experiments: Discriminating between the terminal and penultimate models on the basis of composition data. Macromolecules 27, 386 399.
108. Feng X-J Rabitz H (2004) Optimal identification of biochemical reaction networks. Biophys J 86, 1270 1281.
109. Verheijen PJ (2003) Model selection: an overview of practices in chemical engineering. Comput-Aided Chem Eng 16, 85 104.