Closed-loop evolutionary multiobjective optimization

IEEE Computational Intelligence Magazine

Volumn 4, Issue 3, 2009, Pages 77-91

  Knowles, Joshua ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL MODEL; ARTIFICIAL EVOLUTION; CLOSED-LOOP; COLLABORATIVE WORK; COMPUTATIONAL INTELLIGENCE; DESIGN ENGINEERING; DRUG COMBINATIONS; EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION; EVOLUTIONARY ROBOTICS; EVOLVABLE HARDWARE; EXPERIMENTAL MODES; IN-VITRO; MACHINE-LEARNING; MULTI OBJECTIVE; ON CHIPS; OTHER APPLICATIONS; PHYSICAL EXPERIMENTS; PRODUCTION PROCESS; RESOURCE CONSTRAINT;

BIOCHEMISTRY; CHEMICAL PLANTS; DESIGN OF EXPERIMENTS; EVOLUTIONARY ALGORITHMS; GLOBAL OPTIMIZATION; MACHINE DESIGN; NOISE POLLUTION; RESEARCH; ROBOTICS; TERMINOLOGY;

MULTIOBJECTIVE OPTIMIZATION;

EID: 70349330832     PISSN: 1556603X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCI.2009.933095     Document Type: Article

References (97)

1. B. Anderson, A. Moore, and D. Cohn, "A nonparametric approach to noisy and costly optimization," in Proc. 17th Int. Conf. Machine Learning (ICML 2000), P. Langley, Ed. San Mateo, CA: Morgan Kaufmann, 2000, pp. 17-24.
2. T. Bäck, U. Hammel, and H.-P. Schwefel, "Evolutionary computation: Comments on the history and current state," IEEE Trans. Evol. Comput., vol.1, no.1, pp. 3-17, 1997.
3. T. Bäck, F. Hoffmeister, and H.-P. Schwefel, "A survey of evolution strategies," in Proc. 4th Int. Conf. Genetic Algorithms, 1991.
4. P. Bentley and D. Corne, Creative Evolutionary Systems. San Mateo, CA: Morgan Kauf-mann, 2001.
5. H. Beyer and H. Schwefel, "Evolution strategies-A comprehensive introduction," Nat. Comput., vol.1, no.1, pp. 3-52, 2002.
6. C. Blum and A. Roli, "Metaheuristics in combinatorial optimization: Overview and conceptual comparison," ACM Comput. Surv., vol.35, no.3, pp. 268-308, 2003.
7. G. Box, W. Hunter, and J. Hunter, Statistics for Experimenters: Design, Innovation, and Discovery, 2nd ed. New York: Wiley, 2005.
8. G. E. P. Box, "Evolutionary operation: A method for increasing industrial productivity," Appl. Stat., vol.6, pp. 81-101, 1957.
9. J. Branke and K. Deb, "Integrating user p into evolutionary multi-objective optimization," in Knowledge Incorporation in Evolutionary Computation. New York: Springer, 2005, pp. 461-477.
10. J. Branke, K. Deb, K. Miettinen, and R. Slowiski, "Multiobjective optimization: Interactive and evolutionary approaches," in Lecture Notes in Computer Science, vol.5252. New York: Springer, 2008.
11. D. Brockhoff and E. Zitzler, "Are all objectives necessary? On dimensionality reduction in evolutionary multiobjective optimization," in Parallel Problem Solving from Nature-PPSN IX, vol.4193, Lecture Notes in Computer Science. New York: Springer, 2006, pp. 533-542.
12. E. Byrne, "Optimising the flow of experiments to a robot scientist with multi-objective evolutionary algorithms," in Proc. 2007 GECCO Conf. Companion on Genetic and Evolutionary Computation. New York, NY: ACM, 2007, pp. 2429-2436.
13. D. Calzolari, S. Bruschi, L. Coquin, J. Schofield, J. D. Feala, J. C. Reed, A. D. Mc-Culloch, and G. Paternostro, "Search algorithms as a framework for the optimization of drug combinations," PLoS Comput. Biol., vol.4, no.12, p. e1000249, Dec. 2008.
14. H. Chernoff, Sequential Analysis and Optimal Design (SIAM Monograph). Philade-phia, PA: SIAM, 1972.
15. C. Coello, "An updated survey of GA-based multiobjective optimization techniques," ACM Comput. Surv. (CSUR), vol.32, no.2, pp. 109-143, 2000.
16. C. Coello, "Twenty years of evolutionary multi-objective optimization: A historical view of the field," IEEE Comput. Intell. Mag., vol.1, no.1, 2006.
17. D. Cohn, Z. Ghahramani, and M. Jordan, "Active learning with statistical models," J. Artif. Intell. Res., vol.4, pp. 129-145, 1996.
18. D. Corne, M. Oates, and D. Kell, "Landscape state machines: Tools for evolutionary algorithm performance analyses and landscape/algorithm mapping," in Applications of Evolutionary Computing, vol.2611, Lecture Notes in Computer Science. New York: Springer, 2003, pp. 187-198.
19. D. W. Corne, K. Deb, P. J. Fleming, and J. D. Knowles, "The good of the many outweights the good of the one: Evolutionary multiobjective optimization," coNNectionS, vol.1, 2003. The Quarterly Newsletter of the IEEE Neural Networks Society.
20. D. Cvetkovíc and I. C. Parmee, "P and their application in evolutionary multiobjective optimisation," IEEE Trans. Evol. Comput., vol.6, no.1, pp. 42-57, Feb. 2002.
21. Z. S. Davies, R. J. Gilbert, R. J. Merry, D. B. Kell, M. K. Theodorou, and G. W. Griffith, "Efficient improvement of silage additives by using genetic algorithms," Appl. Environ. Microbiol, pp. 1435-1443, Apr. 2000.
22. K. De Grave, J. Ramon, and L. De Raedt, "Active learning for high throughput screening," in Discovery Science, vol.5255, Lecture Notes in Computer Science. New York: Springer, 2008, pp. 185-196.
23. K. Deb and H. Gupta, "Introducing robustness in multi-objective optimization," Evol. Comput., vol.14, no.4, pp. 463-494, Winter 2006.
24. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjec-tive genetic algorithm: NSGA-II," IEEE Trans. Evol. Comput., vol.6, no.2, pp. 182-197, 2002.
25. K. Deb and J. Sundar, "Reference point based multi-objective optimization using evolutionary algorithms," in Proc. 2006 Genetic and Evolutionary Computation Conf. (GEC-CO'2006), vol.1, M. K. et al., Eds. Seattle, WA: ACM, July 2006, pp. 635-642.
26. M. Dorigo, V. Maniezzo, and A. Colorni, "Ant system: Optimization by a colony of cooperating agents," IEEE Trans. Syst., Man, Cybern. B, vol.26, no.1, pp. 29-41, 1996.
27. S. Ducki, J. Miralles-Garcia, A. Zumbé, A. Tornero, and D. Storey, "Evaluation of solid-phase micro-extraction coupled to gas chromatography-mass spectrometry for the headspace analysis of volatile compounds in cocoa products," Talanta, vol.74, no.5, pp. 1166-1174, 2008.
28. M. Ehrgott, Multicriteria Optimization. New York: Springer, 2005.
29. M. Emmerich, K. Giannakoglou, and B. Naujoks, "Single-and multiobjective evolutionary optimization assisted by Gaussian random field metamodels," IEEE Trans. Evol. Comput., vol.10, no.4, pp. 421-439, 2006.
30. J. R. G. Evans, M. J. Edirisinghe, and P. V. C. J. Eames, "Combinatorial searches of inorganic materials using the inkjet printer: Science philosophy and technology," J. Eur. Ceramic Soc., vol.21, pp. 2291-2299, 2001.
31. J. Fieldsend and R. Everson, "Multi-objective optimisation in the presence of uncertainty," in Proc. 2005 IEEE Congress Evolutionary Computation (CEC05), 2005, pp. 476-483.
32. R. Fisher, The Design of Experiments, 9th ed. New York: Macmillan, 1971.
33. D. Fogel, Evolutionary Computation. The Fossil Record. Selected Readings on the History of Evolutionary Computation. IEEE Press, 1998.
34. C. Fonseca and P. Fleming, "An overview of evolutionary algorithms in multiobjec-tive optimization," Evol. Comput., vol.3, no.1, pp. 1-16, 1995.
35. C. Fonseca and P. Fleming, "Multiobjective optimization and multiple constraint handling with evolutionary algorithms. I. A unified formulation," IEEE Trans. Syst., Man, Cybern. A, vol.28, no.1, pp. 26-37, 1998.
36. F. Frauendorfer and P. Schieberle, "Identification of the key aroma compounds in cocoa powder based on molecular sensory correlations," J. Agr. Food Chem., vol.54, no.15, pp. 5521-5529, 2006.
37. F. Frauendorfer and P. Schieberle, "Changes in key aroma compounds of criollo cocoa beans during roasting," J. Agr. Food Chem., vol.56, no.21, pp. 10244-10251, 2008.
38. F. Glover, "Heuristics for integer programming using surrogate constraints," Decis. Sci., vol.8, no.1, pp. 156-166, 1977.
39. J. Handl, D. Kell, and J. Knowles, "Multiobjective optimization in bioinformatics and computational biology," ACM/IEEE Trans. Comput. Biol. Bioinf., vol.4, no.2, pp. 279-292, 2007.
40. G. Harik and F. Lobo, "A parameter-less genetic algorithm," in Proc. Genetic and Evolutionary Computation Conf., 1999, vol.1, pp. 258-265.
41. I. Harvey, P. Husb, D. Cli, A. Thompson, and N. Jakobi, "Evolutionary robotics: The Sussex approach," 1997.
42. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer, 2001.
43. A. Hopkins, "Network pharmacology: The next paradigm in drug discovery," Nat. Chem. Biol., vol.4, pp. 682-690, 2008.
44. A. Hopkins, J. Mason, and J. Overington, "Can we rationally design promiscuous drugs?," Curr. Opin. Struct. Biol., vol.16, pp. 127-136, 2006.
45. E. Hughes, "Evolutionary multi-objective ranking with uncertainty and noise," in Evolutionary Multi-Criterion Optimization, vol.1993, Lecture Notes in Computer Science. New York: Springer, 2001, pp. 329-343.
46. E. Hughes, "Radar waveform optimisation as a many-objective application benchmark," in Evolutionary Multi-Criterion Optimization, vol.4403, Lecture Notes in Computer Science. New York: Springer, 2007, pp. 700-714.
47. W. G. Hunter and J. R. Kittrell. (1966). Evolutionary operation: A review. Techno-metrics [Online]. 8(3), pp. 389-397. Available: http://www.jstor.org/stable/1266686.
48. HUSERMET: Human serum metabolome in health and disease [Online]. Available: http://www.husermet.org
49. M. T. Jensen, "Robust and flexible scheduling with evolutionary computation," Ph.D. thesis, Dept. Comput. Sci., Univ. Aarhus, Denmark, Oct. 2001.
50. Y. Jin, M. Olhofer, and B. Sendhoff, "A framework for evolutionary optimization with approximate fitness functions," IEEE Trans. Evol. Comput., vol.6, no.5, pp. 481-494, 2002.
51. D. Jones, M. Schonlau, and W. Welch, "Efficient global optimization of expensive black-box functions," J. Global Optim., vol.13, pp. 455-492, 1998.
52. D. R. Jones, "A taxonomy of global optimization methods based on response surfaces," J. Global Optim., vol.21, pp. 345-383, 2001.
53. L. Jourdan, D. Corne, D. Savic, and G. Walters, "LEMMO: Hybridising rule induction and NSGA-II for multi-objective water systems design," in Proc. 8th Int. Conf. Computing and Control for the Water Industry, 2006, vol.2, pp. 45-50.
54. J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Networks, vol.4. IEEE Press, 1995.
55. R. King, K. Whelan, F. Jones, P. Reiser, C. Bryant, S. Muggleton, D. Kell, and S. Oliver, "Functional genomic hypothesis generation and experimentation by a robot scientist," Nature, vol.427, pp. 247-252, 2004.
56. C. G. Knight, M. Platt, W. Rowe, D. C. Wedge, F. Khan, P. J. Day, A. Mcshea, J. Knowles, and D. B. Kell, "Array-based evolution of DNA aptamers allows modelling of an explicit sequence-fitness landscape," Nucl. Acids Res., Nov. 2008.
57. J. Knowles, "ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems," IEEE Trans. Evol. Comput., vol.10, no.1, pp. 50-66, 2006.
58. J. Knowles, D. Corne, and K. Deb, Eds. (2007). Multiobjective Problem Solving from Nature: From Concepts to Applications (Natural Computing Series). Springer-Verlag [Online]. Available: http://www.springer.com/978-3-540-72963-1
59. J. Knowles, D. Corne, and A. Reynolds, "Noisy multiobjective optimization on a budget of 250 evaluations," in Evolutionary Multi-Criterion Optimization-EMO 2009, vol.5467, Lecture Notes in Computer Science. 2009, pp. 36-50.
60. J. Knowles and H. Nakayama, "Meta-modeling in multiobjective optimization," in Multiobjective Optimization-Interactive and Evolutionary Approaches, vol.5252, Lecture Notes in Computer Science. New York: Springer, 2008.
61. K. Krishnakumar, "Micro-genetic algorithm for stationary and non-stationary function optimization," in Intelligent Control and Adaptive Systems, vol.1196, SPIE. 1989, pp. 289-296.
62. P. Larranaga and J. Lozano, Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation. Norwell, MA: Kluwer Academic, 2002.
63. K. Miettinen, Nonlinear Multiobjective Optimization. New York: Springer, 1999.
64. M. Moberg, K. Markides, and D. Bylund, "Multi-parameter investigation of tandem mass spectrometry in a linear ion trap using response surface modelling," J. Mass Spectrometry, vol.40, pp. 317-324, 2005.
65. R. Myers and D. Montgomery, Response Surface Methodology: Process and Product Optimization Using Designed Experiments. New York: Wiley, 1995.
66. S. Nolfi and D. Floreano, Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines. Bradford Book, 2004.
67. M. Oates, "Evolutionary algorithm performance profiles on the adaptive distributed database management problem," BT Technol. J., vol.18, no.4, pp. 66-77, 2000.
68. S. O'Hagan, W. Dunn, J. Knowles, D. Broadhurst, R. Williams, J. Ashworth, M. Cameron, and D. Kell, "Closed-loop, multiobjective optimization of two-dimensional gas chromatography/mass spectrometry for serum metabolomics," Anal. Chem., vol.79, no.2, pp. 464-476, 2007.
69. S. O'Hagan, W. B. Dunn, M. Brown, J. D. Knowles, and D. B. Kell, "Closed-loop, multiobjective optimization of analytical instrumentation: Gas chromatography/time-of-flight mass spectrometry of the metabolomes of human serum and of yeast fermentations," Anal. Chem., vol.77, no.1, pp. 290-303, 2005.
70. M. Platt, W. Rowe, D. Wedge, D. B. Kell, J. Knowles, and P. J. Day, "Aptamer evolution for array-based diagnostics," Anal. Biochem., to be published.
71. S. Poles, Y. Fu, and E. Rigoni, The Effect of Initial Population Sampling on the Convergence of Multi-Objective Genetic Algorithms. New York: Springer, 2009, pp. 123-133.
72. I. Rechenberg, "Cybernetic solution path of an experimental problem," Library Transl., vol.1122, 1964.
73. I. Rechenberg, "Case studies in evolutionary experimentation and computation," Comput. Meth. Appl. Mech. Eng., vol.186, no.2-4, pp. 125-140, 2000.
74. C. Reeves and C. Wright, "An experimental design perspective on genetic algorithms," Foundat. Genet. Algorithm., vol.3, pp. 7-22, 1995.
75. O. Rossi-Doria, M. Sampels, M. Birattari, M. Chiarandini, M. Dorigo, L. M. Gam-bardella, J. Knowles, M. Manfrin, M. Mastrolilli, B. Paechter, L. Paquete, and T. Sttzle, "A comparison of the performance of different metaheuristics on the timetabling problem," in Practice and Theory of Automated Timetabling (PATAT IV), vol.2740, Lecture Notes in Computer Science. New York: Springer-Verlag, 2003, pp. 329-351.
76. W. Rowe, D. Corne, and J. Knowles, "Developing landscape state machines for improved algorithm performance prediction," in Proc. IEEE Congress on Evolutionary Computation (CEC 2006), 2006, pp. 2944-2951.
77. G. Rudolph and H. Schwefel, "Simulated evolution under multiple criteria conditions revisited," Lect. Notes Comput. Sci., vol.5050, p. 249, 2008.
78. D. E. Salazar, C. M. Rocco, and E. Zio, "Robust reliability design of a nuclear system by multiple objective evolutionary optimisation," Int. J. Nucl. Knowl. Manage., vol.2, no.3, pp. 333-345, 2007.
79. T. Stark, S. Bareuther, and T. Hofmann, "Molecular definition of the taste of roasted cocoa nibs (Theobroma cacao) by means of quantitative studies and sensory experiments," J. Agr. Food Chem., vol.54, no.15, pp. 5530-5539, 2006.
80. R. Storn and K. Price, "Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces," J. Global Optim., vol.11, no.4, pp. 341-359, 1997.
81. J. Teich, "Pareto-front exploration with uncertain objectives," in Evolutionary Multi-Criterion Optimization, vol.1993, Lecture Notes in Computer Science. New York: Springer, 2001, pp. 314-328.
82. O. Teytaud, When Does Quasi-Random Work?. New York: Springer, 2008, pp. 325-336.
83. A. Thompson and P. Layzell, "Analysis of unconventional evolved electronics," Commun. ACM, vol.42, no.4, pp. 71-79, 1999.
84. V. Trianni, S. Nolfi, and M. Dorigo, "Cooperative hole avoidance in a swarm-bot," Robot. Autonom. Syst., vol.54, no.2, pp. 97-103, 2006.
85. C. Tuerk and L. Gold, "Systematic evolution of ligands by exponential enrichment: RNA ligands to bacteriophage T4 DNA polymerase," Science, vol.249, no.4968, p. 505, 1990.
86. L. Valigra, "First aptamer-based drugs take on tough diseases," Drug Discov. Develop., 2005.
87. J. A. Vrugt and B. A. Robinson, "Improved evolutionary optimization from genetically adaptive multimethod search," Proc. Nat. Acad. Sci., vol.104, no.3, pp. 708-711, Jan. 2007.
88. W. Wallace, C. Guttman, K. Flynn, and A. Kearsley, "Numerical optimization of matrix-assisted laser desorption/ionization time-of-flight mass spectrometry: Application to synthetic polymer molecular mass distribution measurement," Anal. Chim. Acta, vol.604, no.1, pp. 62-68, 2007.
89. D. Wedge and D. Kell, "Rapid prediction of optimum population size in genetic programming using a novel genotype-Fitness correlation," in Proc. Genetic and Evolutionary Computation Conf. (GECCO'08). ACM, 2008, pp. 1315-1322.
90. D. Wedge, W. Rowe, D. Kell, and J. Knowles, "In silico modelling of directed evolution: Implications for experimental design and stepwise evolution," J. Theor. Biol., vol.257, pp. 131-141, 2009.
91. D. Wedge, W. Rowe, M. Platt, P. Day, D. Kell, and J. Knowles, "Analysis of a complete DNA-protein affinity landscape," J. Royal Soc. Interface, 2009 (In Press).
92. D. Weuster-Botz and C. Wandrey, "Medium optimization by genetic algorithm for continuous production of formate dehydrogenase," Process Biochem., vol.30, pp. 563-571, 1995.
93. J. Wojtusiak and R. Michalski, "The LEM3 implementation of learnable evolution model and its testing on complex function optimization problems," in Proc. 8th Annu. Conf. Genetic and Evolutionary Computation (GECCO). ACM, 2006, pp. 1281-1288.
94. D. Wolpert and W. Macready, "No free lunch theorems for search," IEEE Trans. Evol. Comput., vol.1, no. 1, pp. 67-82, 1997.
95. G. Yen and H. Lu, "Dynamic multiobjective evolutionary algorithm: Adaptive cell-based rank and density estimation," IEEE Trans. Evol. Comput., vol.7, no.3, pp. 253-274, 2003.
96. G. R. Zimmermann, J. Lehár, and C. T. Keith, "Multi-target therapeutics: When the whole is greater than the sum of the parts," Drug Discov. Today, vol.12, pp. 34-42, 2007.
97. E. Zitzler, M. Laumanns, and S. Bleuler, "A tutorial on evolutionary multiobjec-tive optimization," in Metaheuristics for Multiobjective Optimisation, vol.535, LNEMS. New York: Springer-Verlag, 2004, pp. 3-38.