Regression models using pattern search assisted least square support vector machines

Chemical Engineering Research and Design

Volumn 83, Issue 8 A, 2005, Pages 1030-1037

  Patil, N S ^a   Shelokar, P S ^a   Jayaraman, V K ^a   Kulkarni, B D ^a  

^a NATIONAL CHEMICAL LABORATORY   (India)

Author keywords

Equality constraints; LS SVM; Model selection; Optimization; Pattern search

Indexed keywords

ALGORITHMS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; NEURAL NETWORKS; OPTIMIZATION; REGRESSION ANALYSIS;

EQUALITY CONSTRAINTS; LEAST SQURE SUPPORT VECTOR MACHINES; MODEL SELECTION; PATTERN SEARCH ALGORITHM;

CHEMICAL ENGINEERING;

LEARNING;

EID: 23944482252     PISSN: 02638762     EISSN: None     Source Type: Journal    
DOI: 10.1205/cherd.03144     Document Type: Article

References (42)

1. Banerjee, A., Arkun, Y., Ogunnaike, B. and Pearson, R., 1997, Estimation of non-linear systems using linear multiple models, AIChE J, 43(5): 1204-1226.
2. Bishop, C.M., 1995, Neural Networks for Pattern Recognition (Oxford University Press, Oxford, UK).
3. Blake, C.L. and Merz, C.J., 1998, UCI Repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, CA, USA, http://www.ics.uci.edu/~mlearn/ MLRepository.html
4. Breiman, L., 1994, Bagging Predictors, Technical Report 421, Department of Statistics, University of California, Berkley, USA.
5. Davis, L., 1987, Genetic Algorithms and Simulated Annealing (Pitman, London, UK).
6. Dennis, J.E. and Torczon, V.J., 1994, Derivative-free pattern search methods for multidisciplinary design problems, in Proceedings of the 5th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Panama City, Florida, USA, September 7-9, paper AIAA-94-4349, 922-932.
7. Drucker, H., Burges, C.J.C., Kaufman, L., Smola, A. and Vapnik, V., 1997, Support vector regression machines, in Mozer, M.C., Jordan, M.I. and Petsche, T. (eds)., Advances in Neural Information Processing Systems, Vol. 9, 155-161 (MIT Press, Cambridge, MA, USA).
8. Espinosa, G., Yaffe, D., Cohen, Y., Arenas, A. and Giralt, F., 2000, Neural network based quantitative structural property relations (QSPRs) for predicting boiling points of aliphatic hydrocarbons, J Chem Inf Comput Sci, 40: 859-879.
9. Fletcher, R., 1987, Practical Methods of Optimization (Wiley, New York, USA).
10. Gao, L. and Loney, N.W., 2001, Evolutionary polymorphic neural network in chemical process modelling, Comp Chem Eng, 25(11-12): 1403-1410.
11. Goll, E.S. and Jurs, P.C., 1999, Prediction of the normal boiling points of organic compounds from molecular structures with a computational neural network model, J Chem Inf Comput Sci, 39: 974-983.
12. Golub, G.H. and Van Loan, C.F., 1989, Matrix Computations (Johns Hopkins University Press, Baltimore, MD, USA).
13. Gunn, S.R., 1997, Support Vector Machines for Classification and Regression, Technical Report, Image Speech and Intelligent Systems Research Group, University of Southampton, http://www.ecs.soton.ac.uk/ ~srg/publications/pdf/SVM.pdf.
14. Harrison, D. and Rubinfeld, D.L., 1978, Hedonic housing prices and the demand for clean air, J Environ Econ Manag, 5: 81-102.
15. Hestenes, M.R. and Stiefel, E., 1952, Methods of conjugate gradients for solving linear systems, J Res Natl Bur Stand, 49: 409-436.
16. Hornik, K., Stinchcombe, M. and White, H., 1989, Multilayer feed forward networks are universal approximators, Neural Networks, 2: 359-366.
17. Jade, A.M., Srikanth, B., Jayaraman, V.K., Kulkarni, B.D., Jog, J.P. and Priya, L., 2003, Feature extraction and denoising using kernel PCA, Chem Eng Sci, 58(19): 4441-4448.
18. Killory, H., Rössler, O.E. and Hudson, J.L., 1987, Higher chaos in a four variable chemical reaction model, Physics Letters A, 122: 341-345.
19. Lewis, R. and Torczon, V., 1996, Pattern search algorithms for bound constrained minimization, SIAM J Optimization, 9: 1082-1099.
20. Lucic, B. and Trinajstic, N., 1999, A new efficient approach for variable selection based on multiregression: prediction of gas chromatographic retention times and response factors, J Chem Inf Comput Sci, 39: 610-621.
21. Lucic, B., Amic, D. and Trinajstic, N., 2000, Nonlinear multivariate regression outperforms several concisely designed neural networks on three QSPR data sets, J Chem Inf Comput Sci, 40: 403-413.
22. Mackey, M. and Glass, L., 1977, Oscillation and chaos in physiological control systems, Science, 197: 287-289.
23. Mwembeshi, M.M., Kent, C.A. and Salhi, S., 2001, An approach to robust and flexible modeling and control of pH in reactors, Trans IChemE, Part A, Chem Eng Res Des, 79(3): 323-334.
24. Pedrycz, W., Chun, M.G. and Succi, G., 2003, N4: computing with neural receptive fields, Neurocomputing, 55: 383-401.
25. Poggio, T. and Girosi, F., 1990, Networks for approximation and learning, Proceedings of IEEE, 78(9): 1481-1497.
26. Rosipal, R., Girolami, K., Trejo, L.J. and Cichocki, A., 2001, Kernel PCA for feature extraction and de-noising nonlinear regression, Neural Comput Applic, 10: 231-243.
27. Saunders, C., Gammerman, A. and Vovk, V., 1998, Ridge regression learning algorithm in dual variables, Proceedings of the 15th International Conference on Machine Learning (ICML'98), Morgan Kaufmann, San Francisco, CA, USA, 515-521.
28. Smith, M. and Johansen, T.A., 1997, Multiple Model Approaches to Modeling and Control (Taylor and Francis, London, UK).
29. Smola, A., 1999, Learning with kernels, Ph.D. thesis, GMD, Birlinghoven, Germany.
30. Smola, A. and Schölkopf, B., 1998, A tutorial on support vector regression, NeuroCOLT2 Technical Report NC-TR-98-030, Royal Holloway College, University of London, UK.
31. Suykens, J.A.K. and Vandewalle, J., 1998, Nonlinear Modeling: Advanced Black-Box Techniques (Kluwer Academic Publishers, Boston, USA).
32. Suykens, J.A.K. and Vandewalle, J., 1999, Least squares support vector machine classifiers, Neural Processing Letters, 9(3): 293-300.
33. Suykens, J.A.K., Lukas, L., Van Dooren, P., De Moor, B. and Vandewalle, J., 1999, Least squares support vector machine classifiers: a large scale algorithm, European Conference on Circuit Theory and Design, (ECCTD'99), Stresa Italy, 839-842.
34. Suykens, J.A.K., Lukas, L. and Vandewalle, J., 2000, Sparse least squares support vector machine classifiers, in European Symposium on Artificial Neural Networks (ESANN 2000), Bruges Belgium, 37-42.
35. Suykens, J.A.K., De Brabanter, J., Lukas, L. and Vandewalle, J. 2002a, Weighted least squares support vector machines: robustness and sparse approximation, Neurocomputing, 48: 85-105.
36. Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B. and Vandewalle, J., 2002b, Least Squares Support Vector Machines, (ISBN 981-238-151-1) (World Scientific, Singapore).
37. Vapnik, V.N., 1995, The Nature of Statistical Learning Theory (Springer, New York, USA).
38. Vapnik, V., Golowich, S. and Smola, A., 1997, Support vector method for function approximation, regression estimation, and signal processing, in Mozer, M.C., Jordan, M.I. and Petsche, T. (eds), Advances in Neural Information Processing Systems, Vol. 9, 281-287 (MIT Press, Cambridge, MA, USA).
39. Venkatasubramanian, V., Rengaswamy, R. and Kavuri, S.N., 2003, A review of process fault detection and diagnosis. Part II: Qualitative models and search strategies, Comp Chem Eng, 27(3): 313-326.
40. Weston, J., Elisseeff, A., Bakir, G. and F. Sinz, 2005, Spider v1.6: an object oriented machine learning library, http://www.kyb.tuebingen.mpg. de/bs/people/spider/index.html.
41. Yang, S.H., Chung, P.W.H. and Brooks, B.W., 1999, Multi-stage modeling of a semi-batch polymerization reactor using artificial neural networks, Trans IChemE, Part A, Chem Eng Res Des, 77(8): 779-783.
42. Zamprogna, E., Barolo M. and Seborg, D.E., 2001, Composition estimations in a middle-vessel batch distillation column using artificial neural networks, Trans IChemE, Part A, Chem Eng Res Des, 79: 689-696.