Multi-output regression using a locally regularised orthogonal least-squares algorithm

IEE Proceedings: Vision, Image and Signal Processing

Volumn 149, Issue 4, 2002, Pages 185-195

  Chen, S ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; LEARNING ALGORITHMS; LEAST SQUARES APPROXIMATIONS; MARKOV PROCESSES; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; MONTE CARLO METHODS; NONLINEAR SYSTEMS; RADIAL BASIS FUNCTION NETWORKS; REGRESSION ANALYSIS; SAMPLING; VARIATIONAL TECHNIQUES;

BAYESIAN LEARNING; DATA MODELLING; LOCALLY REGULARISED ORTHOGONAL LEAST SQUARES ALGORITHM; MULTI-OUTPUT REGRESSION;

LEARNING SYSTEMS;

EID: 0036697720     PISSN: 1350245X     EISSN: None     Source Type: Journal    
DOI: 10.1049/ip-vis:20020401     Document Type: Article

References (19)

1. CHEN, S., BILLINGS, S.A., and LUO, W.: 'Orthogonal least squares methods and their application to non-linear system identification', Int. J. Control, 1989, 50, (5), pp. 1873-1896
2. CHEN, S., COWAN, C.F.N., and GRANT, P.M.: 'Orthogonal least squares learning algorithm for radial basis function networks', IEEE Trans. Neural Netw., 1991, 2, (2), pp. 302-309
3. FRIEDMAN, J.H.: 'Multivariate adaptive regression splines', Ann. Stat., 1991, 19, (1), pp. 1-141
4. KAVLI, T.: 'ASMOD: an algorithm for adaptive spline modeling of observation data', Int. J. Control, 1993, 58, (4), pp. 947-968
5. BROWN, M., and HARRIS, C.J.: 'Neurofuzzy adaptive modeling and control' (Prentice-Hall, Englewood Cliffs, NJ, 1994)
6. CHEN, S.: 'Basis pursuit'. PhD thesis, Department of Statistics, Stanford University, 1995
7. HOERL, A.E., and KENNARD, R.W.: 'Ridge regression: biased estimation for non-orthogonal problems', Technometrics, 1970, 12, pp. 55-67
8. BISHOP, C.M.: 'Improving the generalisation properties of radial basis function neural networks', Neural Comput., 1991, 3, (4), pp. 579-588
9. CHEN, S., CHNG, E.S., and ALKADHIMI, K.: 'Regularised orthogonal least squares algorithm for constructing radial basis function networks', Int. J. Control, 1996, 64, (5), pp. 829-837
10. MACKAY, D.J.C.: 'Bayesian interpolation', Neural Comput., 1992, 4, (3), pp. 415-447
11. KANDOLA, J.S.: 'Interpretable modelling with sparse kernels'. PhD thesis, Department of Electronics and Computer Science, University of Southampton, UK, 2001
12. TIPPING, M.E.: 'The relevance vector machine' in SOLLA, S.A., LEEn, T.K., and MÜLLER, K.-R. (Eds.,): 'Advances in neural information processing systems 12' (MIT Press, Cambridge, MA, 2000)
13. CHEN, S.: 'Kernel-based data modelling using orthogonal least squares selection with local regularisation'. Proceedings of the 7th Annual Chinese Automation and Computer Science Conference in UK, Nottingham, UK, 2001 pp. 27-30
14. BILLINGS, S.A., CHEN, S., and KORENBERG, M.J.: 'Identification of MIMO non-linear systems using a forward-regression orthogonal estimator', Int. J. Control, 1989, 49, pp. 2157-2189
15. CHEN, S., GRANT, P.M., and COWAN, C.F.N.: 'Orthogonal least squares algorithm for training multi-output radial basis function networks', IEE Proc. F, Radar Signal Process, 1992, 139, (6), pp. 378-384
16. BILLINGS, S.A., and CHEN, S.: 'Extended model set, global data and threshold model identification of severely non-linear systems', Int. J. Control, 1989, 50, (5), pp. 1897-1923
17. LEONTARITIS, I.J., and BILLINGS, S.A.: 'Model selection and validation methods for non-linear systems', Int. J. Control, 1987, 45, (1), pp. 311-341
18. JENKINS, G.M., and WATTS, D.G.: 'Spectral analysis and its applications' (Holden-Day, San Francisco, 1996), Appendix A11.3
19. CHEN, S., and WIGGER, J.: 'Fast orthogonal least squares algorithm for efficient subset model selection', IEEE Trans. Signal Process., 1995, 43, (7), pp. 1713-1715