A division algebraic framework for multidimensional support vector regression

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 2, 2010, Pages 517-528

  Shilton, Alistair ^a   Lai, Daniel T H ^b   Palaniswami, Marimuthu ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b VICTORIA UNIVERSITY   (Australia)

Author keywords

Clifford algebra; Complex numbers; Division algebra; Multidimensional regression; Multiple input multiple output (MIMO); Quaternions; Support vector regression (SVR)

Indexed keywords

CLIFFORD ALGEBRA; COMPLEX NUMBER; DIVISION ALGEBRAS; MULTIPLE INPUT MULTIPLE OUTPUT; SUPPORT VECTOR REGRESSIONS;

REGRESSION ANALYSIS; VECTORS;

ALGEBRA;

EID: 77949774358     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2028314     Document Type: Article

References (47)

1. V. Vapnik, S. Golowich, and A. Smola, "Support vector methods for function approximation, regression estimation, and signal processing," in Advances in Neural Information Processing Systems, vol.9. Cambridge, MA: MIT Press, 1997, pp. 187-281.
2. C. Cortes and V. Vapnik, "Support vector networks," Machine Learning, vol.20, no.3, pp. 273-297, 1995.
3. A. Shilton, "Design and training of support vector machines," Ph.D. dissertation, The University of Melbourne, 2006. [Online]. Available: http://www.ee.unimelb.edu.au/staff/apsh/publications/
4. M. Sánchez-Fernández, M. de Prade-Cumplido, J. Arenas-García, and F. Pérez-Cruz, "SVM multiregression for non linear channel estimation in multiple-input multiple-output systems," IEEE Trans. Signal Process., vol.58, no.8, pp. 2298-2307, Aug. 2004.
5. E. Bayro-Corrochano and R. Vallejo, "Geometric neural networks and support multi-vector machines," in Proc. of IJCNN'2000, 2000, pp. 389-394.
6. D. Komura, H. Nakamura, S. Tsutsumi, H. Aburatani, and S. Ihara, "Multidimensional support vector machines for visualization of gene expression data," Bioinformatics, vol.21, no.4, pp. 439-444, 2005.
7. J. Weston, O. Chapelle, A. Elisseeff, and V. Vapnik, "Kernel dependency estimation,"Max Planck Institute for Biological Cybernetics, Tech. Rep. 098, Aug. 2002.
8. M. Mizuta, "Algebraic curve and surface fitting tomultidimensional data," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Comput. Cybern. Simul., Oct. 1997, vol.1, pp. 52-57.
9. K.-S. Leung, M.-L. Wong, W. Lam, Z. Wang, and K. Xu, "Learning nonlinear multiregression networks based on evolutionary computation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.32, no.5, pp. 630-644, Oct. 2002.
10. X. Shen, H. Yan, W. Yan, and L. Guo, "Estimating regional conductivity in 2D disc head model by multidimensional support vector regression," in Proc. 29th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., Aug. 2007, pp. 4915-4918.
11. J. J. Pan, J. T. Kwok, Q. Yang, and Y. Chen, "Multidimensional vector regression for accurate and low-cost location estimation in pervasive computing," IEEE Trans. Knowl. Data Eng., vol.18, no.9, pp. 1181-1193, Sep. 2006.
12. E. N. Lorenz, "Deterministic nonperiodic flow," J. Atmos. Sci., vol.20, pp. 130-141, Mar. 1963.
13. A. Sudbery, "Quaternionic analysis," Cambridge Philosophical Society, vol.85, pp. 199-225, 1979.
14. J. B. Kuipers, Quaternions and Rotation Sequences: A Primer With Applications to Orbits, Aerospace and Virtual Reality. Princeton, 1999.
15. W. R. Hamilton, "On quaternions: Or a new system of imaginaries in algebra," Phil. Mag., vol.25, p. 210, 1845. ser. 3.
16. E. Bayro-Corrochano and R. Vallejo, "SVMs using geometric algebra for 3D computer vision," in Proc. IEEE/INNS IJCNN, 2001, pp. 872-877.
17. F. Pérez-Cruz, G. Camps-Valls, E. Soria-Olivas, J. J. Pérez-Ruixo, A. R. Figueiras-Vidal, and A. Artés-Rodríguez, "Multi-dimensional function approximation and regression estimation," in Proc. ICANN, Aug. 2002.
18. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme learning machine: Theory and applications," Neurocomputing, vol.70, pp. 489-501, 2006.
19. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Trans. Neural Netw., vol.17, no.4, pp. 879-892, 2006.
20. M.-B. Li, G.-B. Huang, P. Saratchandran, and N. Sundararajan, "Fully complex extreme learning machine," Neurocomputing, vol.68, pp. 306- 314, 2005.
21. J. Baez, "The octonions," Bull. Amer. Math. Soc., vol.39, pp. 145-205, 2002.
22. R. Calderbank, S. Das, N. Al-Dhahir, and S. Diggavi, "Construction and analysis of a new quaternionic space-time code for 4 transmit antennas," Commun. Inf. Syst., vol.5, no.1, pp. 1-26, 2005.
23. J. H. Conway and D. A. Smith, On Quaternions and Octonions: Their Geometry, Arithmetic and Symmetry. Wellesley, MA: A. K. Peters, 2003.
24. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge: Press Syndicate of the University of Cambridge, 2004.
25. A. Ben Tal and A. Nemirovski, Lectures on Modern Convex Optimization. Philadelphia: SIAM, 2001. ser. MPS-SIAM Series on Optimization.
26. A. Nemirovski, Lectures on Modern Convex Optmization (C.O.R.E. Summer School on Modern Convex Optimization), 2005. [Online]. Available: http://www2.isye.gatech.edu/nemirovs/
27. A. Smola, "Regression estimation with support vector learning machines," Master's thesis, Technische Universität Münschen, 1996.
28. B. Schölkopf, P. Bartlett, A. J. Smola, and R.Williamson, "Support vector regression with automatic accuracy control," in Proc. ICANN98, Perspectives in Neural Computing, L. Niklasson, M. Boden, and T. Ziemke, Eds., Springer Verlag, 1998, pp. 111-116.
29. J. Mercer, "Functions of positive and negative type, and their connection with the theory of integral equations," Trans. R. Soc. Lond., vol. 209, no. A, 1909.
30. J. A. K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle, Least Squares Support Vector Machines. New Jersey: World Scientific Publishing, 2002.
31. C. R. Rao and S. K. Mitra, Generalized Inverse of Matrices and Its Application. New York: Wiley, 1971.
32. D. Serre, Matrices: Theory and Applications. New York: Springer, 2002.
33. A. Shilton, D. Lai, and M. Palaniswami, "A monomial v-SV method for regression," Monash University, Tech. Rep. MECSE-24-2005, 2005.
34. A. Smola, N. Murata, B. Schölkopf, and K.-R. Müller, "Asymptotically optimal choice ofepsi-loss for support vector machines," in Proc. 8th Int. Conf. Artif. Neural Netw.-Perspectives in Neural Computing, L. Niklasson, M. Boden, and T. Ziemke, Eds., Springer Verlag, 1998, pp. 105-110. [Online]. Available: citeseer.nj.nec.com/26614.html
35. A. Shiltonin "Mercer's theorem for quaternionic kernels," The University of Melbourne, Department of Electrical and Electronic Engineering, Melbourne, Australia, Tech. Rep. TR07-009, 2007. [Online]. Available: http://www.ee.unimelb.edu.au/staff/apsh/publications/
36. J. A. Cochran, The Analysis of Linear Integral Equations. McGraw-Hill Book Company, 1972.
37. H. Nguyen, J. Zhang, and B. Raghothaman, "A Kalman-filter approach to equalization of CDMA downlink channels," EURASIP J. Appl. Signal Process., vol.2005, no.1, pp. 611-625, 2005.
38. J. Lee, C. D. Beach, and N. Tepedelenlioglu, "Channel equalization using radial basis function network," in Proc. IEEE ICASSP, 1996, vol.3, pp. 1719-1722.
39. C.-J. Lina, S.-J. Honga, and C.-Y. Leeb, "Using least squares support vector machines for adaptive communication channel equalization," Int. J. Appl. Sci. Eng., vol.3, no.1, pp. 51-59, 2005.
40. S. Chen, G. J. Gibson, C. F. N. Cowan, and P. M. Grant, "Adaptive equalization of finite non-linear channels using multilayer perceptrons," EURASIP Signal Process., vol.20, pp. 107-119, Jun. 1990.
41. S. Chen, S. McLaughlin, and B. Mulgrew, "Complex-valued radial basis function network, Part II: Application to digital communications channel equalisation," Signal Process., vol.36, pp. 175-188, 1994.
42. S. Chen, "Multi-output regression using a locally regularised orthogonal least-squares algorithm," Proc. Inst. Elect. Eng.-Vision, Image Signal Process., vol.149, no.4, pp. 185-195, Aug. 2002.
43. J. Matías, "Multi-output nonparametric regression," Lecture Notes in Computer Science, no.3808, pp. 288-292, 2005.
44. M. Alvarez and N. D. Lawrence, "Sparse convolved Gaussian processes for multi-output regression," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2009.
45. A. Hirose, Complex-Valued Neural Networks. Springer, 2006.
46. T. Kim and T. Adali, "Fully complex multi-layer perceptron network for nonlinear signal processing," J. VLSI Signal Process. Syst. Signal Image Video Technol., vol.32, pp. 29-43, 2002.
47. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press, 2001.