Hierarchical approach for multiscale support vector regression

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 9, 2012, Pages 1448-1460

  Bellocchio, Francesco ^a   Ferrari, Stefano ^a   Piuri, Vincenzo ^a   Borghese, Nunzio Alberto ^a  

^a UNIVERSITY OF MILAN   (Italy)

Author keywords

Multiple kernels; multiscale regression; support vector machine (SVM); support vector regression (SVR)

Indexed keywords

CONFIGURATION PARAMETERS; HIERARCHICAL APPROACH; LINEAR COMBINATIONS; MULTI-SCALE RECONSTRUCTION; MULTIPLE KERNELS; MULTISCALES; REGRESSION FUNCTION; SUPPORT VECTOR REGRESSION (SVR);

SUPPORT VECTOR MACHINES; VECTORS;

REGRESSION ANALYSIS;

EID: 84876933315     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2205018     Document Type: Article

References (36)

1. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
2. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
3. A. J. Smola and B. Schölkopf, "A tutorial on support vector regression," Stat. Comput., vol. 14, no. 3, pp. 199-222, 2004.
4. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semi-definite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Jan. 2004.
5. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, "Choosing multiple parameters for support vector machines," Mach. Learn., vol. 46, nos. 1-3, pp. 131-159, 2002.
6. Z. Wang, S. Chen, and T. Sun, "MultiK-MHKS: A novel multiple kernel learning algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 348-353, Feb. 2008.
7. M. Gönen and E. Alpaydin, "Localized multiple kernel learning," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 352-359.
8. M. Gönen and E. Alpayd?n, "Localized multiple kernel regression," in Proc. 20th IAPR Int. Conf. Pattern Recognit., 2010, pp. 1425-1428.
9. D. Zheng, J. Wang, and Y. Zhao, "Non-flat function estimation with a multi-scale support vector regression," Neurocomputing, vol. 70, nos. 1-3, pp. 420-429, 2006.
10. H. Peng and J. Wang, "Nonlinear system identification based on multiresolution support vector regression," in Proc. Int. Conf. Neural Netw. Brain, vol. 1. 2005, pp. 240-243.
11. J. E. Moody, "Fast learning in multi-resolution hierarchies," in Neural Information Processing Systems. San Francisco, CA: Morgan Kaufmann, 1988, pp. 29-39.
12. S. Ferrari, M. Maggioni, and N. A. Borghese, "Multi-scale approximation with hierarchical radial basis functions networks," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 178-188, Jan. 2004.
13. S. Ferrari, F. Bellocchio, V. Piuri, and N. A. Borghese, "A hierarchical RBF online learning algorithm for real-time 3-D scanner," IEEE Trans. Neural Netw., vol. 21, no. 2, pp. 275-285, Feb. 2010.
14. C. K. Reddy and J. H. Park, "Multi-resolution boosting for classification and regression problems," in Proc. 13th Pacific-Asia Conf. Adv. Knowl. Discovery Data Mining, 2009, pp. 196-207.
15. F. Steinke, B. Schölkopf, and V. Blanz, "Support vector machines for 3D shape processing," Comput. Graph. Forum, vol. 24, no. 3, pp. 285-294, 2005.
16. R. E. Schapire, "A brief introduction to boosting," in Proc. Int. Joint Conf. Artif. Intell., 1999, pp. 1401-1406.
17. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, pp. 119-139, Aug. 1997.
18. N. Duffy and D. Helmbold, "Boosting methods for regression," Mach. Learn., vol. 47, pp. 153-200, May 2002.
19. X. Liang, "An effective method of pruning support vector machine classifiers," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 26-38, Jan. 2010.
20. G. M. Fung, O. L. Mangasarian, and A. J. Smola, "Minimal kernel classifiers," J. Mach. Learn. Res., vol. 3, pp. 2303-321, Mar. 2002.
21. S. S. Keerthi, O. Chapelle, and D. D. Coste, "Building support vector machines with reduced classifier complexity," J. Mach. Learn. Res., vol. 7, pp. 1493-1515, Jul. 2006.
22. J. Guo, N. Takahashi, and T. Nishi, "An efficient method for simplifying decision functions of support vector machines," IEICE Trans. Fundam. Electron. Commun. Comput. Sci., vol. E89-A, no. 10, pp. 2795-2802, Oct. 2006.
23. X. Zeng and X. Chen, "SMO-based pruning methods for sparse least squares support vector machines," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1541-1546, Nov. 2005.
24. D. Nguyen and T. Ho, "An efficient method for simplifying support vector machines," in Proc. 22nd Int. Conf. Mach. Learn., 2005, pp. 617-624.
25. I. W. Tsang, J. T. Kwok, and P.-M. Cheung, "Core vector machines: Fast SVM training on very large data sets," J. Mach. Learn. Res., vol. 6, pp. 363-392, Apr. 2005.
26. T. Joachims, "Making large-scale SVM learning practical," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. Burges, and A. Smola, Eds. Cambridge, MA: MIT Press, 1999, ch. 11, pp. 169-184.
27. D. Wang, X.-B. Wu, and D.-M. Lin, "Two heuristic strategies for searching optimal hyper parameters of C-SVM," in Proc. 8th Int. Conf. Mach. Learn. Cybern., 2009, pp. 3690-3695.
28. Y. Tang, W. Guo, and J. Gao, "Efficient model selection for support vector machine with Gaussian kernel function," in Proc. IEEE Symp. Comp. Intell. Data Mining, Apr. 2009, pp. 40-45.
29. A. J. Smola, N. Murata, B. Schölkopf, and K.-R. Müller, "Asymptotically optimal choice of-loss for support vector machines," in Proc. 8th Int. Conf. Artif. Neural Netw., Perspect. Neural Comput., 1998, pp. 105-110.
30. Heteroscedastic Kernel Ridge Regression Demo. (2005, Jul.) [Online]. Available: http://theoval.cmp.uea.ac.uk/matlab/hkrr-demo/hkrr-demo.m
31. UCI Machine Learning Repository. (1993, Jul. 7) [Online]. Available: http://archive.ics.uci.edu/ml/datasets/Housing
32. S. Qiu and T. Lane, "Multiple kernel learning for support vector regression," Dept. Comput. Sci., Univ. New Mexico, Albuquerque, Tech. Rep. TR-CS-2005-42, 2005.
33. M. Hasenjäger and H. Ritter, "New learning paradigms in soft computing," in Active Learning in Neural Networks. Heidelberg, Germany: Physica-Verlag GmbH, 2002, pp. 137-169.
34. T. M. Martinetz, S. G. Berkovich, and K. J. Schulten, "'Neuralgas' network for vector quantization and its application to time-series prediction," IEEE Trans. Neural Netw., vol. 4, no. 4, pp. 558-568, Jul. 1993.
35. D. Wunsch and R. Xu, Clustering. Piscataway, NJ: IEEE Press, 2008.
36. F. Girosi, M. Jones, and T. Poggio, "Regularization theory and neural networks architectures," Neural Comput., vol. 7, no. 2, pp. 219-269, 1995.