Recurrent sparse support vector regression machines trained by active learning in the time-domain

Expert Systems with Applications

Volumn 39, Issue 12, 2012, Pages 10933-10942

  Ceperic, V ^a,b   Gielen, G ^a   Baric, A ^b  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF ZAGREB   (Croatia)

Author keywords

Active learning; Recurrent models; Sparse models; Support vector machines; Support vector regression

Indexed keywords

ACTIVE LEARNING; ACTIVE LEARNING PRINCIPLES; SPARSE REPRESENTATION; SPARSE SOLUTIONS; SUPPORT VECTOR; SUPPORT VECTOR REGRESSION (SVR); SUPPORT VECTOR REGRESSION MACHINES; SUPPORT VECTOR REGRESSION METHOD; TIME DOMAIN; TIME-DOMAIN DATA; TRAINING DATA; TRAINING TIME;

REGRESSION ANALYSIS; SUPPORT VECTOR MACHINES; VECTORS;

TIME DOMAIN ANALYSIS;

EID: 84861201931     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.03.031     Document Type: Article

References (54)

1. Anon.; 2002. Adaptive Nonlinear System Identification with Echo State Networks, MIT Press, Cambridge, MA.
2. A.F. Atiya, and A.G. Parlos New results on recurrent network training: Unifying the algorithms and accelerating convergence IEEE Transactions on Neural Networks 11 2000 697 709
3. Bao, Y.; Lu, Y.; Zhang, J. (2004). Forecasting stock price by SVMs regression. In Artificial Intelligence: Methodology, Systems, and Applications, Lecture Notes in Computer Science, Springer Berlin/ Heidelberg, (pp. 295-303).
4. A. Ben-Hur, C.S. Ong, S. Sonnenburg, B. Schölkopf, and G. Rätsch Support Vector Machines and Kernels for Computational Biology PLoS Computational Biology 4 10 2008
5. Boser, B. E.; Guyon, I. M.; Vapnik, V.N. (1992). A training algorithm for optimal margin classifiers. In COLT '92: Proceedings of the fifth annual ACM workshop on computational learning theory, ACM, New York, NY, USA, (pp. 144-152).
6. K.D. Brabanter, J.D. Brabanter, J. Suykens, and B.D. Moor Optimized fixed-size kernel models for large data sets Computational Statistics & Data Analysis 54 6 2010 1484 1504
7. C. Cao, and J. Xu Short-Term Traffic Flow Predication Based on PSO-SVM Q. Peng, K.C.P. Wang, Y. Qiu, Y. Pu, X. Luo, B. Shuai, Proceedings of the First International Conference on Transportation Engineering Vol. 246 2007 American Society of Civil Engineers (ASCE) Chengdu, China 28
8. Ceperic, V.; Baric, A. (2004). Modeling of analog circuits by using support vector regression machines. In Proceedings of the 11th IEEE international conference on electronics, circuits and systems, ICECS 2004, (pp. 391-394).
9. Chang, C. -C.; Lin, C. -J. (2001). LIBSVM: A library for support vector machines, software available at .
10. C.-Y. Chang, H.-J. Wang, and C.-F. Li Semantic analysis of real-world images using support vector machine Expert Systems with Applications 36 7 2009 10560 10569
11. C. Cortes, and V. Vapnik Support-Vector Networks Machine Learning 20 3 1995 273 297
12. Drucker, H.; Burges, C. J. C.; Kaufman, L.; Smola, A. J.; Vapnik, V. (1996). Support Vector Regression Machines. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems 9, (pp. 155-161).
13. R.-E. Fan, P.-H. Chen, and C.-J. Lin Working Set Selection Using Second Order Information for Training Support Vector Machines Journal of Machine Learning Research 6 2005 1889 1918
14. Fei, S.; Liu, C.; Zeng, Q.; Miao, Y. (2008). Application of Particle Swarm Optimization-Based Support Vector Machine in Fault Diagnosis of Turbo-Generator. In IITA '08: Proceedings of the 2008 second international symposium on intelligent information technology application, IEEE Computer Society, Washington, DC, USA, (pp. 1040-1044).
15. M.A.T. Figueiredo Adaptive sparseness for supervised learning IEEE Transactions on Pattern Analysis and Machine Intelligence 25 9 2003 1150 1159
16. A. Graves, and J. Schmidhuber Framewise phoneme classification with bidirectional LSTM and other neural network architectures Neural Networks 18 5-6 2005 602 610 iJCNN 2005
17. B. Guo, S. Gunn, R. Damper, and J. Nelson Customizing kernel functions for SVM-based hyperspectral image classification IEEE Transactions on Image Processing 17 4 2008 622 629
18. G. Guo, J.-S. Zhang, and G.-Y. Zhang A method to sparsify the solution of support vector regression Neural Computing & Applications 19 1 2010 115 122
19. P.-Y. Hao, J.-H. Chiang, and Y.-K. Tu Hierarchically SVM classification based on support vector clustering method and its application to document categorization Expert Systems with Applications 33 3 2007 627 635
20. Härdle, W. K.; Moro, R.; Hoffmann, L. (2010). Learning Machines Supporting Bankruptcy Prediction, SFB 649 Discussion Paper 2010-032, Sonderforschungsbereich 649, Humboldt Universität zu Berlin, Germany.
21. G. Holzmann, and H. Hauser Echo state networks with filter neurons and a delay & sum readout Neural Networks 23 2 2010 244 256
22. W. Hong, and C. Lai Reliability forecasting by recurrent Support Vector Regression International Journal of Artificial Intelligence and Soft Computing 1 2008 114 129
23. Hsu, C. -W.; Chang, C. -C.; Lin, C. -J. (2003). A Practical Guide to Support Vector Classification, Tech. Rep.; Department of Computer Science and Information Engineering, National Taiwan University.
24. H. Jaeger, M. Lukosevicius, D. Popovici, and U. Siewert Optimization and applications of echo state networks with leaky- integrator neurons Neural Networks 20 3 2007 335 352 echo State Networks and Liquid State Machines
25. Jiang, J.; Ip, H. H. (2007). Dynamic Distance-Based Active Learning with SVM. In MLDM '07: Proceedings of the 5th international conference on machine learning and data mining in pattern recognition, Springer-Verlag, Berlin, Heidelberg, (pp. 296-309).
26. Jiang, M. -H.; Yuan, X. -C. (2007). Construction and Application of PSO-SVM Model for Personal Credit Scoring. In ICCS '07: Proceedings of the 7th international conference on Computational Science, Part IV, Springer-Verlag, Berlin, Heidelberg, (pp. 158-161).
27. Karush, W. (1939). Minima of functions of several variables with inequalities as side constraints, Master's thesis, University of Chicago.
28. S.S. Keerthi, S.K. Shevade, C. Bhattacharyya, and K.R.K. Murthy Improvements to Platt's SMO algorithm for SVM classifier design Neural Computation 13 3 2001 637 649
29. Kuhn, H. W.; Tucker, A. W. (1951). Nonlinear programming. In Proceedings of the 2nd Berkeley Symposium on Mathematical Statistics and Probabilistics, University of California Press, Berkeley.
30. T.-F. Kuo, and Y. Yajima Ranking and selecting terms for text categorization via SVM discriminate boundary International Journal of Intelligent Systems 25 2 2010 137 154
31. L.-x. Liu, Y.-q. Zhuang, and X.-y. Liu Tax forecasting theory and model based on SVM optimized by PSO Expert Systems with Applications 38 1 2011 116 120
32. G. Marsaglia, and W.W. Tsang The ziggurat method for generating random variables Journal of Statistical Software 5 8 2000 1 7
33. M. Mascagni, and A. Srinivasan Parameterizing parallel multiplicative lagged-Fibonacci generators Parallel Computing 30 7 2004 899 916
34. D. Mirikitani, and N. Nikolaev Recursive bayesian recurrent neural networks for time-series modeling IEEE Transactions on Neural Networks 21 2 2010 262 274
35. K. Narendra, and K. Parthasarathy Identification and control of dynamical systems using neural networks IEEE Transactions on Neural Networks 1 1 1990 4 27
36. A. Neumaier Solving ill-conditioned and singular linear systems: A tutorial on regularization SIAM Review 40 3 1998 636 666
37. Platt, J. C. (1999). Fast training of support vector machines using sequential minimal optimization. In Advances in kernel methods: Support vector learning, MIT Press, Cambridge, MA, USA, (pp. 185-208).
38. Qu, H.; Oussar, Y.; Dreyfus, G.; Xu, W. (2009). Regularized Recurrent Least Squares Support Vector Machines. In International joint conference on bioinformatics, systems biology and intelligent computing, 2009. IJCBS '09, (pp. 508-511).
39. V. Roth The generalized LASSO IEEE Transactions on Neural Networks 15 1 2004 16 28
40. J. Schmidhuber, M. Gagliolo, D. Wierstra, and F. Gomez Evolino for Recurrent Support Vector Machines M. Verleysen, ESANN '06 - 14 th European Symposium on Artificial Neural Networks 2006 Evere Belgium 593 598
41. J. Schmidhuber, D. Wierstra, M. Gagliolo, and F. Gomez Training recurrent networks by evolino Neural Computation 19 2007 757 779
42. B. Schölkopf, and A. Smola Learning with kernels: Support vector machines, regularization, optimization, and beyond (adaptive computation and machine learning) 2001 The MIT Press Cambridge, MA, USA
43. B. Schölkopf, A.J. Smola, R.C. Williamson, and P.L. Bartlett New support vector algorithms Neural Computation 12 5 2000 1207 1245
44. Settles, B. (2009). Active Learning Literature Survey, Computer Sciences Technical Report 1648, University of Wisconsin-Madison.
45. K.-S. Shin, T.S. Lee, and H.-J. Kim An application of support vector machines in bankruptcy prediction model Expert Systems with Applications 28 1 2005 127 135
46. A.J. Smola, and B. Schölkopf A tutorial on support vector regression Statistics and Computing 14 3 2004 199 222
47. J.A.K. Suykens Least squares support vector machines 2002 World Scientific River Edge, NJ
48. J. Suykens, and J. Vandewalle Recurrent least squares support vector machines IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 47 7 2000 1109 1114
49. M.E. Tipping Sparse bayesian learning and the relevance vector machine Journal of Machine Learning Reserach 1 2001 211 244
50. S. Tong, and D. Koller Support vector machine active learning with applications to text classification Journal of Machine Learning Research 2 2002 45 66
51. Vapnik, V.; Golowich, S. E.; Smola, A. (1996). Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing. In Advances in neural information processing systems 9, MIT Press, (pp. 281-287).
52. A. Vaz, and L. Vicente A particle swarm pattern search method for bound constrained global optimization Journal of Global Optimization 39 2 2007 197 219
53. Y. Xue, L. Yang, and S. Haykin Decoupled echo state networks with lateral inhibition Neural Networks 20 3 2007 365 376
54. W. Zhong, J. He, R. Harrison, P.C. Tai, and Y. Pan Clustering support vector machines for protein local structure prediction Expert Systems with Applications 32 2 2007 518 526