Generalization bounds of ERM-based learning processes for continuous-time markov chains

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 12, 2012, Pages 1872-1883

  Zhang, Chao ^a,b   Tao, Dacheng ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b ARIZONA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Convergence; deviation inequality; empirical risk minimization; generalization bound; Markov chain; rate of convergence; statistical learning theory

Indexed keywords

CONVERGENCE; DEVIATION INEQUALITIES; EMPIRICAL RISK MINIMIZATION; GENERALIZATION BOUND; RATE OF CONVERGENCE; STATISTICAL LEARNING THEORY;

APPROXIMATION THEORY; MARKOV PROCESSES;

LEARNING SYSTEMS;

EID: 84876897651     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2217987     Document Type: Article

References (28)

1. V. N. Vapnik, "An overview of statistical learning theory," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 988-999, Sep. 1999.
2. O. Bousquet, S. Boucheron, and G. Lugosi, "Introduction to statistical learning theory," in Advanced Lectures on Machine Learning, O. Bousquet, Ed. New York: Springer-Verlag, 2004, pp. 169-207.
3. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
4. A. van der Vaart and J. Wellner, Weak Convergence and Empirical Processes with Applications to Statistics (Hardcover). New York: Springer-Verlag, 2000.
5. A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth, "Learnability and the Vapnik-Chervonenkis dimension," J. ACM, vol. 36, no. 4, pp. 929-965, 1989.
6. D. Zhou, "Capacity of reproducing kernel spaces in learning theory," IEEE Trans. Inf. Theory, vol. 49, no. 7, pp. 1743-1752, Jul. 2003.
7. C. Zhang, W. Bian, D. Tao, and W. Lin, "Discretized-Vapnik- Chervonenkis dimension for analyzing complexity of real function classes," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 9, pp. 1461-1472, Sep. 2012.
8. P. L. Bartlett, O. Bousquet, and S. Mendelson, "Local Rademacher complexities," Ann. Stat., vol. 33, no. 4, pp. 1497-1537, 2005.
9. Z. Hussain and J. Shawe-Taylor, "Improved loss bounds for multiple kernel learning," J. Mach. Learn. Res., vol. 15, pp. 370-377, Dec. 2011.
10. M. Mohri and A. Rostamizadeh, "Rademacher complexity bounds for non-i.i.d. processes," in Proc. Neural Inf. Process. Syst., 2008, pp. 1097-1104.
11. M. Mohri and A. Rostamizadeh, "Stability bounds for stationary ?-mixing and β-mixing processes," J. Mach. Learn. Res., vol. 11, pp. 798-814, Feb. 2010.
12. C. Zhang and D. Tao, "Risk bounds for Lévy processes in the PAClearning framework," J. Mach. Learn. Res., vol. 9, pp. 948-955, Dec. 2010.
13. B. Yu, "Rates of convergence for empirical processes of stationary mixing sequences," Ann. Probab., vol. 22, no. 1, pp. 94-116, 1994.
14. C. Houdré and P. Marchal, "Median, concentration and fluctuations for Lévy processes," Stochastic Processes Appl., vol. 118, pp. 852-863, Aug. 2008.
15. K.-R. Müller, A. Smola, G. Rätsh, B. Schölkopf, J. Kohlmorgen, and V. Vapnik, "Predicting time series with support vector machines," in Proc. 7th Int. Conf. Artif. Neural Netw., 1997, pp. 1-7.
16. S. Mukherjee, E. Osuna, and F. Girosi, "Nonlinear prediction of chaotic time series using support vector machines," in Proc. IEEE Workshop Neural Netw. Signal Process., Sep. 1997, pp. 511-520.
17. K.-J. Kim, "Financial time series forecasting using support vector machines," Neurocomputing, vol. 55, nos. 1-2, pp. 307-319, 2003.
18. M. Biguesh and A. B. Gershman, "Training-based MIMO channel estimation: A study of estimator tradeoffs and optimal training signals," IEEE Trans. Signal Process., vol. 54, no. 3, pp. 884-893, Mar. 2006.
19. D. Love, R. Heath, V. Lau, D. Gesbert, B. Rao, and M. Andrews, "An overview of limited feedback in wireless communication systems," IEEE J. Sel. Areas Commun., vol. 26, no. 8, pp. 1341-1365, Oct. 2008.
20. A. Tulino, A. Lozano, and S. Verdú, "Impact of antenna correlation on the capacity of multiantenna channels," IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2491-2509, Jul. 2005.
21. M. Sanchez-Fernandez, M. de-Prado-Cumplido, J. Arenas-Garcia, and F. Perez-Cruz, "SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2298-2307, Aug. 2004.
22. A. Sutivong, M. Chiang, T. M. Cover, and Y.-H. Kim, "Channel capacity and state estimation for state-dependent Gaussian channels," IEEE Trans. Inf. Theory, vol. 51, no. 4, pp. 1486-1495, Apr. 2005.
23. A. Joulin, "Poisson-type deviation inequalities for curved continuoustime Markov chains," Bernoulli, vol. 13, no. 3, pp. 782-798, 2007.
24. M. Chen, From Markov Chains to Non-Equilibrium Particle Systems, 2nd ed. Singapore: World Scientific, 2004.
25. Y. Ollivier, "Ricci curvature of Markov chains on metric spaces," J. Funct. Anal., vol. 256, no. 3, pp. 810-864, 2009.
26. Q. Zhu and J. Cao, "Stability analysis of Markovian jump stochastic BAM neural networks with impulse control and mixed time delays," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 467-479, Mar. 2012.
27. S. Mendelson, "A few notes on statistical learning theory," in Advances in Lectures on Computer Science, vol. 2600. New York: Springer-Verlag, 2003, pp. 1-40.
28. D. Zhou, "The covering number in learning theory," J. Complexity, vol. 18, no. 3, pp. 739-767, 2002.