Regularized stochastic BFGS algorithm

2013 IEEE Global Conference on Signal and Information Processing, GlobalSIP 2013 - Proceedings

Volumn , Issue , 2013, Pages 1109-1112

  Mokhtari, Aryan ^a   Ribeiro, Alejandro ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HIGH-DIMENSIONAL PROBLEMS; LARGE-SCALE MACHINE LEARNING; NUMBER OF ITERATIONS; NUMERICAL EXPERIMENTS; OPTIMIZATION PROBLEMS; QUASI-NEWTON METHODS; STOCHASTIC GRADIENT DESCENT; STOCHASTIC GRADIENT DESCENT ALGORITHM;

DATA PROCESSING; NEWTON-RAPHSON METHOD; OPTIMIZATION; TIME VARYING NETWORKS;

STOCHASTIC SYSTEMS;

EID: 84897694467     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GlobalSIP.2013.6737088     Document Type: Conference Paper

References (10)

1. V. Vapnik, The nature of statistical learning theory, 2nd ed. springer, 1999.
2. L. Bottou, "Large-scale machine learning with stochastic gradient descent," In Proceedings of COMPSTAT'2010, pp. 177-186, Physica-Verlag HD, 2010.
3. A. Mokhtari and A. Ribeiro, "A dual stochastic dfp algorithm for optimal resource allocation in wireless systems," In Proc. IEEE Workshop on Signal Process. Advances in Wireless Commun., (to appear), Darmstadt, Germany, June 16-19 2013.
4. A. Ribeiro, "Optimal resource allocation in wireless communication and networking," EURASIP J. Wireless commun., vol. 2012, no. 272, pp. 3727-3741, August 2012.
5. S. Shalev-Shwartz, Y. Singer, and N. Srebro, "Pegasos: Primal estimated subgradient solver for svm," In Proceedings of the 24th international conference on Machine learning, pp. 807-814, ACM, 2007.
6. T. Zhang, "Solving large scale linear prediction problems using stochastic gradient descent algorithms," In Proceedings of the twenty-first international conference on Machine learning, p. 919926, ACM, 2004.
7. R. H. Byrd, J. Nocedal, and Y. Yuan, "Global convergence of a class of quasi-newton methods on convex problems," SIAM J. Numer. Anal., vol. 24, no. 5, pp. 1171-1190, October 1987.
8. J. Nocedal and S. J. Wright, Numerical optimization, 2nd ed. New York, NY: Springer-Verlag, 1999.
9. N. N. Schraudolph, J. Yu, and S. Gnter, "A stochastic quasi-newton method for online convex optimization," In Proc. 11th Intl. Conf. on Artificial Intelligence and Statistics (AIstats), p. 433 440, Soc. for Artificial Intelligence and Statistics, 2007.
10. A. Mokhtari and A. Ribeiro, "Regularized stochastic bfgs algorithm," https: //fling.seas.upenn.edu/-aryanm/wiki/ index.php?n=Research.Publications.