On the equivalence of Hebbian learning and the SVM formalism

2012 46th Annual Conference on Information Sciences and Systems, CISS 2012

Volumn , Issue , 2012, Pages

  Nowotny, Thomas ^a   Huerta, Ramon ^b  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

^b UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY CLASSIFICATION PROBLEMS; FIRING RATES; HEBBIAN; HEBBIAN LEARNING; INSECT BRAIN; LARGE MARGIN CLASSIFIERS; MEMORY LOSS; OLFACTORY LEARNING; REINFORCEMENT SIGNAL; TWO-NEURON SYSTEM;

INFORMATION SCIENCE; NEURONS;

SUPPORT VECTOR MACHINES;

EID: 84868585218     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CISS.2012.6310939     Document Type: Conference Paper

References (17)

1. Abbott, L.F., & Regehr, w.G. (2004). Synaptic Computation. Nature 43, 796-803.
2. Heisenberg, M. (2003). Mushroom body memoir: From maps to models. Nat. Rev. Neurosci., 4(4), 266275
3. R Huerta, T Nowotny, M Garcia-Sanchez, HOI Abarbanel, M. L. Rabinovich. Learning classification in the olfactory system of insects. Neural computation, Vol. 16, No. 8, Pages 160 1-1640 (2004).
4. Huerta R, Nowotny T. Fast and robust learning by reinforcement signals: explorations in the insect brain. Neural Com put. 21 (8):2123-5L. (2009).
5. R. Huerta, S. Vembu, J. M. Amigo, T. Nowotny, C. Elkan. Inhibition in Multiclass Classification. Neural Comput. (2012).
6. S. Cassenaer, G Laurent. Conditional modulation of spike-timing dependent plasticity for olfactory learning. 482:47-52 (2012).
7. O. Chapelle, (2007) Training a support vector machine in the primal. Neural Computation, 19(5): 1 155-1 178.
8. L. Bottou, O. Bousquet, (2007) The tradeoffs of large learning. In Advances in Neural Information Processing Systems, 20.
9. Yin-Wen Chang, Cho-Jui Hsieh, Kai-Wei Chang, Michael Ringgaard and Chih-Jen Lin. (2010) Training and Testing Low-degree Polynomial Data Mappings via Linear SVM. Journal of Machine Learning Research, 1 1: 147 1-1490.
10. O'Reilly, R. C. (2001). Generalization in interactive networks: The benefits of inhibitory competition and Hebbian learning. Neural Computation 13, 1 199-124 1.
11. J. Kivinen, A. J. Smola, R. C. Williamson. (2004) Online Learning with Kernels, IEEE Transactions on Signal processing 100(10).
12. Nowotny, T., Huerta, R., Abarbanel, H. D. I., & Rabinovich, M. I. (2005). Self-organization in the olfactory system: One shot odor recognition in insects, Bioi. Cybern. 93 (6), 436-446.
13. Laurent, G. (2002). Olfactory Network Dynamics and the coding of multidimensional signals. Nat. Rev. New"osci. 3, 884-95.
14. Harvey, C.D., & Svoboda, K. (2007). Locally dynamic synaptic learning rules in pyramidal neuron dendrites. Nature 450, 1 195-1200.
15. Seung, H. S. (2003) Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40, 1063-73.
16. Shalev-Shwartz, S., Singer, Y., & Srebro, N. (2007) Pegasos: Primal Estimated sub-GrAdient SOlver for SVM. In Proceedings of the 24th international Conference on Machine Learning (Corvallis, Oregon, June 20-24, 2007). Z. Ghahramani, Ed. ICML '07, vol. 227. ACM, New York, NY, 807-814. 00]= http://doi.acm.org/IO. 1 145/ 1273496. 1273598.
17. Zhang, T, (2004) Solving large scale linear prediction problems using stochastic gradient descent algorithms, ICML '04: Proceedings of the twenty-first international conference on Machine learning, (isbn = 1-58 1 13-828-5) pages 1 16, Banff, Alberta, Canada, ACM, New York, NY, USA.