Dynamic hyperparameter scaling method for LVQ algorithms

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2006, Pages 3196-3203

  Seo, Sambu ^a   Obermayer, Klaus ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS; ONLINE SYSTEMS; PARAMETER ESTIMATION; VECTOR QUANTIZATION;

ANNEALING METHODS; DYNAMIC HYPERPARAMETER; HYPERPARAMETER SELECTION; MACHINE LEARNING REPOSITORY;

LEARNING ALGORITHMS;

EID: 40649125311     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. T. Kohonen, Self Oiganization Maps. New York: Springer-Verlag, 2001.
2. T. Kohonen, J. Hynninen, J. Kangas, J. Laaksonen, and K. Torkkola, Lvq Pak: The Learning Vector Quantization Program Package, 1995.
3. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Sohn Wiley & Sons, 2001.
4. T. Komori and S. Katagiri, "Application of a generalized probabilistic descent method to dynamic time warping-based speech recognition," in IEEE International Conference on Acoustics, Speech, and Signal Processing. 1992, pp. 497-500.
5. E. McDermott and S. Katagiri, "Prototype-based minimum classification error/generalized probabilistic descent training for various speech units," Computer Speech and Language, vol. 8, no. 4. pp. 351-368, 1994.
6. B. Weigelt, A. Glas, L. Wessels, A. Witteveen, J. Peterse, and L. Veer, "Gene expression profiles of primary breast tumors maintained in distant metastases," in Proceedings of the National Academy of Sciences of the United States of America, vol. 100, 2003, pp. 15901-15 905.
7. R. Tibshirani, T. Hastie, B. Narasimhan, and G. Chu, "Diagnosis of multiple cancer types by shrunken centroids of gene expression," in Proceedings of the National Academy of Sciences of the United States of America, vol. 99, 2002. pp. 6567-6572.
8. T. Kohonen, "Learning vector quantization," Helsinki Univ. of Tech., Otaniemi, Tech. Rep., 1986.
9. N. N. R. Centre, Bibliography on the Self-Oiganizing Map (SOM) and Learning Vector Quantization (LVQ), Helsinki Univ. of Tech., 2003, http://liinwww.ira.uka.de/bibliography/Neural/SOM.LVQ.html.
10. A. Sato and K. Yamada. "Generalized learning vector quantization," in Advances in Neural Information Processing Systems 8, D. Touretzky, M. Mozer, and M. Ha'sselmo, Eds. MIT Press, 1996, pp. 423-429.
11. K. Crammer, R. Gilad-Bachrach, A. Navot, and N. Tishby, "Margin analysis of the lvq algorithm," in Advances in Neural Information Processing Systems 15, S. Becker, S. Thrun, and K. Obermayer. Eds. MIT press., 2002.
12. S. Seo, M. Bode, and K. Obermayer, "Soft nearest prototype classification," IEEE Transactions on Neural Network, vol. 14, pp. 390-398, 2003.
13. S. Seo and K. Obermayer, "Soft learning vector quantization," Neural Computation, vol. 15. pp. 1589-1604, 2003.
14. Y. Bengio. "Gradient-based optimization of hyperparameters," Neural Computation, vol. 12, no. 8. pp. 1889-1900, 2000.
15. T. Kohonen. "Improved versions of learning vector quantization," in International Joint Conference on Neural Networks, vol. 1, 1990, pp. 545 -550.
16. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Stat., vol. 22, pp. 400-407, 1951.
17. T. Graepel, M. Burger, and K. Obermayer. "Phase transduction in stochastic self-organizing maps," Physical Review E., vol. 56, pp. 3876-3890, 1997.
18. D. Miller, A. V. Rao. K. Rose, and A. Gersho, "A global optimization technique for statistical classifier design," IEEE Transactions on Signal Processing, vol. 44, no. 12. pp. 3108-22, 1996.
19. L. Bottou. "Online learning and stochastic approximations," in Online Learning and Neural Networks, D. Saad, Ed. Cambridge, UK: Cambridge University Press, 1998, pp. 9-42.
20. S. Seo. "Clustering and prototype based classification." Ph.D. dissertation. Berlin University of Technology, 2005.