Learning a Mahalanobis metric from equivalence constraints

Journal of Machine Learning Research

Volumn 6, Issue , 2005, Pages

  Bar Hillel, Aharon ^a   Hertz, Tomer ^a   Shental, Noam ^a   Weinshall, Daphna ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Clustering; Dimensionality reduction; Equivalence constraints; Metric learning; Side information

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; DATA REDUCTION; MATRIX ALGEBRA; PROBLEM SOLVING;

CLUSTERING; DIMENSIONALITY REDUCTION; EQUIVALENCE CONSTRAINTS; METRIC LEARNING; SIDE INFORMATION;

LEARNING SYSTEMS;

EID: 21844457672     PISSN: 15337928     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (26)

1. Y. Adini, Y. Moses, and S. Ullman. Face recognition: The problem of compensating for changes in illumination direction. In proc. of IEEE PAMI, volume 19(7), pages 721-732, 1997.
2. A. Bar-Hillel, T. Hertz, N. Shental, and D. weinshall. Learning distance functions using equivalence relations. In T. Fawcett and Nina Mishra, editors, 20th International Conference on Machine Learning, Wahington DC, 2003. AAAI press.
3. S. Becker and G. E. Hinton. A self-organising neural network that discovers surfaces in random-dot stereograms. Nature, 355:161-163, 1992.
4. P. N. Belhumeur, J. Hespanha, and D. Kriegman. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE PAMI 8, 19(7):711-720, 1997.
5. A. J. Bell and T. J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6): 1129-1159, 1995.
6. M. Bilenko, S. Basu, and R.J Mooney. Integrating constraints and metric learning in semi-supervised clustering. In Proc. 21st International Conf. on Machine Learning, Banff Canada, 2004. AAAI press. URL citeseer.ist.psu.edu/ 705723.html.
7. C. L. Blake and C. J. Merz. UCI repository of machine learning databases, 1998. URL http://www.ics.uci.edu/~mlearn/MLRepository.html.
8. J. S. Boreczky and L. A. Rowe. Comparison of video shot boundary detection techniques. SPIE Storage and Retrieval for Still Images and Video Databases IV, 2664:170-179, 1996.
9. G. Chechik and N. Tishby. Extracting relevant structures with side information. In S Becker, S. Thrune, and K. Obermayer, editors, Advances in Neural Information Processing Systems, volume 15. The MIT Press, 2003.
10. K. Fukunaga. Statistical Pattern Recognition. Academic Press, San Diego, 2nd edition, 1990.
11. P. Geladi and B. Kowalski. Partial least squares regression: A tutorial. Analytica Chimica Acta, 185:1-17, 1986.
12. T. Hastie and R. Tibshirani. Discriminant adaptive nearest neighbor classification and regression. In David S. Touretzky, Michael C. Mozer, and Michael E. Hasselmo, editors, Advances in Neural Information Processing Systems, volume 8, pages 409-415. The MIT Press, 1996.
13. T. Jaakkola and D. Haussler. Exploiting generative models in discriminative classifiers, 1998.
14. D. Klein, S. Kamvar, and C. Manning. From instance-level constraints to space-level constraints: Making the most of prior knowledge in data clustering. In Proc. 19th International Conf. on Machine Learning, 2002. URL citeseer.nj.nec.com/klein02from.html.
15. R. Linsker. An application of the principle of maximum information preservation to linear systems. In David S. Touretzky, editor, Advances in Neural Information Processing Systems, pages 186-194. Morgan Kaufmann, 1989.
16. K. V. Mardia. Measures of multivariate skewness and kurtosis with applications. Biometrika, 36: 519-530, 1970.
17. W. M. Rand. Objective criteria for the evaluation of clustering method. Journal of the American Statistical Association, 66(366):846-850, 1971.
18. N. Shental, A. Bar-Hillel, T. Hertz, and D. Weinshall. Computing gaussian mixture models with em using equivalence constraints. In Sebastian Thrun, Lawrence Saul, and Bernhard Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
19. N. Shental, T. Hertz, D. Weinshall, and M. Pavel. Adjustment learning and relevant component analysis. In A. Heyden, G. Sparr, M. Nielsen, and P. Johansen, editors, 7th European Conference on Computer Vision, volume 4, 2002.
20. J. B. Tenenbaum and W. T. Freeman. Separating style and content with bilinear models. Neural Computation, 12(6): 1247-1283, 2000.
21. B. Thompson. Canonical correlation analysis: Uses and interpretation. Newbury Park CA: SAGE, 1984.
22. S. Thrun. Is learning the n-th thing any easier than learning the first? In David S. Touretzky, Michael C. Mozer, and Michael E. Hasselmo, editors, Advances in Neural Information Processing Systems, volume 8, pages 640-646. The MIT Press, 1996.
23. N. Tishby, F. C. Pereira, and W. Bialek. The information bottleneck method. In Proc. of the 37-th Annual Allerton Conference on Communication, Control and Computing, pages 368-377, 1999.
24. M. A. Turk and A.P Pentland. Face recognition using eigenfaces. In Proc. of IEEE CVPR, pages 586-591, 1991.
25. K. Wagstaff, C. Cardie, S. Rogers, and S. Schroedl. Constrained K-means clustering with background knowledge. In Proc. 18th International Conf. on Machine Learning, pages 577-584. Morgan Kaufmann, San Francisco, CA, 2001.
26. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell. Distance metric learning with application to clustering with side-information. In Advances in Neural Information Processing Systems, volume 15. The MIT Press, 2002.