Learning a Mahalanobis distance metric for data clustering and classification

Pattern Recognition

Volumn 41, Issue 12, 2008, Pages 3600-3612

  Xiang, Shiming ^a   Nie, Feiping ^a   Zhang, Changshui ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Data clustering; Distance metric learning; Face pose estimation; Global optimization; Interactive image segmentation; Mahalanobis distance

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; CONSTRAINED OPTIMIZATION; CONSTRAINT THEORY; EDUCATION; FACE RECOGNITION; FLOW OF SOLIDS; GLOBAL OPTIMIZATION; IMAGE PROCESSING; IMAGE SEGMENTATION; LEARNING SYSTEMS;

CONSTRAINED OPTIMIZATION PROBLEMS; DATA CLUSTERING; DATA POINTS; DISTANCE METRIC; DISTANCE METRIC LEARNING; FACE POSE ESTIMATION; GLOBAL OPTIMUM; INTERACTIVE IMAGE SEGMENTATION; LINK INFORMATION; MACHINE-LEARNING ALGORITHMS; MAHALANOBIS DISTANCE; NATURAL IMAGES; PAIR-WISE CONSTRAINT; SIDE INFORMATION; SOME APPLICATIONS;

LEARNING ALGORITHMS;

EID: 49449088902     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.05.018     Document Type: Article

References (67)

1. Hastie T., and Tibshirani R. Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18 6 (1996) 607-615
2. Muller H., Pun T., and Squire D. Learning from user behavior in image retrieval: application of market basket analysis. Int. J. Comput. Vision 56 1-2 (2004) 65-77
3. He X., King O., Ma W.Y., Li M., and Zhang H.J. Learning a semantic space from users relevance feedback for image retrieval. IEEE Trans. Circuits Systems Video Technol. 13 1 (2003) 39-48
4. Peltonen J., Klami A., and Kaski S. Learning more accurate metrics for self-organizing maps. International Conference on Artificial Neural Networks. Madrid, Spain (2002) 999-1004
5. C. Domeniconi, D. Gunopulos, Adaptive nearest neighbor classification using support vector machines, in: Advances in Neural Information Processing Systems, vol. 14, 2002.
6. Peng J., Heisterkamp D., and Dai H. Adaptive kernel metric nearest neighbor classification. International Conference on Pattern Recognition. Quebec City, Canada (2002) 33-36
7. Yan R., Hauptmann A., and Jin R. Negative pseudo-relevance feedback in content-based video retrieval. Proceedings of ACM on Multimedia. Berkeley, CA, USA (2003) 343-346
8. He X., Ma W.Y., and Zhang H.J. Learning an image manifold for retrieval. Proceedings of ACM on Multimedia. New York, USA (2004) 17-23
9. He J.R., Li M.J., Zhang H.J., Tong H.H., and Zhang C.S. Manifold ranking based image retrieval. Proceedings of ACM on Multimedia. New York, USA (2004) 9-16
10. Varde A.S., Rundensteiner E.A., Ruiz C., Maniruzzaman M., and Jr. R. Learning semantics-preserving distance metrics for clustering graphical data. SIGKDD Workshop on Multimedia Data Mining: Mining Integrated Media and Complex Data. Chicago, IL, USA (2005) 107-112
11. Wu G., Chang E.Y., and Panda N. Formulating context-dependent similarity functions. Proceedings of ACM on Multimedia. Chicago, IL, USA (2005) 725-734
12. Korkmaz E.E., and Ucoluk G. Choosing a distance metric for automatic word categorization. Proceedings of the Joint Conference on New Methods in Language Processing and Computational Natural Language Learning. Sydney, Australia (1998) 111-120
13. Li F., Yang J., and Wang J. A transductive framework of distance metric learning by spectral dimensionality reduction. Proceedings of International Conference on Machine Learning. Corvallis, Oregon, USA (2007) 513-520
14. L. Yang, R. Jin, Distance metric learning: a comprehensive survey, Technical Report, Michigan State University 〈http://www.cse.msu.edu/∼yangliu1/frame_survey_v2.pdf〉, 2006.
15. Goldberger J., Roweis S., Hinton G., and Salakhutdinov R. Neighbourhood components analysis. Advances in NIPS (2004), MIT Press, Cambridge, MA, USA 513-520
16. Weinberger K., Blitzer J., and Saul L. Distance metric learning for large margin nearest neighbor classification. Advances in NIPS (2006), MIT Press, Cambridge, MA, USA 1473-1480
17. Torresani L., and Lee K.C. Large margin component analysis. Advances in NIPS (2007), MIT Press, Cambridge, MA, USA 505-512
18. Globerson A., and Roweis S. Metric learning by collapsing classes. Advances in NIPS (2006), MIT Press, Cambridge, MA, USA 451-458
19. Zhang Z.H., Kwok J.T., and Yeung D.Y. Parametric distance metric learning with label information. IJCAI (2003), Acapulco, Mexico 1450-1452
20. G. Lebanon, Flexible metric nearest neighbor classification, Technical Report, Statistics Department, Stanford University, 1994.
21. C.H. Hoi, W. Liu, M.R. Lyu, W.Y. Ma, Learning distance metrics with contextual constraints for image retrieval, in: Proceedings of Conference on Computer Vision and Pattern Recognition, vol. 2, New York, USA, 2006, pp. 2072-2078.
22. Xing E.P., Ng A.Y., Jordan M.I., and Russell S. Distance metric learning, with application to clustering with side-information. Advances in NIPS (2003), MIT Press, Cambridge, MA, USA 505-512
23. Bar-hillel A., Hertz T., Shental N., and Weinshall D. Learning distance functions using equivalence relations. J. Mach. Learn. Res. 6 (2005) 11-18
24. Tsang I.W., and Kwok J.T. Distance metric learning with kernels. Proceedings of the International Conference on Artificial Neural Networks (ICANN). Istanbul, Turkey (2003) 126-129
25. Rosales R., and Fung G. Learning sparse metrics via linear programming. SIGKDD. New York, USA (2006) 367-373
26. Schultz M., and Joachims T. Learning a distance metric from relative comparisons. Advances in NIPS (2004), MIT Press, Cambridge, MA, USA
27. L. Yang, R. Jin, R. Sukthankar, Y. Liu, An efficient algorithm for local distance metric learning, in: AAAI, Boston, USA, 2006.
28. Mochihashi D., Kikui G., and Kita K. Learning nonstructural distance metric by minimum cluster distortions. Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. Barcelona, Spain (2004) 341-348
29. W. Tang, S. Zhong, Pairwise constraints-guided dimensionality reduction, in: SDM Workshop on Feature Selection for Data Mining, 2006.
30. Bie T.D., Momma M., and Cristianini N. Efficiently learning the metric using side-information. International Conference on Algorithmic Learning Theory. Sapporo, Japan (2003) 175-189
31. N. Shental, A. Bar-Hillel, T. Hertz, D. Weinshall, Computing Gaussian mixture models with em using side-information, in: ICML Workshop on The Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, 2003.
32. Lanckriet G.R.G., Cristianini N., Bartlett P., Ghaoui L.E., and Jordan M.I. Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5 1 (2004) 27-72
33. Lu Z., and Leen T. Semi-supervised learning with penalized probabilistic clustering. Advances in NIPS (2005), MIT Press, Cambridge, MA, USA 849-856
34. Yeung D.-Y., and Chang H. Extending the relevant component analysis algorithm for metric learning using both positive and negative equivalence constraints. Pattern Recognition 39 5 (2006) 1007-1010
35. Zhang J., and Yan R. On the value of pairwise constraints in classification and consistency. Proceedings of International Conference on Machine Learning. Corvallis, Oregon, USA (2007) 1111-1118
36. Weinberger K.Q., and Tesauro G. Metric learning for kernel regression. Proceedings of International Workshop on Artificial Intelligence and Statistics. Puerto Rico (2007) 608-615
37. Hertz T., Bar-Hillel A., and Weinshall D. Boosting margin based distance functions for clustering. Proceedings of International Conference on Machine Learning. Banff, Alberta, Canada (2004) 393-400
38. Bilenko M., Basu S., and Mooney R.J. Integrating constraints and metric learning in semi-supervised clustering. Proceedings of International Conference on Machine Learning. Banff, Alberta, Canada (2004) 81-88
39. Davis J.V., Kulis B., Jain P., Sra S., and Dhillon I.S. Information-theoretic metric learning. Proceedings of International Conference on Machine Learning. Corvallis, Oregon, USA (2007) 209-216
40. Yang L., Jin R., and Sukthankar R. Bayesian active distance metric learning. Proceedings of International Conference on Uncertainty in Artificial Intelligence (2007)
41. Kumar N., Kummamuru K., and Paranjpe D. Semi-supervised clustering with metric learning using relative comparisons. IEEE International Conference on Data Mining. New Orleans, Louisiana, USA (2005) 693-696
42. Rosales R., and Fung G. Learning sparse metrics via linear programming. Proceedings of the International Conference on Knowledge Discovery and Data Mining. Chicago, IL, USA (2005) 367-373
43. Tsang I.W., Cheung P.M., and Kwok J.T. Kernel relevant component analysis for distance metric learning. Proceedings of the International Joint Conference on Neural Networks (IJCNN). Montreal, Canada (2005) 954-959
44. Kwok J., and Tsang I. Learning with idealized kernels. Proceedings of International Conference on Machine Learning. Washington, DC, USA (2003) 400-407
45. Zhang Z. Learning metrics via discriminant kernels and multidimensional scaling: toward expected Euclidean representation. Proceedings of International Conference on Machine Learning. Washington, DC, USA (2003) 872-879
46. Chen J., Zhao Z., Ye J., and Liu H. Nonlinear adaptive distance metric learning for clustering. Conference on Knowledge Discovery and Data Mining. San Jose, USA (2007) 123-132
47. Shalev-Shwartz S., Singer Y., and Ng A.Y. Online and batch learning of pseudo-metrics. Proceedings of International Conference on Machine Learning. Banff, Alberta, Canada (2004) 94-101
48. Bach F.R., and Jordan M.I. Learning spectral clustering. with application to speech separation, J. Mach. Learn. Res. 7 (2006) 1963-2001
49. E.-J. Ong, R. Bowden, Learning distances for arbitrary visual features, in: Proceedings of British Machine Vision Conference, vol. 2, Edinburgh, England, 2006, pp. 749-758.
50. Chopra S., Hadsell R., and LeCun Y. Learning a similarity metric discriminatively, with application to face verification. Proceedings of International Conference on Computer Vision and Pattern Recognition. San Diego, USA (2005) 539-546
51. L. Yang, R. Jin, R. Sukthankar, B. Zheng, L. Mummert, M. Satyanarayanan, M. Chen, D. Jukic, Learning distance metrics for interactive search-assisted diagnosis of mammograms, in: SPIE Symposium on Medical Imaging: Computer-Aided Diagnosis, vol. 6514, 2007.
52. Yan R., Zhang J., Yang J., and Hauptmann A. A discriminative learning framework with pairwise constraints for video object classification. Proceedings of International Conference on Computer Vision and Pattern Recognition. Washington, DC, USA (2004) 284-291
53. Langmead C.J. A randomized algorithm for learning mahalanobis metrics: application to classification and regression of biological data. Asia Pacific Bioinformatics Conference. Taiwan, China (2006) 217-226
54. Chang E., and Li B. On learning perceptual distance function for image retrieval. Asia Pacific Bioinformatics Conference. Orlando, Florida, USA (2002) 4092-4095
55. Belhumeur P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intelligence. 19 7 (1997) 711-720
56. Chen L., Liao H., Ko M., Lin J., and Yu G. A new lda based face recognition system which can solve the small sample size problem. Pattern Recognition 33 10 (2000) 1713-1726
57. Yu H., and Yang J. A direct lda algorithm for high-dimensional data-with application to face recognition. Pattern Recognition 34 10 (2001) 2067-2070
58. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2000), Wiley, New York, USA
59. Golub G.H., and van Loan C.F. Matrix Computations. third ed. (1996), The Johns Hopkins University Press, Baltimore, MD, USA
60. Guo Y.F., Li S.J., Yang J.Y., Shu T.T., and Wu L.D. A generalized Foley-Sammon transform based on generalized fisher discriminant criterion and its application to face recognition. Pattern Recognition Lett. 24 1 (2003) 147-158
61. Samaria F.S., and Harter A.C. Parameterisation of a stochastic model for human face identification. Proceedings of Second IEEE Workshop on Applications of Computer Vision (1994) 138-142
62. S. Nene, S. Nayar, H. Murase, Columbia object image library (coil-20), Technical Report, Columbia University, 1996.
63. Boykov Y.Y., and Jolly M.P. Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. International Conference on Computer Vision. Vancouver, Canada (2001) 105-112
64. Li Y., Sun J., Tang C.K., and Shum H.Y. Lazy snapping. SIGGRAPH. Los Angeles, USA (2004) 303-307
65. S. Yan, X. Tang, Trace quotient problems revisited, in: European Conference on Computer Vision, vol. 2, Graz, Austria, 2006, pp. 232-244.
66. Wang H., Yan S., Xu D., Tang X., and Huang T. Trace ratio vs. ratio trace for dimensionality reduction. Proceedings of Conference on Computer Vision and Pattern Recognition (2007)
67. Gourier N., Hall D., and Crowley J. Estimating face orientation from robust detection of salient facial features. ICPR Workshop on Visual Observation of Deictic Gestures (2004), Cambridge, UK