Relaxational metric adaptation and its application to semi-supervised clustering and content-based image retrieval

Pattern Recognition

Volumn 39, Issue 10, 2006, Pages 1905-1917

  Chang, Hong ^a   Yeung, Dit Yan ^a   Cheung, William K ^b  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

Constrained k means; Content based image retrieval; Distance metric; Nonparametric method; Pairwise similarity and dissimilarity; Semi supervised clustering; Side information

Indexed keywords

IMAGE PROCESSING; INFORMATION ANALYSIS; LEARNING ALGORITHMS; PATTERN RECOGNITION; REAL TIME SYSTEMS; RELAXATION PROCESSES;

CONSTRAINED K-MEANS; CONTENT-BASED IMAGE RETRIEVAL; DISTANCE METRICS; NONPARAMETRIC METHOD; PAIRWISE SIMILARITY AND DISSIMILARITY; SEMI-SUPERVISED CLUSTERING; SIDE INFORMATION;

CONTENT BASED RETRIEVAL;

EID: 33745405918     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2006.04.006     Document Type: Article

References (39)

1. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York, NY, USA
2. Fukunaga K., and Hostetler L. Optimization of k-nearest neighbor density estimates. IEEE Trans. Inf. Theory 19 3 (1973) 320-326
3. Short R.D., and Fukunaga K. The optimal distance measure for nearest neighbor classification. IEEE Trans. Inf. Theory 27 5 (1981) 622-627
4. Fukunaga K., and Flick T.E. An optimal global nearest neighbor metric. IEEE Trans. Pattern Anal. Mach. Intell. 6 3 (1984) 314-318
5. J.H. Friedman, Flexible metric nearest neighbor classification, Technical Report, Department of Statistics, Stanford University, Stanford, CA, USA, November 1994.
6. Lowe D.G. Similarity metric learning for a variable-kernel classifier. Neural Comput. 7 1 (1995) 72-85
7. Hastie T., and Tibshirani R. Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18 6 (1996) 607-616
8. Domeniconi C., Peng J., and Gunopulos D. An adaptive metric machine for pattern classification. In: Leen T., Dietterich T., and Tresp V. (Eds). Advances in Neural Information Processing Systems vol. 13 (2001), MIT Press, Cambridge, MA, USA 458-464
9. Domeniconi C., and Gunopulos D. Adaptive nearest neighbor classification using support vector machines. In: Dietterich T.G., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems vol. 14 (2002), MIT Press, Cambridge, MA, USA 665-672
10. Domeniconi C., Peng J., and Gunopulos D. Locally adaptive metric nearest-neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 24 9 (2002) 1281-1285
11. Peng J., Heisterkamp D.R., and Dai H.K. Adaptive kernel metric nearest neighbor classification. Proceedings of the 16th International Conference on Pattern Recognition vol. 3 (11-15 August 2002), Québec City, Québec, Canada 33-36
12. Poggio T., and Girosi F. Networks for approximation and learning. Proc. IEEE 78 9 (1990) 1481-1497
13. A. Blum, T. Mitchell, Combining labeled and unlabeled data with co-training, in: Proceedings of the 11th Annual Conference on Computational Learning Theory, Madison, WI, USA, 24-26 July 1998, pp. 92-100.
14. Kaski S., Sinkkonen J., and Peltonen J. Bankruptcy analysis with self-organizing maps in learning metrics. IEEE Trans. Neural Networks 12 4 (2001) 936-947
15. Sinkkonen J., and Kaski S. Clustering based on conditional distributions in an auxiliary space. Neural Comput. 14 1 (2002) 217-239
16. Zhang Z., Kwok J.T., and Yeung D.Y. Parametric distance metric learning with label information. Proceedings of the 18th International Joint Conference on Artificial Intelligence (9-15 August 2003), Acapulco, Mexico 1450-1452
17. Z. Zhang, J.T. Kwok, D.Y. Yeung, Parametric distance metric learning with label information, Technical Report HKUST-CS03-02, Hong Kong University of Science and Technology, Department of Computer Science, Clear Water Bay, Kowloon, Hong Kong, January 2003, 〈ftp://ftp.cs.ust.hk/pub/techreport/03/tr03-02.ps.gz〉.
18. K. Wagstaff, C. Cardie, Clustering with instance-level constraints, in: Proceedings of the 17th International Conference on Machine Learning, Stanford, CA, USA, 29 June-2 July 2000, pp. 1103-1110.
19. K. Wagstaff, C. Cardie, S. Rogers, S. Schroedl, Constrained k-means clustering with background knowledge, in: Proceedings of the 18th International Conference on Machine Learning, Williamstown, MA, USA, 28 June-1 July 2001, pp. 577-584.
20. Xing E.P., Ng A.Y., Jordan M.I., and Russell S. Distance metric learning, with application to clustering with side-information. In: Becker S., Thrun S., and Obermayer K. (Eds). Advances in Neural Information Processing Systems vol. 15 (2003), MIT Press, Cambridge, MA, USA 505-512
21. A. Bar-Hillel, T. Hertz, N. Shental, D. Weinshall, Learning distance functions using equivalence relations, in: Proceedings of the 20th International Conference on Machine Learning, Washington, DC, USA, 21-24 2003, pp. 11-18.
22. Hertz T., Bar-Hillel A., and Weinshall D. Boosting margin based distance functions for clustering. Proceedings of the 21st International Conference on Machine Learning (4-8 July 2004), Banff, Alberta, Canada 393-400
23. T. Hertz, A. Bar-Hillel, D. Weinshall, Learning distance functions for image retrieval, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, Washington, DC, USA, 27 June-3 2004, pp. 570-577.
24. Z. Zhang, Learning metrics via discriminant kernels and multidimensional scaling: toward expected Euclidean representation, in: Proceedings of the 20th International Conference on Machine Learning, Washington, DC, USA, 21-24 August 2003, pp. 872-879.
25. J.T. Kwok, I.W. Tsang, Learning with idealized kernels, in: Proceedings of the 20th International Conference on Machine Learning, Washington, DC, USA, 21-24 August 2003, pp. 400-407.
26. Rand W.M. Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66 (1971) 846-850
27. Smeulders A., Worring M., Santini S., Gupta A., and Jain R. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22 12 (2000) 1349-1380
28. T. Hertz, N. Shental, A. Bar-Hillel, D. Weinshall, Enhancing image and video retrieval: learning via equivalence constraints, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, Madison, WI, USA, 18-20 June 2003, pp. 668-674.
29. Pass G., Zabih R., and Miller J. Comparing images using color coherence vectors. ACM Multimedia (1996) 65-73
30. Rui Y., Huang T.S., Ortega M., and Mehrotra S. Relevance feedback: a powerful tool for interactive content-based image retrieval. IEEE Trans. Circuits Syst. Video Technol. 8 5 (1998) 644-655
31. Revow M., Williams C.K.I., and Hinton G.E. Using generative models for handwritten digit recognition. IEEE Trans. Pattern Anal. Mach. Intell. 18 6 (1996) 592-606
32. Cheung K.W., Yeung D.Y., and Chin R.T. A Bayesian framework for deformable pattern recognition with application to handwritten character recognition. IEEE Trans. Pattern Anal. Mach. Intell. 20 12 (1998) 1382-1388
33. Cheung K.W., Yeung D.Y., and Chin R.T. Bidirectional deformable matching with application to handwritten character extraction. IEEE Trans. Pattern Anal. Mach. Intell. 24 8 (2002) 1133-1139
34. Cheung K.W., Yeung D.Y., and Chin R.T. On deformable models for visual pattern recognition. Pattern Recognition 35 7 (2002) 1507-1526
35. Dubnov S., El-Yaniv R., Gdalyahu Y., Schneidman E., Tishby N., and Yona G. A new nonparametric pairwise clustering algorithm based on iterative estimation of distance profiles. Mach. Learn. 47 1 (2002) 35-61
36. Kohonen T. Self-Organization and Associative Memory. third ed. (1989), Springer, Berlin, Germany
37. Bishop C.M., Svensén M., and Williams C.K.I. GTM: the generative topographic mapping. Neural Comput. 10 1 (1998) 215-234
38. Hinton G., and Roweis S. Stochastic neighbor embedding. In: Becker S., Thrun S., and Obermayer K. (Eds). Advances in Neural Information Processing Systems vol. 15 (2003), MIT Press, Cambridge, MA, USA 833-840
39. Cox T.F., and Cox M.A.A. Multidimensional Scaling. second ed. (2001), CRC/Chapman & Hall, Boca Raton, FL/London