Random forests for metric learning with implicit pairwise position dependence

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 958-966

  Xiong, Caiming ^a   Johnson, David ^a   Xu, Ran ^a   Corso, Jason J ^a  

^a UNIVERSITY AT BUFFALO   (United States)

Author keywords

metric learning; pairwise constraints; random forests

Indexed keywords

DATA SETS; DISTANCE FUNCTIONS; FEATURE SPACE; HETEROGENEOUS DATA; MAHALANOBIS METRIC; METRIC ADAPTATION; METRIC LEARNING; PAIRWISE CONSTRAINTS; POSITION DEPENDENCE; RANDOM FORESTS; RELATIVE POSITIONS; STATE OF THE ART;

DATA MINING;

DECISION TREES;

EID: 84866052108     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339680     Document Type: Conference Paper

References (32)

1. Y. Amit and D. Geman. Shape quantization and recognition with randomized trees. Neural computation, 9(7):1545-1588, 1997.
2. B. Babenko, S. Branson, and S. Belongie. Similarity metrics for categorization: from monolithic to category specific. In International Conference on Computer Vision, pages 293-300, 2009.
3. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall. Learning distance functions using equivalence relations. In International Conference on Machine Learning, volume 20, page 11, 2003.
4. G. Biau and L. Devroye. On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification. Journal of Multivariate Analysis, 101(10):2499-2518, 2010.
5. O. Boiman, E. Shechtman, and M. Irani. In defense of nearest-neighbor based image classification. In Computer Vision and Pattern Recognition. IEEE Conference on, pages 1-8. IEEE, 2008.
6. L. Breiman. Random forests. Machine learning, 45(1):5-32, 2001.
7. R. Caruana and A. Niculescu-Mizil. An empircal comparison of supervised learning algorithms. In International Conference on Machine Learning, 2006.
8. S. Chopra, R. Hadsell, and Y. LeCun. Learning a similarity metric discriminatively, with application to face verification. In Computer Vision and Pattern Recognition, volume 1, pages 539-546. IEEE, 2005.
9. J. Davis, B. Kulis, P. Jain, S. Sra, and I. Dhillon. Information- theoretic metric learning. In International Conference on Machine Learning, pages 209-216, 2007.
10. M. Fink. Object classification from a single example utilizing class relevance metrics. In Advances in Neural Information Processing Systems, volume 17, page 449. The MIT Press, 2004.
11. A. Frome, Y. Singer, and J. Malik. Image retrieval and classification using local distance functions. Advances in Neural Information Processing Systems, 19:417, 2006.
12. A. Frome, Y. Singer, F. Sha, and J. Malik. Learning globally-consistent local distance functions for shape-based image retrieval and classification. In International Conference on Computer Vision, pages 1-8. IEEE, 2007.
13. A. Globerson and S. Roweis. Metric learning by collapsing classes. Advances in Neural Information Processing Systems, 18:451, 2006.
14. S. Hoi, W. Liu, M. Lyu, and W. Ma. Learning distance metrics with contextual constraints for image retrieval. In Computer Vision and Pattern Recognition, volume 2, pages 2072-2078. IEEE, 2006.
15. P. Jain, B. Kulis, and K. Grauman. Fast image search for learned metrics. Computer Vision and Pattern Recognition, 2008.
16. G. Lebanon. Metric learning for text documents. Transactions Pattern Analysis and Machine Intelligence, pages 497-508, 2006.
17. C. Leistner, A. Saffari, J. Santner, and H. Bischof. Semi-supervised random forests. In Computer Vision, 2009 IEEE 12th International Conference on, pages 506-513. IEEE.
18. Y. Lin and Y. Jeon. Random forests and adaptive nearest neighbors. Journal of the American Statistical Association, 101(474):578-590, 2006.
19. G. Martinez-Munoz, N. Larios, E. Mortensen, W. Zhang, A. Yamamuro, R. Paasch, N. Payet, D. Lytle, L. Shapiro, S. Todorovic, et al. Dictionary-free categorization of very similar objects via stacked evidence trees. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 549-556. IEEE, 2009.
20. H. Nguyen and L. Bai. Cosine similarity metric learning for face verification. Asian Conference on Computer Vision, pages 709-720, 2010.
21. N. Nguyen and Y. Guo. Metric Learning: A Support Vector Approach. ECML PKDD, pages 125-136, 2008.
22. N. Payet and S. Todorovic. (rf) 2 - random forest random field. Advanced in Neural Information Processing Systems, 2010.
23. S. Shalev-Shwartz, Y. Singer, and A. Ng. Online and batch learning of pseudo-metrics. In International Conference on Machine Learning, page 94. ACM, 2004.
24. C. Shen, J. Kim, and L. Wang. Scalable Large-Margin Mahalanobis Distance Metric Learning. Neural Networks, IEEE Transactions on, 21(9):1524-1530, 2010.
25. Y. Shi, Y. Noh, F. Sha, and D. Lee. Learning discriminative metrics via generative models and kernel learning. Arxiv preprint arXiv:1109.3940, 2011.
26. J. Wang, S. Wu, H. Vu, and G. Li. Text document clustering with metric learning. In Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval, pages 783-784. ACM, 2010.
27. K. Weinberger and L. Saul. Fast solvers and efficient implementations for distance metric learning. In International Conference on Machine Learning, pages 1160-1167. ACM, 2008.
28. K. Weinberger and L. Saul. Distance metric learning for large margin nearest neighbor classification. The Journal of Machine Learning Research, 10:207-244, 2009.
29. L.Wu, R. Jin, S. Hoi, J. Zhu, and N. Yu. Learning bregman distance functions and its application for semi-supervised clustering. Advances in Neural Information Processing Systems, 22:2089-2097, 2009.
30. E. Xing, A. Ng, M. Jordan, and S. Russell. Distance metric learning with application to clustering with side-information. Advances in Neural Information Processing Systems, pages 521-528, 2003.
31. W. Yang, Y. Wang, and G. Mori. Learning transferable distance functions for human action recognition. Machine Learning for Vision-Based Motion Analysis, pages 349-370, 2011.
32. D. Zhan, M. Li, Y. Li, and Z. Zhou. Learning instance specific distances using metric propagation. In Proceedings of the 26th Annual International Conference on Machine Learning, pages 1225-1232. ACM, 2009.