A distributed approach toward discriminative distance metric learning

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 9, 2015, Pages 2111-2122

  Li, Jun ^a   Lin, Xun ^b   Rui, Xiaoguang ^c   Rui, Yong ^d   Tao, Dacheng ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^c IBM Research   (China)

^d MICROSOFT RESEARCH ASIA   (China)

Author keywords

Distance metric learning; online learning; parallel computing.

Indexed keywords

AGGREGATES; ALGORITHMS; PARALLEL PROCESSING SYSTEMS;

DISTANCE METRIC LEARNING; DISTRIBUTED APPROACHES; DISTRIBUTED SCHEMES; EXPERIMENTAL EVALUATION; INTRINSIC RELATION; ONLINE LEARNING; PARALLEL COMPUTATION; STATE-OF-THE-ART PERFORMANCE;

LEARNING ALGORITHMS;

EID: 84940039372     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2377211     Document Type: Article

References (32)

1. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell, "Distance metric learning, with application to clustering with side-information, " in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2003, pp. 505-512.
2. N. Shental, T. Hertz, D. Weinshall, and M. Pavel, "Adjustment learning and relevant component analysis, " in Proc. Eur. Conf. Comput. Vis. (ECCV), 2002, pp. 776-792.
3. S. C. H. Hoi, W. Liu, M. R. Lyu, and W.-Y. Ma, "Learning distance metrics with contextual constraints for image retrieval, " in Proc. Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2006, pp. 2072-2078.
4. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov, "Neighbourhood components analysis, " in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2005, pp. 513-520.
5. K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification, " J. Mach. Learn. Res., vol. 10, pp. 207-244, Feb. 2009.
6. S. Fouad, P. Tino, S. Raychaudhury, and P. Schneider, "Incorporating privileged information through metric learning, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 7, pp. 1086-1098, Jul. 2013.
7. C. Shen, J. Kim, and L. Wang, "Scalable large-margin Mahalanobis distance metric learning, " IEEE Trans. Neural Netw., vol. 21, no. 9, pp. 1524-1530, Sep. 2010.
8. S. C. H. Hoi, W. Liu, and S.-F. Chang, "Semi-supervised distance metric learning for collaborative image retrieval and clustering, " ACM Trans. Multimedia Comput. Commun. Appl., vol. 6, no. 3, pp. 18:1-18:26, Aug. 2010.
9. F. Kang, R. Jin, and R. Sukthankar, "Correlated label propagation with application to multi-label learning, " in Proc. Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2006, pp. 1719-1726.
10. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters, " ACM Commun., vol. 51, no. 1, pp. 107-113, Jan. 2008.
11. V. N. Vapnik, Statistical Learning Theory. New York, NY, USA:Wiley, 1998.
12. L. Yang and R. Jin, "Distance metric learning: A comprehensive survey, " Dept. Comput. Sci. Eng., Michigan State Univ., East Lansing, MI, USA, Tech. Rep., 2006. Online. Available: http://www. cs. cmu. edu/~liuy/frame-survey-v2. pdf
13. D.-Y. Yeung and H. Chang, "A kernel approach for semisupervised metric learning, " IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 141-149, Jan. 2007.
14. C. Domeniconi, J. Peng, and D. Gunopulos, "Locally adaptive metric nearest-neighbor classification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1281-1285, Sep. 2002.
15. T. Hastie and R. Tibshirani, "Discriminant adaptive nearest neighbor classification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 6, pp. 607-616, Jun. 1996.
16. L. Grippo, "Convergent on-line algorithms for supervised learning in neural networks, " IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1284-1299, Nov. 2000.
17. J. V. Davis, B. Kulis, S. Sra, and I. S. Dhillon, "Information-theoretic metric learning, " in Proc. Int. Conf. Mach. Learn. (ICML), 2007, pp. 209-216.
18. S. Shalev-Shwartz, Y. Singer, and A. Y. Ng, "Online and batch learning of pseudo-metrics, " in Proc. Int. Conf. Mach. Learn. (ICML), 2004, pp. 743-750.
19. B. Catanzaro, N. Sundaram, and K. Keutzer, "Fast support vector machine training and classification on graphics processors, " in Proc. Int. Conf. Mach. Learn. (ICML), 2008, pp. 104-111.
20. R. Raina, A. Madhavan, and A. Y. Ng, "Large-scale deep unsupervised learning using graphics processors, " in Proc. Int. Conf. Mach. Learn. (ICML), 2009, pp. 873-880.
21. C.-T. Chu et al., "Map-reduce for machine learning on multicore, " in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2007, pp. 281-288.
22. N. Lin and R. Xi, "Aggregated estimating equation estimation, " Statist. Inter., vol. 4, no. 1, pp. 73-84, 2011.
23. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U. K.: Cambridge Univ. Press, 1990. Online. Available: http://www. citeulike. org/user/Borelli/article/669570
24. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000.
25. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "NUS-WIDE: A real-world web image database from National University of Singapore, " in Proc. ACM Int. Conf. Image Video Retr., 2009, pp. 48:1-48:9.
26. J. Jeon, V. Lavrenko, and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models, " in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retr. (SIGIR), 2003, pp. 119-126.
27. C. J. Van Rijsbergen, Information Retrieval, 2nd ed. London, U. K.: Butterworth, 1979.
28. A. Makadia, V. Pavlovic, and S. Kumar, "A new baseline for image annotation, " in Proc. Eur. Conf. Comput. Vis. (ECCV), 2008, pp. 316-329.
29. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "TagProp: Discriminative metric learning in nearest neighbor models for image autoannotation, " in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep. /Oct. 2009, pp. 309-316.
30. G. E. Blelloch and B. M. Maggs. A Brief Overview of Parallel Algorithms. Online. Available: http://www. cs. cmu. edu/~scandal/htmlpapers/ short/short. html
31. M. A. Tahir and A. Bouridane, "An FPGA based coprocessor for cancer classification using nearest neighbour classifier, " in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), May 2006. Online. Available: http://ieeexplore. ieee. org/xpl/articleDetails. jsp?arnumber=1660828
32. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York, NY, USA: Springer-Verlag, 2003. Online. Available: http://www.citeulike.org/user/gyuli/article/161814