Metric learning

Synthesis Lectures on Artificial Intelligence and Machine Learning

Volumn 30, Issue , 2015, Pages 1-151

  Bellet, Aurélien ^a   Habrard, Amaury ^b   Sebban, Marc ^b  

^a TELECOM PARISTECH   (France)

^b UNIVERSITÉ JEAN MONNET   (France)

Author keywords

edit distance; learning theory; Mahalanobis distance; metric learning; similarity learning; structured data

Indexed keywords

COGNITIVE SYSTEMS; DATA MINING; MACHINE LEARNING; PATTERN RECOGNITION; REVIEWS; SUPERVISED LEARNING; TREES (MATHEMATICS);

EDIT DISTANCE; LEARNING THEORY; MAHALANOBIS DISTANCES; METRIC LEARNING; SIMILARITY LEARNING; STRUCTURED DATA;

LEARNING ALGORITHMS;

EID: 84924034422     PISSN: 19394608     EISSN: 19394616     Source Type: Book Series    
DOI: 10.2200/s00626ed1v01y201501aim030     Document Type: Article

References (276)

1. M. Ehsan Abbasnejad, Dhanesh Ramachandram, and Mandava Rajeswari. A survey of the state of the art in learning the kernels. Knowledge and Information Systems (KAIS), 31(2):193 -221, 2012. DOI: 10.1007/s10115-011-0404-6. 2
2. Noga Alon, Shai Ben-David, Nicolò Cesa-Bianchi, and David Haussler. Scale-sensitive dimensions, uniform convergence, and learnability. Journal of the ACM, 44(4):615-631, 1997. DOI: 10.1145/263867.263927. 61
3. Naomi S. Altman. An introduction to kernel and nearest-neighbor nonparametric regression. American Statistician, 46(3):175-185, 1992. DOI: 10.1080/00031305.1992.10475879. 14
4. F. Gregory Ashby and Nancy A. Perrin. Toward a unified theory of similarity and recognition. Psychological Review, 95(1):124-150, 1988. DOI: 10.1037/0033-295X.95.1.124. 1, 26
5. Francis R. Bach, Rodolphe Jenatton, Julien Mairal, and Guillaume Obozinski. Optimization with Sparsity-Inducing Penalties. Foundations and Trends in Machine Learning (FTML), 4(1): 1-106, 2012. DOI: 10.1561/2200000015. 23, 25
6. Ricardo Baeza-Yates and Berthier Ribeiro-Neto. Modern Information Retrieval. Addison-Wesley, 1999. 10, 15, 27-96
7. Mahdie h S. Baghshah and Saeed B. Shouraki. Semi-Supervised Metric Learning Using Pairwise Constraints. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI), pages 1217-1222, 2009. 48
8. Maria-Florina Balcan and Avrim Blum. On a eory of Learning with Similarity Functions. In Proceedings of the 23rd International Conference on Machine Learning (ICML), pages 73-80, 2006. DOI: 10.1145/1143844.1143854. 75, 77
9. Maria-Florina Balcan, Avrim Blum, and Nathan Srebro. Improved Guarantees for Learning via Similarity Functions. In Proceedings of the 21st Annual Conference on Learning ?eory (COLT), pages 287-298, 2008 a. 57, 63, 75, 76, 77
10. Maria-Florina Balcan, Avrim Blum, and Santosh Vempala. A Discriminative Framework for Clustering via Similarity Functions. In ACM Symposium on ?eory of Computing (STOC), pages 671-680, 2008 b. DOI: 10.1145/1374376.1374474. 101
11. Peter L. Bartlett and Shahar Mendelson. Rademacher and Gaussian Complexities: Risk Bounds and Structural Results. Journal of Machine Learning Research (JMLR), 3:463- 482, 2002. 61, 62, 80
12. Jonathan Baxter and Peter L. Bartlett. e Canonical Distortion Measure in Feature Space and 1-NN Classification. In Advances in Neural Information Processing Systems (NIPS) 10, 1997. 1
13. Mikhail Belkin and Partha Niyogi. Semi-Supervised Learning on Riemannian Manifolds. Machine Learning Journal (MLJ), 56(1- 3):209-239, 2004. DOI: 10.1023/B:MACH.0000033120.25363.1e. 47
14. Auré lien Bellet. Supervised Metric Learning with Generalization Guarantees. PhD thesis, University of Saint-Etienne, 2012. 61.
15. Aurélien Bellet,Amaury Habrard, Robustness and generalization for metric learning, Neurocomputing, 151, 1, 259-267, 2015,doi 10.1016/j.neucom.2014.09.044, 62 68 72.
16. Auré lien Bellet, Amaury Habrard, and M arc Sebban. Learning Good Edit Similarities with Generalization Guarantees. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), pages 188-203, 2011. DOI: 10.1007/978-3-642-23780-5-22. 57, 63, 99
17. Auré lien Bellet, Amaury Habrard, and Marc Sebban. Good edit similarity learning by loss minimization. Machine Learning Journal (MLJ), 89(1):5- 35, 2012a. DOI: 10.1007/s10994-012-5293-8. 57, 63
18. Auré lien Bellet, Amaury Habrard, and Marc Sebban. Similarity Learning for Provably Accurate Sparse Linear Classification. In Proceedings of the 29th International Confer ence on Machine Learning (ICML), pages 1871-1878, 2012b. 27, 63, 74, 75, 77, 102
19. Auré lien Bellet, Amaury Habrard, and Marc Sebban. A Survey on Metric Learning for Feature Vectors and Structured Data. Technical report, arXiv:1306.6709, 2013. 4
20. Shai Ben-David, John Blitzer, Koby Crammer, Alex Kulesza, Fernando Pereira, and Jennifer Wortman Vaughan. A theory of learning from different domains. Machine Learning Journal (MLJ), 79(1-2):151 -175, 2010. DOI: 10.1007/s10994-009-5152-4. 48
21. Yoshua Bengio. Learning deep architectures for AI. Foundations and Trends in Machine Learning (FTML), 2(1):1-127, 2009. DOI: 10.1561/2200000006. 35
22. Marc Bernard, Amaury Habrard, and Marc Se bban. Learning Stochastic Tree Edit Distance. In Proceedings of the 17th European Conference on Machine Learning (ECML), pages 42-53, 2006. DOI: 10.1007/11871842-9. 58
23. Marc Bernard, Laurent Boyer, Amaury Habrard, and Marc Sebban. Learning probabilistic models of tree edit distance. Pattern Recognition (PR), 41(8):2611-2629, 2008. DOI: 10.1016/j.patcog.2008.01.011. 58
24. Enrico Bertini, Andrada Tatu, and Daniel Keim. Quality Metrics in High-Dimensional Data Visualization: An Overview and Systematization. IEEE Transactions on Visualization and Computer Graphics (TVCG), 17(12):2203 -2212, 2011. DOI: 10.1109/TVCG.2011.229. 15
25. Jinbo Bi, Dijia Wu, Le Lu, Meizhu Liu, Yimo Tao, and Matthias Wolf. AdaBoost on low-rank PSD matrices for metric learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2617-2624, 2011. DOI: 10.1109/CVPR.2011.5995363. 26
26. Wei Bian and Dacheng Tao. Learning a Distance Metric by Empirical Loss Minimization. In Proceedings of the 22nd International Joint Conference on Artifici al Intelligence (IJCAI), pages 1186-1191, 2011. DOI: 10.5591/978-1-57735-516-8/IJCAI11-202. 62
27. Wei Bian and Dacheng Tao. Constrained Empirical Risk Minimization Framework for Distance Metric Learning. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 23 (8):1194 -1205, 2012. DOI: 10.1109/TNNLS.2012.2198075. 62
28. Mikhail Bilenko and Raymond J. Mooney. Adaptive Duplicate Detection Using Learnable String Similarity Measures. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 39-48, 2003. DOI: 10 .1145/956750.956759. 55
29. Mikhail Bilenko, Sugato Basu, and Raymond J. Mooney. Integrating Constraints and Metric Learning in Semi-Supervised Clustering. In Proceedings of the 21st International Conference on Machine Lear ning (ICML), pages 81-88, 2004. DOI: 10.1145/1015330.1015360. 47
30. Philip Bille. A survey on tree edit distance and related problems. ?eoretical Computer Science (TCS), 337(1- 3):217-239, 2005. DOI: 10.1016/j.tcs.2004.12.030. 13
31. Oren Boiman, Eli Shechtman, and Michal Irani. In defense of nearest-neighbor based image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Reco gnition (CVPR), 2008. DOI: 10.1109/CVPR.2008.4587598. 89
32. Léon Bottou and Olivier Bousquet. ?e Tradeoffs of Large Scale Learning. In Advances in Neural Information Processing Systems (NIPS) 20, pages 161-168, 2007. 28, 31
33. Olivier Bousquet and André Elisseeff. Stability and Generalization. Journal of Machine Learning Research (JMLR), 2:499- 526, 2002. DOI: 10.1162/153244302760200704. 62, 64, 65, 78, 103
34. Stephen Boyd and Lieven Vandenberghe. Convex Optimization. Cambridge University Press, 2004. DOI: 10.1017/CBO9780511804441. 3
35. Stephen P. B., Neal Parikh, Eric Chu, Borja Peleato, and Jonathan Eckstein. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers. Foundations and Trends in Machine Learning (FTML), 3(1):1 -122, 2011. DOI: 10.1561/2200000016. 30
36. Laurent Boyer,Amaury Habrard,Marc Sebban, Learning metrics between tree structured data: application to image recognition, Proceedings of the 18th European Conference on Machine Learning (ECML), 54-66, 2007,doi 10.1007/978-3-540-74958-5-9. 58.
37. Laurent Boyer, Yann Esposito, Amaury Habrard, José Oncina, and Marc Sebban. SEDiL: Software for Edit Distance Learning. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), pages 672-677, 2008. URL http://labh-curien.univ-st-etienne.fr/SEDiL/. DOI: 10.1007/978-3-540-87481-2-45. 54.
38. Laurent Boyer, Olivier Gandrillon, Amaury Habrard, Mathilde Pellerin, and Marc Sebban. Learning constrained edit state machines. In Proceedings of the 21st IEEE International Conference on Tools with Artificial Inte lligence (ICTAI), pages 734-741, 2009. DOI: 10.1109/ICTAI. 2009.27. 93
39. Lev M. Bregman. ?e relaxation method of finding the common points of convex sets and its application to the solution of problems in convex prog ramming. USSR Computational Mathematics and Mathematical Physics, 7(3):200-217, 1967. DOI: 10.1016/0041-5553(67)90040-7. 40
40. Leo Breiman. Random Forests. Machine Learning Journal (MLJ), 45(1):5-32, 2001. DOI: 10.1023/A:1010933404324. 41
41. Bin Cao, Xiaochuan Ni, Jian-Tao Sun, Gang Wang, and Qiang Yang. Distance Metric Learning under Covariate Shift. In Proceedings of the 22nd Internationa l Joint Conference on Artificial Intelligence (IJCAI), pages 1204-1210, 2011. DOI: 10.5591/978-1-57735-516-8/IJCAI11-205. 49
42. Qiong Cao, Zheng-Chu Guo, and Yiming Ying. Generalization Bounds for Metric and Similarity Learning. Technical report, University of Exeter, July 2012a. arXiv:1207.5437. 62, 63, 80
43. Qiong Cao, Yiming Ying, and Peng Li. Distance Metric Learning Revisited. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), pages 283-298, 2012b. DOI: 10.1007/978-3-642 -33460-3-24. 20
44. Rich Caruana. Multitask Learning. Machine Learning Journal (MLJ), 28(1):41-75, 1997. DOI: 10.1023/A:1007379606734. 43
45. Nicoló Cesa-Bianchi and Claudio Gentile. Improv ed Risk Tail Bounds for On-Line Algorithms. IEEE Transactions on Information ?eory (TIT), 54(1):386-390, 2008. DOI: 10.1109/TIT.2007.911292. 62
46. Nicolò Cesa-Bianchi and Gabor Lugosi. Prediction, Le arning, and Games. Cambridge University Press, 2006. DOI: 10.1017/CBO9780511546921. 28
47. Ratthachat Chatpatanasiri, Teesid Korsrilabutr, Pasakorn Tangchanachaianan, and Boonserm Kijsirikul. A new kernelization framework for Mahalanobis distance learning algorithms. Neurocomputing, 73:1570 -1579, 2010. DOI: 10.1016/j.neucom.2009.11.037. 34
48. Gal Chechik, Uri Shalit, Varun Sharma, and Samy Bengio. An Online Algorithm for Large Scale Image Similarity Learning. In Advances in Neural Information Processing Systems (NIPS) 22, pages 306-314, 2009. 27, 29, 74
49. Gal Chechik, Varun Sharma, Uri Shalit, and Samy Bengio. Large Scale Online Learning of Image Similarity ?rough Ranking. Journal of Machine Learning Research (JMLR), 11:1109-1135, 2010. DOI: 10.1145/1756006.1756042. 27, 29
50. Minmin Chen, Zhixiang Eddi e Xu, Kilian Q. Weinberger, and Fei Sha. Marginalized Denoising Autoencoders for Domain Adaptation. In Proceedings of the 29th International Conference on Machine Learning (ICML), 2012. 101
51. Li Cheng. Rieman nian Similarity Learning. In Proceedings of the 30th International Conference on Machine Learning (ICML), 2013. 27
52. Sumit Chopra, Raia Hadsell, and Yann LeCun. Learning a Similarity Metric Discriminatively, with Application to Face Verification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 539-546, 2005. DOI: 10.1109/CVPR.2005.202. 35
53. Ramazan Gokberk Cinbis, Jakob J. V, and Cordelia Schmid. Unsupervised metric learning for face identification in tv video. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), pages 1559-1566, 2011. DOI: 10.1109/ICCV.2011. 6126415. 87
54. Stéphan Clé mençon, Aurélien Bellet, and Igor Colin. Scaling-up Empirical Risk Minimization: Optimization of Incomplete U-statistics. Technical report, arXiv:1501.02629, 2015. DOI: 10.1109/ICCV.20 11.6126415. 28, 31
55. Corinna Cortes and Vladimir Vapnik. Support-Vector Networks. Machine Learning Journal (MLJ), 20(3):273-297, 1995. DOI: 10.1023/A:1022627411411. 14, 23
56. Corinna Cortes, Patrick Haffner, and Mehryar Mohri. Rational Kernels: ?eory and Algorithms. Journal of Machine Learning Research (JMLR), 5:1035- 1062, 2004. 14
57. Lomas Cover and Pet er Hart. Nearest neighbor pattern classification. IEEE Transactions on Information ?eory (TIT), 13(1):21-27, 1967. DOI: 10.1109/TIT.1967.1053964. 1, 14
58. Koby Crammer,Gal Chechik, Adaptive Regularization for Weight Matrices, Proceedings of the 29th International Conference on Machine Learning (ICML), 2012, 30.
59. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. Online Passive-Aggressive Algorithms. Journal of Machine Learning Research (JMLR), 7:551 -585, 2006. 29
60. Marco Cuturi and David Avis. Ground Metric Learning. Technical report, Kyoto University, 2011. 1110-2306. 51
61. Nilesh N. Dalvi, Philip Bohannon, and Fei Sha. Robust web extraction: an approach based on a probabilistic tree-edit model. In Proceedings of the ACM SIGMOD International Conferenc e on Management of data (COMAD), pages 335-348, 2009. DOI: 10.1145/1559845.1559882. 58
62. Jason V. Davis and Inderjit S. Dhillon. Structured metric learning for high dimensional problems. In Proceedings of the 14t h ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 195-203, 2008. DOI: 10.1145/1401890.1401918. 96
63. Jason V. Davis, Brian Kulis, Prateek Jain, Suvrit Sra, and Inderjit S. Dhillon. Informationtheoretic metric learning. In Proceedings of the 24th International Conference on Machine Learning (ICML), pages 209-216, 2007. DOI: 10.1145/1273496.1273523. 24, 34
64. Margaret O. Dayho ff, Robert M. Schwartz, and Bruce C. Orcutt. A model of evolutionary change in proteins. Atlas of protein sequence and structure, 5(3):345-351, 1978. 54
65. Ofer Dekel, Ran Gilad-Bachrach, Ohad Shamir, and Lin Xiao. Optimal Distributed Online Prediction Using Mini-Batches. Journal of Machine Learning Research (JMLR), 13:165-202, 2012. 30
66. Arthur P. D, Nan M. L., and Donald B. R. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1):1-38, 1977. 54
67. J. Deng, W. Dong, R. Socher, L.J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009. DOI: 10.1109/CVPR.2009.5206848. 88
68. Jia Deng, Alexander C. Berg, and Li Fei-Fei. Hierarchical semantic indexing for large scale image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 785-792, 2011. DOI: 10.1109/CVPR.2011.5995516. 10.
69. Li Deng and Dong Yu. Deep Learning: Methods and Applications. Foundations and Trends in Signal Processing (FTSP), 7(3-4):197- 387, 2014. DOI: 10.1561/2000000039. 35
70. Inderjit S. Dhillon and Joel A. Tropp. Matrix Nearness Problems with Bregman Divergences. SIAM Journal on Matrix Analysis and Applications, 29(4):1120-1146, 2007. DOI: 10.1137/060649021. 45
71. Huyen Do, Alexandros Kalousis, Jun Wang, and Adam Woznica. A metric learning perspective of SVM: on the relation of LMNN and SVM. In Proceedings of the 15th International Conference on Artificial Intelligence and Statistics (AISTA TS), pages 308-317, 2012. 22
72. John Duchi, Elad Hazan, and Yoram Singer. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research (JMLR), 12:2121-2159, 2011. 30
73. John C. Duchi, Alekh Agarwal, and Martin J. Wainwright. Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling. IEEE Transactions on Automatic Control (TAC), 57(3):592 -606, 2012. DOI: 10.1109/TAC.2011.2161027. 30
74. Martin Emms. On Stochastic Tree Distances and ?eir Training via Expectation-Maximisation. In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods (ICPRAM), pages 144-153, 2012. 58
75. Leodoros Evgeniou and Massimiliano Pontil. Regularized multi-task learning. In Proceedings of the 10th ACM SIGKDD International Conf erence on Knowledge Discovery and Data Mining, pages 109-117, 2004. DOI: 10.1145/1014052.1014067. 43
76. R. Fang, K. Tang, N. Snavely, and T. Chen. Towards computational models of kinship verification. In P roceedings of the International Conference on Image Processing (ICIP), page 1577-1580, 2010. DOI: 10.1109/ICIP.2010.5652590. 88
77. Bao Q. Feng. Equivalence constants for certain matrix norms. Linear Algebra and Its Applications, 374:247-253, 2003. DOI: 10.1016/S0024-3795(03)00616-5. 110
78. Imola K. Fodor. A Survey of Dimension Reduction Techniques. Technical report, Lawrence Livermore National Laboratory, 2002. UCRL-ID-148494. DOI: 10.2172/15002155. 3
79. Cedric Frambourg,Ahlame Douzal Chouakria,Eric Gaussier, Learning multiple temporal matching for time series classification, Proceedings of the 12th International Symposium on Advances in Intelligent Data Analysis (IDA), 8207, 198-209, 2013,doi 10.1007/978-3-642-41398-8-18.59.
80. Yoav Freund and Robert E. Schapire. A Decision-?eoretic Generalization of On-Line Learning and an Appli cation to Boosting. In Proceedings of the 2nd European Conference on Computational Learning ?eory (EuroCOLT), pages 23-37, 1995. DOI: 10.1006/jcss.1997.1504. 25
81. Jerome H. Friedman. Flexible Metric Nearest Neighbor Classification. Technical report, Department of Statistics, Stanford University, 1994. DOI: 10.1109/IGARSS.2008.4779695. 1
82. Jerome H. Friedman. Greedy Function Approximation: A Gradient Boosting Machine. Annals of Statistics (AOS), 29(5):1189-1232, 2001. DOI: 10.1214/aos/1013203451. 36
83. Andrea Frome, Yoram Singer, Fei Sha, and Jitendra Malik. Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), pages 1-8, 2007. DOI: 10.1109/ICCV.2007.4408839. 91
84. Keinosuke Fukunaga. Introduction to Statistical Pattern Recognition. Academic Press, 1990. 1
85. Xinbo Gao, Bing Xiao, Dacheng Tao, and Xuelong Li. A survey of graph edit distance. Pattern Analysis and Applications (PAA), 13(1):113- 129, 2010. DOI: 10.1007/s10044-008-0141-y. 13
86. Xingyu Gao, Steven C.H. Hoi, Yongdong Zhang, Ji Wan, and Jintao Li. SOML: Sparse Online Metric Learning with Application to Image Retrieval. In Proceedings of the 28th AAAI Conference on Artificial Intelligence, pages 1206-1212, 2014. 32
87. Lomas Gä rtner. A survey of kernels for structured data. SIGKDD Explorations, 5(1):49-58, 2003. DOI: 10.1145/959242.959248. 15
88. R. Gaudin and Nicolas Nicoloyannis. An adaptable time warping distance for time series learning. In Proceedings of the 5th International Conference on Machine Learning and Applications (ICMLA), December 2006. DOI: 10.1109/ICMLA.2006.12. 59
89. Bo Geng, Dacheng Tao, and Chao Xu. DAML: Domain Adaptation Metri c Learning. IEEE Transactions on Image Processing (TIP), 20(10):2980- 2989, 2011. DOI: 10.1109/TIP.2011.2134107. 49
90. Amir Globerson and Sam T. Roweis. Metric Learning by Collapsing Classes. In Advances in Neural Information Processing Systems (NIPS) 18, pages 451-458, 2005. 21
91. Jacob Goldberger, Sam Roweis, Geoff Hinton, and Ruslan Salakhutdinov. Neighbourhood Components Analysis. In Advances in Neural Information Processing Systems (NIPS) 17, pages 513-520, 2004. 20
92. Robert L. Goldstone, Douglas L. Medin, and Jamin Halberstadt. Similarity in context. Memory & Cognition, 25(2):237-255, 1997. DOI: 10.3758/BF03201115. 1
93. Mehmet Gönen and Ethem Alpaydin. Multiple Kernel Learning Algorithms. Journal of Machine Learning Research (JMLR), 12:2211-2268, 2011. 2
94. Arthur Gretton, Karsten M. B., Malte J. R., Bernhard Schölkopf, and Alexander J. S.. A Kernel Method for the Two-Sample-Problem. In Advances in Neural Information Processing Systems (NIPS) 19, pag es 513-520, 2006. 49
95. Matthieu Guillaumin, ?omas Mensink, Jakob Verbeek, and Cordelia Schmid. Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation. In Proceedings of the IEEE In ternational Conference on Computer Vision (ICCV), pages 309-316, 2009a . DOI: 10.1109/ICCV.2009.5459266. 90
96. Matthieu Guillaumin, Jakob J. Verbeek, and Cordelia Schmid. Is that you? Metric learning approaches for face identification. In Proceddings of the IEEE International Conference on Computer Vision (ICCV), pages 498-505, 2009 b. DOI: 10.1109/ICCV.2009.5459197. 87
97. Matthieu Guillaumin, Jakob Verbeek, and Cordelia Schmid. Multiple instance metric learning from automatically labeled bags of faces. In Proceedings of the 10th European Conference on Computer Vision (ECCV), volume 6311, pages 634-647, 2010. DOI: 10.1007/978-3-642-15549-9- 46. 87
98. Zheng-Chu Guo and Yiming Ying. Guaranteed Classification via Regularized Similarity Learning. Neural Computation, 26(3):497-522, 2014. DOI: 10.1162/NECO-a-00556. 63, 80, 81, 82, 102
99. James L. Hafner, Harpreet S. Sawhney, William Equitz, Myron Flickner, and Wayne Niblack. Efficient Color Histogram Indexing for Quadratic Form Distance Functions. IEEE Transactions on Pattern Analysis and Machine Int elligence (TPAMI), 17(7):729-736, 1995. DOI: 10.1109/34.391417. 11
100. Ulrike Hahn,Nick Chater,Lucy B.R.,Similarity as transformation, Cognition, 87, 1,1-32, 2003.
101. Trevor Hastie and Robert Tibshirani. Discriminant Adaptive Nearest Neighbor Classification. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 18(6):607-616, 1996. DOI: 10.1109/34.506411. 1
102. Sø ren Hauberg, Oren Freifeld, and Michael J. Black. A Geometric take on Metric Learning. In Advances in Neural Information Processing Systems (NIPS) 25, pages 2033-2041, 2012. 38
103. Yujie He, Wenlin Chen, and Yixin Chen. Kernel Density Metric Learning. Technical report, Washington University in St. Louis, 2013. 34
104. Steven Henikoff and Jorja G. Henikoff. Amino acid substitution matrices from protein blocks. Proceedings of the National Academy of Sciences of the United States of America, 89(22):10915-10919, 1992. DOI: 10.1073/pnas.89.22.10915. 54
105. Steven C. Hoi, Wei Liu, Michael R. Lyu, and Wei-Ying Ma. Learning Distance Metrics with Contextual Constraints for Image Retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pa ges 2072-2078, 2006. DOI: 10.1109/CVPR.2006.167. 34
106. Steven C. Hoi, Wei Liu, and Shih-Fu Chang. Semi-supervised distance metric learning for Collaborative Image Retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008. DOI: 10.1109/CVPR.2008.4587351. 47, 48
107. Steven C. Hoi, Wei Liu, and Shih-Fu Chang. Semi-supervised distance metric learning for collaborative image retrieval and clustering. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 6(3), 2010. DOI: 10.1145/1823746.1823752. 47, 48
108. Junlin Hu, Jiwen Lu, and Yap-Peng Tan. Discriminative Deep Metric Learning for Face Verification in the Wild. In IEEE Conference on Computer Vision an d Pattern Recognition (CVPR), pages 1875-1882, 2014. DOI: 10.1145/1823746.1823752. 35
109. G. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007. 86
110. Prateek Jain, Brian Kulis, Inderjit S. Dhillon, and Kristen Grauman. Online Metric Learning and Fast Similarity Search. In Advances in Neural Information Processing Systems (NIPS) 21, pages 761-768, 2008. 24, 29
111. Prateek Jain, Brian Kulis, and Inderjit S. Dhillon. Inductive Regularized Learning of Kernel Functions. In Advances in Neural Information Processing Systems (NIPS) 23, pages 946-954, 2010. 34
112. Prateek Jain, Brian Kulis, Jason V. Davis, and Inderjit S. Dhillon. Metric and Kernel Learning Using a Linear Transformation. Journal of Machine Learning Research (JMLR), 13:519-547, 2012. 34
113. Young-Seon Jeong, Myong K. Jeong, and Olufemi A. Omitaomu. Weighted dynamic time warping for time series classification. Pattern Recognition, 44(9):2231- 2240, 2010. DOI: 10.1016/j.patcog.2010.09.022. 59
114. Rong Jin, Shijun Wang, and Yang Zhou. Regu larized Distance Metric Learning: ?eory and Algorithm. In Advances in Neural Information Processing Systems (NIPS) 22, pages 862-870, 2009. 29, 62, 64
115. Lorsten Joachims, ?omas Finley, and Chun-Nam J. Yu. Cuttin g-plane training of structural SVMs. Machine Learning Journal (MLJ), 77(1):27-59, 2009. DOI: 10.1007/s10994-009-5108-8. 46
116. Purushottam Kar and Prateek Jain. Similarity-based Learning via Data Driven E mbeddings. In Advances in Neural Information Processing Systems (NIPS) 24, 2011. 77
117. Purushottam Kar, Bharath Sriperumbudur Prateek Jain, and Harish Karnick. On the Generalization Ability of Online Learning Alg orithms for Pairwise Loss Functions. In Proceedings of the 30th International Conference on Machine Learning, 2013. 63
118. Tsuyoshi Kato and Nozomi Nagano. Metric learning for enzyme active-site search. Bioinformatics, 26(21):2698- 2704, 2010. DOI: 10.1093/bioinformatics/btq519. 94
119. Leonard Kaufman and Peter Rousseeuw. Clustering by Means of Medoids. In Y. Dodge, Elsevier/ North Holland, editor, Statistical Data adlysis based on the L1 norm and Related Methods, pages 405-416, 1987. 15
120. Dor Kedem, Stephen Tyree, Kilian Weinberger, Fei Sha, and Gert Lanckriet. Non-linear Metric Learning. In Advances in Neural Information Processing Systems (NIPS) 25, pages 2582-2590, 2012. 35, 50, 101
121. Anne-Louise Klaus and Chi-Kwong Li. Isometries for the vector (p,q) norm and the induced (p,q) norm. Linear & Multilinear Algebra, 38(4):315-332, 1995. DOI: 10.1080/03081089508818368. 110
122. Andrei N. K.,Vassili M. T. entropy and capacity of sets in functional spaces, American Mathematical Society, Translations, 2,17):277-364,1961, 69.
123. Vladimir Koltchinskii. Rademacher penalties and structural risk minimization. IEEE Transactions on Information ?eory (TIT), 47(5):1902- 1914, 2001. DOI: 10.1109/18.930926. 61
124. J. B. Kruskall and M. Liberman. ?e symmetric time warping algorithm: From continuous to discrete. Time warps, string edits and macromolecules, 1983. 58
125. Brian Kulis, Mát yás A. Sustik, and Inderjit S. Dhillon. Learning low-rank kernel matrices. In Proceedings of the 23rd International Conference on Machine Learning (ICML), pages 505-512, 2006. DOI: 10.1145/1143844.1143908. 24
126. Brian Kulis, Prateek Jain, and Kristen Grauman. Fast Similarity Search for Learned Metrics. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 31(12):2143-2157, 2009. DOI: 10.11 09/TPAMI.2009.151. 24
127. Brian Kulis, Kate Saenko, and Trevor Darrell. What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In Proceedings of the IEEE Conference on Computer Vi sion and Pattern Recognition (CVPR), pages 1785-1792, 2011. DOI: 10.1109/CVPR.2011.5995702. 48
128. Solomon Kullback and Richard Leibler. On Information and Sufficiency. Annals of Mathematical Statistics, 22(1):79-86, 1951. DOI: 10.1214/aoms/1177729694. 41
129. M. P. Kumar, Philip H. S. T., and Andrew Zisserman. An Invariant Large Margin Nearest Neighbour Classifier. In Proceedings of the IEEE Inte rnational Conference on Computer Vision (ICCV), pages 1-8, 2007. DOI: 10.1109/ICCV.2007.4409041. 101
130. Gautam Kunapuli and Jude Shavlik. Mirror Descent for Metric Learning: A Unified Approach. In Proceedings of t he European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Database (ECML/PKDD), pages 859-874, 2012. DOI: 10.1007/978-3-642-33460-3-60. 25
131. Ré mi Lajugie, Sylvain Arlot, and Fran cis Bach. Large-Margin Metric Learning for Constrained Partitioning Problems. In Proceedings of the 31st International Conference on Machine Learning (ICML), 2014a. 101
132. Ré mi Lajugie, Damien Garreau, Francis R. Bach, and Sylvain Arlot. Metric learning for temporal sequence alignment. In Advances in Neural Information Processing Systems (NIPS) 27, pages 1817-1825, 2014b. 59, 99
133. Nicolas Le Roux, Mark W. Schmidt, and Francis Bach. A Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets. In Advances in Neural Information Processing Systems (NIPS) 25, pages 2672-2680, 2012. 30
134. Guy Lebanon . Metric Learning for Text Documents. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 28(4):497-508, 2006. DOI: 10.1109/TPAMI.2006.77. 96
135. Jung-Eun Lee, Rong Jin, and A nil K. Jain. Rank-based distance metric learning: An application to image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008. DOI: 10.1109/CVPR.2008.4587389. 95
136. C hristina S. Leslie, Eleazar Eskin, and William S. Noble. ?e Spectrum Kernel: A String Kernel for SVM Protein Classification. In Pacific Symposium on Biocomputing, pages 566-575, 2002 a. 13
137. Christina S. L eslie, Eleazar Eskin, Jason Weston, and William S. Noble. Mismatch String Kernels for SVM Protein Classification. In Advances in Neural Information Processing Systems (NIPS) 15, pages 1417-1424, 2002 b. 14
138. Vladimir I. Levenshtein. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics-Doklandy, 6:707- 710, 1966. 12
139. Fei-Fei Li and Pietro Perona. A Bayesian Hierarc hical Model for Learning Natural Scene Categories. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 524-531, 2005. DOI: 10.1109/CVPR.2005.16. 11, 53, 85
140. Haifeng Li and Tao Jiang. A class of edit kernels for SVMs to predict translation initiation sites in eukaryotic mRNAs. In Proceedings of the 8th Annual International Conference on Research in Computational Molecular Biology (RECOMB), pages 262-2 71, 2004. DOI: 10.1145/974614.974649. 14
141. Xi Li, Chunhua Shen, Qinfeng Shi, Anthony R. Dick, and Anton van den Hengel. Non-sparse linear representations for visual tracking with online reservoir metric learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012. DOI: 10.1109/CVPR.2012.6247872. 92
142. Daryl Lim and Gert R. Lanckriet. Efficient Learning of Mahalanobis Metrics for R anking. In Proceedings of the 31st International Conference on Machine Learning (ICML), pages 1980-1988, 2014. 47
143. Daryl K L,Brian McFee,Gert Lanckriet, Robust Structural Metric Learning, In Proceedings of the 30th International Conference on Machine Learning (ICML), 2013, 47.
144. Nick Littlestone. Learning Quickly When Irrelevant Attributes Abound: A New Linear-?reshold Algorithm. Machine Learning Journal (MLJ) , 2(4):285-318, 1988. DOI: 10.1023/A:1022869011914. 28
145. Kuan Liu, Auré lien Bellet, and Fei Sha. Similarity Learning for High-Dimensional Sparse Data. Technical report, arXiv:1411.2374, 2014. 32
146. Meizhu Liu and Baba C. Vemuri. A Robust and Efficient Doubly Regularized Metric Learning Approach. In Proceedings of the 12th European Conference on Computer Vision (ECCV), pages 646-659, 2012. DOI: 10.1007/978-3-642-33765-9-46. 26
147. Tie-Yan Liu. Learning to Rank for Information Retrieval. Foundations and Trends in Information Retrieval (FTIR), 3(3):225-331, 2009. DOI: 10.1561/1500000016.
148. Wei Liu, Shiqian Ma, Dacheng Tao, Jianzhuang Liu, and Peng Liu. Semi-Supervised Sparse Metric Learning using Alternating Linearization Optimization. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 1139-1148, 2010. DOI: 10.1145/1835804.1835947. 48
149. Stuart P. Lloyd. Least squares quantization in PCM. IEEE Transactions on Information ?eory (TIT), 28:129- 137, 1982. DOI: 10.1109/TIT.1982.1056489. 1, 15
150. Huma Lodhi, Craig Saunders, John Shawe-Taylor, Nello Cristianini, and Chris Watkins. Text Classification using String Kernels. Journal of Machine Learning Research (JMLR), 2:419 -444, 2002. DOI: 10.1162/153244302760200687. 14, 53
151. Jiwen Lu, Junlin Hu, Xiuzhuang Zhou, Yuanyuan Shang, Yap-Peng Tan, and Gang Wang. Neighborhood repulsed metric learning for kinship verification. In Proceedings of the IEEE Confer ence on Computer Vision and Pattern Recognition (CVPR), pages 2594-2601, 2012a. DOI: 10.1109/CVPR.2012.6247978. 88
152. Jiwen Lu, Gang Wang, and ?omas S. Huang. Gait-based gender classification in unconstrained environments. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR), pages 3284-3287, 2012b. DOI: 10.1109/ITNG.2013.134. 91
153. Prasanta Chandra Mahalanobis. On the generalised distance in statistics. Proceedings of the National Institute of Sciences of India, 2(1):49-55, 1936. 9
154. Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze. Introduction to Information Retrieval. Cambridge University Press, 2008. DOI: 10.1017/CBO9780511809071. 1, 15
155. Yishay Mansour, Mehryar Mohri, and Afshin Rostamizadeh. Domain Adaptation: Learning Bounds and Algorithms. In Proceedings of the 22nd Annual Conference on Learning ?eory (COLT), 2009. 48
156. Arthur B. Markman and Dedre Gentner. Structural Alignment during Similarity Comparisons. Cognitive Psychology, 25(4):431-467, 1993. DOI: 10.1006/cogp.1993.1011. 1
157. Andrew McCallum, Kedar Bellare, and Fernando Pereira. A Conditional Random Field for Discriminatively-trained Finite-state String Edi t Distance. In Proceedings of the 21st Conference in Uncertainty in Artificial Intelligence (UAI), pages 388-395, 2005. 56
158. Colin McDiarmid. Surveys in Combinatorics, chapter On the method of bounded differences, pages 148-188. Cambridge University Press, 1989. 66
159. Brian McFee and Gert R. G. Lanckriet. Metric Learning to Rank. In Proceedings of the 27th International Conference on Machine Learning (ICML), pages 775-782, 2010. 46, 68, 73
160. Douglas L. Medin, Robert L. Goldstone, and Dedre Gentner. Respects for similarity. Psychological Review, 100(2):254-278, 1993. DOI: 10.1037/0033-295X.100.2.254. 1
161. ?omas Mensink, Jakob J. Verbeek, Florent Perronnin, and Gabriela Csurka. Metric learning for large scale image classification: Generalizing to new classes at near-zero cost. In Proceedings of the 10th European Conference on Co mputer Vision (ECCV), pages 488-501, 2012. DOI: 10.1007/978-3-642-33709-3-35. 90
162. Luisa Micó and Jose Oncina. Comparison of fast nearest neighbour classifiers for handwritten character recognition. Pattern Reco gnition Letters (PRL), 19:351-356, 1998. DOI: 10.1016/S0167-8655(98)00007-5. 54
163. Kenta Mikawa, Takashi Ishida, and Masayuki Goto. A proposal of extended cosine measure for distance metric learning in text cl assification. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 1741-1746, 2011. DOI: 10.1109/ICSMC. 2011.6083923. 96
164. Kenta Mikawa,Takashi Ishida,Masayuki Goto, An optimal weighting method by using the category information in text classification based on metric learning, Industrial Engineering & Management Systems, 11(1), 87 -93, 2012,doi 10.7232/iems.2012.1 1.1.087. 96.
165. David W. Mount. Bioinformatics: Sequence and Genome Analysis. Cold Spring Harbor Laboratory Press, 2nd edition, 2004. 12
166. Saul B. Needleman and Christian D. Wunsch. A general method applicable to the search for similarities in the amino acid sequence of two proteins. Journal of Molecular Biology (JMB), 48 (3):443-453, 1970. DOI: 10.1016/0022-2836(70)90057-4. 13
167. Yurii Nesterov. Smoot h minimization of non-smooth functions. Mathematical Programming, 103:127-152, 2005. DOI: 10.1007/s10107-004-0552-5. 25
168. Michel Neuhaus and Horst Bunke. Automatic learning of cost functions for graph edit distance. Journal of Information Science (JIS), 177(1):239-247, 2007. DOI: 10.1016/j.ins.2006.02.013. 58
169. Behnam Neyshabur, Nati Sr ebro, Ruslan Salakhutdinov, Yury Makarychev, and Payman Yadollahpour. ?e Power of Asymmetry in Binary Hashing. In Advances in Neural Information Processing Systems (NIPS) 26, pages 2823-2831, 2013. 37
170. Hieu V. Nguyen and Li Bai. Cosine Similarity Metric Learning for Face Verification. In Proceedings of the 10th Asian Conference on Computer Vision (ACCV), pages 709-720, 2010. DOI: 10.1007/978-3-642-19309-5-55. 27
171. Nam Nguyen and Yunsong Guo. Metric Learning: A Support Vector Approach. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), pages 125-136, 2008. DOI: 10.1007/978-3-540-87481-2-9. 22
172. Mohammad Norouzi, David J. Fleet, and Ruslan Salakhutdinov. Hamming Distance Metric Learning. In Advances in Neural Information Processing Systems (NIPS) 25, pages 1070-1078, 2012a. 36
173. Mohammad Norouzi, Ali Punjani, and David J. Flee t. Fast Search in Hamming Space with Multi-Index Hashing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012b. DOI: 10.1109/CVPR.2012.6248043. 36
174. Robert M. Nosofsky. Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General, 115(1):39-57, 1986. DOI: 10.1037/0096-3445.115.1.39. 1
175. Eric Nowak and Frédéric Jurie. L earning visual similarity measures for comparing never seen objects. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2007. DOI: 10.1109/CVPR.2007.382969. 91
176. Jose Oncina and Ma rc Sebban. Learning Stochastic Edit Distance: application in handwritten character recognition. Pattern Recognition (PR), 39(9):1575-1587, 2006. DOI: 10.1016/j.patcog.2006.03.011. 55, 58
177. Shibin Parameswaran and Kilian Q. Weinberger. Large Margin Multi-Task Metric Learning. In Advances in Neural Information Processing Systems (NIPS) 23, pages 1867-1875, 2010. 43
178. Kyoungup Park, Chunhua Shen, Zhihui Hao, and Junae Kim. Efficiently Learning a Distance Metric for Large Margin Nearest Neighbor Classification. In Proceedings of the 25th AAAI Conference on Artificial Intelligence, 2011. 22
179. Mateusz Pawlik and Nikolaus Augs ten. RTED: a robust algorithm for the tree edit distance. Proceedings of the VLDB Endowment, 5(4):334- 345, 2011. DOI: 10.14778/2095686.2095692. 13
180. Karl Pearson. On Lines and Planes of Closest Fit to Points in Space. Philosophical Magazine, 2 (6):559-572, 1901. DOI: 10.1080/14786440109462720. 14, 34
181. Michaël Perrot, Amaury Habrard, Damien Muselet, and Marc Sebban. Modeling perceptual co lor differences by local metric learning. In Proceedings of the 13th European Conference on Computer Vision (ECCV), pages 96-111, 2014. DOI: 10.1007/978-3-319-10602-1-7. 92
182. Ali M. Qamar and Eric Gaussier. Online and Batch Learning of Generalized Cosine Similarities. In Proceedings of the IEEE International Conference on Data Mining (ICDM), pages 926-931, 2009. DOI: 10.1109/ICDM.2009.114. 27
183. Ali M. Qamar, Eric Gaussier, Jean-Pierre Chevallet, and Joo-Hwee Lim. Similarity Learning for Nearest Neighbor Classification. In Proceedings of the IEEE International Conference on Data Mining (ICDM), pages 983-988, 2 008. DOI: 10.1109/ICDM.2008.81. 27, 74, 96
184. Guo-Jun Qi, Jinhui Tang, Zheng-Jun Zha, Tat-Seng Chua, and Hong-Jiang Zhang. An Efficient Sparse Metric Learning in High-Dimensional Space via l1-Penalized Log-D eterminant Regularization. In Proceedings of the 26th International Conference on Machine Learning (ICML), 2009. DOI: 10.1145/1553374.1553482. 24
185. Qi Qian, Rong Jin, Shenghuo Zhu, and Yuanqing Lin. An Integrate d Framework for High Dimensional Distance Metric Learning and Its Application to Fine-Grained Visual Categorization. Technical report, arXiv:1402.0453, 2014. 32
186. Joaquin Quiñonero-Candela, Dataset Shift in Machine Learning, MIT Press, 2009, 48.
187. Deva Ramanan and Simon Baker. Local Distance Functions: A Taxonomy, New Algorithms, and an Evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 33(4):794 -806, 2011. DOI: 10.1109/TPAMI.2010.127. 37
188. Chotirat Ann Ratanamahatana and Eamonn Keogh. Making time-series classification more accurate using learned constraints. In Proceedings of the SIAM International Conference on Data Mining (SDM), pages 11-22, 2004. 59
189. Benjamin Recht, Christopher Re, Stephen J. Wright, and Feng Niu. Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descen t. In Advances in Neural Information Processing Systems (NIPS) 24, pages 693-701, 2011. 30
190. Eric S. Ristad and Peter N. Yianilos. Learning String-Edit Distance. IEEE Transactions on Pattern Analysis an d Machine Intelligence (TPAMI), 20(5):522-532, 1998. DOI: 10.1109/34.682181. 54, 55, 56, 58
191. Romer Rosales and Glenn Fung. Learning Sparse Metrics via Linear Programming. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 367-373, 2006. DOI: 10.1145/1150402.1150444. 25, 68, 73
192. Eleanor Rosch. Cognitive reference points. Cognitive Psychology, 7(4):532-547, 1975. DOI: 10.1016/0010-0285(75)90021-3. 26
193. Yossi Rubner, Carlo Tomasi, and Leonidas J. Guibas. ?e Earth Mover's Distance as a Metric for Image Retrieval. International Journal of C omputer Vision (IJCV), 40(2):99-121, 2000. DOI: 10.1023/A:1026543900054. 11, 51
194. Kate Saenko, Brian Kulis, Mario Fritz, and Trevor Darrell. Adapting Visual Category Models to New Domains. In Pr oceedings of the 11th European Conference on Computer Vision (ECCV), pages 213-226, 2010. DOI: 10.1007/978-3-642-15561-1-16. 49
195. Hiroto Saigo, Jean-Philippe Vert, Nobuhisa Ueda, and Tatsuya Akutsu. Protein homology detection using string alignment kernels. Bioinformatics, 20(11):1682-1689, 2004. DOI: 10.1093/bioinformatics/bth141. 14, 56
196. Hiroto Saigo, Jean-Philippe Vert, and Tatsuya Akutsu. Optimizing amino acid substitution matrices with a local alignment kernel. Bioinformatics, 7(246):1-12, 2006. DOI: 10.1186/1471-2105-7-246. 56, 93
197. Hiroaki Sakoe. Dynamic programming a lgorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing (TASS), 26:43-49, 1978. DOI: 10.1109/TASSP.1978.1163055. 59
198. Ruslan Salakhutdinov and Geoffrey E. Hinton. Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure. In Proceedings of the 11th International Conference on Artificial Intelligence and Statistics (AISTATS), pages 412-419, 2007. 35
199. G erard Salton, Andrew Wong, and C. S. Yang. A vector space model for automatic indexing. Communications of the ACM, 18(11):613-620, 1975. DOI: 10.1145/361219.361220. 10, 11, 15, 53
200. Craig Saun ders, Alexander Gammerman, and Volodya Vovk. Ridge Regression Learning Algorithm in Dual Variables. In Proceedings of the 15th International Conference on Machine Learning (ICML), pages 515-521, 1998. 14
201. Robert E. Schap ire and Yoav Freund. Boosting: Foundations and Algorithms. MIT Press, 2012. 25
202. Jü rgen Schmidhuber. Deep Learning in Neural Networks: An Overview. Technical report, arXiv:1404.7828, 2014. DOI: 10.1016/j.neunet.2014.09.003. 35
203. Bernhard Schölkopf and Alexander J. Smola. Learning With Kernels, Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, 2001. 1, 8, 14-33
204. Bernhard Schö lkopf, Alexander Smola, and Klaus-Robert Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation (NECO), 10(1):1299-1319, 1998. DOI: 10.1162/089976698 300017467. 14, 34
205. Matthew Schultz and ?orsten Joachims. Learning a Distance Metric from Relative Comparisons. In Advances in Neural Information Processing Systems (NIPS) 16, 2003. DOI: 10.1145/1273496.1273523. 23, 32, 34, 74
206. Stanley M. Selkow. ?e tree-to-tree editing problem. Information Processing Letters, 6(6):184-186, 1977. DOI: 10.1016/0020-0190(77)90064-3. 13, 58
207. Shai Shalev-Shwartz,Tong Zhang, Stochastic Dual Coordinate Ascent Methods for Regularized Loss Minimization, Journal of Machine Learning Research (JMLR), 14(1):567-599, 2013, 30.
208. Shai Shalev-Shwartz, Yoram Singer, and Andrew Y. Ng. Online and batch learning of pseudometrics. In Proceedings of the 21st International Conference on Machine Learning (ICML), 2004. DOI: 10.1145/1015330.1015376. 28-34
209. Uri Shalit, Daphna Weinshall, and Gal Chechik. Online Learning in ?e Manifold of Low-Rank Matrices. In Advances in Neural Information Processing Systems (NIPS) 23, pages 2128-2136, 2010. 30
210. Uri Shalit, Daphna Weinshall, and Gal Chechik. Online Learning in the Embedded Manifold of Low-rank Matrices. Journal of Machine Learning Research (JMLR), 13:429-458, 2012. 30
211. Blake Shaw, Bert C. Huang, and Tony Jebara. Learning a Distance Metric from a Network. In Advances in Neural Information Processing Systems (NIPS) 24, pages 1899-1907, 2011. 101
212. Chunhua Shen, Junae Kim, Lei Wang, and Anton van den Hengel. Positive Semide finite Metric Learning with Boosting. In Advances in Neural Information Processing Systems (NIPS) 22, pages 1651-1660, 2009. 22, 25
213. Chunhua Shen, Junae Kim, Lei Wang, and Anton van den Hengel. Posi tive Semidefinite Metric Learning Using Boosting-like Algorithms. Journal of Machine Learning Research (JMLR), 13: 1007-1036, 2012. 25
214. Roger N. Shepard. Toward a Universal Law of Generalization for Psychological Science. Science, 237(4820):1317-1323, 1987. DOI: 10.1126/science.3629243. 1
215. Yuan Shi, Auré lien Bellet, and Fei Sha. Sparse Compositional Metric Learning. In Proceedings of the 28th AAAI Conference on Artificial Intelligence, pages 2078-2084, 2014. 22, 32, 39, 68, 73
216. Robert D. Short and Keinosuke Fukunaga. ?e optimal distance measure for nearest neighbor classification. IEEE Transactions on Informa tion ?eory (TIT), 27(5):622-626, 1981. DOI: 10.1109/TIT.1981.1056403. 1
217. Josef Sivic and Andrew Zisserman. Efficient visual search of videos cast as text retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 31:591 -606, 2009. DOI: 10.1109/TPAMI.2008.111. 10, 15, 27, 96
218. Temple F. Smith and Michael S. Waterman. Identification of common molecular subsequences. Journal of Molecular Biology (JMB), 147(1):195-197, 1981. DOI: 10.1016/0022-2836(81)90087-5. 13
219. Suvrit Sra, Sebastian Nowozin , and Stephen J. Wright, editors. Optimization for Machine Learning. MIT Press, 2011. 3
220. Atsuhiro Takasu. Bayesian Similarity Model Estimation for Approximate Recognized Text Search. In Proceedings of the 10th International Conference on Document Analysis and Recognition (ICDAR), pages 611-615, 2009. DOI: 10.1109/ICDAR.2009.193. 55
221. Daniel Tarlow, Kevin Swersky, Ilya Sutskever, Laurent Charlin, and Rich Ze mel. Stochastic k-Neighborhood Selection for Supervised and Unsupervised Learning. In Proceedings of the 30th International Conference on Machine Learning (ICML), 2013. 21
222. Lorenzo Torresani and Kuang-Chih Lee. Large Margin Component Analysis. In Advances in Neural Information Processing Systems (NIPS) 19, pages 1385-1392, 2006. 22, 34, 44
223. Ioannis Tsochantaridis, ?orsten Joachims, ?omas Hofmann, and Yasemin Altun. Large Margin Methods for Structured and Interdependent Output Variables. Journal of Machine Learning Research, 6:1453 -1484, 2005. 46
224. Yuta Tsuboi, Hisashi Kashima, Shohei Hido, Steffen Bickel, and Masashi Sugiyama. Direct Density Ratio Estimation for Large-scale Covariate Shift Adaptation. In Proceedings of the SIAM International Conference on Data Mining (SDM), pages 443-454, 2008. DOI: 10.2197/ipsjjip. 17.138. 49
225. Amos Tversky. Features of similarity. Psychological Review, 84(4):327-352, 1977. DOI: 10.1037/0033-295X.84.4.327. 1, 26
226. Amos Tversky and Itamar Gati. Similarity, separabili ty, and the triangle inequality. Psychological Review, 89(2):123-154, 1982. DOI: 10.1037/0033-295X.89.2.123. 26
227. Jeffrey K. Uhlmann. Satisfying general proximity / similarity queries with metric trees. Information Processing Letters, 40(4):175-179, 1991. DOI: 10.1016/0020-0190(91)90074-R. 26
228. Leslie G. Valiant, A theory of the learnable. Communications of the ACM, 27, 1134-1142, 1984,doi 10.1145/1968.1972. 61,64.
229. Laurens van der Maaten and Geoffrey Hinton. Visualizing Data using t-SNE. Journal of Machine Learning Research (JMLR), 9:2579- 2605, 2008. 15
230. Laurens J.P. van der Maaten, Eric O. Postma, and H. Jaap van den Herik. Dimensionality Reduction: A Comparative Review. Technical report, Tilburg University, 2009. TiCC-TR 2009-005. 3
231. Aad W. van der Vaart and Jon A. Wellner. Weak convergence and empirical processes. Springer, 2000. 108
232. Vladimir N. V. Statistical Learning ?eory. Wiley-Interscience, 1998. 82
233. Vladimir N. V. and Alexey Y. C. On the uniform convergence of relative frequencies of events to their probabilities. ?eory of Probability and its Applications (TPA), 16(2): 264-280, 1971. DOI: 10.1137/1116025. 61
234. Rav iteja Vemulapalli and David W. J. Riemannian Metric Learning for Symmetric Positive Definite Matrices. Technical report, arXiv:1501.02393, 2015. DOI: 10.1016/j.laa.2009.01.025. 101
235. Jarkko Venna, Jaakko Peltonen, Kristian Nybo, Helena Aidos, and Samuel Kaski. Information Retrieval Perspective to Nonlinear Dimensionality Reduction for Data Visualization. Journal of Machine Learning Research (JMLR), 11:451 -490, 2010. DOI: 10.1145/1756006.1756019. 15
236. Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th International Conference on Machine Learning (ICML), pages 1096-1103, 2008. DOI: 10.1145/1390156.1390294. 101
237. Kiri Wagstaff, Claire Cardie, Seth Rogers, and Stefan Schrödl. Constrained K-means Clustering wi th Background Knowledge. In Proceedings of the 18th International Conference on Machine Learning (ICML), pages 577-584, 2001. 20
238. Fan Wang and Leonidas J. Guibas. Supervised Earth Mover's Distance Learning and Its Computer Vision Applications. In Proceedings of the 12th European Conference on Computer Vision (ECCV), pages 442-455, 2012. DOI: 10.1007/978-3-642-3371 8-5-32. 51
239. Fang Wang, Shuqiang Jiang, Luis Herranz, and Qingming Huang. Improving image distance metric learning by embedding semantic relations. In Proceedings of the 13th Pacific-Rim Conference on Multimedia (PCM), volume 7674, pages 424-434, 2012a. DOI: 10.1007/978-3-642-34778-8-39. 91
240. Jingyan Wang, Xin Gao, Quanquan Wang, and Yongping Li. ProDis-ContSHC: learning protein dissimilarity measures and hierarchical context coherently for protein-protein comparison in protein database retrieval. BMC Bioinformatics, 13(S-7):S2, 2012b. DOI: 10.1186/1471 -2105-13-S7-S2. 95
241. Jun Wang, Huyen T. D., Adam Woznica, and Alexandros Kalousis. Metric Learning with Multiple Kernels. In Advances in Neural Information Processing Systems (NIPS) 24, pages 1170-1178, 2011. 35
242. Jun Wang, Adam Woznica, and Alexandros Kalousis. Parametric Local Metric Learning for Nearest Neighbor Classification. In Advances in Neural Information Processing Systems (NIPS) 25, pages 1610-1618, 2012c. 22, 38
243. Qianying Wang, Pong C. Y., and Guocan Feng. Semi-supervised metric learning via topology preserving multiple semi-supervised assumptions. Pattern Recognition (PR), 2013a. DOI: 10.1016/j.patcog.2013.02.015. 48
244. Yuyang Wang, Roni Khardon, Dmitry Pechyony, and Rosie Jones. Generalization Bounds for Online Learning Algorithms with Pairwise Loss Functions. In Proceedings of the 25th Annual Conference on Learning ?eory (COLT), pages 13.1-13.22, 2012d. 62
245. Yuyang Wang, Roni Khardon, Dmitry Pechyony, and Rosie Jones. Online Learning with Pairwise Loss Functions. Technical report, Tufts University, January 2013b. arXiv:1301.5332. 62
246. Zhengxiang Wang, Yiqun Hu, and Liang-Tien Chia. Image-to-class distance metric learning for image classification. In Proceedings of the 10th European Conference on Computer Vision (ECCV), volume 6311, pages 706-719, 2010. DOI: 10.1007/978-3-642-15549-9-51. 89
247. Kilian Q. Weinberger and Lawrence K. Saul. Fast Solvers and Efficient Implementations for Distance Metric Learning. In Proceedings of the 25th Internati onal Conference on Machine Learning (ICML), pages 1160-1167, 2008. DOI: 10.1145/1390156.1390302. 21, 38
248. Kilian Q. Weinberger and Lawrence K. Saul. Distance Metric Learning for Large Margin Nearest Neighbor Classification. Journal of Machine Learning Research (JMLR), 10:207 -244, 2009. DOI: 10.1145/1577069.1577078. 21, 38
249. Kilian Q. Weinberger, John Blitzer, and Lawrence K. Saul. Distance Metric Lear ning for Large Margin Nearest Neighbor Classification. In Advances in Neural Information Processing Systems (NIPS) 18, pages 1473-1480, 2005. DOI: 10.1145/1577069.1577078. 21
250. Lei Wu,Rong Jin,Steven C.-H.H, Jianke Zhu,Nenghai Yu, Learning Bregman Distance Functions and Its Application for Semi-Supervised Clustering, In Advances in Neural Information Processing Systems (NIPS), 22, pages 2089-2097, 2009, 40, 59.
251. Lei Wu, Steven C.-H. Hoi, Rong Jin, Jianke Zhu, and Nenghai Yu. Learning Bregman Distance Functions for Semi-Supervised Clustering. IEEE Transactions on Knowledge and Data Engineering (TKDE), 24(3):478 -491, 2012. DOI: 10.1109/TKDE.2010.215. 40
252. Gaoyu Xiao and Anant Madabhushi. Aggregated distance metric learning (adm) for image classification in presence of limited training data. In Proceedings of the 14th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), volume 6893, pages 33-40, 2011. 91
253. Pengtao Xie and Eric Xing. Large Scale Distributed Distance Metric Learning. Technical report, arXiv:1412.5949, 2014. 31
254. Eric P. X., Andrew Y. N., Michae l I. J., and Stuart J. R. Distance Metric Learning with Application to Clustering with Side-Information. In Advances in Neural Information Processing Systems (NIPS) 15, pages 505-512, 2002. 1, 19
255. Caiming Xiong, David Johnson, Ran Xu, and Jason J. Corso. Random forests for metric learning with implicit pairwise position dependence. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and D ata Mining, pages 958-966, 2012. DOI: 10.1145/2339530.2339680. 41
256. Huilin Xiong and Xue-Wen Chen. Kernel-based distance metric learning for microarray data classification. BMC Bioinformatics, 7:299, 2006. DOI: 10.1186/1471-2105-7-299. 95
257. Huan Xu and Shie Mannor. Robustness and Generalization. In Proceedings of the 23rd Annual Conference on Learning ?eory (COLT), pages 503-515, 2010. DOI: 10.1007/s10994-011-5268-1. 68
258. Huan Xu and Shie Mannor. Robustness and Generalization. Machine Learning Journal (MLJ), 86(3):391-423, 2012. DOI: 10.1007/s10994-011-5268-1. 62, 68, 69
259. Huan Xu, Const antine Caramanis, and Shie Mannor. Sparse Algorithms Are Not Stable: A No-Free-Lunch ?eorem. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 34(1):187 -193, 2012. DOI: 10.1109/TPAMI.2011.177. 68
260. Rui Xu and Don C. Wunsch. Clustering. Wiley-IEEE Press, 2008. 15
261. Liu Yang and Rong Jin. An efficient algorithm for local distance metric learning. In Proceedings of the 20th AAAI Conference on Artificial Intelligence, 2006. 91
262. Liu Yang, Rong Jin, Lily B. Mummert, Rahul Sukthankar, Adam Goode, Bin Zheng, Steven C. H. Hoi, and Mahadev Satyanarayanan. A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval. IEEE Transactions on Pattern Anal ysis and Machine Intelligence (TPAMI), 32(1):30- 44, 2010. DOI: 10.1109/TPAMI.2008.273. 91
263. Peipei Yang, Kaizhu Huang, and Cheng-Lin Liu. Multi-Task Low-Rank Metric Learning Based on Common Subspace. In Proceedings of the 18th International Conference on Neural Information Processing (ICONIP), pages 151-159, 2011. DOI: 10.1007/978-3-642-24958-7-18. 44
264. Peipei Yang, Kaizhu Huang, and Cheng-Lin Liu. Geomet ry Preserving Multi-task Metric Learning. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), pages 648-664, 2012. DOI: 10.1007/s10994-013-5379-y. 44
265. Rui Yang, Panos Kalnis, and Anthony K. H. Tung. Similarity evaluation on tree-structured data. In Proceedings of the ACM SIGMOD International Conference on Management of Data (COMAD), pages 754-765, 2005. DOI: 10.1145/1066157.1066243. 13
266. Wen-Tau Yih, Kristina Toutanova, John Platt, and Chris Meek. Learning discriminative projections for text similarity measures. In Proceedings of the 15th Conference on Computational Natural Language Learning (CoNNL), 2011. 97
267. Yiming Ying and Peng Li. Di stance Metric Learning with Eigenvalue Optimization. Journal of Machine Learning Research (JMLR), 13:1-26, 2012. 20
268. Yiming Ying, Kaizhu Huang, and Colin Campbell. Sparse Metric Learning via Smooth Optimization. In Advances in Neural Information Processing Systems (NIPS) 22, pages 2214-2222, 2009. 25, 68, 73, 74
269. Daren Yu, Xiao Yu, Qinghua Hu, Jinfu Liu, and Anqi Wu. Dynamic time warping constraint learning for large margin nearest neighbor classification. Information Sciences, 181(13):2787 -2796, 2011. DOI: 10.1016/j.ins.2011.03.001. 59
270. Zheng-Jun Zha, Tao Mei, Meng Wang, Zengfu Wang, and Xian-Sheng Hua. Robust Distance Metric Learning with Auxiliary Knowledge. In Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI), pages 1327-1332, 2009. 48
271. De-Chuan Zhan,Ming Li,Yu-Feng Li,Zhi-Hua Zhou, Learning instance specific distances using metric propagation, Proceedings of the 26th International Conference on Machine Learning, 2009,doi 10.1145/1553374.1553530. 38
272. Changshui Zhang, Feiping Nie, and Shiming Xiang. A general kernelization framework for learning algorithms based on kernel PCA. Neurocomputing, 73(4-6):959- 967, 2010. DOI: 10.1016/j.neucom.2009.08.014. 34.
273. Kaizhong Zhang and Dennis Shasha. Simple fast algorithms for the editing distance between trees and related problems. SIAM Journal of Computing (SICOMP), 18(6):1245-1262, 1989. DOI: 10.1137/0218082. 13, 58
274. Yu Zhang and Dit-Yan Yeung. Transfer metric learning by learning task relationships. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 1199-1208, 2010. DOI: 10.1145/1835804.1835954. 45
275. Guoqiang Zhong, Kaizhu Huang, and Cheng-Lin Liu. Low Rank Metric Learning with Manifold Regularization. In Proceedings of the IEEE International Conference on Data Min ing (ICDM), pages 1266-1271, 2011. DOI: 10.1109/ICDM.2011.95. 48
276. Ji Zhu, Saharon Rosset, Trevor Hastie, and Robert Tibshirani. 1-norm Support Vector Machines. In Advances in Neural Information Processing Systems (NIPS) 16, pages 49-56, 2003. 77