Regularized vector field learning with sparse approximation for mismatch removal

Pattern Recognition

Volumn 46, Issue 12, 2013, Pages 3519-3532

  Ma, Jiayi ^a   Zhao, Ji ^a   Tian, Jinwen ^a   Bai, Xiang ^a,c   Tu, Zhuowen ^b,c  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

Hilbert space; Mismatch removal; Outlier; Regularization; Reproducing kernel; Sparse approximation; Vector field learning

Indexed keywords

OUTLIER; REGULARIZATION; REPRODUCING KERNEL; SPARSE APPROXIMATIONS; VECTOR FIELDS;

BENCHMARKING; HILBERT SPACES; LEARNING SYSTEMS; VECTORS;

LEAST SQUARES APPROXIMATIONS;

EID: 84881032491     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.05.017     Document Type: Article

References (57)

1. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer Verlag
2. T. Evgeniou, M. Pontil, and T. Poggio Regularization networks and support vector machines Computational Mathematics 13 2000 1 50
3. F. Girosi, M. Jones, and T. Poggio Regularization theory and neural networks architectures Neural Computation 7 1995 219 269
4. N. Aronszajn Theory of reproducing kernels Transactions of the American Mathematical Society 68 1950 337 404
5. R. Rifkin, G. Yeo, T. Poggio, Regularized least-squares classification, in: Advances in Learning Theory: Methods, Model and Applications, 2003.
6. C. Saunders, A. Gammermann, V. Vovk, Ridge regression learning algorithm in dual variables, in: Proceedings of International Conference on Machine Learning, 1998, pp. 515-521.
7. J.A.K. Suykens, and J. Vandewalle Least squares support vector machine classifiers Neural Processing Letters 9 1999 293 300
8. L. Baldassarre, L. Rosasco, A. Barla, A. Verri, Multi-Output Learning via Spectral Filtering, Technical Report, MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, 2011.
9. J. Zhao, J. Ma, J. Tian, J. Ma, D. Zhang, A robust method for vector field learning with application to mismatch removing, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 2977-2984.
10. C.A. Micchelli, and M. Pontil On learning vector-valued functions Neural Computation 17 2005 177 204
11. E. Candes, and T. Tao Near-optimal signal recovery from random projections universal encoding strategies IEEE Transactions on Information Theory 52 2005 5406 5425
12. S.S. Keerthi, O. Chapelle, and D. DeCoste Building support vector machines with reduced classifier complexity Journal of Machine Learning Research 7 2006 1493 1515
13. M. Wu, B. Scholkopf, and G. Bakir A direct method for building sparse kernel learning algorithms Journal of Machine Learning Research 7 2006 603 624
14. P. Sun, and X. Yao Sparse approximation through boosting for learning large scale kernel machines IEEE Transactions on Neural Networks 21 2010 883 894
15. E. Tsivtsivadze, T. Pahikkala, A. Airola, J. Boberg, T. Salakoski, A sparse regularized least-squares preference learning algorithm, in: Proceedings of the Conference on Tenth Scandinavian Conference on Artificial Intelligence, 2008, pp. 76-83.
16. C.K.I. Williams, M. Seeger, Using the Nyström method to speed up kernel machines, in: Advances in Neural Information Processing Systems, 2000, pp. 682-688.
17. A.J. Smola, B. Schölkopf, Sparse greedy matrix approximation for machine learning, in: Proceedings of International Conference on Machine Learning, 2000, pp. 911-918.
18. Y.-J. Lee, O. Mangasarian, RSVM: reduced support vector machines, in: Proceedings of the SIAM International Conference on Data Mining, 2001.
19. S. Fine, and K. Scheinberg Efficient SVM training using low-rank kernel representations Journal of Machine Learning Research 2 2001 243 264
20. F. Girosi An equivalence between sparse approximation and support vector machines Neural Computation 10 1998 1455 1480
21. S. Chen, D. Donoho, and M. Saunders Atomic decomposition by basis pursuit SIAM Journal of Scientific Computing 20 1999 33 61
22. 1-regularized least squares IEEE Journal of Selected Topics in Signal Processing 1 2007 606 617
23. M.N. Gibbs, D.J.C. MacKay, Efficient Implementation of Gaussian Processes, Technical Report, Department of Physics, Cavendish Laboratory, Cambridge University, Cambridge, 1997.
24. J.C. Platt, Fast training of support vector machines using sequential minimal optimization, in: Advances in Kernel Methods: Support Vector Learning, 1999, pp. 185-208.
25. S.S. Keerthi, K. Duan, S. Shevade, and A. Poo A fast dual algorithm for kernel logistic regression Machine Learning 61 2005 151 165
26. L. Bottou, O. Bousquet, The tradeoffs of large scale learning, in: Advances in Neural Information Processing Systems, 2008, pp. 161-168.
27. M. Zinkevich, M. Weimer, A. Smola, L. Li, Parallelized stochastic gradient descent, in: Advances in Neural Information Processing Systems, 2010, pp. 2595-2603.
28. Y. Tsuruoka, J. Tsujii, S. Ananiadou, Stochastic gradient descent training for L1-regularized log-linear models with cumulative penalty, in: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, 2009, pp. 477-485.
29. C. Carmeli, E. De Vito, and A. Toigo Vector valued reproducing kernel hilbert spaces of integrable functions and mercer theorem Analysis and Applications 4 2006 377 408
30. T. Poggio, and F. Girosi Networks for approximation and learning Proceedings of the IEEE 78 1990 1481 1497
31. J. Quiñonero-Candela, C.E. Ramussen, C.K.I. Williams, Approximation methods for gaussian process regression, in: Large-Scale Kernel Machines, 2007, pp. 203-223.
32. A.R. Barron Universal approximation bounds for superpositions of a sigmoidal function IEEE Transactions on Information Theory 39 1993 930 945
33. L.K. Jones A simple lemma on greedy approximation in hilbert space and convergence rates for projection pursuit regression and neural network training Annals of Statistics 20 1992 608 613
34. V. Kůrková, High-dimensional approximation by neural networks, in: Advances in Learning Theory: Methods, Models and Applications, 2003, pp. 69-88.
35. V. Kůrková, and M. Sanguineti Comparison of worst case errors in linear and neural network approximation IEEE Transactions on Information Theory 48 2002 264 275
36. V. Kůrková, and M. Sanguineti Learning with generalization capability by kernel methods of bounded complexity Journal of Complexity 21 2005 350 367
37. S. Yu, V. Tresp, K. Yu, Robust multi-task learning with t-processes, in: Proceedings of International Conference on Machine Learning, 2007, pp. 1103-1110.
38. S. Zhu, K. Yu, Y. Gong, Predictive matrix-variate t models, in: Advances in Neural Information Processing Systems, 2008, pp. 1721-1728.
39. P.J. Huber Robust Statistics 1981 John Wiley & Sons New York
40. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer
41. A. Myronenko, and X. Song Point set registration coherent point drift IEEE Transactions on Pattern Analysis and Machine Intelligence 32 2010 2262 2275
42. R. Hartley, and A. Zisserman Multiple View Geometry in Computer Vision 2nd ed. 2003 Cambridge University Press Cambridge
43. D. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2004 91 110
44. P.H.S. Torr, and A. Zisserman MLESAC a new robust estimator with application to estimating image geometry Computer Vision and Image Understanding 78 2000 138 156
45. J.H. Kim, and J.H. Han Outlier correction from uncalibrated image sequence using the triangulation method Pattern Recognition 39 2006 394 404
46. L. Goshen, and I. Shimshoni Guided sampling via weak motion models and outlier sample generation for epipolar geometry estimation International Journal of Computer Vision 80 2008 275 288
47. X. Li, and Z. Hu Rejecting mismatches by correspondence function International Journal of Computer Vision 89 2010 1 17
48. J. Ma, J. Zhao, Y. Zhou, J. Tian, Mismatch removal via coherent spatial mapping, in: Proceedings of IEEE International Conference on Image Processing, 2012, pp. 1-4.
49. J. Ma, J. Zhao, J. Tian, Z. Tu, A. Yuille, Robust estimation of nonrigid transformation for point set registration, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2013.
50. J. Barron, D. Fleet, and S. Beauchemin Performance of optical flow techniques International Journal of Computer Vision 12 1994 43 77
51. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. van Gool A comparison of affine region detectors International Journal of Computer Vision 65 2005 43 72
52. T. Tuytelaars, and L. van Gool Matching widely separated views based on affine invariant regions International Journal of Computer Vision 59 2004 61 85
53. A. Vedaldi, B. Fulkerson, VLFeat - an open and portable library of computer vision algorithms, in: Proceedings of the 18th Annual ACM International Conference on Multimedia, 2010, pp. 1469-1472.
54. A. Zaharescu, E. Boyer, K. Varanasi, R. Horaud, Surface feature detection and description with applications to mesh matching, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 373-380.
55. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 886-893.
56. I. Macêdo, R. Castro, Learning Divergence-Free and Curl-Free Vector Fields with Matrix-Valued Kernels, Technical Report, Instituto Nacional de Matematica Pura e Aplicada, Brasil, 2008.
57. M.A. Fischler, and R.C. Bolles Random sample consensus a paradigm for model fitting with application to image analysis and automated cartography Communications of the ACM 24 1981 381 395