ASIFT: A new framework for fully affine invariant image comparison

SIAM Journal on Imaging Sciences

Volumn 2, Issue 2, 2009, Pages 438-469

  Morel, Jean Michel ^a   Yu, Guoshen ^b  

^a UNIVERSITÉ PARIS SACLAY   (France)

^b CENTRE DE MATHÉMATIQUES APPLIQUÉES   (France)

Author keywords

Affine invariance; Affine normalization; Descriptors; Image matching; Scale invariance; Scale invariant feature transform (SIFT)

Indexed keywords

CAMERAS; DEFORMATION; IMAGE MATCHING; OBJECT RECOGNITION;

AFFINE INVARIANCE; AFFINE NORMALIZATION; DESCRIPTORS; SCALE INVARIANCE; SCALE INVARIANT FEATURE TRANSFORMS;

AFFINE TRANSFORMS;

EID: 85018540432     PISSN: None     EISSN: 19364954     Source Type: Journal    
DOI: 10.1137/080732730     Document Type: Article

References (65)

1. A. Agarwala, M. Agrawala, M. Cohen, D. Salesin, and R. Szeliski, Photographing long scenes with multi-viewpoint panoramas, ACM Trans. Graph., 25 (2006), pp. 853-861.
2. A. Ashbrook, N. Thacker, P. Rockett, and C. Brown, Robust recognition of scaled shapes using pairwise geometric histograms, in BMVC '95: Proceedings of the 6th British Conference on Machine Vision (Vol. 2), BMVA Press, Surrey, UK, 1995, pp. 503-512.
3. A. Baumberg, Reliable feature matching across widely separated views, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, 2000, pp. 774-781.
4. H. Bay, T. Tuytelaars, and L. Van Gool, Surf: Speeded up robust features, in Computer Vision-ECCV 2006, Springer-Verlag, Berlin, Heidelberg, 2006, pp. 404-417.
5. S. Belongie, J. Malik, and J. Puzicha, Shape matching and object recognition using shape contexts, IEEE Trans. Pattern Anal. Mach. Intell., 24 (2002), pp. 509-522.
6. M. Bennewitz, C. Stachniss, W. Burgard, and S. Behnke, Metric localization with scale-invariant visual features using a single perspective camera, in Proceedings of the European Robotics Symposium, Springer Tracts in Advanced Robotics (STAR) 22, Springer-Verlag, New York, 2006, pp. 143-157.
7. M. Brown and D. Lowe, Recognising panoramas, in Proceedings of the 9th IEEE International Conference on Computer Vision, 2003, pp. 1218-1225.
8. F. Cao, J.-L. Lisani, J.-M. Morel, P. Musé, and F. Sur, A Theory of Shape Identification, Springer-Verlag, New York, 2008.
9. E. Chang, EXTENT: Fusing context, content, and semantic ontology for photo annotation, in Proceedings of the 2nd International Workshop on Computer Vision Meets Databases, ACM, New York, 2005, pp. 5-11.
10. Q. Fan, K. Barnard, A. Amir, A. Efrat, and M. Lin, Matching slides to presentation videos using SIFT and scene background matching, in Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, 2006, pp. 239-248.
11. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, MIT Press, Cambridge, MA, 1993.
12. L. Février, A Wide-baseline Matching Library for Zeno, Internship report, http://www.di.ens.fr/ ~fevrier/papers/2007-InternsipReportILM.pdf (2007).
13. J. Foo and R. Sinha, Pruning SIFT for scalable near-duplicate image matching, in Proceedings of the 18th Conference on Australasian Database, Vol. 63, Australian Computer Society, Darlinghurst, Australia, 2007, pp. 63-71.
14. G. Fritz, C. Seifert, M. Kumar, and L. Paletta, Building detection from mobile imagery using informative SIFT descriptors, in Proceedings of the 14th Scandinavian Conference on Image Analysis, Lecture Notes in Comput. Sci. 3540, Springer-Verlag, Berlin, pp. 629-638.
15. I. Gordon and D. Lowe, What and where: 3D object recognition with accurate pose, in Toward Category-Level Object Recognition, Lecture Notes in Comput. Sci. 4170, Springer-Verlag, Berlin, 2006, pp. 67-82.
16. J. Hare and P. Lewis, Salient regions for query by image content, in Image and Video Retrieval, Lecture Notes in Comput. Sci. 3115, Springer-Verlag, Berlin, 2004, pp. 317-325.
17. C. Harris and M. Stephens, A combined corner and edge detector, in Proceedings of the Fourth Alvey Vision Conference, Vol. 15, 1988, pp. 147-151.
18. T. Kadir, A. Zisserman, and M. Brady, An affine invariant salient region detector, in Proceedings of the 8th European Conference on Computer Vision, 2004, pp. 228-241.
19. Y. Ke and R. Sukthankar, PCA-SIFT: A more distinctive representation for local image descriptors, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 2, 2004, pp. 506-513.
20. J. Kim, S. Seitz, and M. Agrawala, Video-based document tracking: Unifying your physical and electronic desktops, in Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, 2004, pp. 99-107.
21. B. Lee, W. Chen, and E. Chang, Fotofiti: Web service for photo management, in Proceedings of the 14th Annual ACM International Conference on Multimedia, 2006, pp. 485-486.
22. H. Lejsek, F. Ásmundsson, B. Jónsson, and L. Amsaleg, Scalability of local image descriptors: A comparative study, in Proceedings of the 14th Annual ACM International Conference on Multimedia, 2006, pp. 589-598.
23. T. Lindeberg, Scale-space theory: A basic tool for analyzing structures at different scales, J. Appl. Stat., 21 (1994), pp. 225-270.
24. T. Lindeberg and J. Gårding, Shape-adapted smoothing in estimation of 3-D depth cues from affine distortions of local 2-D brightness structure, in Proceedings of the Third European Conference on Computer Vision, Springer-Verlag, New York, 1994, pp. 389-400.
25. T. Lindeberg and J. Gårding, Shape-adapted smoothing in estimation of 3-D shape cues from affine deformations of local 2-D brightness structure, Image Vision Comput., 15 (1997), pp. 415-434.
26. H. Ling and D. Jacobs, Deformation invariant image matching, in Proceedings of the Tenth IEEE International Conference on Computer Vision, 2005, pp. 1466-1473.
27. H. Ling and K. Okada, Diffusion distance for histogram comparison, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 246-253.
28. D. Lowe, Demo Software: SIFT Keypoint Detector, http://www.cs.ubc.ca/~lowe/keypoints/ (July 2005).
29. D. Lowe, Distinctive image features from scale-invariant key points, Int. J. Comput. Vis., 60 (2004), pp. 91-110.
30. G. Loy and J. Eklundh, Detecting symmetry and symmetric constellations of features, in Proceedings of the 9th European Conference on Computer Vision (ECCV), Lecture Notes in Comput. Sci. 3952, Springer-Verlag, Berlin, 2006, pp. 508-521.
31. J. Matas, O. Chum, M. Urban, and T. Pajdla, WBS Image Matcher, Online demo, http://cmp.felk. cvut.cz/~wbsdemo/demo/.
32. J. Matas, O. Chum, M. Urban, and T. Pajdla, Robust wide-baseline stereo from maximally stable extremal regions, Image Vision Comput., 22 (2004), pp. 761-767.
33. K. Mikolajczyk, Affine Covariant Features, http://www.robots.ox.ac.uk/~vgg/research/affine/ (2007).
34. K. Mikolajczyk and C. Schmid, Indexing based on scale invariant interest points, in Proceedings of the 8th International Conference on Computer Vision (ICCV), 2001, pp. 525-531.
35. K. Mikolajczyk and C. Schmid, An affine invariant interest point detector, in Proceedings of the Seventh European Conference on Computer Vision (ECCV), Springer-Verlag, London, 2002, pp. 128-142.
36. K. Mikolajczyk and C. Schmid, A performance evaluation of local descriptors, in Proceedings of the International Conference on Computer Vision and Pattern Recognition, Vol. 2, 2003, pp. 257-263.
37. K. Mikolajczyk and C. Schmid, Scale and affine invariant interest point detectors, Int. J. Comput. Vis., 60 (2004), pp. 63-86.
38. K. Mikolajczyk and C. Schmid, A performance evaluation of local descriptors, IEEE Trans. Pattern Anal. Mach. Intell., (2005), pp. 1615-1630.
39. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Gool, A comparison of affine region detectors, Int. J. Comput. Vis., 65 (2005), pp. 43-72.
40. P. Moreels and P. Perona, Common-frame model for object recognition, in Proceedings of Neural Information Processing Systems, 2004.
41. P. Moreels and P. Perona, Evaluation of features detectors and descriptors based on 3D objects, Int. J. Comput. Vis., 73 (2007), pp. 263-284.
42. J. Morel and G. Yu, On the Consistency of the SIFT Method, Technical report, CMLA, ENS Cachan, Cachan, France, 2008.
43. A. Murarka, J. Modayil, and B. Kuipers, Building local safety maps for a wheelchair robot using vision and lasers, in Proceedings of the 3rd Canadian Conference on Computer and Robot Vision, IEEE Computer Society, Washington, DC, 2006.
44. P. Musé, F. Sur, F. Cao, and Y. Gousseau, Unsupervised thresholds for shape matching, in Proceedings of the International Conference on Image Processing, 2003, pp. 647-650.
45. P. Musé, F. Sur, F. Cao, Y. Gousseau, and J. Morel, An a contrario decision method for shape element recognition, Int. J. Comput. Vis., 69 (2006), pp. 295-315.
46. A. Negre, H. Tran, N. Gourier, D. Hall, A. Lux, and J. Crowley, Comparative study of people detection in surveillance scenes, in Structural, Syntactic, and Statistical Pattern Recognition, Lecture Notes in Comput. Sci. 4109, Springer-Verlag, Berlin, 2006, pp. 100-108.
47. D. Nister and H. Stewenius, Scalable recognition with a vocabulary tree, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 2161-2168.
48. D. Pritchard and W. Heidrich, Cloth motion capture, Computer Graphics Forum, 22 (2003), pp. 263-271.
49. F. Riggi, M. Toews, and T. Arbel, Fundamental matrix estimation via TIP-transfer of invariant parameters, in Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), IEEE Computer Society, Washington, DC, 2006, pp. 21-24.
50. J. Ruiz-del Solar, P. Loncomilla, and C. Devia, A new approach for fingerprint verification based on wide baseline matching using local interest points and descriptors, in Advances in Image and Video Technology, Lecture Notes in Comput. Sci. 4872, Springer-Verlag, Berlin, 2007, pp. 586-599.
51. F. Schaffalitzky and A. Zisserman, Multi-view matching for unordered image sets, or “How do I organize my holiday snaps?,” in Proceedings of the Seventh European Conference on Computer Vision (ECCV), Springer-Verlag, London, 2002, pp. 414-431.
52. P. Scovanner, S. Ali, and M. Shah, A 3-dimensional SIFT descriptor and its application to action recognition, in Proceedings of the 15th International Conference on Multimedia, ACM, New York, 2007, pp. 357-360.
53. S. Se, D. Lowe, and J. Little, Vision-based mobile robot localization and mapping using scale-invariant features, in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2001, pp. 2051-2058.
54. S. Sinha, J. Frahm, M. Pollefeys, and Y. Genc, GPU-based video feature tracking and matching, in Proceedings of EDGE 2006, Workshop on Edge Computing Using New Commodity Architectures, 2006.
55. N. Snavely, S. Seitz, and R. Szeliski, Photo tourism: Exploring photo collections in 3D, ACMTrans. Graphics, 25 (2006), pp. 835-846.
56. T. Tuytelaars and L. Van Gool, Wide baseline stereo matching based on local, affinely invariant regions, in Proceedings of the British Machine Vision Conference, 2000, pp. 412-425.
57. T. Tuytelaars and L. Van Gool, Matching widely separated views based on affine invariant regions, Int. J. Comput. Vis., 59 (2004), pp. 61-85.
58. T. Tuytelaars and L. Van Gool, Content-based image retrieval based on local affinely invariant regions, in Proceedings of the Third International Conference on Visual Information and Information Systems, 1999, pp. 493-500.
59. L. Vacchetti, V. Lepetit, and P. Fua, Stable real-time 3D tracking using online and offline information, IEEE Trans. Pattern Anal. Mach. Intell., 26 (2004), pp. 1385-1391.
60. L. Van Gool, T. Moons, and D. Ungureanu, Affine/photometric invariants for planar intensity patterns, in Proceedings of the 4th European Conference on Computer Vision-Volume I, Springer-Verlag, London, 1996, pp. 642-651.
61. M. Veloso, F. von Hundelshausen, and P. Rybski, Learning visual object definitions by observing human activities, in Proceedings of the IEEE-RAS International Conference on Humanoid Robots, 2005, pp. 148-153.
62. M. Vergauwen and L. Van Gool, Web-based 3D reconstruction service, Mach. Vision Appl., 17 (2006), pp. 411-426.
63. K. Yanai, Image collector III: A web image-gathering system with bag-of-keypoints, in Proceedings of the 16th International Conference on World Wide Web, ACM, New York, 2007, pp. 1295-1296.
64. G. Yang, C. Stewart, M. Sofka, and C. Tsai, Alignment of challenging image pairs: Refinement and region growing starting from a single keypoint correspondence, IEEE Trans. Pattern Anal. Mach. Intell., 23 (2007), pp. 1973-1989.
65. J. Yao and W. Cham, Robust multi-view feature matching from multiple unordered views, Pattern Recognition, 40 (2007), pp. 3081-3099.