Covering the space of tilts. Application to affine invariant image comparison

Research output: Journal PublicationsJournal Article (refereed)peer-review

10 Citations (Scopus)

Abstract

We propose a mathematical method to analyze the numerous algorithms performing image matching by affine simulation (IMAS). To become affine invariant they apply a discrete set of affine transforms to the images, prior to the comparison of all images by a scale invariant image matching (SIIM), like SIFT (scale invariant feature transform). Obviously this multiplication of images to be compared increases the image matching complexity. Three questions arise: (a) what is the best set of affine transforms to apply to each image to gain full practical affine invariance? (b) what is the lowest attainable complexity for the resulting method? (c) how is the underlying SIIM method chosen? We provide an explicit answer and a mathematical proof of quasi-optimality of the solution to the _rst question. As an answer to (b) we find that the near-optimal complexity ratio between full affine matching and scale invariant matching is more than halved, compared to the current IMAS methods. This means that the number of key points necessary for affine matching can be halved, and that the matching complexity is divided by four for exactly the same performance. This also means that an affine invariant set of descriptors can be associated with any image. The price to pay for full affine invariance is that the cardinality of this set is around 6.4 times larger than for a SIIM.
Original languageEnglish
Pages (from-to)1230-1267
Number of pages38
JournalSIAM Journal on Imaging Sciences
Volume11
Issue number2
DOIs
Publication statusPublished - Jan 2018
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2018 Society for Industrial and Applied Mathematics. And by SIAM.

Funding

The work of the authors was partially funded by BPIFrance and Region Ile de France, in the framework of the FUI 18 Plein Phare project, the Office of Naval research by grant N00014-17-1-2552, ANR-DGA project ANR-12-ASTR-0035, and the French Research Agency (ANR) under grant ANR-14-CE27-001 (MIRIAM).

Keywords

  • Affine invariance
  • Affine normal-ization
  • ASIFT
  • Image matching
  • Local descriptors
  • MODS
  • Scale invariance
  • SIFT
  • Space of tilts
  • SURF

Fingerprint

Dive into the research topics of 'Covering the space of tilts. Application to affine invariant image comparison'. Together they form a unique fingerprint.

Cite this