Reference-based Iterative Interaction with P2-Matching for Stereo Image Super-Resolution

Runmin CONG, Rongxin LIAO, Feng LI, Ronghui SHENG, Huihui BAI, Renjie WAN, Sam KWONG, Wei ZHANG

Research output: Journal PublicationsJournal Article (refereed)peer-review

1 Citation (Scopus)

Abstract

Stereo Image Super-Resolution (SSR) holds great promise in improving the quality of stereo images by exploiting the complementary information between left and right views. Most SSR methods primarily focus on the inter-view correspondences in low-resolution (LR) space. The potential of referencing a high-quality SR image of one view benefits the SR for the other is often overlooked, while those with abundant textures contribute to accurate correspondences. Therefore, we propose Reference-based Iterative Interaction (RIISSR), which utilizes reference-based iterative pixel-wise and patch-wise matching, dubbed P2-Matching, to establish cross-view and cross-resolution correspondences for SSR. Specifically, we first design the information perception block (IPB) cascaded in parallel to extract hierarchical contextualized features for different views. Pixel-wise matching is embedded between two parallel IPBs to exploit cross-view interaction in LR space. Iterative patch-wise matching is then executed by utilizing the SR stereo pair as another mutual reference, capitalizing on the cross-scale patch recurrence property to learn high-resolution (HR) correspondences for SSR performance. Moreover, we introduce the supervised side-out modulator (SSOM) to re-weight local intra-view features and produce intermediate SR images, which seamlessly bridge two matching mechanisms. Experimental results demonstrate the superiority of RIISSR against existing state-of-the-art methods.
Original languageEnglish
Pages (from-to)3779-3789
Number of pages11
JournalIEEE Transactions on Image Processing
Volume34
Early online date12 Jun 2025
DOIs
Publication statusPublished - 12 Jun 2025

Bibliographical note

Publisher Copyright:
© 1992-2012 IEEE.

Keywords

  • P -matching
  • Stereo Image Super-Resolution
  • information perception block
  • supervised side-out modulator

Fingerprint

Dive into the research topics of 'Reference-based Iterative Interaction with P2-Matching for Stereo Image Super-Resolution'. Together they form a unique fingerprint.

Cite this