Stereo superpixel segmentation aims to obtain the superpixel segmentation results of the left and right views more cooperatively and consistently, rather than simply performing independent segmentation directly. Thus, the correspondence between two views should be reasonably modeled and fully considered. In this paper, we propose a left-right interactive optimization framework for stereo superpixel segmentation. Considering the disparity in stereo image pairs, we first divide the images into paired region and non-paired region, and propose a collaborative optimization scheme to coordinately refine the matched superpixels of the left and right views in an interactive manner. This is, to the best of our knowledge, the first attempt to generate stereo superpixels considering the parallax consistency. Quantitative and qualitative experiments demonstrate that the proposed framework achieves superior performance in terms of consistency and accuracy compared with single-image superpixel segmentation.
Bibliographical noteThis work was supported by the Key Project of Science and Technology Innovation 2030 supported by the Ministry of Science and Technology of China under Grant 2018AAA0101301, in part by the Natural Science Foundation of China under Grants 61772344, 62002014, in part by the Hong Kong RGC General Research Funds under 9042816 (CityU 11209819), in part by the Beijing Nova Program under Grant Z201100006820016, in part by the Fundamental Research Funds for the Central Universities under Grant 2019RC039, in part by Elite Scientist Sponsorship Program by the Beijing Association for Science and Technology, in part by Hong Kong Scholars Program, and in part by China Postdoctoral Science Foundation under Grant 2020T130050, Grant 2019M660438.
- Collaborative optimization
- Parallax consistency
- Stereo superpixel
- Superpixel segmentation