Abstract
The piecewise constant Mumford{Shah (PCMS) model and the Rudin{Osher{Fatemi (ROF) model are two important variational models in image segmentation and image restoration, respectively. In this paper, we explore a linkage between these models. We prove that for the twophase segmentation problem a partial minimizer of the PCMS model can be obtained by thresholding the minimizer of the ROF model. A similar linkage is still valid for multiphase segmentation under specific assumptions. Thus it opens a new segmentation paradigm: image segmentation can be done via image restoration plus thresholding. This new paradigm, which circumvents the innate nonconvex property of the PCMS model, therefore, improves the segmentation performance in both efficiency (much faster than state-of-the-art methods based on the PCMS model, particularly when the phase number is high)the and effectiveness (producing segmentation results with better quality) due to the flexibility of the ROF model in tackling degraded images, such as noisy images, blurry images, or images with information loss. As a by-product of the new paradigm, we derive a novel segmentation method, called thresholded-ROF (T-ROF) method, to illustrate the virtue of managing image segmentation through image restoration techniques. The convergence of the T-ROF method is proved, and elaborate experimental results and comparisons are presented.
Original language | English |
---|---|
Pages (from-to) | B1310-B1340 |
Number of pages | 31 |
Journal | SIAM Journal on Scientific Computing |
Volume | 41 |
Issue number | 6 |
DOIs | |
Publication status | Published - 2019 |
Externally published | Yes |
Bibliographical note
Publisher Copyright:Copyright © by SIAM.
Funding
The work of the first author was supported by the EPSRC grant EP/K032208/1, Issac Newton Trust (University of Cambridge), and the Leverhulme grant. The work of the second author was supported by HKRGC grants CUHK14306316, CityU grant 9380101, CRF grant C1007, and the Leverhulme grant. The work of the third author was supported by the Leverhulme Trust project, EPSRC grants EP/K032208/1, EP/M00483X/1, and EP/N014588/1, the RISE projects ChiPS and NoMADS, the Cantab Capital Institute for the Mathematics of Information, and the Alan Turing Institute. The work of the fifth author was supported by the National Natural Science Foundation of China under grant 11671002, CUHK start-up, CUHK DAG 4053296, 4053342, and the RGC 14300219.
Keywords
- Chan-Vese model
- Image restoration
- Image segmentation
- Mumford{Shah model
- Thresholding
- Total variation ROF model