Abstract
The family of regularization by denoising (RED) methods introduce denoising operator as the regularization term to perform compressed sensing (CS) reconstruction, which shows higher flexibility and scalability. However, traditional RED framework has strict requirements on several properties of denoiser, making it hard to design the specific denoiser and limits the quality of reconstructed images. Although some relaxation for denoisers can be made by incorporating the fixed point projection during the iteration process, the involved parameters have great impact on the effectiveness and efficiency of the algorithm, which is non-trivial to set them properly. In this paper, we propose an innovative Deep Unfolding Network framework termed FP-DUN based on the iterative process of Regularization by Denoising via Fixed-Point Projection (RED-PRO). In FP-DUN, fix-point projection module is implemented with learnable weights of neural networks, where an effective denoiser based on dual attention mechanism (DAM) is developed to capture the details of the reconstructed image. Additionally, we propose a new loss function based on fixed point constraints, which is able to overcome the over-smoothness caused by multi-stage denoising and maintain the structural details to progressively improve the reconstruction quality. By training the DUN model, the parameters for the process of fix point projection and denoiser are learned automatically. Extensive experimental results comparing with state-of-the-art CS algorithms and traditional RED-PRO approach validate the effectiveness of FP-DUN, especially on some images with complex details.
Original language | English |
---|---|
Pages (from-to) | 3462-3474 |
Number of pages | 13 |
Journal | IEEE Transactions on Circuits and Systems for Video Technology |
Volume | 35 |
Issue number | 4 |
Early online date | 25 Nov 2024 |
DOIs | |
Publication status | Published - 2025 |
Bibliographical note
Publisher Copyright:© 1991-2012 IEEE.
Funding
This work was supported in part by Guangdong S&T Programme under Grant 2024B0101120003, in part by Shenzhen Science and Technology Program under Grant KJZD20230923114111021, in part by the Natural Science Foundation China (NSFC) under Grants 62032015 and 62273241, in part by the Natural Science Foundation China (NSFC) for Distinguished Young Scholars under Grant 61925108, in part by the Joint fund of the National Natural Science Foundation of China and Robot Fundamental Research Center of Shenzhen Government under Grant U1913203, in part by Guangdong Basic and Applied Basic Research Foundation under Grants 2024A1515012485 and 2024A1515011946, and in part by Shenzhen Fundamental Research Program under grant JCYJ20220810112354002 (Corresponding author: Jianmin Jiang.) Yu Zhou, Wei Xie, Huisi Wu and Jianmin Jiang are with the College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China (e-mail: [email protected]; [email protected]; [email protected]; [email protected]). This work was supported in part by Guangdong Science and Technology Programme under Grant 2024B0101120003; in part by Shenzhen Science and Technology Program under Grant KJZD20230923114111021; in part by the Natural Science Foundation China (NSFC) under Grant 62032015, Grant 62273241, and Grant 72271168; in part by the Natural Science Foundation China (NSFC) for Distinguished Young Scholars under Grant 61925108; in part by the Joint fund of the National Natural Science Foundation of China and Robot Fundamental Research Center of Shenzhen Government under Grant U1913203; in part by Guangdong Basic and Applied Basic Research Foundation under Grant 2024A1515012485 and Grant 2024A1515011946; and in part by Shenzhen Fundamental Research Program under Grant JCYJ20220810112354002.
Keywords
- Compressed sensing
- deep learning
- deep unfolding network
- image reconstruction
- transformer