MHAFNet: multi-stage hybrid attention and adaptive feature fusion network for image restoration

Image restoration is a vital research area in computer vision, focusing on reconstructing high-quality clear images from degraded observations. Common types of degradation include noise and blur, which may stem from imaging device limitations, environmental interference, and other factors. This paper centers on the design and optimization of multi-stage image restoration networks, conducting in-depth exploration of feature extraction, feature fusion, attention mechanisms, and their practical applications. A multi-stage hybrid attention mechanism-based image restoration network is proposed. Initially, each stage progressively extracts and restores image features. Then, an adaptive feature fusion block enables effective cross-stage information transfer. Finally, by calculating losses at each stage and assigning different weights, the network achieves stable convergence during training. The hybrid attention mechanism enhances the model’s focus on critical features and improves its understanding of the overall image structure. Outstanding performance has been achieved in both image deblurring and denoising tasks. On the GoPro dataset, the restored results achieved a PSNR of 33.26 and an SSIM of 0.963. On the SIDD dataset, the restored results reached a PSNR of 40.23 and an SSIM of 0.963. Furthermore, ablation experiments demonstrated the effectiveness of the multi-stage model, hybrid attention mechanism, and adaptive feature fusion block.