Electronic Science and Technology ›› 2024, Vol. 37 ›› Issue (9): 34-42.doi: 10.16180/j.cnki.issn1007-7820.2024.09.006

Previous Articles     Next Articles

Hybrid Image Super-Resolution Reconstruction with Multiple and Multi-Scale Attention

KUAI Xinchen, LI Ye   

  1. School of Optical Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China
  • Received:2023-03-19 Online:2024-09-15 Published:2024-09-20
  • Supported by:
    Project of Artificial Intelligence Key Laboratory of Sichuan(2022RZY02)

Abstract:

Image itself information is naturally robust to image reconstruction, yet most current super-resolution methods do not fully utilize global feature information. This study proposes a new image super-resolution model mixing multiple and multi-scale attentions, including two new modules: Multi-scale hybrid non-local attention upsampling module and residual dense attention block. Different from previous nonlocal methods, multi-scale hybrid non-local attention upsampling module mixes pixel-based and patch-based nonlocal attention and establishes patch-level upsampling mapping relationships at multiple scales, which enables a wider global search space. The residual dense attention block establishes attention associations in channel and spatial dimensions, which enhances the transfer and fusion of front-to-back attention information through dense connections. In this study, quantitative and qualitative evaluations are conducted on several benchmark datasets, and the experimental results show that the model outperforms similar super-resolution models in terms of performance and reconstruction quality.

Key words: image super-resolution, multi-scale, attention mechanism, non-local, recurrent network, dense connection, upsampling, self-similarity

CLC Number: 

  • TP316