Abstract:
The trade-off between spatial and spectral resolution is one of the fundamental issues in hyperspectral images (HSI). Given the challenges of directly acquiring high-reso...Show MoreMetadata
Abstract:
The trade-off between spatial and spectral resolution is one of the fundamental issues in hyperspectral images (HSI). Given the challenges of directly acquiring high-resolution hyperspectral images (HR-HSI), a compromised solution is to fuse a pair of images: one has high-resolution (HR) in the spatial domain but low-resolution (LR) in spectral-domain and the other vice versa. Model-based image fusion methods including pan-sharpening aim at reconstructing HR-HSI by solving manually designed objective functions. However, such hand-crafted prior often leads to inevitable performance degradation due to a lack of end-to-end optimization. Although several deep learning-based methods have been proposed for hyperspectral pan-sharpening, HR-HSI related domain knowledge has not been fully exploited, leaving room for further improvement. In this paper, we propose an iterative Hyperspectral Image Super-Resolution (HSISR) algorithm based on a deep HSI denoiser to leverage both domain knowledge likelihood and deep image prior. By taking the observation matrix of HSI into account during the end-to-end optimization, we show how to unfold an iterative HSISR algorithm into a novel model-guided deep convolutional network (MoG-DCN). The representation of the observation matrix by subnetworks also allows the unfolded deep HSISR network to work with different HSI situations, which enhances the flexibility of MoG-DCN. Extensive experimental results are reported to demonstrate that the proposed MoG-DCN outperforms several leading HSISR methods in terms of both implementation cost and visual quality. The code is available at https://see.xidian.edu.cn/faculty/wsdong/Projects/MoG-DCN.htm.
Published in: IEEE Transactions on Image Processing ( Volume: 30)
Funding Agency:
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Hyperspectral Image Super-resolution ,
- Spatial Resolution ,
- Objective Function ,
- Deep Network ,
- Cognitive Domains ,
- Iterative Algorithm ,
- Spectral Resolution ,
- Image Pairs ,
- Spatial Domain ,
- Deep Convolutional Network ,
- Model-based Methods ,
- Deep Learning-based Methods ,
- Observation Matrix ,
- Room For Further Improvement ,
- Deep Learning ,
- Training Dataset ,
- Gaussian Kernel ,
- Convolutional Layers ,
- Feature Maps ,
- Inverse Problem ,
- Blur Kernel ,
- Reconstruction Module ,
- Proximal Operator ,
- Proximal Algorithm ,
- Multispectral Images ,
- Spectral Angle Mapper ,
- Encoder Block ,
- Peak Signal-to-noise Ratio ,
- Ill-posed Inverse Problem ,
- Single Convolutional Layer
- Author Keywords
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Hyperspectral Image Super-resolution ,
- Spatial Resolution ,
- Objective Function ,
- Deep Network ,
- Cognitive Domains ,
- Iterative Algorithm ,
- Spectral Resolution ,
- Image Pairs ,
- Spatial Domain ,
- Deep Convolutional Network ,
- Model-based Methods ,
- Deep Learning-based Methods ,
- Observation Matrix ,
- Room For Further Improvement ,
- Deep Learning ,
- Training Dataset ,
- Gaussian Kernel ,
- Convolutional Layers ,
- Feature Maps ,
- Inverse Problem ,
- Blur Kernel ,
- Reconstruction Module ,
- Proximal Operator ,
- Proximal Algorithm ,
- Multispectral Images ,
- Spectral Angle Mapper ,
- Encoder Block ,
- Peak Signal-to-noise Ratio ,
- Ill-posed Inverse Problem ,
- Single Convolutional Layer
- Author Keywords