Loading [MathJax]/extensions/MathMenu.js
Unsupervised Hyperspectral Image Blind Super-Resolution via a Kernel Prior Network | IEEE Conference Publication | IEEE Xplore

Unsupervised Hyperspectral Image Blind Super-Resolution via a Kernel Prior Network


Abstract:

Hyperspectral images typically suffer from low resolution due to inherent hardware constraints, complicating downstream tasks like detection, classification, and recognit...Show More

Abstract:

Hyperspectral images typically suffer from low resolution due to inherent hardware constraints, complicating downstream tasks like detection, classification, and recognition. In our study, we introduce a kernel prior network (KPNet) designed to address the the hyperspectral image (HSI) blind super-resolution (BSR) challenge in an unsupervised fashion. Double-DIP, comprising two deep image priors (DIP), enables the simultaneous reconstruction of high-dimensional spectral data and kernel estimates via an untrained encoder-decoder network configuration in the parameter space. The KPNet creates a reversible connection between complex blur kernel distributions and simple hidden variable distributions. In addition, the proposed DIP can also estimate reliable blur kernels, which can be integrated into existing blind super-resolution techniques. Comprehensive experiments conducted on standard datasets demonstrate that our proposed approach markedly surpasses current techniques in performance.
Date of Conference: 22-24 November 2024
Date Added to IEEE Xplore: 12 February 2025
ISBN Information:
Conference Location: Zhuhai, China
References is not available for this document.

I. Introduction

The challenge of upgrading hyperspectral images from low resolution to high resolution, referred to as hyperspectral image super-resolution, plays a crucial role in fields including detection [1], classification [2], and recognition. Hyperspectral images are three-dimensional datasets that capture the reflective properties of electromagnetic waves over hundreds of contiguous spectral bands with precise sensors [3], as shown in Fig. 1. These images consist of multiple grayscale layers, with each pixel signifying a spectral vector that indicates the reflection intensity at that position. The performance of hyperspectral image super-resolution faces challenges due to factors such as the extensive dimensionality of the data, inadequate image quality, and the difficulty in obtaining training samples [4].

Select All
1.
S. Liu, D. Marinelli, L. Bruzzone and F. Bovolo, "A review of change detection in multitemporal hyperspectral images: Current techniques applications and challenges", IEEE Geoscience and Remote Sensing Magazine, vol. 7, no. 2, pp. 140-158, 2019.
2.
G. A. Carter, K. L. Lucas, G. A. Blossom, C. L. Lassitter, D. M. Holiday, D. S. Mooneyhan, et al., "Remote sensing and mapping of tamarisk along the colorado river USA: A comparative use of summer-acquired hyperion thematic mapper and quickbird data", Remote Sensing, vol. 1, no. 3, pp. 318-329, 2009.
3.
P. Ghamisi, N. Yokoya, J. Li, W. Liao, S. Liu, J. Plaza, et al., "Advances in hyperspectral image and signal processing: A comprehensive overview of the state of the art", IEEE Geoscience and Remote Sensing Magazine, vol. 5, no. 4, pp. 37-78, 2017.
4.
N. Yokoya, C. Grohnfeldt and J. Chanussot, "Hyperspectral and multispectral data fusion: A comparative review of the recent literature", IEEE Geoscience and Remote Sensing Magazine, vol. 5, no. 2, pp. 29-56, 2017.
5.
C. Dong, C. C. Loy, K. He and X. Tang, "Image super-resolution using deep convolutional networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 2, pp. 295-307, 2016.
6.
Y. Zhang, Y. Tian, Y. Kong, B. Zhong and Y. Fu, "Residual dense network for image restoration", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 7, pp. 2480-2495, 2021.
7.
J. Kim, J. K. Lee and K. M. Lee, "Accurate image super-resolution using very deep convolutional networks", 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1646-1654, 2016.
8.
Z. Yang, J. Xia, S. Li, W. Liu, S. Zhi, S. Zhang, et al., "Meta-learning based blind image super-resolution approach to different degradations", Neural Networks, vol. 178, pp. 106429, 2024.
9.
S. Y. Kim, H. Sim and M. Kim, "Koalanet: Blind super-resolution using kernel-oriented adaptive local adjustment", 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10 606-10 615, 2021.
10.
Y. Gandelsman, A. Shocher and M. Irani, "double-dip”: Unsupervised image decomposition via coupled deep-image-priors", 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11 018-11 027, 2019.
11.
V. Lempitsky, A. Vedaldi and D. Ulyanov, "Deep image prior", 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9446-9454, 2018.
12.
Laurent Dinh, Jascha Sohl-Dickstein and Samy Bengio, Density estimation using real nvp, vol. 2, pp. 3, 2016.
13.
N. Yokoya and A. Iwasaki, "Airborne hyperspectral data over chikusei", Space Application Laboratory University of Tokyo Japan Tech. Rep. SAL-2016-05-27, May 2016.
14.
Y. Li, L. Zhang, C. Dingl, W. Wei and Y. Zhang, "Single hyperspectral image super-resolution with grouped deep recursive residual network", 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM), pp. 1-4, 2018.
15.
J. Liang, K. Zhang, S. Gu, L. V. Gool and R. Timofte, "Flow-based kernel prior with application to blind super-resolution", 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10 596-10 605, 2021.
16.
G. Riegler, S. Schulter, M. Rüther and H. Bischof, "Conditioned regression models for non-blind single image super-resolution", 2015 IEEE International Conference on Computer Vision (ICCV), pp. 522-530, 2015.
17.
J. Xia, Z. Yang, S. Li, S. Zhang, Y. Fu, D. Gündüz, et al., "Blind super-resolution via meta-learning and markov chain monte carlo simulation", IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-18, 2024.
18.
Z. Yang, J. Xia, S. Li, X. Huang, S. Zhang, Z. Liu, et al., "A dynamic kernel prior model for unsupervised blind image super-resolution", 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 26 046-26 056, 2024.

Contact IEEE to Subscribe

References

References is not available for this document.