Convolutional Two-Stream Generative Adversarial Network-Based Hyperspectral Feature Extraction | IEEE Journals & Magazine | IEEE Xplore

Convolutional Two-Stream Generative Adversarial Network-Based Hyperspectral Feature Extraction


Abstract:

Hyperspectral image processing is faced with difficulties considering its redundant features and complex information. Studies on hyperspectral feature extraction in the d...Show More

Abstract:

Hyperspectral image processing is faced with difficulties considering its redundant features and complex information. Studies on hyperspectral feature extraction in the deep learning domain have become increasingly popular. The mainstream techniques fully consider the spatial information in local neighborhoods when extracting spectral features by constructing deep neural networks. Deep generative models simulate the intrinsic structure of samples by adequately training, showing their potential values for signal processing. In this article, a convolutional two-stream network (cs2GAN-FE) based on the improved Wasserstein generative adversarial network (WGAN) is proposed for unsupervised hyperspectral spatial–spectral feature extraction. The improved WGAN is composed of one generator and one discriminator; the former perceives real data distributions, and the latter determines the attribution of generated data. The designed two-stream strategy is not a simple extension of a one-stream strategy and considers both the static spectral–spatial information and the dynamic spectral reflectance variation in multiple bands. Intrinsic spatial–spectral features are extracted by the trained discriminator considering sample distributions and feature relationships. The loss function is also improved for the unique structure of cs2GAN-FE. Various state-of-the-art techniques are chosen for comparison. Experimental results show the feasibility and potential of this network. Besides, experiments with the random split and the disjointed split both show that the proposed method can outperform other comparison techniques.
Article Sequence Number: 5506010
Date of Publication: 03 May 2021

ISSN Information:

Funding Agency:


I. Introduction

Hyperspectral imaging technologies occupy crucial positions in the geoscience field, providing abundant research directions [1], [2]. Compared with classical RGB images, hyperspectral images comprise more discriminant information delivering complex topographic features; however, this is at the expense of hundreds of spectral redundant bands [2], [3]. As an effective solution to these problems, feature extraction maps original spectral features into specific latent spaces by transformation and then generates latent embeddings with the higher discriminant ability and less storage space [4], [5].

References

References is not available for this document.