Center Category Focusing Transformer Network for Hyperspectral Image Classification

Recently, the methods based on self-attention mechanisms have gained increasing prominence in hyperspectral image classification (HSIC). However, the existing self-attention mechanism suffers the challenge of attention shift and redundancy. To address the problem, we propose the center category focusing transformer network (CCSF-Transformer) for HSIC, which is designed to resolve attention shifts and redundancy by balancing the multiple category features. Specifically, the central-category-focused attention mechanism (CFA) is presented in the proposed framework to compute the category-matched attention between the center pixel and neighbor pixels, closely matching the center-pixel style labeling strategy, and reducing the computation complexity by excluding the computation between interference pixels. Besides, the spectral-salient-focused attention module (SFA) is developed to capture the spectral correlation, which concentrates on the salient bands and suppresses the expression of redundant bands. Moreover, the hierarchical integration network (HIN) is built to rectify spatial and spectral features The experiment results on two popular HSI datasets demonstrate that the proposed method achieves robust performance compared to other state-of-the-art methods.