In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, but it has intrinsic specificities that make the application of deep learning less straightforward than with other optical data. This article presents the state of the art of previous machine-learning approaches, reviews the various deep-learning approaches currently proposed for hyperspectral classification, and identifies the problems and difficulties that arise in the implementation of deep neural networks for this task. In particular, the issues of spatial and spectral resolution, data volume, and transfer of models from multimedia images to hyperspectral data are addressed. Additionally, a comparative study of various families of network architectures is provided, and a software toolbox is publicly released to allow experimenting with these methods (https://github.com/nshaud/DeepHyperX). This article is intended for both data scientists with interest in hyperspectral data and remote sensing experts eager to apply deep-learning techniques to their own data set.
Abstract:
In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, ...Show MoreMetadata
Abstract:
In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, but it has intrinsic specificities that make the application of deep learning less straightforward than with other optical data. This article presents the state of the art of previous machine-learning approaches, reviews the various deep learning approaches currently proposed for hyperspectral classification, and identifies the problems and difficulties that arise in the implementation of deep neural networks for this task. In particular, the issues of spatial and spectral resolution, data volume, and transfer of models from multimedia images to hyperspectral data are addressed. Additionally, a comparative study of various families of network architectures is provided, and a software toolbox is publicly released to allow experimenting with these methods (https://github.com/nshaud/DeepHyperX). This article is intended for both data scientists with interest in hyperspectral data and remote sensing experts eager to apply deep learning techniques to their own data set.
Published in: IEEE Geoscience and Remote Sensing Magazine ( Volume: 7, Issue: 2, June 2019)
Citations are not available for this document.
Cites in Papers - |
Cites in Papers - IEEE (224)
Select All
1.
Pei Zhang, Dong Wang, Chanyue Wu, Jing Yang, Lei Kang, Zongwen Bai, Ying Li, Qiang Shen, "HyperDiff: Masked Diffusion Model with High-efficient Transformer for Hyperspectral Image Cross-Scene Classification", ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1-5, 2025.
2.
Yeva Gabrielyan, Arpi Hunanyan, Sona Bezirganyan, Lusine Davtyan, Ani Avetisyan, Narine Sarvazyan, Aram Butavyan, Varduhi Yeghiazaryan, "Comparative Analysis of Deep Learning Methods for Classification of Ablated Regions in Hyperspectral Images of Atrial Tissue", IEEE Access, vol.13, pp.35029-35047, 2025.
3.
Qingwang Wang, Jiangbo Huang, Shunyuan Wang, Zhen Zhang, Tao Shen, Yanfeng Gu, "Community Structure Guided Network for Hyperspectral Image Classification", IEEE Transactions on Geoscience and Remote Sensing, vol.63, pp.1-15, 2025.
4.
Qiao Zhe, Wei Gao, Chen Zhang, Gang Du, Yan Li, Desheng Chen, "A Hyperspectral Classification Method Based on Deep Learning and Dimension Reduction for Ground Environmental Monitoring", IEEE Access, vol.13, pp.29969-29982, 2025.
5.
Jinbin Wu, Jiankang Zhao, Haihui Long, "Advanced Hyperspectral Image Classification via Spectral–Spatial Redundancy Reduction and TokenLearner-Enhanced Transformer", IEEE Transactions on Geoscience and Remote Sensing, vol.63, pp.1-12, 2025.
6.
Chenjing Jia, Xiaohua Zhang, Hongyun Meng, Shuxiang Xia, Licheng Jiao, "CenterFormer: A Center Spatial–Spectral Attention Transformer Network for Hyperspectral Image Classification", IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol.18, pp.5523-5539, 2025.
7.
Zhen Zhang, Lehao Huang, Qingwang Wang, Linhuan Jiang, Yemao Qi, Shunyuan Wang, Tao Shen, Bo-Hui Tang, Yanfeng Gu, "UAV Hyperspectral Remote Sensing Image Classification: A Systematic Review", IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol.18, pp.3099-3124, 2025.
8.
Matteo Ciotola, Giuseppe Guarino, Gemine Vivone, Giovanni Poggi, Jocelyn Chanussot, Antonio Plaza, Giuseppe Scarpa, "Hyperspectral Pansharpening: Critical review, tools, and future perspectives", IEEE Geoscience and Remote Sensing Magazine, vol.13, no.1, pp.311-338, 2025.
9.
Jiao Shi, Chunhui Tan, Hanwen Yu, A. K. Qin, Yu Lei, Maoguo Gong, "A Collaborative Network for Multiple Hyperspectral Images Joint Classification", IEEE Transactions on Geoscience and Remote Sensing, vol.63, pp.1-14, 2025.
10.
Zhijun Zhang, Ming Wang, Yueji Qi, Xiaoqin Su, Di Kong, "Deep Learning-Based Methods for Lithology Classification and Identification in Remote Sensing Images", IEEE Access, vol.13, pp.3038-3050, 2025.
11.
P. Addesso, G. Vivone, R. Restaino, M. Carpentiero, J. Chanussot, "Regression-Based Injection for Hyperspectral Pansharpening Within A Generalized Laplacian Pyramid Framework", 2024 14th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), pp.1-5, 2024.
12.
Nathaniel Hanson, Philip Manke, Simon Birkholz, Maximilian Mühlbauer, Rene Heine, Arnd Brandes, "Cuvis.AI: An Open-Source, Low-Code Software Ecosystem for Hyperspectral Processing and Classification", 2024 14th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), pp.1-5, 2024.
13.
Shingo Takemoto, Shunsuke Ono, "Rotation Invariant Spatio-Spectral Total Variation for Hyperspectral Image Denoising", 2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp.1-6, 2024.
14.
Rameez Ahsen, Pierpaolo Di Bitonto, Lorenzo De Trizio, Michele Magarelli, Donato Romano, Pierfrancesco Novielli, Domenico Diacono, Sabina Tangaro, Roberto Bellotti, "Precision Agriculture: Integrating Sensors for Weed Detection using Machine Learning in Agriculture Fields", 2024 IEEE International Humanitarian Technologies Conference (IHTC), pp.1-7, 2024.
15.
Saurabh Suman, Utkarsha Pacharaney, Vishal Kumar Choudhary, Rahul Raushan, Abhishek Kumar, Gulshan Kumar, "Kolmogorov Arnold Network for Hyperspectral Image Classification: A Detailed Explanation", 2024 2nd DMIHER International Conference on Artificial Intelligence in Healthcare, Education and Industry (IDICAIEI), pp.1-5, 2024.
16.
Xuanwen Tao, Bikram Koirala, Antonio Plaza, Paul Scheunders, "A New Dual-Feature Fusion Network for Enhanced Hyperspectral Unmixing", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-13, 2024.
17.
Archana Uriti, Naga Jyothi Pothabathula, "Evaluating Object Detection Approaches for Fruit Detection in Precision Agriculture: A Comprehensive Review", 2024 International Conference on Intelligent Computing and Sustainable Innovations in Technology (IC-SIT), pp.1-6, 2024.
18.
Shou Feng, Hongzhe Zhang, Bobo Xi, Chunhui Zhao, Yunsong Li, Jocelyn Chanussot, "Cross-Domain Few-Shot Learning Based on Decoupled Knowledge Distillation for Hyperspectral Image Classification", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-14, 2024.
19.
Danyang Peng, Haoran Feng, Jun Wu, Yi Wen, Tingting Han, Yuanyuan Li, Guangyu Yang, Lei Qu, "Robust Hyperspectral Image Classification Using a Multiscale Transformer With Long- and Short-Distance Spatial–Spectral Cross Attention", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-14, 2024.
20.
Shuguo Jiang, Nanying Li, Meng Xu, Shuyu Zhang, Sen Jia, "SQformer: Spectral-Query Transformer for Hyperspectral Image Arbitrary-Scale Super-Resolution", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-15, 2024.
21.
Fahmida Tasnim Tisha, Monmoy Alam, Sadia Zaman Mishu, "Deep Reinforcement Learning With Mutual Information for Selecting Bands in Hyperspectral Image Classification", 2024 IEEE International Conference on Power, Electrical, Electronics and Industrial Applications (PEEIACON), pp.804-809, 2024.
22.
Qin Qing, Xinwei Li, Li Zhang, "FeatureFlow Transformer: Enhancing Feature Fusion and Position Information Modeling for Hyperspectral Image Classification", IEEE Access, vol.12, pp.127685-127701, 2024.
23.
Priyanka G.S, Venkatesan M, "Hyperspectral Image Classification Using Quantum Machine Learning", 2024 1st International Conference on Advanced Computing and Emerging Technologies (ACET), pp.1-7, 2024.
24.
Haoyu Jing, Sensen Wu, Laifu Zhang, Fanen Meng, Tian Feng, Yiming Yan, Yuanyuan Wang, Zhenhong Du, "Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-17, 2024.
25.
Fan Xiang, Zhaohui Wang, "Spectral-Spatial Attention Denosie ResNet for Hyperspectral Image Classification", 2024 IEEE 9th International Conference on Computational Intelligence and Applications (ICCIA), pp.125-129, 2024.
26.
Shun Cheng, Zhaohui Xue, Ziyu Li, Aijun Xu, Hongjun Su, "Spectral–Spatial Score Fusion Attention Network for Hyperspectral Image Classification With Limited Samples", IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol.17, pp.14521-14542, 2024.
27.
Ámbar Pérez-García, Adrián Rodríguez-Molina, Emma Hernández, José Fco López, "Spectral Indices Survey for Oil Spill Detection in Coastal Areas", IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol.17, pp.15359-15372, 2024.
28.
Yaqian Long, Songxin Ye, Liqiong Wang, Weixi Wang, Xiaomei Liao, Sen Jia, "Scale Pyramid Graph Network for Hyperspectral Individual Tree Segmentation", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-14, 2024.
29.
Zhijing Ye, Liming Zhang, Chengyong Zheng, Jiangtao Peng, Jón Atli Benediktsson, "Small-Sample Classification for Hyperspectral Images With EPF-Based Smooth Ordering", IEEE Transactions on Geoscience and Remote Sensing, vol.62, pp.1-14, 2024.
30.
Wenbiao Li, Yi Yang, Meng Zhang, Pengbo Mi, Zhuo Xiao, Jincheng Xiang, "Deep Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification", 2024 43rd Chinese Control Conference (CCC), pp.7955-7960, 2024.
Cites in Papers - Other Publishers (228)
1.
P. Hemashree, G. Padmavathi, "Enhancing FGSM Attacks with Genetic Algorithms for Robust Adversarial Examples in Remote Sensing Image Classification Systems", Applications and Techniques in Information Security, vol.2306, pp.229, 2025.
2.
Mücahit Cihan, Murat Ceylan, Murat Konak, Hanifi Soylu, "Involution-based HarmonyNet: An efficient hyperspectral imaging model for automatic detection of neonatal health status", Biomedical Signal Processing and Control, vol.100, pp.106982, 2025.
3.
Muzhi Gao, Gaoyang Zhu, "A deep learning-assisted inversion for EM logging tool with tilted-coil antennas in VTI media", Acta Geophysica, 2024.
4.
Ye Ma, Yuetong Liu, Jiayao Wang, Zhen Zhen, Fengri Li, Fujuan Feng, Yinghui Zhao, "Understanding ecosystem services of detailed forest and wetland types using remote sensing and deep learning techniques in Northern China", Journal of Environmental Management, vol.372, pp.123410, 2024.
5.
Neetu Sigger, Tuan T. Nguyen, Gianluca Tozzi, "Brain tissue classification in hyperspectral images using multistage diffusion features and transformer", Journal of Microscopy, 2024.
6.
Ziqi Zhao, Changbao Yang, Zhongjun Qiu, Qiong Wu, "Discrete Cosine Transform-Based Joint Spectral–Spatial Information Compression and Band-Correlation Calculation for Hyperspectral Feature Extraction", Remote Sensing, vol.16, no.22, pp.4270, 2024.
7.
Neetu Sigger, Quoc-Tuan Vien, Sinh Van Nguyen, Gianluca Tozzi, Tuan Thanh Nguyen, "Unveiling the potential of diffusion model-based framework with transformer for hyperspectral image classification", Scientific Reports, vol.14, no.1, 2024.
8.
Eman N. Abdelhafez, Ahmed Hagag, Tamer A. Abassy, , 2024.
9.
Shuhan Du, Wei Han, Zhenping Kang, Yurong Liao, Zhaoming Li, "A Convolution Auto-Encoders Network for Aero-Engine Hot Jet FT-IR Spectrum Feature Extraction and Classification", Aerospace, vol.11, no.11, pp.933, 2024.
10.
Donge Zhao, Peiyun Yu, Feng Guo, Xuefeng Yang, Yayun Ma, Changli Wang, Kang Li, Wenbo Chu, Bin Zhang, "Classification of Hyperspectral Images of Explosive Fragments Based on Spatial–Spectral Combination", Sensors, vol.24, no.22, pp.7131, 2024.
11.
Sai Li, Shuo Huang, "AFA–Mamba: Adaptive Feature Alignment with Global–Local Mamba for Hyperspectral and LiDAR Data Classification", Remote Sensing, vol.16, no.21, pp.4050, 2024.
12.
Ali Jamali, Bing Lu, Rishi R. Burlakoti, Siva Sabaratnam, Margaret Schmidt, Carolyn Teasdale, Eric M. Gerbrandt, Lilian Yang, Jonathon McIntyre, David McCaffrey, "High-resolution mapping of Blueberry scorch virus incidence using RGB and multispectral UAV images and deep learning", Remote Sensing Applications: Society and Environment, pp.101390, 2024.
13.
Nathalie Brun, Guillaume Lambert, Laura Bocher, "EELS hyperspectral images unmixing using autoencoders", The European Physical Journal Applied Physics, vol.99, pp.28, 2024.
14.
Saiful Anuar Jaafar, Abdul Rauf Abdul Rasam, Norizan Mat Diah, "Evaluating Convolutional Neural Network Architecture for Historical Topographic Hardcopy Maps Analysis: A Study on Training and Validation Accuracy Variation", Pertanika Journal of Science and Technology, vol.32, no.6, pp.2609, 2024.
15.
Wenliang Chen, Kun Shang, Yibo Wang, Wenchao Qi, Songtao Ding, Xia Zhang, "A mixed convolution and distance covariance matrix network for fine classification of corn straw cover types with fused hyperspectral and multispectral data", International Journal of Applied Earth Observation and Geoinformation, vol.134, pp.104213, 2024.
16.
Tian Ke, Yanfei Zhong, Mi Song, Xinyu Wang, Liangpei Zhang, "Mineral detection based on hyperspectral remote sensing imagery on Mars: From detection methods to fine mapping", ISPRS Journal of Photogrammetry and Remote Sensing, vol.218, pp.761, 2024.
17.
Ningbo Guo, Mingyong Jiang, Decheng Wang, Yutong Jia, Kaitao Li, Yanan Zhang, Mingdong Wang, Jiancheng Luo, "PGNN-Net: Parallel Graph Neural Networks for Hyperspectral Image Classification Using Multiple Spatial-Spectral Features", Remote Sensing, vol.16, no.18, pp.3531, 2024.
18.
Chuanzhi Wang, Jun Huang, Mingyun Lv, Huafei Du, Yongmei Wu, Ruiru Qin, "A local enhanced mamba network for hyperspectral image classification", International Journal of Applied Earth Observation and Geoinformation, vol.133, pp.104092, 2024.
19.
Rahman Momeni, Tuba Bircan, Robert King, Eloy Zafra Santos, "Deciphering climate-induced displacement in Somalia: A remote sensing perspective", PLOS ONE, vol.19, no.8, pp.e0304202, 2024.
20.
L. C. Ayres, S. J. M. de Almeida, J. C. M. Bermudez, R. A. Borsoi, "Hierarchical homogeneity-based superpixel segmentation: application to hyperspectral image analysis", International Journal of Remote Sensing, vol.45, no.17, pp.6004, 2024.
21.
Yiyi Xiong, Cheryl McCarthy, Jacob Humpal, Cassandra Percy, "Near‐infrared spectroscopy and deep neural networks for early common root rot detection in wheat from multi‐season trials", Agronomy Journal, 2024.
22.
Xinhua Lu, Jiaxuan Hao, Hua Wang, Jianliang Qiao, Junbo Huang, "Hyperspectral image classification using a deep relation network with random replacement data augmentation", Remote Sensing Letters, vol.15, no.8, pp.805, 2024.
23.
Jinfeng Wang, Yuhang Chu, Guoqing Chen, Minyi Zhao, Jizhuang Wu, Ritao Qu, Zhentao Wang, "Characterization and Identification of NPK Stress in Rice Using Terrestrial Hyperspectral Images", Plant Phenomics, vol.6, 2024.
24.
Ahmed Sedik, Hoshang Kolivand, Meshal Albeedan, "An efficient image classification and segmentation method for crime investigation applications", Multimedia Tools and Applications, 2024.
25.
Junheng Gao, Hailin Wang, Jiangjun Peng, , 2024.
26.
Jianxin Jia, Xiaorou Zheng, Yueming Wang, Yuwei Chen, Mika Karjalainen, Shoubin Dong, Runuo Lu, Jianyu Wang, Juha Hyyppä, "The effect of artificial intelligence evolving on hyperspectral imagery with different signal-to-noise ratio, spectral and spatial resolutions", Remote Sensing of Environment, vol.311, pp.114291, 2024.
27.
Saziye Ozge Atik, "Dual-Stream Spectral-Spatial Convolutional Neural Network for Hyperspectral Image Classification and Optimal Band Selection", Advances in Space Research, 2024.
28.
Hufeng Guo, Wenyi Liu, "DMAF-NET: Deep Multi-Scale Attention Fusion Network for Hyperspectral Image Classification with Limited Samples", Sensors, vol.24, no.10, pp.3153, 2024.
29.
Yeniu Mickey Wang, Bertram Ostendorf, Vinay Pagay, "Evaluating the potential of high-resolution hyperspectral UAV imagery for grapevine viral disease detection in Australian vineyards", International Journal of Applied Earth Observation and Geoinformation, vol.130, pp.103876, 2024.
30.
Romain Thoreau, Laurent Risser, Véronique Achard, Béatrice Berthelot, Xavier Briottet, "Toulouse Hyperspectral Data Set: A benchmark data set to assess semi-supervised spectral representation learning and pixel-wise classification techniques", ISPRS Journal of Photogrammetry and Remote Sensing, vol.212, pp.323, 2024.