In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, but it has intrinsic specificities that make the application of deep learning less straightforward than with other optical data. This article presents the state of the art of previous machine-learning approaches, reviews the various deep-learning approaches currently proposed for hyperspectral classification, and identifies the problems and difficulties that arise in the implementation of deep neural networks for this task. In particular, the issues of spatial and spectral resolution, data volume, and transfer of models from multimedia images to hyperspectral data are addressed. Additionally, a comparative study of various families of network architectures is provided, and a software toolbox is publicly released to allow experimenting with these methods (https://github.com/nshaud/DeepHyperX). This article is intended for both data scientists with interest in hyperspectral data and remote sensing experts eager to apply deep-learning techniques to their own data set.
Abstract:
In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, ...Show MoreMetadata
Abstract:
In recent years, deep-learning techniques revolutionized the way remote sensing data are processed. The classification of hyperspectral data is no exception to the rule, but it has intrinsic specificities that make the application of deep learning less straightforward than with other optical data. This article presents the state of the art of previous machine-learning approaches, reviews the various deep learning approaches currently proposed for hyperspectral classification, and identifies the problems and difficulties that arise in the implementation of deep neural networks for this task. In particular, the issues of spatial and spectral resolution, data volume, and transfer of models from multimedia images to hyperspectral data are addressed. Additionally, a comparative study of various families of network architectures is provided, and a software toolbox is publicly released to allow experimenting with these methods (https://github.com/nshaud/DeepHyperX). This article is intended for both data scientists with interest in hyperspectral data and remote sensing experts eager to apply deep learning techniques to their own data set.
Published in: IEEE Geoscience and Remote Sensing Magazine ( Volume: 7, Issue: 2, June 2019)
References is not available for this document.
Select All
1.
N. Audebert, B. Le Saux and S. Lefèvre, "Semantic segmentation of Earth observation data using multimodal and multi-scale deep networks", Proc. Asian Conf. Computer Vision, pp. 180-196, 2016.
2.
M. Volpi and D. Tuia, "Dense semantic labeling of subdecimeter resolution images with convolutional neural networks", IEEE Trans. Geosci. Remote Sens., vol. 55, no. 2, pp. 881-893, 2017.
3.
D. Marmanis, J. D. Wegner, S. Galliani, K. Schindler, M. Datcu and U. Stilla, "Semantic segmentation of aerial images with an ensemble of CNNs", ISPRS Ann. Photogrammetry Remote Sensing Spatial Inform. Sci., vol. 3, pp. 473-480, June 2016.
4.
J. Bioucas-Dias, A. Plaza, G. Camps-Valls, N. Nasrabadi, P. Scheunders and J. Chanussot, "Hyperspectral remote sensing data analysis and future challenges", IEEE Geosci. Remote Sens. Mag. (replaces Newsletter), vol. 1, no. 2, pp. 6-36, June 2013.
5.
M. Cubero-Castan, J. Chanussot, V. Achard, X. Briottet and M. Shimoni, "A physics-based unmixing method to estimate subpixel temperatures on mixed pixels", IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 1894-1906, Apr. 2015.
6.
X. X. Zhu et al., "Deep learning in remote sensing: A comprehensive review and list of resources", IEEE Geosci. Remote Sens. Mag. (replaces Newsletter), vol. 5, no. 4, pp. 8-36, Dec. 2017.
7.
P. Ghamisi et al., "Advances in hyperspectral image and signal processing: A comprehensive overview of the state of the art", IEEE Geosci. Remote Sens. Mag. (replaces Newsletter), vol. 5, no. 4, pp. 37-78, Dec. 2017.
8.
P. Y. Deschamps and T. Phulpin, "Atmospheric correction of infrared measurements of sea surface temperature using channels at 3.7 11 and 12 mm", Boundary Layer Meteorol., vol. 18, no. 2, pp. 131-143, Mar. 1980.
9.
H. Rahman and G. Dedieu, "SMAC: A simplified method for the atmospheric correction of satellite measurements in the solar spectrum", Int. J. Remote Sens., vol. 15, no. 1, pp. 123-143, Jan. 1994.
10.
P. Chavez, "Image-based atmospheric corrections: Revisited and improved", Photogrammetric Eng. Remote Sens., vol. 62, no. 9, pp. 1025-1036, 1996.
11.
B.-C. Gao, M. J. Montes, C. O. Davis and A. F. Goetz, "Atmospheric correction algorithms for hyperspectral remote sensing data of land and ocean", Remote Sens. Environ., vol. 113, pp. S17-S24, Sept. 2009.
12.
2018 IEEE GRSS Data Fusion Contest, 2018, [online] Available: http://www.grss-ieee.org/community/technical-committees/data-fusion.
13.
B. Le Saux, N. Yokoya, R. Haensch and S. Prasad, "2018 IEEE GRSS Data Fusion Contest: Multimodal land use classification [technical committees]", IEEE Geosci. Remote Sens. Mag. (replaces Newsletter), vol. 6, no. 1, pp. 52-54, Mar. 2018.
14.
M. D. Farrell and R. M. Mersereau, "On the impact of PCA dimension reduction for hyperspectral detection of difficult targets", IEEE Geosci. Remote Sens. Lett., vol. 2, no. 2, pp. 192-195, Apr. 2005.
15.
B. Guo, S. R. Gunn, R. I. Damper and J. D. B. Nelson, "Band selection for hyperspectral image classification using mutual information", IEEE Geosci. Remote Sens. Lett., vol. 3, no. 4, pp. 522-526, Oct. 2006.
16.
Q. Du, "Band selection and its impact on target detection and classification in hyperspectral image analysis", Proc. IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, pp. 374-377, 2003.
17.
R. Yuhas, A. Goetz and J. Boardman, "Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm", Proc. Summaries of the Third Annu. JPL Airborne Geoscience Workshop, pp. 147-149., 1992, [online] Available: https://ntrs.nasa.gov/search.jsp?R=19940012238.
18.
L. Parra, C. Spence, P. Sajda, A. Ziehe and K.-R. Müller, "Unmixing hyperspectral data", Proc. 12th Int. Conf. Neural Information Processing Systems, pp. 942-948, 1999.
19.
A. Le Bris, N. Chehata, X. Briottet and N. Paparoditis, "Extraction of optimal spectral bands using hierarchical band merging out of hyperspectral data", Int. Arch. Photogrammetry Remote Sens. Spatial Inform. Sci., vol. XL-3/W3, pp. 459-465, Aug. 2015.
20.
C. Rodarmel and J. Shan, "Principal component analysis for hyperspectral image classification", Surveying Land Inform. Sci., vol. 62, no. 2, pp. 115, 2002.
21.
B. B. Damodaran, N. Courty and S. Lefèvre, "Sparse Hilbert Schmidt independence criterion and surrogate-kernel-based feature selection for hyperspectral image classification", IEEE Trans. Geosci. Remote Sens., vol. 55, no. 4, pp. 2385-2398, 2017.
22.
J. Ham, Y. Chen, M. M. Crawford and J. Ghosh, "Investigation of the random forest framework for classification of hyperspectral data", IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 492-501, Mar. 2005.
23.
F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines", IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
24.
J. A. Gualtieri and R. F. Cromp, "Support vector machines hyperspectral remote sensing classification”", Proc. SPIE, vol. 3584, pp. 1-12, Oct. 1999.
25.
L. Chapel, T. Burger, N. Courty and S. Lefèvre, "PerTurbo manifold learning algorithm for weakly labeled hyperspectral image classification", IEEE J. Sel. Topics Appl. Earth Observations Remote Sens., vol. 7, no. 4, pp. 1070-1078, Apr. 2014.
26.
J. Wu, Z. Jiang, H. Zhang, B. Cai and Q. Wei, "Semi-supervised conditional random field for hyperspectral remote sensing image classification", Proc. 2016 IEEE Int. Geoscience Remote Sensing Symp. (IGARSS), pp. 2614-2617, 2016.
27.
Y. Tarabalka, J. Chanussot and J. A. Benediktsson, "Segmentation and classification of hyperspectral images using watershed transformation", Pattern Recogn., vol. 43, no. 7, pp. 2367-2379, 2010.
28.
M. Fauvel, Y. Tarabalka, J. A. Benediktsson, J. Chanussot and J. C. Tilton, "Advances in spectral-spatial classification of hyperspectral images", Proc. IEEE, vol. 101, no. 3, pp. 652-675, Mar. 2013.
29.
E. Aptoula, M. D. Mura and S. Lefèvre, "Vector attribute profiles for hyperspectral image classification", IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3208-3220, June 2016.
30.
M. D. Mura, J. A. Benediktsson, B. Waske and L. Bruzzone, "Extended profiles with morphological attribute filters for the analysis of hyperspectral data", Int. J. Remote Sens., vol. 31, no. 22, pp. 5975-5991, 2010.