Loading [MathJax]/extensions/MathZoom.js
Robust Remote Sensing Image Cross-Scene Classification Under Noisy Environment | IEEE Journals & Magazine | IEEE Xplore

Robust Remote Sensing Image Cross-Scene Classification Under Noisy Environment


Abstract:

In recent years, great progress has been made in the field of cross-scene classification. However, most existing cross-scene methods assume that the source domain has mas...Show More

Abstract:

In recent years, great progress has been made in the field of cross-scene classification. However, most existing cross-scene methods assume that the source domain has massive and carefully annotated data, which is time-consuming and labor-intensive in practice. Datasets in real-life applications usually contain a large number of noisy labels, which will significantly affect cross-scene classification performance. How to perform more discriminative and generalized cross-scene classification in the presence of noisy samples needs to be urgently addressed. Apart from that, existing methods tend to implement global matching between domains, causing problems such as unbalanced adaptation and negative transfer, limiting the cross-scene performance of the model. For more effective and reliable cross-scene classification under noisy environment, robust adaptation with noise (RAN) is proposed in this article. RAN explores which samples are noiseless and transferable to enable positive and robust cross-scene transfer. The curriculum learning strategy is used to filter out noisy samples for better source supervised learning and cross-domain matching. To further improve the stability and effectiveness of cross-scene adaptation, the class weighting factor and the public weighting factor are introduced to consider the class information of the source and target domains. RAN is an efficient plug-and-play adaptation framework, which is easily implemented and can be embedded in existing methods. Experimental results demonstrate that the proposed RAN can achieve remarkable performance on cross-scene classification tasks in noisy environments.
Article Sequence Number: 5600411
Date of Publication: 28 November 2023

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

In recent years, scene classification has gained increasing attention in the field of remote sensing (RS). It attempts to build models that can discriminate the scene category of RS images. Not only does scene classification provide clues for other RS tasks, but also it is used in many real-world applications such as land use [1], urban planning [2], and environment and climate monitoring [3]. However, difficulty in acquiring high-quality labeled data and poor generalizability of models have seriously hampered the development and application of scene classification methods.

Select All
1.
R. Zhu, L. Yan, N. Mo, and Y. Liu, “Semi-supervised center-based discriminative adversarial learning for cross-domain scene-level land-cover classification of aerial images,” ISPRS J. Photogramm. Remote Sens., vol. 155, pp. 72–89, Sep. 2019.
2.
X. Zhang, S. Du, and Y. Zhang, “Semantic and spatial co-occurrence analysis on object pairs for urban scene classification,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 11, no. 8, pp. 2630–2643, Aug. 2018.
3.
S. Liu and Q. Shi, “Local climate zone mapping as remote sensing scene classification using deep learning: A case study of metropolitan China,” ISPRS J. Photogramm. Remote Sens., vol. 164, pp. 229–242, Jun. 2020.
4.
J. Peng, Y. Huang, W. Sun, N. Chen, Y. Ning, and Q. Du, “Domain adaptation in remote sensing image classification: A survey,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 15, pp. 9842–9859, 2022.
5.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015.
6.
L. Zhang, L. Zhang, and B. Du, “Deep learning for remote sensing data: A technical tutorial on the state of the art,” IEEE Geosci. Remote Sens. Mag., vol. 4, no. 2, pp. 22–40, Jun. 2016.
7.
T. Xiao, T. Xia, Y. Yang, C. Huang, and X. Wang, “Learning from massive noisy labeled data for image classification,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 2691–2699.
8.
K.-H. Lee, X. He, L. Zhang, and L. Yang, “CleanNet: Transfer learning for scalable image classifier training with label noise,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2018, pp. 5447–5456.
9.
H. Song, M. Kim, and J.-G. Lee, “SELFIE: Refurbishing unclean samples for robust deep learning,” in Proc. 36th Int. Conf. Mach. Learn., vol. 97, K. Chaudhuri and R. Salakhutdinov, Eds., Jun. 2019, pp. 5907–5915.
10.
C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals, “Understanding deep learning (still) requires rethinking generalization,” Commun. ACM, vol. 64, no. 3, pp. 107–115, Mar. 2021.
11.
J. Zhuo, S. Wang, and Q. Huang, “Uncertainty modeling for robust domain adaptation under noisy environments,” IEEE Trans. Multimedia, vol. 25, pp. 6157–6170, 2022.
12.
J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, “How transferable are features in deep neural networks? ” in Advances in Neural Information Processing Systems, vol. 27, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K. Weinberger, Eds. Red Hook, NY, USA : Curran Associates, 2014.
13.
E. Othman, Y. Bazi, F. Melgani, H. Alhichri, N. Alajlan, and M. Zuair, “Domain adaptation network for cross-scene classification,” IEEE Trans. Geosci. Remote Sens., vol. 55, no. 8, pp. 4441–4456, Aug. 2017.
14.
J. Geng, X. Deng, X. Ma, and W. Jiang, “Transfer learning for SAR image classification via deep joint distribution adaptation networks,” IEEE Trans. Geosci. Remote Sens., vol. 58, no. 8, pp. 5377–5392, Aug. 2020.
15.
J. Zhang, J. Liu, B. Pan, and Z. Shi, “Domain adaptation based on correlation subspace dynamic distribution alignment for remote sensing image scene classification,” IEEE Trans. Geosci. Remote Sens., vol. 58, no. 11, pp. 7920–7930, Nov. 2020.
16.
S. Zhu, B. Du, L. Zhang, and X. Li, “Attention-based multiscale residual adaptation network for cross-scene classification,” IEEE Trans. Geosci. Remote Sens., vol. 60, 2022, Art. no. 5400715.
17.
W. Huang, Y. Shi, Z. Xiong, Q. Wang, and X. X. Zhu, “Semi-supervised bidirectional alignment for remote sensing cross-domain scene classification,” ISPRS J. Photogramm. Remote Sens., vol. 195, pp. 192–203, Jan. 2023.
18.
D. Wittich and F. Rottensteiner, “Appearance based deep domain adaptation for the classification of aerial images,” ISPRS J. Photogramm. Remote Sens., vol. 180, pp. 82–102, Oct. 2021.
19.
A. Elshamli, G. W. Taylor, A. Berg, and S. Areibi, “Domain adaptation using representation learning for the classification of remote sensing images,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 9, pp. 4198–4209, Sep. 2017.
20.
M. B. Bejiga, F. Melgani, and P. Beraldini, “Domain adversarial neural networks for large-scale land cover classification,” Remote Sens., vol. 11, no. 10, p. 1153, May 2019.
21.
X. Lu, T. Gong, and X. Zheng, “Multisource compensation network for remote sensing cross-domain scene classification,” IEEE Trans. Geosci. Remote Sens., vol. 58, no. 4, pp. 2504–2515, Apr. 2020.
22.
W. Liu, “Adversarial unsupervised domain adaptation for 3D semantic segmentation with multi-modal learning,” ISPRS J. Photogramm. Remote Sens., vol. 176, pp. 211–221, Jun. 2021.
23.
J. Jiang, J. Ma, Z. Wang, C. Chen, and X. Liu, “Hyperspectral image classification in the presence of noisy labels,” IEEE Trans. Geosci. Remote Sens., vol. 57, no. 2, pp. 851–865, Feb. 2019.
24.
H. Song, M. Kim, D. Park, Y. Shin, and J.-G. Lee, “Learning from noisy labels with deep neural networks: A survey,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 11, pp. 8135–8153, Nov. 2022.
25.
I. Jindal, M. Nokleby, and X. Chen, “Learning deep networks from noisy labels with dropout regularization,” in Proc. IEEE 16th Int. Conf. Data Mining (ICDM), Dec. 2016, pp. 967–972.
26.
K. Lee, S. Yun, K. Lee, H. Lee, B. Li, and J. Shin, “Robust inference via generative classifiers for handling noisy labels,” in Proc. 36th Int. Conf. Mach. Learn., vol. 97, K. Chaudhuri and R. Salakhutdinov, Eds., Jun. 2019, pp. 3763–3772.
27.
M. Lukasik, S. Bhojanapalli, A. Menon, and S. Kumar, “Does label smoothing mitigate label noise? ” in Proc. 37th Int. Conf. Mach. Learn., vol. 119, A. Singh, Ed., Jul. 2020, pp. 6448–6458.
28.
H. Wei, L. Tao, R. Xie, and B. An, “Open-set label noise can improve robustness against inherent label noise,” in Advances in Neural Information Processing Systems, vol. 34, M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, Eds. Red Hook, NY, USA : Curran Associates, Inc., 2021, pp. 7978–7992.
29.
R. Wang, T. Liu, and D. Tao, “Multiclass learning with partially corrupted labels,” IEEE Trans. Neural Netw. Learn. Syst., vol. 29, no. 6, pp. 2568–2580, Jun. 2018.
30.
L. Jiang, D. Meng, Q. Zhao, S. Shan, and A. Hauptmann, “Self-paced curriculum learning,” in Proc. AAAI Conf. Artif. Intell., vol. 29, Feb. 2015, pp. 1–12.

Contact IEEE to Subscribe

References

References is not available for this document.