Relationship between Model Compression and Adversarial Robustness: A Review of Current Evidence | IEEE Conference Publication | IEEE Xplore

Relationship between Model Compression and Adversarial Robustness: A Review of Current Evidence


Abstract:

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques...Show More

Abstract:

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques, including pruning and quantization, can reduce the size of the network while preserving its accuracy. Several recent studies have addressed the relationship between model compression and adversarial robustness, while some experiments have reported contradictory results. This work summarizes available evidence and discusses possible explanations for the observed effects.
Date of Conference: 05-08 December 2023
Date Added to IEEE Xplore: 01 January 2024
ISBN Information:

ISSN Information:

Conference Location: Mexico City, Mexico
FZI Research Center for Information Technology
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
FZI Research Center for Information Technology
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany

I. Introduction and Related Work

Goodfellow et al. [1] and Szegedy et al. [2] first brought up the risk of adversarial attacks, small perturbations (often imperceptible by humans) that are carefully crafted and added to the input of state-of-the-art (SOTA) deep neural networks (DNNs). Without specific DNN training or mitigation mea-sures, these attacks lead to high-confidence wrong outputs of SOTA DNNs and convolutional neural networks (CNNs). This inherent vulnerability of DNN s poses an especially high risk when applying them in autonomous driving, facial recognition, or medical domains.

FZI Research Center for Information Technology
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
FZI Research Center for Information Technology
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany

References

References is not available for this document.