FACL-Attack: Frequency-Aware Contrastive Learning for Transferable Adversarial Attacks
About
Deep neural networks are known to be vulnerable to security risks due to the inherent transferable nature of adversarial examples. Despite the success of recent generative model-based attacks demonstrating strong transferability, it still remains a challenge to design an efficient attack strategy in a real-world strict black-box setting, where both the target domain and model architectures are unknown. In this paper, we seek to explore a feature contrastive approach in the frequency domain to generate adversarial examples that are robust in both cross-domain and cross-model settings. With that goal in mind, we propose two modules that are only employed during the training phase: a Frequency-Aware Domain Randomization (FADR) module to randomize domain-variant low- and high-range frequency components and a Frequency-Augmented Contrastive Learning (FACL) module to effectively separate domain-invariant mid-frequency features of clean and perturbed image. We demonstrate strong transferability of our generated adversarial perturbations through extensive cross-domain and cross-model experiments, while keeping the inference time complexity.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Adversarial Attack | ImageNet (val) | Accuracy48.38 | 80 | |
| Adversarial Attack | ImageNet | Accuracy65.68 | 63 | |
| Image Classification | ImageNet | Accuracy74.23 | 40 | |
| Semantic segmentation | SemSeg (SS) | mIoU26.4 | 26 | |
| Object Detection | ObjDet (OD) | mAP5027.94 | 26 | |
| Adversarial Attack Transferability | Stanford Cars | Accuracy51.23 | 13 | |
| Adversarial Attack Transferability | FGVC Aircraft | Accuracy Difference/Score40.08 | 13 | |
| Adversarial Attack Transferability | CUB-200 2011 | Accuracy40.85 | 13 | |
| Semantic segmentation | Cross-task Classification surrogate to Segmentation | DeepLabV3+ mIoU23.75 | 13 | |
| Object Detection | Cross-task Classification surrogate to Detection | Faster R-CNN mAP5027.94 | 13 |