NEO-KD maintains similar clean accuracy levels to Adv. w/o Distill on Tiny-ImageNet, while significantly boosting adversarial test accuracy, indicating its effectiveness.
The Adversarial Training via Average Attack section emphasizes that NEO-KD demonstrates advantages in adversarial training, particularly validated through experiments on datasets like CIFAR-100.
Collection
[
|
...
]