Machine learningML & AI Methods

Can overfitted deep neural networks in adversarial training generalize? - An approximation viewpoint

The study offers a theoretical insight into the robust overfitting issue in adversarial training on over-parameterized deep neural networks (DNNs), showing that overfitting can be avoided and a robust generalization gap is unavoidable, with the model capacity requirement depending on the target function's smoothness.