MixNN: Combating Noisy Labels in Deep Learning by Mixing with Nearest Neighbors

Noisy labels are ubiquitous in real-world datasets, especially in the ones from web sources. Training deep neural networks on noisy datasets is a challenging task, as the networks have been shown to overfit the noisy labels in training, resulting in performance degradation. When trained on noisy datasets, deep neural networks have been observed to fit t he clean samples during an "early learning" phase, before eventually memorizing the …