Home

/oliverrensu/ DeepMIM: Deep Supervision for Masked Image Modeling

Code Link
Description
Deep supervision, which involves extra supervisions to the intermediate features of a neural network, was widely used in image classification in the early deep learning era since it significantly reduces the training difficulty and eases the optimization like avoiding gradient vanish over the vanilla training. Code: https://github.com/oliverrensu/deepmim
Retrieved
2023/03/17
Stars
25
TOP