fine tunning pretrained model

[SharonPeled]

Thank you for this great work and for sharing the pretrained models!

I got my eye on dino_small_patch_16_ep200.torch and I'd like to fine tune it to my task.
Unfortunately, only the ViT model is available, without the trained DINOHead.
Could you share the full model checkpoint (as it checkpoints in the DINO repo)?
As instructed here: facebookresearch/dino#80 (comment)

Thanks!

[CocoGzh]

Hi, I have a similar problem. I reproduced the results of MHIST based on the pretrained resnet50. But I can't reproduce the results based on pretrained vit.

[HaileyyyLau]

Hi, I have a similar problem. I reproduced the results of MHIST based on the pretrained resnet50. But I can't reproduce the results based on pretrained vit.

Hi, I have a similar situation.. I reproduce all 4 classification dataset results using pretrained ViT-smallp8, and the MHIST result is very out of expectations...

Did you meet the same problem? I think it is related to the rules how the dataset splits? looking forward to your reply!