Attention Distillation: self-supervised vision transformer students need more guidance (BMVC 2022)

Requirements

Please check the packages in your environment with the "requirements.txt", normally these scripts don't depend on much on the package versions.

Please modify the data paths in "dino_teacher.sh" and "mugs_teacher.sh" to run the scripts by "bash xxx.sh".

The teacher models checkpoints can be downloaded from the github repositories of DINO (https://github.com/facebookresearch/dino) and Mugs (https://github.com/sail-sg/mugs).

If you have any question, do not hesitate to contact me or post an issue.

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
engine		engine
models		models
util		util
dino_teacher.sh		dino_teacher.sh
dino_transfer.py		dino_transfer.py
mugs_teacher.sh		mugs_teacher.sh
readme.md		readme.md
requirements.txt		requirements.txt