This repository is an implementation of YANG, Jing, et al. Knowledge distillation via adaptive instance normalization. arXiv preprint arXiv:2003.04289, 2020.
Naive implementation.
| Teacher model | Student model | Scratch Teacher acc. | Scratch Student acc. | Student acc. |
|---|---|---|---|---|
| WRN-40-4 | WRN-16-4 | 76.44 % |