# Task-Oriented Feature Distillation 

These are partial codes of the paper *Task-Oriented Feature Distillation*, submitted to NeurIPS2020. We will release all the codes if this paper is accepted :)  

## Experiments on CIFAR100

**Step1.** Install the required packages. 

```shell
pip install torch torchvision
```

**Step2**. Train a resnet152 teacher model. 

```python
python train_teacher.py --model=resnet152
```

Then, a resent152 teacher model is trained and saved in *teacher* folder.  

**Step3**. Train a student model wit TOFD.

```python
python distill.py --model=senet18 --teacher=resnet152
```

