Environment Preparation:
https://github.com/vturrisi/solo-learn

pip install -r requirements

Datasets:
In addition to IMAGENET-1k needs to go to the official website to download, the rest will be automatically downloaded during training. You only need to specify the config file.

Training:

cmd = 'python3 -u main_pretrain.py  --config-path scripts/pretrain/cifar --config-name {}.yaml ++regular_method={} ++regular_weight={}'.format(base,method,weight)
cmd = 'python3 -u main_pretrain.py  --config-path scripts/pretrain/imagenet --config-name {}.yaml ++regular_method={} ++regular_weight={}'.format(base,method,weight)