# Synthetic algorithmic experiments

Here is an example script. We will release all the scripts upon acceptance.

```
export CUDA_VISIBLE_DEVICES=0

export PYTHONPATH=$PWD

MODEL_CONFIG=

LR=0.005
CLIP=1.0
BSZ=1024
LAY=2
INIT=0.006
STEP=20000
CHK=8
SEED=1

python experiments/main.py \
  --config=${MODEL_CONFIG} \
  --grad_clip_norm $CLIP \
  --lr ${LR} \
  --n_layers ${LAY} \
  --batch_size $BSZ \
  --initializer_range ${INIT} \
  --val_every_step 100 \
  --num_steps ${STEP} \
  --wand_name "synthetic-parity" \
  --chunk_size ${CHK} \
  --seed ${SEED}
```
