Arch: resnet50_pt
Bs trn: 256
Bs val: 256
Hidden dim: 256
Dataset: celebA
Resample class: 
Slice with: rep
Rep cluster method: gmm
Num anchor: 32
Num positive: 32
Num negative: 32
Num negative easy: 0
Weight anc by loss: False
Weight pos by loss: False
Weight neg by loss: False
Anc loss temp: 0.5
Pos loss temp: 0.5
Neg loss temp: 0.5
Data wide pos: False
Target sample ratio: 1
Balance targets: False
Additional negatives: False
Hard negative factor: 0
Full contrastive: False
Train encoder: False
No projection head: False
Projection dim: 128
Batch factor: None
Temperature: 0.05
Single pos: False
Supervised linear scale up: False
Supervised update delay: 0
Contrastive weight: 0.5
Classifier update interval: 8
Optim: adam
Max epoch: 100
Lr: 0.0001
Momentum: 0.9
Weight decay: 0.01
Weight decay c: 0.01
Stopping window: 30
Load encoder: 
Freeze encoder: False
Finetune epochs: 0
Clip grad norm: False
Lr scheduler classifier: 
Lr scheduler: 
Grad clip grad norm: False
Erm: False
Erm only: False
Pretrained spurious path: ./model/celebA/config/pgd_table_six/pgd_table_six_model_b_epoch99_seed0.pt
Max epoch s: 1
Bs trn s: 32
Lr s: 0.001
Momentum s: 0.9
Weight decay s: 0.0005
Slice temp: 10
Log loss interval: 10
Checkpoint interval: 50
Grad checkpoint interval: 50
Log visual interval: 100
Log grad visual interval: 50
Verbose: True
Seed: 0
Replicate: 0
No cuda: False
Resume: False
New slice: False
Num workers: 32
Evaluate: False
Data cmap: hsv
Test cmap: 
P correlation: 0.9
P corr by class: None
Train classes: ['blond', 'nonblond']
Train class ratios: None
Test shift: random
Flipped: False
Q: 0.7
Pretrained bmodel: True
Cosine: True
Exp: pgd_table_six
Supervised contrast: True
Prioritize spurious pos: False
Contrastive type: cnc
Compute auroc: False
Model type: resnet50_pt_cnc
Criterion: cross_entropy
Pretrained: False
Max grad norm: 1.0
Adam epsilon: 1e-08
Warmup steps: 0
Max grad norm s: 1.0
Adam epsilon s: 1e-08
Warmup steps s: 0
Grad max grad norm: 1.0
Grad adam epsilon: 1e-08
Grad warmup steps: 0
Device: cuda
Img file type: .png
Display image: False
Image path: ./images/celebA/celebA/config/contrastive_umaps
Log interval: 1
Log path: ./logs/celebA/config
Results path: ./results/celebA/config
Model path: ./model/celebA/config
Loss factor: 1
Supersample labels: False
Subsample labels: False
Weigh slice samples by loss: True
Val split: 0.2
Spurious train split: 0.2
Subsample groups: False
Train method: sc
Max robust acc: -1
Max robust epoch: -1
Max robust group acc: (None, None)
Root dir: ./datasets/data/CelebA/
Target name: Blond_Hair
Confounder names: ['Male']
Image mean: 0.449
Image std: 0.226
Augment data: False
Task: celebA
Num classes: 2
Experiment configs: config
Experiment name: cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=adam-lr=0.0001-mo=0.9-wd=0.01-wdc=0.01-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0
Mi resampled: None

Loading checkpoints for train split:
[-1 -1 -1 ... -1 -1 -1]
<class 'numpy.ndarray'>
[0 1 2 3] [71629 66874 22880  1387]
Loading checkpoints for val split:
[-1 -1 -1 ... -1  1 -1]
<class 'numpy.ndarray'>
[0 1 2 3] [8535 8276 2874  182]
Loading checkpoints for test split:
[-1 -1 -1 ... -1 -1  1]
<class 'numpy.ndarray'>
[0 1 2 3] [9767 7535 2480  180]
Train dataset:
    Blond_Hair = 0, Male = 0 : n = 71629
    Blond_Hair = 0, Male = 1 : n = 66874
    Blond_Hair = 1, Male = 0 : n = 22880
    Blond_Hair = 1, Male = 1 : n = 1387
Val dataset:
    Blond_Hair = 0, Male = 0 : n = 8535
    Blond_Hair = 0, Male = 1 : n = 8276
    Blond_Hair = 1, Male = 0 : n = 2874
    Blond_Hair = 1, Male = 1 : n = 182
Test dataset:
    Blond_Hair = 0, Male = 0 : n = 9767
    Blond_Hair = 0, Male = 1 : n = 7535
    Blond_Hair = 1, Male = 0 : n = 2480
    Blond_Hair = 1, Male = 1 : n = 180
------------------------
> Loading spurious model
------------------------
Pretrained model loaded from ./model/celebA/config/pgd_table_six/pgd_table_six_model_b_epoch99_seed0.pt
======
# Calculate probability ...
======
======
# Load biased model ...
======
Epoch:   1 | Train Loss: 0.003 | Train Acc: 69.754 | Val Loss: 0.002 | Val Acc: 79.710
Training:
Accuracies by groups:
0, 0  acc: 56719 / 66231 =  85.638
0, 1  acc: 12478 / 16827 =  74.155
1, 0  acc: 32516 / 63000 =  51.613
1, 1  acc: 11826 / 16712 =  70.764
--------------------------------------
Average acc: 113539 / 162770 =  69.754
Robust  acc: 32516 / 63000 =  51.613
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6198 /  8535 =  72.619
0, 1  acc:  6891 /  8276 =  83.265
1, 0  acc:  2583 /  2874 =  89.875
1, 1  acc:   164 /   182 =  90.110
------------------------------------
Average acc: 15836 / 19867 =  79.710
Robust  acc:  6198 /  8535 =  72.619
------------------------------------
New max robust acc: 72.61862917398946
debias model - Saving best checkpoint at epoch 0
replace: True
-> Updating checkpoint debias-wga-best_seed0.pt...
Checkpoint saved at ./model/celebA/config/debias-wga-best_seed0.pt
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 81.775
Robust Acc: 77.987 | Best Acc: 90.484
-------------------------------------
Training, Epoch 0:
Accuracies by groups:
0, 0  acc:  7617 /  9767 =  77.987
0, 1  acc:  6301 /  7535 =  83.623
1, 0  acc:  2244 /  2480 =  90.484
1, 1  acc:   162 /   180 =  90.000
------------------------------------
Average acc: 16324 / 19962 =  81.775
Robust  acc:  7617 /  9767 =  77.987
------------------------------------
Accuracies by groups:
0, 0  acc:  7617 /  9767 =  77.987
0, 1  acc:  6301 /  7535 =  83.623
1, 0  acc:  2244 /  2480 =  90.484
1, 1  acc:   162 /   180 =  90.000
------------------------------------
Average acc: 16324 / 19962 =  81.775
Robust  acc:  7617 /  9767 =  77.987
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7617 /  9767 =  77.987
0, 1  acc:  6301 /  7535 =  83.623
1, 0  acc:  2244 /  2480 =  90.484
1, 1  acc:   162 /   180 =  90.000
------------------------------------
Average acc: 16324 / 19962 =  81.775
Robust  acc:  7617 /  9767 =  77.987
------------------------------------
Epoch:   2 | Train Loss: 0.002 | Train Acc: 79.329 | Val Loss: 0.005 | Val Acc: 55.227
Training:
Accuracies by groups:
0, 0  acc: 55820 / 66098 =  84.450
0, 1  acc: 12715 / 16562 =  76.772
1, 0  acc: 45546 / 63330 =  71.919
1, 1  acc: 15043 / 16780 =  89.648
--------------------------------------
Average acc: 129124 / 162770 =  79.329
Robust  acc: 45546 / 63330 =  71.919
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  3742 /  8535 =  43.843
0, 1  acc:  4365 /  8276 =  52.743
1, 0  acc:  2690 /  2874 =  93.598
1, 1  acc:   175 /   182 =  96.154
------------------------------------
Average acc: 10972 / 19867 =  55.227
Robust  acc:  3742 /  8535 =  43.843
------------------------------------
-------------------------------------------
Avg Test Loss: 0.004 | Avg Test Acc: 56.137
Robust Acc: 49.207 | Best Acc: 93.333
-------------------------------------
Training, Epoch 1:
Accuracies by groups:
0, 0  acc:  4806 /  9767 =  49.207
0, 1  acc:  3961 /  7535 =  52.568
1, 0  acc:  2271 /  2480 =  91.573
1, 1  acc:   168 /   180 =  93.333
------------------------------------
Average acc: 11206 / 19962 =  56.137
Robust  acc:  4806 /  9767 =  49.207
------------------------------------
Accuracies by groups:
0, 0  acc:  4806 /  9767 =  49.207
0, 1  acc:  3961 /  7535 =  52.568
1, 0  acc:  2271 /  2480 =  91.573
1, 1  acc:   168 /   180 =  93.333
------------------------------------
Average acc: 11206 / 19962 =  56.137
Robust  acc:  4806 /  9767 =  49.207
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  4806 /  9767 =  49.207
0, 1  acc:  3961 /  7535 =  52.568
1, 0  acc:  2271 /  2480 =  91.573
1, 1  acc:   168 /   180 =  93.333
------------------------------------
Average acc: 11206 / 19962 =  56.137
Robust  acc:  4806 /  9767 =  49.207
------------------------------------EEpoch:   3 | Train Loss: 0.002 | Train Acc: 83.367 | Val Loss: 0.001 | Val Acc: 87.925
Training:
Accuracies by groups:
0, 0  acc: 56744 / 65872 =  86.143
0, 1  acc: 13579 / 16859 =  80.545
1, 0  acc: 49875 / 63149 =  78.980
1, 1  acc: 15499 / 16890 =  91.764
--------------------------------------
Average acc: 135697 / 162770 =  83.367
Robust  acc: 49875 / 63149 =  78.980
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8488 /  8535 =  99.449
0, 1  acc:  8271 /  8276 =  99.940
1, 0  acc:   705 /  2874 =  24.530
1, 1  acc:     4 /   182 =   2.198
------------------------------------
Average acc: 17468 / 19867 =  87.925
Robust  acc:     4 /   182 =   2.198
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 88.914
Robust Acc: 2.222 | Best Acc: 99.841
------------------------------------
Training, Epoch 2:
Accuracies by groups:
0, 0  acc:  9723 /  9767 =  99.550
0, 1  acc:  7523 /  7535 =  99.841
1, 0  acc:   499 /  2480 =  20.121
1, 1  acc:     4 /   180 =   2.222
------------------------------------
Average acc: 17749 / 19962 =  88.914
Robust  acc:     4 /   180 =   2.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9723 /  9767 =  99.550
0, 1  acc:  7523 /  7535 =  99.841
1, 0  acc:   499 /  2480 =  20.121
1, 1  acc:     4 /   180 =   2.222
------------------------------------
Average acc: 17749 / 19962 =  88.914
Robust  acc:     4 /   180 =   2.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9723 /  9767 =  99.550
0, 1  acc:  7523 /  7535 =  99.841
1, 0  acc:   499 /  2480 =  20.121
1, 1  acc:     4 /   180 =   2.222
------------------------------------
Average acc: 17749 / 19962 =  88.914
Robust  acc:     4 /   180 =   2.222
------------------------------------
Epoch:   4 | Train Loss: 0.001 | Train Acc: 86.065 | Val Loss: 0.001 | Val Acc: 88.071
Training:
Accuracies by groups:
0, 0  acc: 58181 / 66270 =  87.794
0, 1  acc: 14279 / 16953 =  84.227
1, 0  acc: 51864 / 62676 =  82.749
1, 1  acc: 15764 / 16871 =  93.438
--------------------------------------
Average acc: 140088 / 162770 =  86.065
Robust  acc: 51864 / 62676 =  82.749
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8123 /  8535 =  95.173
0, 1  acc:  8144 /  8276 =  98.405
1, 0  acc:  1193 /  2874 =  41.510
1, 1  acc:    37 /   182 =  20.330
------------------------------------
Average acc: 17497 / 19867 =  88.071
Robust  acc:    37 /   182 =  20.330
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.194
Robust Acc: 16.667 | Best Acc: 98.275
-------------------------------------
Training, Epoch 3:
Accuracies by groups:
0, 0  acc:  9388 /  9767 =  96.120
0, 1  acc:  7405 /  7535 =  98.275
1, 0  acc:   982 /  2480 =  39.597
1, 1  acc:    30 /   180 =  16.667
------------------------------------
Average acc: 17805 / 19962 =  89.194
Robust  acc:    30 /   180 =  16.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9388 /  9767 =  96.120
0, 1  acc:  7405 /  7535 =  98.275
1, 0  acc:   982 /  2480 =  39.597
1, 1  acc:    30 /   180 =  16.667
------------------------------------
Average acc: 17805 / 19962 =  89.194
Robust  acc:    30 /   180 =  16.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9388 /  9767 =  96.120
0, 1  acc:  7405 /  7535 =  98.275
1, 0  acc:   982 /  2480 =  39.597
1, 1  acc:    30 /   180 =  16.667
------------------------------------
Average acc: 17805 / 19962 =  89.194
Robust  acc:    30 /   180 =  16.667
------------------------------------
Epoch:   5 | Train Loss: 0.001 | Train Acc: 88.183 | Val Loss: 0.002 | Val Acc: 77.717
Training:
Accuracies by groups:
0, 0  acc: 59109 / 66260 =  89.208
0, 1  acc: 14541 / 16924 =  85.919
1, 0  acc: 53871 / 62697 =  85.923
1, 1  acc: 16015 / 16889 =  94.825
--------------------------------------
Average acc: 143536 / 162770 =  88.183
Robust  acc: 14541 / 16924 =  85.919
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6231 /  8535 =  73.005
0, 1  acc:  6783 /  8276 =  81.960
1, 0  acc:  2280 /  2874 =  79.332
1, 1  acc:   146 /   182 =  80.220
------------------------------------
Average acc: 15440 / 19867 =  77.717
Robust  acc:  6231 /  8535 =  73.005
------------------------------------
New max robust acc: 73.00527240773287
debias model - Saving best checkpoint at epoch 4
replace: True
-> Updating checkpoint debias-wga-best_seed0.pt...
Checkpoint saved at ./model/celebA/config/debias-wga-best_seed0.pt
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 79.506
Robust Acc: 77.680 | Best Acc: 81.977
-------------------------------------
Training, Epoch 4:
Accuracies by groups:
0, 0  acc:  7587 /  9767 =  77.680
0, 1  acc:  6177 /  7535 =  81.977
1, 0  acc:  1963 /  2480 =  79.153
1, 1  acc:   144 /   180 =  80.000
------------------------------------
Average acc: 15871 / 19962 =  79.506
Robust  acc:  7587 /  9767 =  77.680
------------------------------------
Accuracies by groups:
0, 0  acc:  7587 /  9767 =  77.680
0, 1  acc:  6177 /  7535 =  81.977
1, 0  acc:  1963 /  2480 =  79.153
1, 1  acc:   144 /   180 =  80.000
------------------------------------
Average acc: 15871 / 19962 =  79.506
Robust  acc:  7587 /  9767 =  77.680
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7587 /  9767 =  77.680
0, 1  acc:  6177 /  7535 =  81.977
1, 0  acc:  1963 /  2480 =  79.153
1, 1  acc:   144 /   180 =  80.000
------------------------------------
Average acc: 15871 / 19962 =  79.506
Robust  acc:  7587 /  9767 =  77.680
------------------------------------
Epoch:   6 | Train Loss: 0.001 | Train Acc: 89.091 | Val Loss: 0.002 | Val Acc: 74.088
Training:
Accuracies by groups:
0, 0  acc: 59509 / 66287 =  89.775
0, 1  acc: 14703 / 16987 =  86.554
1, 0  acc: 54865 / 62767 =  87.411
1, 1  acc: 15937 / 16729 =  95.266
--------------------------------------
Average acc: 145014 / 162770 =  89.091
Robust  acc: 14703 / 16987 =  86.554
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5585 /  8535 =  65.436
0, 1  acc:  6490 /  8276 =  78.420
1, 0  acc:  2490 /  2874 =  86.639
1, 1  acc:   154 /   182 =  84.615
------------------------------------
Average acc: 14719 / 19867 =  74.088
Robust  acc:  5585 /  8535 =  65.436
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 75.599
Robust Acc: 70.370 | Best Acc: 85.766
-------------------------------------
Training, Epoch 5:
Accuracies by groups:
0, 0  acc:  6873 /  9767 =  70.370
0, 1  acc:  5938 /  7535 =  78.806
1, 0  acc:  2127 /  2480 =  85.766
1, 1  acc:   153 /   180 =  85.000
------------------------------------
Average acc: 15091 / 19962 =  75.599
Robust  acc:  6873 /  9767 =  70.370
------------------------------------
Accuracies by groups:
0, 0  acc:  6873 /  9767 =  70.370
0, 1  acc:  5938 /  7535 =  78.806
1, 0  acc:  2127 /  2480 =  85.766
1, 1  acc:   153 /   180 =  85.000
------------------------------------
Average acc: 15091 / 19962 =  75.599
Robust  acc:  6873 /  9767 =  70.370
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  6873 /  9767 =  70.370
0, 1  acc:  5938 /  7535 =  78.806
1, 0  acc:  2127 /  2480 =  85.766
1, 1  acc:   153 /   180 =  85.000
------------------------------------
Average acc: 15091 / 19962 =  75.599
Robust  acc:  6873 /  9767 =  70.370
------------------------------------
Epoch:   7 | Train Loss: 0.001 | Train Acc: 90.292 | Val Loss: 0.002 | Val Acc: 83.530
Training:
Accuracies by groups:
0, 0  acc: 60074 / 66220 =  90.719
0, 1  acc: 14951 / 16955 =  88.180
1, 0  acc: 55961 / 62957 =  88.888
1, 1  acc: 15982 / 16638 =  96.057
--------------------------------------
Average acc: 146968 / 162770 =  90.292
Robust  acc: 14951 / 16955 =  88.180
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6923 /  8535 =  81.113
0, 1  acc:  7424 /  8276 =  89.705
1, 0  acc:  2120 /  2874 =  73.765
1, 1  acc:   128 /   182 =  70.330
------------------------------------
Average acc: 16595 / 19867 =  83.530
Robust  acc:   128 /   182 =  70.330
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 84.245
Robust Acc: 63.889 | Best Acc: 89.476
-------------------------------------
Training, Epoch 6:
Accuracies by groups:
0, 0  acc:  8161 /  9767 =  83.557
0, 1  acc:  6742 /  7535 =  89.476
1, 0  acc:  1799 /  2480 =  72.540
1, 1  acc:   115 /   180 =  63.889
------------------------------------
Average acc: 16817 / 19962 =  84.245
Robust  acc:   115 /   180 =  63.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8161 /  9767 =  83.557
0, 1  acc:  6742 /  7535 =  89.476
1, 0  acc:  1799 /  2480 =  72.540
1, 1  acc:   115 /   180 =  63.889
------------------------------------
Average acc: 16817 / 19962 =  84.245
Robust  acc:   115 /   180 =  63.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8161 /  9767 =  83.557
0, 1  acc:  6742 /  7535 =  89.476
1, 0  acc:  1799 /  2480 =  72.540
1, 1  acc:   115 /   180 =  63.889
------------------------------------
Average acc: 16817 / 19962 =  84.245
Robust  acc:   115 /   180 =  63.889
------------------------------------
Epoch:   8 | Train Loss: 0.001 | Train Acc: 91.191 | Val Loss: 0.001 | Val Acc: 85.297
Training:
Accuracies by groups:
0, 0  acc: 59974 / 65778 =  91.176
0, 1  acc: 14995 / 16867 =  88.901
1, 0  acc: 57124 / 63207 =  90.376
1, 1  acc: 16339 / 16918 =  96.578
--------------------------------------
Average acc: 148432 / 162770 =  91.191
Robust  acc: 14995 / 16867 =  88.901
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7047 /  8535 =  82.566
0, 1  acc:  7548 /  8276 =  91.203
1, 0  acc:  2222 /  2874 =  77.314
1, 1  acc:   129 /   182 =  70.879
------------------------------------
Average acc: 16946 / 19867 =  85.297
Robust  acc:   129 /   182 =  70.879
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.384
Robust Acc: 67.222 | Best Acc: 91.055
-------------------------------------
Training, Epoch 7:
Accuracies by groups:
0, 0  acc:  8375 /  9767 =  85.748
0, 1  acc:  6861 /  7535 =  91.055
1, 0  acc:  1887 /  2480 =  76.089
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 17244 / 19962 =  86.384
Robust  acc:   121 /   180 =  67.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8375 /  9767 =  85.748
0, 1  acc:  6861 /  7535 =  91.055
1, 0  acc:  1887 /  2480 =  76.089
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 17244 / 19962 =  86.384
Robust  acc:   121 /   180 =  67.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8375 /  9767 =  85.748
0, 1  acc:  6861 /  7535 =  91.055
1, 0  acc:  1887 /  2480 =  76.089
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 17244 / 19962 =  86.384
Robust  acc:   121 /   180 =  67.222
------------------------------------
Epoch:   9 | Train Loss: 0.001 | Train Acc: 91.860 | Val Loss: 0.002 | Val Acc: 82.821
Training:
Accuracies by groups:
0, 0  acc: 60447 / 65784 =  91.887
0, 1  acc: 15098 / 16878 =  89.454
1, 0  acc: 57825 / 63390 =  91.221
1, 1  acc: 16150 / 16718 =  96.602
--------------------------------------
Average acc: 149520 / 162770 =  91.860
Robust  acc: 15098 / 16878 =  89.454
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6867 /  8535 =  80.457
0, 1  acc:  7466 /  8276 =  90.213
1, 0  acc:  2012 /  2874 =  70.007
1, 1  acc:   109 /   182 =  59.890
------------------------------------
Average acc: 16454 / 19867 =  82.821
Robust  acc:   109 /   182 =  59.890
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 83.158
Robust Acc: 58.333 | Best Acc: 89.701
-------------------------------------
Training, Epoch 8:
Accuracies by groups:
0, 0  acc:  8060 /  9767 =  82.523
0, 1  acc:  6759 /  7535 =  89.701
1, 0  acc:  1676 /  2480 =  67.581
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 16600 / 19962 =  83.158
Robust  acc:   105 /   180 =  58.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8060 /  9767 =  82.523
0, 1  acc:  6759 /  7535 =  89.701
1, 0  acc:  1676 /  2480 =  67.581
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 16600 / 19962 =  83.158
Robust  acc:   105 /   180 =  58.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8060 /  9767 =  82.523
0, 1  acc:  6759 /  7535 =  89.701
1, 0  acc:  1676 /  2480 =  67.581
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 16600 / 19962 =  83.158
Robust  acc:   105 /   180 =  58.333
------------------------------------
Epoch:  10 | Train Loss: 0.001 | Train Acc: 92.422 | Val Loss: 0.002 | Val Acc: 82.896
Training:
Accuracies by groups:
0, 0  acc: 60840 / 65936 =  92.271
0, 1  acc: 15459 / 17143 =  90.177
1, 0  acc: 57838 / 62899 =  91.954
1, 1  acc: 16299 / 16792 =  97.064
--------------------------------------
Average acc: 150436 / 162770 =  92.422
Robust  acc: 15459 / 17143 =  90.177
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6807 /  8535 =  79.754
0, 1  acc:  7396 /  8276 =  89.367
1, 0  acc:  2137 /  2874 =  74.356
1, 1  acc:   129 /   182 =  70.879
------------------------------------
Average acc: 16469 / 19867 =  82.896
Robust  acc:   129 /   182 =  70.879
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 83.459
Robust Acc: 67.222 | Best Acc: 89.078
-------------------------------------
Training, Epoch 9:
Accuracies by groups:
0, 0  acc:  8085 /  9767 =  82.779
0, 1  acc:  6712 /  7535 =  89.078
1, 0  acc:  1742 /  2480 =  70.242
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 16660 / 19962 =  83.459
Robust  acc:   121 /   180 =  67.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8085 /  9767 =  82.779
0, 1  acc:  6712 /  7535 =  89.078
1, 0  acc:  1742 /  2480 =  70.242
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 16660 / 19962 =  83.459
Robust  acc:   121 /   180 =  67.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8085 /  9767 =  82.779
0, 1  acc:  6712 /  7535 =  89.078
1, 0  acc:  1742 /  2480 =  70.242
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 16660 / 19962 =  83.459
Robust  acc:   121 /   180 =  67.222
------------------------------------
Epoch:  11 | Train Loss: 0.001 | Train Acc: 92.841 | Val Loss: 0.003 | Val Acc: 71.581
Training:
Accuracies by groups:
0, 0  acc: 61319 / 66048 =  92.840
0, 1  acc: 15609 / 17166 =  90.930
1, 0  acc: 57915 / 62762 =  92.277
1, 1  acc: 16274 / 16794 =  96.904
--------------------------------------
Average acc: 151117 / 162770 =  92.841
Robust  acc: 15609 / 17166 =  90.930
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5169 /  8535 =  60.562
0, 1  acc:  6142 /  8276 =  74.215
1, 0  acc:  2745 /  2874 =  95.511
1, 1  acc:   165 /   182 =  90.659
------------------------------------
Average acc: 14221 / 19867 =  71.581
Robust  acc:  5169 /  8535 =  60.562
------------------------------------
-------------------------------------------
Avg Test Loss: 0.003 | Avg Test Acc: 73.109
Robust Acc: 66.008 | Best Acc: 95.363
-------------------------------------
Training, Epoch 10:
Accuracies by groups:
0, 0  acc:  6447 /  9767 =  66.008
0, 1  acc:  5619 /  7535 =  74.572
1, 0  acc:  2365 /  2480 =  95.363
1, 1  acc:   163 /   180 =  90.556
------------------------------------
Average acc: 14594 / 19962 =  73.109
Robust  acc:  6447 /  9767 =  66.008
------------------------------------
Accuracies by groups:
0, 0  acc:  6447 /  9767 =  66.008
0, 1  acc:  5619 /  7535 =  74.572
1, 0  acc:  2365 /  2480 =  95.363
1, 1  acc:   163 /   180 =  90.556
------------------------------------
Average acc: 14594 / 19962 =  73.109
Robust  acc:  6447 /  9767 =  66.008
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  6447 /  9767 =  66.008
0, 1  acc:  5619 /  7535 =  74.572
1, 0  acc:  2365 /  2480 =  95.363
1, 1  acc:   163 /   180 =  90.556
------------------------------------
Average acc: 14594 / 19962 =  73.109
Robust  acc:  6447 /  9767 =  66.008
------------------------------------
Epoch:  12 | Train Loss: 0.001 | Train Acc: 93.422 | Val Loss: 0.005 | Val Acc: 60.422
Training:
Accuracies by groups:
0, 0  acc: 61831 / 66259 =  93.317
0, 1  acc: 15526 / 16971 =  91.485
1, 0  acc: 58554 / 62897 =  93.095
1, 1  acc: 16152 / 16643 =  97.050
--------------------------------------
Average acc: 152063 / 162770 =  93.422
Robust  acc: 15526 / 16971 =  91.485
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  4245 /  8535 =  49.736
0, 1  acc:  4818 /  8276 =  58.217
1, 0  acc:  2766 /  2874 =  96.242
1, 1  acc:   175 /   182 =  96.154
------------------------------------
Average acc: 12004 / 19867 =  60.422
Robust  acc:  4245 /  8535 =  49.736
------------------------------------
-------------------------------------------
Avg Test Loss: 0.005 | Avg Test Acc: 61.271
Robust Acc: 54.193 | Best Acc: 95.121
-------------------------------------
Training, Epoch 11:
Accuracies by groups:
0, 0  acc:  5293 /  9767 =  54.193
0, 1  acc:  4415 /  7535 =  58.593
1, 0  acc:  2359 /  2480 =  95.121
1, 1  acc:   164 /   180 =  91.111
------------------------------------
Average acc: 12231 / 19962 =  61.271
Robust  acc:  5293 /  9767 =  54.193
------------------------------------
Accuracies by groups:
0, 0  acc:  5293 /  9767 =  54.193
0, 1  acc:  4415 /  7535 =  58.593
1, 0  acc:  2359 /  2480 =  95.121
1, 1  acc:   164 /   180 =  91.111
------------------------------------
Average acc: 12231 / 19962 =  61.271
Robust  acc:  5293 /  9767 =  54.193
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  5293 /  9767 =  54.193
0, 1  acc:  4415 /  7535 =  58.593
1, 0  acc:  2359 /  2480 =  95.121
1, 1  acc:   164 /   180 =  91.111
------------------------------------
Average acc: 12231 / 19962 =  61.271
Robust  acc:  5293 /  9767 =  54.193
------------------------------------
Epoch:  13 | Train Loss: 0.001 | Train Acc: 93.638 | Val Loss: 0.002 | Val Acc: 81.270
Training:
Accuracies by groups:
0, 0  acc: 61796 / 66065 =  93.538
0, 1  acc: 15698 / 17112 =  91.737
1, 0  acc: 58535 / 62778 =  93.241
1, 1  acc: 16385 / 16815 =  97.443
--------------------------------------
Average acc: 152414 / 162770 =  93.638
Robust  acc: 15698 / 17112 =  91.737
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6443 /  8535 =  75.489
0, 1  acc:  7000 /  8276 =  84.582
1, 0  acc:  2556 /  2874 =  88.935
1, 1  acc:   147 /   182 =  80.769
------------------------------------
Average acc: 16146 / 19867 =  81.270
Robust  acc:  6443 /  8535 =  75.489
------------------------------------
New max robust acc: 75.48916227299355
debias model - Saving best checkpoint at epoch 12
replace: True
-> Updating checkpoint debias-wga-best_seed0.pt...
Checkpoint saved at ./model/celebA/config/debias-wga-best_seed0.pt
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 82.887
Robust Acc: 79.902 | Best Acc: 87.702
-------------------------------------
Training, Epoch 12:
Accuracies by groups:
0, 0  acc:  7804 /  9767 =  79.902
0, 1  acc:  6420 /  7535 =  85.202
1, 0  acc:  2175 /  2480 =  87.702
1, 1  acc:   147 /   180 =  81.667
------------------------------------
Average acc: 16546 / 19962 =  82.887
Robust  acc:  7804 /  9767 =  79.902
------------------------------------
Accuracies by groups:
0, 0  acc:  7804 /  9767 =  79.902
0, 1  acc:  6420 /  7535 =  85.202
1, 0  acc:  2175 /  2480 =  87.702
1, 1  acc:   147 /   180 =  81.667
------------------------------------
Average acc: 16546 / 19962 =  82.887
Robust  acc:  7804 /  9767 =  79.902
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7804 /  9767 =  79.902
0, 1  acc:  6420 /  7535 =  85.202Epoch:  14 | Train Loss: 0.001 | Train Acc: 94.041 | Val Loss: 0.001 | Val Acc: 88.413
Training:
Accuracies by groups:
0, 0  acc: 68900 / 72309 =  95.286
0, 1  acc: 16906 / 18212 =  92.829
1, 0  acc: 51855 / 56309 =  92Epoch:  14 | Train Loss: 0.001 | Train Acc: 93.904 | Val Loss: 0.002 | Val Acc: 83.364
Training:
Accuracies by groups:
0, 0  acc: 62072 / 66257 =  93.684
0, 1  acc: 15378 / 16707 =  92.045
1, 0  acc: 59060 / 63022 =  93.713
1, 1  acc: 16337 / 16784 =  97.337
--------------------------------------
Average acc: 152847 / 162770 =  93.904
Robust  acc: 15378 / 16707 =  92.045
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6711 /  8535 =  78.629
0, 1  acc:  7287 /  8276 =  88.050
1, 0  acc:  2431 /  2874 =  84.586
1, 1  acc:   133 /   182 =  73.077
------------------------------------
Average acc: 16562 / 19867 =  83.364
Robust  acc:   133 /   182 =  73.077
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 84.325
Robust Acc: 71.667 | Best Acc: 87.790
-------------------------------------
Training, Epoch 13:
Accuracies by groups:
0, 0  acc:  8043 /  9767 =  82.349
0, 1  acc:  6615 /  7535 =  87.790
1, 0  acc:  2046 /  2480 =  82.500
1, 1  acc:   129 /   180 =  71.667
------------------------------------
Average acc: 16833 / 19962 =  84.325
Robust  acc:   129 /   180 =  71.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8043 /  9767 =  82.349
0, 1  acc:  6615 /  7535 =  87.790
1, 0  acc:  2046 /  2480 =  82.500
1, 1  acc:   129 /   180 =  71.667
------------------------------------
Average acc: 16833 / 19962 =  84.325
Robust  acc:   129 /   180 =  71.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8043 /  9767 =  82.349
0, 1  acc:  6615 /  7535 =  87.790Epoch:  15 | Train Loss: 0.001 | Train Acc: 94.301 | Val Loss: 0.001 | Val Acc: 88.619
Training:
Accuracies by groups:
0, 0  acc: 69314 / 72695 =  95.349
0, 1  acc: 17016 / 18198 =  93.505
1, 0  acc: 51834 / 56109 =  92Epoch:  15 | Train Loss: 0.001 | Train Acc: 94.140 | Val Loss: 0.001 | Val Acc: 85.287
Training:
Accuracies by groups:
0, 0  acc: 62140 / 66172 =  93.907
0, 1  acc: 15604 / 16888 =  92.397
1, 0  acc: 58979 / 62801 =  93.914
1, 1  acc: 16508 / 16909 =  97.628
--------------------------------------
Average acc: 153231 / 162770 =  94.140
Robust  acc: 15604 / 16888 =  92.397
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7156 /  8535 =  83.843
0, 1  acc:  7693 /  8276 =  92.956
1, 0  acc:  2004 /  2874 =  69.729
1, 1  acc:    91 /   182 =  50.000
------------------------------------
Average acc: 16944 / 19867 =  85.287
Robust  acc:    91 /   182 =  50.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 85.833
Robust Acc: 45.556 | Best Acc: 93.099
-------------------------------------
Training, Epoch 14:
Accuracies by groups:
0, 0  acc:  8387 /  9767 =  85.871
0, 1  acc:  7015 /  7535 =  93.099
1, 0  acc:  1650 /  2480 =  66.532
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 17134 / 19962 =  85.833
Robust  acc:    82 /   180 =  45.556
------------------------------------
Accuracies by groups:
0, 0  acc:  8387 /  9767 =  85.871
0, 1  acc:  7015 /  7535 =  93.099
1, 0  acc:  1650 /  2480 =  66.532
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 17134 / 19962 =  85.833
Robust  acc:    82 /   180 =  45.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8387 /  9767 =  85.871
0, 1  acc:  7015 /  7535 =  93.099Epoch:  16 | Train Loss: 0.001 | Train Acc: 94.614 | Val Loss: 0.001 | Val Acc: 91.408
Training:
Accuracies by groups:
0, 0  acc: 69325 / 72533 =  95.577
0, 1  acc: 17089 / 18249 =  93.643
1, 0  acc: 52247 / 56198 =  92Epoch:  16 | Train Loss: 0.001 | Train Acc: 94.504 | Val Loss: 0.001 | Val Acc: 88.911
Training:
Accuracies by groups:
0, 0  acc: 62615 / 66330 =  94.399
0, 1  acc: 15758 / 17034 =  92.509
1, 0  acc: 59051 / 62634 =  94.279
1, 1  acc: 16400 / 16772 =  97.782
--------------------------------------
Average acc: 153824 / 162770 =  94.504
Robust  acc: 15758 / 17034 =  92.509
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7468 /  8535 =  87.499
0, 1  acc:  7889 /  8276 =  95.324
1, 0  acc:  2214 /  2874 =  77.035
1, 1  acc:    93 /   182 =  51.099
------------------------------------
Average acc: 17664 / 19867 =  88.911
Robust  acc:    93 /   182 =  51.099
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.936
Robust Acc: 46.111 | Best Acc: 95.514
-------------------------------------
Training, Epoch 15:
Accuracies by groups:
0, 0  acc:  8773 /  9767 =  89.823
0, 1  acc:  7197 /  7535 =  95.514
1, 0  acc:  1900 /  2480 =  76.613
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17953 / 19962 =  89.936
Robust  acc:    83 /   180 =  46.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8773 /  9767 =  89.823
0, 1  acc:  7197 /  7535 =  95.514
1, 0  acc:  1900 /  2480 =  76.613
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17953 / 19962 =  89.936
Robust  acc:    83 /   180 =  46.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8773 /  9767 =  89.823
0, 1  acc:  7197 /  7535 =  95.514Epoch:  17 | Train Loss: 0.001 | Train Acc: 94.957 | Val Loss: 0.003 | Val Acc: 75.930
Training:
Accuracies by groups:
0, 0  acc: 69950 / 72921 =  95.926
0, 1  acc: 17246 / 18365 =  93.907
1, 0  acc: 52120 / 55797 =  93Epoch:  17 | Train Loss: 0.001 | Train Acc: 94.699 | Val Loss: 0.001 | Val Acc: 87.155
Training:
Accuracies by groups:
0, 0  acc: 62949 / 66638 =  94.464
0, 1  acc: 15669 / 16798 =  93.279
1, 0  acc: 59513 / 62955 =  94.533
1, 1  acc: 16010 / 16379 =  97.747
--------------------------------------
Average acc: 154141 / 162770 =  94.699
Robust  acc: 15669 / 16798 =  93.279
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7192 /  8535 =  84.265
0, 1  acc:  7659 /  8276 =  92.545
1, 0  acc:  2353 /  2874 =  81.872
1, 1  acc:   111 /   182 =  60.989
------------------------------------
Average acc: 17315 / 19867 =  87.155
Robust  acc:   111 /   182 =  60.989
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 87.957
Robust Acc: 64.444 | Best Acc: 92.687
-------------------------------------
Training, Epoch 16:
Accuracies by groups:
0, 0  acc:  8493 /  9767 =  86.956
0, 1  acc:  6984 /  7535 =  92.687
1, 0  acc:  1965 /  2480 =  79.234
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 17558 / 19962 =  87.957
Robust  acc:   116 /   180 =  64.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8493 /  9767 =  86.956
0, 1  acc:  6984 /  7535 =  92.687
1, 0  acc:  1965 /  2480 =  79.234
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 17558 / 19962 =  87.957
Robust  acc:   116 /   180 =  64.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8493 /  9767 =  86.956
0, 1  acc:  6984 /  7535 =  92.687
1, 0  acc:  1965 /  2480 =  79.234
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 17558 / 19962 =  87.957
Robust  acc:   116 /   180 =  64.444
------------------------------------
Epoch:  18 | Train Loss: 0.001 | Train Acc: 95.002 | Val Loss: 0.001 | Val Acc: 87.925
Training:
Accuracies by groups:
0, 0  acc: 62627 / 66079 =  94.776
0, 1  acc: 15860 / 16983 =  93.388
1, 0  acc: 59805 / 63008 =  94.917
1, 1  acc: 16342 / 16700 =  97.856
--------------------------------------
Average acc: 154634 / 162770 =  95.002
Robust  acc: 15860 / 16983 =  93.388
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7276 /  8535 =  85.249
0, 1  acc:  7745 /  8276 =  93.584
1, 0  acc:  2340 /  2874 =  81.420
1, 1  acc:   107 /   182 =  58.791
------------------------------------
Average acc: 17468 / 19867 =  87.925
Robust  acc:   107 /   182 =  58.791
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 88.789
Robust Acc: 53.889 | Best Acc: 93.603
-------------------------------------
Training, Epoch 17:
Accuracies by groups:
0, 0  acc:  8602 /  9767 =  88.072
0, 1  acc:  7053 /  7535 =  93.603
1, 0  acc:  1972 /  2480 =  79.516
1, 1  acc:    97 /   180 =  53.889
------------------------------------
Average acc: 17724 / 19962 =  88.789
Robust  acc:    97 /   180 =  53.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8602 /  9767 =  88.072
0, 1  acc:  7053 /  7535 =  93.603
1, 0  acc:  1972 /  2480 =  79.516
1, 1  acc:    97 /   180 =  53.889
------------------------------------
Average acc: 17724 / 19962 =  88.789
Robust  acc:    97 /   180 =  53.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8602 /  9767 =  88.072
0, 1  acc:  7053 /  7535 =  93.603
1, 0  acc:  1972 /  2480 =  79.516
1, 1  acc:    97 /   180 =  53.889
------------------------------------
Average acc: 17724 / 19962 =  88.789
Robust  acc:    97 /   180 =  53.889
------------------------------------
Epoch:  19 | Train Loss: 0.001 | Train Acc: 95.121 | Val Loss: 0.001 | Val Acc: 87.839
Training:
Accuracies by groups:
0, 0  acc: 62834 / 66097 =  95.063
0, 1  acc: 15750 / 16855 =  93.444
1, 0  acc: 59965 / 63193 =  94.892
1, 1  acc: 16279 / 16625 =  97.919
--------------------------------------
Average acc: 154828 / 162770 =  95.121
Robust  acc: 15750 / 16855 =  93.444
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7390 /  8535 =  86.585
0, 1  acc:  7792 /  8276 =  94.152
1, 0  acc:  2171 /  2874 =  75.539
1, 1  acc:    98 /   182 =  53.846
------------------------------------
Average acc: 17451 / 19867 =  87.839
Robust  acc:    98 /   182 =  53.846
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 88.102
Robust Acc: 54.444 | Best Acc: 93.670
-------------------------------------
Training, Epoch 18:
Accuracies by groups:
0, 0  acc:  8620 /  9767 =  88.256
0, 1  acc:  7058 /  7535 =  93.670
1, 0  acc:  1811 /  2480 =  73.024
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 17587 / 19962 =  88.102
Robust  acc:    98 /   180 =  54.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8620 /  9767 =  88.256
0, 1  acc:  7058 /  7535 =  93.670
1, 0  acc:  1811 /  2480 =  73.024
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 17587 / 19962 =  88.102
Robust  acc:    98 /   180 =  54.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8620 /  9767 =  88.256
0, 1  acc:  7058 /  7535 =  93.670
1, 0  acc:  1811 /  2480 =  73.024
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 17587 / 19962 =  88.102
Robust  acc:    98 /   180 =  54.444
------------------------------------
Epoch:  20 | Train Loss: 0.001 | Train Acc: 95.304 | Val Loss: 0.001 | Val Acc: 89.269
Training:
Accuracies by groups:
0, 0  acc: 63184 / 66386 =  95.177
0, 1  acc: 15643 / 16707 =  93.631
1, 0  acc: 59838 / 62886 =  95.153
1, 1  acc: 16461 / 16791 =  98.035
--------------------------------------
Average acc: 155126 / 162770 =  95.304
Robust  acc: 15643 / 16707 =  93.631
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7610 /  8535 =  89.162
0, 1  acc:  7933 /  8276 =  95.855
1, 0  acc:  2111 /  2874 =  73.452
1, 1  acc:    81 /   182 =  44.505
------------------------------------
Average acc: 17735 / 19867 =  89.269
Robust  acc:    81 /   182 =  44.505
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.981
Robust Acc: 46.111 | Best Acc: 95.833
-------------------------------------
Training, Epoch 19:
Accuracies by groups:
0, 0  acc:  8895 /  9767 =  91.072
0, 1  acc:  7221 /  7535 =  95.833
1, 0  acc:  1763 /  2480 =  71.089
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17962 / 19962 =  89.981
Robust  acc:    83 /   180 =  46.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8895 /  9767 =  91.072
0, 1  acc:  7221 /  7535 =  95.833
1, 0  acc:  1763 /  2480 =  71.089
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17962 / 19962 =  89.981
Robust  acc:    83 /   180 =  46.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8895 /  9767 =  91.072
0, 1  acc:  7221 /  7535 =  95.833
1, 0  acc:  1763 /  2480 =  71.089
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17962 / 19962 =  89.981
Robust  acc:    83 /   180 =  46.111
------------------------------------
Epoch:  21 | Train Loss: 0.001 | Train Acc: 95.647 | Val Loss: 0.001 | Val Acc: 90.260
Training:
Accuracies by groups:
0, 0  acc: 63116 / 66172 =  95.382
0, 1  acc: 15826 / 16827 =  94.051
1, 0  acc: 60370 / 63121 =  95.642
1, 1  acc: 16373 / 16650 =  98.336
--------------------------------------
Average acc: 155685 / 162770 =  95.647
Robust  acc: 15826 / 16827 =  94.051
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7722 /  8535 =  90.475
0, 1  acc:  8007 /  8276 =  96.750
1, 0  acc:  2115 /  2874 =  73.591
1, 1  acc:    88 /   182 =  48.352
------------------------------------
Average acc: 17932 / 19867 =  90.260
Robust  acc:    88 /   182 =  48.352
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.863
Robust Acc: 44.444 | Best Acc: 96.762
-------------------------------------
Training, Epoch 20:
Accuracies by groups:
0, 0  acc:  8991 /  9767 =  92.055
0, 1  acc:  7291 /  7535 =  96.762
1, 0  acc:  1776 /  2480 =  71.613
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18138 / 19962 =  90.863
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8991 /  9767 =  92.055
0, 1  acc:  7291 /  7535 =  96.762
1, 0  acc:  1776 /  2480 =  71.613
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18138 / 19962 =  90.863
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8991 /  9767 =  92.055
0, 1  acc:  7291 /  7535 =  96.762
1, 0  acc:  1776 /  2480 =  71.613
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18138 / 19962 =  90.863
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  22 | Train Loss: 0.001 | Train Acc: 95.715 | Val Loss: 0.001 | Val Acc: 88.589
Training:
Accuracies by groups:
0, 0  acc: 63103 / 66020 =  95.582
0, 1  acc: 16266 / 17259 =  94.246
1, 0  acc: 59972 / 62755 =  95.565
1, 1  acc: 16455 / 16736 =  98.321
--------------------------------------
Average acc: 155796 / 162770 =  95.715
Robust  acc: 16266 / 17259 =  94.246
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7510 /  8535 =  87.991
0, 1  acc:  7826 /  8276 =  94.563
1, 0  acc:  2169 /  2874 =  75.470
1, 1  acc:    95 /   182 =  52.198
------------------------------------
Average acc: 17600 / 19867 =  88.589
Robust  acc:    95 /   182 =  52.198
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.560
Robust Acc: 46.111 | Best Acc: 94.585
-------------------------------------
Training, Epoch 21:
Accuracies by groups:
0, 0  acc:  8835 /  9767 =  90.458
0, 1  acc:  7127 /  7535 =  94.585
1, 0  acc:  1833 /  2480 =  73.911
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17878 / 19962 =  89.560
Robust  acc:    83 /   180 =  46.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8835 /  9767 =  90.458
0, 1  acc:  7127 /  7535 =  94.585
1, 0  acc:  1833 /  2480 =  73.911
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17878 / 19962 =  89.560
Robust  acc:    83 /   180 =  46.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8835 /  9767 =  90.458
0, 1  acc:  7127 /  7535 =  94.585
1, 0  acc:  1833 /  2480 =  73.911
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 17878 / 19962 =  89.560
Robust  acc:    83 /   180 =  46.111
------------------------------------
Epoch:  23 | Train Loss: 0.001 | Train Acc: 95.844 | Val Loss: 0.001 | Val Acc: 88.700
Training:
Accuracies by groups:
0, 0  acc: 63256 / 66124 =  95.663
0, 1  acc: 16082 / 17018 =  94.500
1, 0  acc: 60331 / 62994 =  95.773
1, 1  acc: 16337 / 16634 =  98.215
--------------------------------------
Average acc: 156006 / 162770 =  95.844
Robust  acc: 16082 / 17018 =  94.500
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7517 /  8535 =  88.073
0, 1  acc:  7882 /  8276 =  95.239
1, 0  acc:  2128 /  2874 =  74.043
1, 1  acc:    95 /   182 =  52.198
------------------------------------
Average acc: 17622 / 19867 =  88.700
Robust  acc:    95 /   182 =  52.198
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.435
Robust Acc: 51.667 | Best Acc: 95.116
-------------------------------------
Training, Epoch 22:
Accuracies by groups:
0, 0  acc:  8823 /  9767 =  90.335
0, 1  acc:  7167 /  7535 =  95.116
1, 0  acc:  1770 /  2480 =  71.371
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 17853 / 19962 =  89.435
Robust  acc:    93 /   180 =  51.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8823 /  9767 =  90.335
0, 1  acc:  7167 /  7535 =  95.116
1, 0  acc:  1770 /  2480 =  71.371
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 17853 / 19962 =  89.435
Robust  acc:    93 /   180 =  51.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8823 /  9767 =  90.335
0, 1  acc:  7167 /  7535 =  95.116
1, 0  acc:  1770 /  2480 =  71.371
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 17853 / 19962 =  89.435
Robust  acc:    93 /   180 =  51.667
------------------------------------
Epoch:  24 | Train Loss: 0.000 | Train Acc: 95.903 | Val Loss: 0.001 | Val Acc: 91.453
Training:
Accuracies by groups:
0, 0  acc: 63344 / 66133 =  95.783
0, 1  acc: 15962 / 16965 =  94.088
1, 0  acc: 60477 / 63084 =  95.867
1, 1  acc: 16319 / 16588 =  98.378
--------------------------------------
Average acc: 156102 / 162770 =  95.903
Robust  acc: 15962 / 16965 =  94.088
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8146 /  8535 =  95.442
0, 1  acc:  8193 /  8276 =  98.997
1, 0  acc:  1780 /  2874 =  61.935
1, 1  acc:    50 /   182 =  27.473
------------------------------------
Average acc: 18169 / 19867 =  91.453
Robust  acc:    50 /   182 =  27.473
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.165
Robust Acc: 28.889 | Best Acc: 99.031
-------------------------------------
Training, Epoch 23:
Accuracies by groups:
0, 0  acc:  9417 /  9767 =  96.417
0, 1  acc:  7462 /  7535 =  99.031
1, 0  acc:  1467 /  2480 =  59.153
1, 1  acc:    52 /   180 =  28.889
------------------------------------
Average acc: 18398 / 19962 =  92.165
Robust  acc:    52 /   180 =  28.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9417 /  9767 =  96.417
0, 1  acc:  7462 /  7535 =  99.031
1, 0  acc:  1467 /  2480 =  59.153
1, 1  acc:    52 /   180 =  28.889
------------------------------------
Average acc: 18398 / 19962 =  92.165
Robust  acc:    52 /   180 =  28.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9417 /  9767 =  96.417
0, 1  acc:  7462 /  7535 =  99.031
1, 0  acc:  1467 /  2480 =  59.153
1, 1  acc:    52 /   180 =  28.889
------------------------------------
Average acc: 18398 / 19962 =  92.165
Robust  acc:    52 /   180 =  28.889
------------------------------------
Epoch:  25 | Train Loss: 0.000 | Train Acc: 96.260 | Val Loss: 0.002 | Val Acc: 85.403
Training:
Accuracies by groups:
0, 0  acc: 63808 / 66425 =  96.060
0, 1  acc: 15937 / 16811 =  94.801
1, 0  acc: 60328 / 62658 =  96.281
1, 1  acc: 16609 / 16876 =  98.418
--------------------------------------
Average acc: 156682 / 162770 =  96.260
Robust  acc: 15937 / 16811 =  94.801
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6892 /  8535 =  80.750
0, 1  acc:  7364 /  8276 =  88.980
1, 0  acc:  2576 /  2874 =  89.631
1, 1  acc:   135 /   182 =  74.176
------------------------------------
Average acc: 16967 / 19867 =  85.403
Robust  acc:   135 /   182 =  74.176
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 86.519
Robust Acc: 70.556 | Best Acc: 89.025
-------------------------------------
Training, Epoch 24:
Accuracies by groups:
0, 0  acc:  8263 /  9767 =  84.601
0, 1  acc:  6708 /  7535 =  89.025
1, 0  acc:  2173 /  2480 =  87.621
1, 1  acc:   127 /   180 =  70.556
------------------------------------
Average acc: 17271 / 19962 =  86.519
Robust  acc:   127 /   180 =  70.556
------------------------------------
Accuracies by groups:
0, 0  acc:  8263 /  9767 =  84.601
0, 1  acc:  6708 /  7535 =  89.025
1, 0  acc:  2173 /  2480 =  87.621
1, 1  acc:   127 /   180 =  70.556
------------------------------------
Average acc: 17271 / 19962 =  86.519
Robust  acc:   127 /   180 =  70.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8263 /  9767 =  84.601
0, 1  acc:  6708 /  7535 =  89.025
1, 0  acc:  2173 /  2480 =  87.621
1, 1  acc:   127 /   180 =  70.556
------------------------------------
Average acc: 17271 / 19962 =  86.519
Robust  acc:   127 /   180 =  70.556
------------------------------------
Epoch:  26 | Train Loss: 0.000 | Train Acc: 96.224 | Val Loss: 0.001 | Val Acc: 88.806
Training:
Accuracies by groups:
0, 0  acc: 63823 / 66436 =  96.067
0, 1  acc: 15963 / 16850 =  94.736
1, 0  acc: 60357 / 62752 =  96.183
1, 1  acc: 16480 / 16732 =  98.494
--------------------------------------
Average acc: 156623 / 162770 =  96.224
Robust  acc: 15963 / 16850 =  94.736
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7448 /  8535 =  87.264
0, 1  acc:  7821 /  8276 =  94.502
1, 0  acc:  2272 /  2874 =  79.054
1, 1  acc:   102 /   182 =  56.044
------------------------------------
Average acc: 17643 / 19867 =  88.806
Robust  acc:   102 /   182 =  56.044
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.645
Robust Acc: 51.667 | Best Acc: 94.399
-------------------------------------
Training, Epoch 25:
Accuracies by groups:
0, 0  acc:  8762 /  9767 =  89.710
0, 1  acc:  7113 /  7535 =  94.399
1, 0  acc:  1927 /  2480 =  77.702
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 17895 / 19962 =  89.645
Robust  acc:    93 /   180 =  51.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8762 /  9767 =  89.710
0, 1  acc:  7113 /  7535 =  94.399
1, 0  acc:  1927 /  2480 =  77.702
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 17895 / 19962 =  89.645
Robust  acc:    93 /   180 =  51.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8762 /  9767 =  89.710
0, 1  acc:  7113 /  7535 =  94.399
1, 0  acc:  1927 /  2480 =  77.702
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 17895 / 19962 =  89.645
Robust  acc:    93 /   180 =  51.667
------------------------------------
Epoch:  27 | Train Loss: 0.000 | Train Acc: 96.407 | Val Loss: 0.001 | Val Acc: 89.042
Training:
Accuracies by groups:
0, 0  acc: 63643 / 66160 =  96.196
0, 1  acc: 15887 / 16705 =  95.103
1, 0  acc: 60992 / 63262 =  96.412
1, 1  acc: 16399 / 16643 =  98.534
--------------------------------------
Average acc: 156921 / 162770 =  96.407
Robust  acc: 15887 / 16705 =  95.103
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7398 /  8535 =  86.678
0, 1  acc:  7772 /  8276 =  93.910
1, 0  acc:  2406 /  2874 =  83.716
1, 1  acc:   114 /   182 =  62.637
------------------------------------
Average acc: 17690 / 19867 =  89.042
Robust  acc:   114 /   182 =  62.637
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.761
Robust Acc: 58.333 | Best Acc: 94.054
-------------------------------------
Training, Epoch 26:
Accuracies by groups:
0, 0  acc:  8704 /  9767 =  89.116
0, 1  acc:  7087 /  7535 =  94.054
1, 0  acc:  2022 /  2480 =  81.532
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 17918 / 19962 =  89.761
Robust  acc:   105 /   180 =  58.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8704 /  9767 =  89.116
0, 1  acc:  7087 /  7535 =  94.054
1, 0  acc:  2022 /  2480 =  81.532
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 17918 / 19962 =  89.761
Robust  acc:   105 /   180 =  58.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8704 /  9767 =  89.116
0, 1  acc:  7087 /  7535 =  94.054
1, 0  acc:  2022 /  2480 =  81.532
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 17918 / 19962 =  89.761
Robust  acc:   105 /   180 =  58.333
------------------------------------
Epoch:  28 | Train Loss: 0.000 | Train Acc: 96.478 | Val Loss: 0.001 | Val Acc: 89.233
Training:
Accuracies by groups:
0, 0  acc: 63854 / 66325 =  96.274
0, 1  acc: 15942 / 16758 =  95.131
1, 0  acc: 60814 / 63017 =  96.504
1, 1  acc: 16427 / 16670 =  98.542
--------------------------------------
Average acc: 157037 / 162770 =  96.478
Robust  acc: 15942 / 16758 =  95.131
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7473 /  8535 =  87.557
0, 1  acc:  7915 /  8276 =  95.638
1, 0  acc:  2244 /  2874 =  78.079
1, 1  acc:    96 /   182 =  52.747
------------------------------------
Average acc: 17728 / 19867 =  89.233
Robust  acc:    96 /   182 =  52.747
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.876
Robust Acc: 48.333 | Best Acc: 95.275
-------------------------------------
Training, Epoch 27:
Accuracies by groups:
0, 0  acc:  8800 /  9767 =  90.099
0, 1  acc:  7179 /  7535 =  95.275
1, 0  acc:  1875 /  2480 =  75.605
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 17941 / 19962 =  89.876
Robust  acc:    87 /   180 =  48.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8800 /  9767 =  90.099
0, 1  acc:  7179 /  7535 =  95.275
1, 0  acc:  1875 /  2480 =  75.605
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 17941 / 19962 =  89.876
Robust  acc:    87 /   180 =  48.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8800 /  9767 =  90.099
0, 1  acc:  7179 /  7535 =  95.275
1, 0  acc:  1875 /  2480 =  75.605
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 17941 / 19962 =  89.876
Robust  acc:    87 /   180 =  48.333
------------------------------------
Epoch:  29 | Train Loss: 0.000 | Train Acc: 96.624 | Val Loss: 0.001 | Val Acc: 91.262
Training:
Accuracies by groups:
0, 0  acc: 63643 / 66009 =  96.416
0, 1  acc: 16371 / 17169 =  95.352
1, 0  acc: 60763 / 62852 =  96.676
1, 1  acc: 16498 / 16740 =  98.554
--------------------------------------
Average acc: 157275 / 162770 =  96.624
Robust  acc: 16371 / 17169 =  95.352
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8147 /  8535 =  95.454
0, 1  acc:  8161 /  8276 =  98.610
1, 0  acc:  1768 /  2874 =  61.517
1, 1  acc:    55 /   182 =  30.220
------------------------------------
Average acc: 18131 / 19867 =  91.262
Robust  acc:    55 /   182 =  30.220
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.779
Robust Acc: 32.778 | Best Acc: 98.407
-------------------------------------
Training, Epoch 28:
Accuracies by groups:
0, 0  acc:  9387 /  9767 =  96.109
0, 1  acc:  7415 /  7535 =  98.407
1, 0  acc:  1460 /  2480 =  58.871
1, 1  acc:    59 /   180 =  32.778
------------------------------------
Average acc: 18321 / 19962 =  91.779
Robust  acc:    59 /   180 =  32.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9387 /  9767 =  96.109
0, 1  acc:  7415 /  7535 =  98.407
1, 0  acc:  1460 /  2480 =  58.871
1, 1  acc:    59 /   180 =  32.778
------------------------------------
Average acc: 18321 / 19962 =  91.779
Robust  acc:    59 /   180 =  32.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9387 /  9767 =  96.109
0, 1  acc:  7415 /  7535 =  98.407
1, 0  acc:  1460 /  2480 =  58.871
1, 1  acc:    59 /   180 =  32.778
------------------------------------
Average acc: 18321 / 19962 =  91.779
Robust  acc:    59 /   180 =  32.778
------------------------------------
Epoch:  30 | Train Loss: 0.000 | Train Acc: 96.799 | Val Loss: 0.001 | Val Acc: 91.066
Training:
Accuracies by groups:
0, 0  acc: 63653 / 65949 =  96.519
0, 1  acc: 16147 / 16878 =  95.669
1, 0  acc: 61279 / 63235 =  96.907
1, 1  acc: 16481 / 16708 =  98.641
--------------------------------------
Average acc: 157560 / 162770 =  96.799
Robust  acc: 16147 / 16878 =  95.669
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8052 /  8535 =  94.341
0, 1  acc:  8121 /  8276 =  98.127
1, 0  acc:  1859 /  2874 =  64.683
1, 1  acc:    60 /   182 =  32.967
------------------------------------
Average acc: 18092 / 19867 =  91.066
Robust  acc:    60 /   182 =  32.967
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.694
Robust Acc: 32.222 | Best Acc: 98.235
-------------------------------------
Training, Epoch 29:
Accuracies by groups:
0, 0  acc:  9299 /  9767 =  95.208
0, 1  acc:  7402 /  7535 =  98.235
1, 0  acc:  1545 /  2480 =  62.298
1, 1  acc:    58 /   180 =  32.222
------------------------------------
Average acc: 18304 / 19962 =  91.694
Robust  acc:    58 /   180 =  32.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9299 /  9767 =  95.208
0, 1  acc:  7402 /  7535 =  98.235
1, 0  acc:  1545 /  2480 =  62.298
1, 1  acc:    58 /   180 =  32.222
------------------------------------
Average acc: 18304 / 19962 =  91.694
Robust  acc:    58 /   180 =  32.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9299 /  9767 =  95.208
0, 1  acc:  7402 /  7535 =  98.235
1, 0  acc:  1545 /  2480 =  62.298
1, 1  acc:    58 /   180 =  32.222
------------------------------------
Average acc: 18304 / 19962 =  91.694
Robust  acc:    58 /   180 =  32.222
------------------------------------
Epoch:  31 | Train Loss: 0.000 | Train Acc: 96.770 | Val Loss: 0.001 | Val Acc: 89.052
Training:
Accuracies by groups:
0, 0  acc: 63747 / 66025 =  96.550
0, 1  acc: 16096 / 16877 =  95.372
1, 0  acc: 61115 / 63101 =  96.853
1, 1  acc: 16554 / 16767 =  98.730
--------------------------------------
Average acc: 157512 / 162770 =  96.770
Robust  acc: 16096 / 16877 =  95.372
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7436 /  8535 =  87.124
0, 1  acc:  7853 /  8276 =  94.889
1, 0  acc:  2302 /  2874 =  80.097
1, 1  acc:   101 /   182 =  55.495
------------------------------------
Average acc: 17692 / 19867 =  89.052
Robust  acc:   101 /   182 =  55.495
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.981
Robust Acc: 53.333 | Best Acc: 95.063
-------------------------------------
Training, Epoch 30:
Accuracies by groups:
0, 0  acc:  8729 /  9767 =  89.372
0, 1  acc:  7163 /  7535 =  95.063
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    96 /   180 =  53.333
------------------------------------
Average acc: 17962 / 19962 =  89.981
Robust  acc:    96 /   180 =  53.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8729 /  9767 =  89.372
0, 1  acc:  7163 /  7535 =  95.063
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    96 /   180 =  53.333
------------------------------------
Average acc: 17962 / 19962 =  89.981
Robust  acc:    96 /   180 =  53.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8729 /  9767 =  89.372
0, 1  acc:  7163 /  7535 =  95.063
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    96 /   180 =  53.333
------------------------------------
Average acc: 17962 / 19962 =  89.981
Robust  acc:    96 /   180 =  53.333
------------------------------------
Epoch:  32 | Train Loss: 0.000 | Train Acc: 96.870 | Val Loss: 0.001 | Val Acc: 89.646
Training:
Accuracies by groups:
0, 0  acc: 63979 / 66177 =  96.679
0, 1  acc: 16329 / 17057 =  95.732
1, 0  acc: 60903 / 62848 =  96.905
1, 1  acc: 16465 / 16688 =  98.664
--------------------------------------
Average acc: 157676 / 162770 =  96.870
Robust  acc: 16329 / 17057 =  95.732
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7517 /  8535 =  88.073
0, 1  acc:  7873 /  8276 =  95.130
1, 0  acc:  2324 /  2874 =  80.863
1, 1  acc:    96 /   182 =  52.747
------------------------------------
Average acc: 17810 / 19867 =  89.646
Robust  acc:    96 /   182 =  52.747
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.267
Robust Acc: 55.000 | Best Acc: 95.023
-------------------------------------
Training, Epoch 31:
Accuracies by groups:
0, 0  acc:  8823 /  9767 =  90.335
0, 1  acc:  7160 /  7535 =  95.023
1, 0  acc:  1937 /  2480 =  78.105
1, 1  acc:    99 /   180 =  55.000
------------------------------------
Average acc: 18019 / 19962 =  90.267
Robust  acc:    99 /   180 =  55.000
------------------------------------
Accuracies by groups:
0, 0  acc:  8823 /  9767 =  90.335
0, 1  acc:  7160 /  7535 =  95.023
1, 0  acc:  1937 /  2480 =  78.105
1, 1  acc:    99 /   180 =  55.000
------------------------------------
Average acc: 18019 / 19962 =  90.267
Robust  acc:    99 /   180 =  55.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8823 /  9767 =  90.335
0, 1  acc:  7160 /  7535 =  95.023
1, 0  acc:  1937 /  2480 =  78.105
1, 1  acc:    99 /   180 =  55.000
------------------------------------
Average acc: 18019 / 19962 =  90.267
Robust  acc:    99 /   180 =  55.000
------------------------------------
Epoch:  33 | Train Loss: 0.000 | Train Acc: 97.154 | Val Loss: 0.002 | Val Acc: 85.086
Training:
Accuracies by groups:
0, 0  acc: 64223 / 66224 =  96.978
0, 1  acc: 16064 / 16745 =  95.933
1, 0  acc: 61289 / 63025 =  97.246
1, 1  acc: 16561 / 16776 =  98.718
--------------------------------------
Average acc: 158137 / 162770 =  97.154
Robust  acc: 16064 / 16745 =  95.933
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6795 /  8535 =  79.613
0, 1  acc:  7463 /  8276 =  90.176
1, 0  acc:  2523 /  2874 =  87.787
1, 1  acc:   123 /   182 =  67.582
------------------------------------
Average acc: 16904 / 19867 =  85.086
Robust  acc:   123 /   182 =  67.582
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 85.703
Robust Acc: 64.444 | Best Acc: 90.246
-------------------------------------
Training, Epoch 32:
Accuracies by groups:
0, 0  acc:  8062 /  9767 =  82.543
0, 1  acc:  6800 /  7535 =  90.246
1, 0  acc:  2130 /  2480 =  85.887
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 17108 / 19962 =  85.703
Robust  acc:   116 /   180 =  64.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8062 /  9767 =  82.543
0, 1  acc:  6800 /  7535 =  90.246
1, 0  acc:  2130 /  2480 =  85.887
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 17108 / 19962 =  85.703
Robust  acc:   116 /   180 =  64.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8062 /  9767 =  82.543
0, 1  acc:  6800 /  7535 =  90.246
1, 0  acc:  2130 /  2480 =  85.887
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 17108 / 19962 =  85.703
Robust  acc:   116 /   180 =  64.444
------------------------------------
Epoch:  34 | Train Loss: 0.000 | Train Acc: 97.202 | Val Loss: 0.001 | Val Acc: 90.799
Training:
Accuracies by groups:
0, 0  acc: 64109 / 66119 =  96.960
0, 1  acc: 16248 / 16900 =  96.142
1, 0  acc: 61335 / 63050 =  97.280
1, 1  acc: 16523 / 16701 =  98.934
--------------------------------------
Average acc: 158215 / 162770 =  97.202
Robust  acc: 16248 / 16900 =  96.142
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7796 /  8535 =  91.342
0, 1  acc:  8007 /  8276 =  96.750
1, 0  acc:  2157 /  2874 =  75.052
1, 1  acc:    79 /   182 =  43.407
------------------------------------
Average acc: 18039 / 19867 =  90.799
Robust  acc:    79 /   182 =  43.407
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.208
Robust Acc: 38.333 | Best Acc: 96.656
-------------------------------------
Training, Epoch 33:
Accuracies by groups:
0, 0  acc:  9068 /  9767 =  92.843
0, 1  acc:  7283 /  7535 =  96.656
1, 0  acc:  1787 /  2480 =  72.056
1, 1  acc:    69 /   180 =  38.333
------------------------------------
Average acc: 18207 / 19962 =  91.208
Robust  acc:    69 /   180 =  38.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9068 /  9767 =  92.843
0, 1  acc:  7283 /  7535 =  96.656
1, 0  acc:  1787 /  2480 =  72.056
1, 1  acc:    69 /   180 =  38.333
------------------------------------
Average acc: 18207 / 19962 =  91.208
Robust  acc:    69 /   180 =  38.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9068 /  9767 =  92.843
0, 1  acc:  7283 /  7535 =  96.656
1, 0  acc:  1787 /  2480 =  72.056
1, 1  acc:    69 /   180 =  38.333
------------------------------------
Average acc: 18207 / 19962 =  91.208
Robust  acc:    69 /   180 =  38.333
------------------------------------
Epoch:  35 | Train Loss: 0.000 | Train Acc: 97.312 | Val Loss: 0.001 | Val Acc: 88.116
Training:
Accuracies by groups:
0, 0  acc: 64463 / 66400 =  97.083
0, 1  acc: 16217 / 16892 =  96.004
1, 0  acc: 61026 / 62633 =  97.434
1, 1  acc: 16688 / 16845 =  99.068
--------------------------------------
Average acc: 158394 / 162770 =  97.312
Robust  acc: 16217 / 16892 =  96.004
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7243 /  8535 =  84.862
0, 1  acc:  7765 /  8276 =  93.826
1, 0  acc:  2389 /  2874 =  83.125
1, 1  acc:   109 /   182 =  59.890
------------------------------------
Average acc: 17506 / 19867 =  88.116
Robust  acc:   109 /   182 =  59.890
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 88.989
Robust Acc: 58.889 | Best Acc: 94.068
-------------------------------------
Training, Epoch 34:
Accuracies by groups:
0, 0  acc:  8549 /  9767 =  87.529
0, 1  acc:  7088 /  7535 =  94.068
1, 0  acc:  2021 /  2480 =  81.492
1, 1  acc:   106 /   180 =  58.889
------------------------------------
Average acc: 17764 / 19962 =  88.989
Robust  acc:   106 /   180 =  58.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8549 /  9767 =  87.529
0, 1  acc:  7088 /  7535 =  94.068
1, 0  acc:  2021 /  2480 =  81.492
1, 1  acc:   106 /   180 =  58.889
------------------------------------
Average acc: 17764 / 19962 =  88.989
Robust  acc:   106 /   180 =  58.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8549 /  9767 =  87.529
0, 1  acc:  7088 /  7535 =  94.068
1, 0  acc:  2021 /  2480 =  81.492
1, 1  acc:   106 /   180 =  58.889
------------------------------------
Average acc: 17764 / 19962 =  88.989
Robust  acc:   106 /   180 =  58.889
------------------------------------
Epoch:  36 | Train Loss: 0.000 | Train Acc: 97.326 | Val Loss: 0.001 | Val Acc: 89.777
Training:
Accuracies by groups:
0, 0  acc: 64091 / 66026 =  97.069
0, 1  acc: 16542 / 17154 =  96.432
1, 0  acc: 61444 / 63049 =  97.454
1, 1  acc: 16341 / 16541 =  98.791
--------------------------------------
Average acc: 158418 / 162770 =  97.326
Robust  acc: 16542 / 17154 =  96.432
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7540 /  8535 =  88.342
0, 1  acc:  7893 /  8276 =  95.372
1, 0  acc:  2310 /  2874 =  80.376
1, 1  acc:    93 /   182 =  51.099
------------------------------------
Average acc: 17836 / 19867 =  89.777
Robust  acc:    93 /   182 =  51.099
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.542
Robust Acc: 51.667 | Best Acc: 95.421
-------------------------------------
Training, Epoch 35:
Accuracies by groups:
0, 0  acc:  8848 /  9767 =  90.591
0, 1  acc:  7190 /  7535 =  95.421
1, 0  acc:  1943 /  2480 =  78.347
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 18074 / 19962 =  90.542
Robust  acc:    93 /   180 =  51.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8848 /  9767 =  90.591
0, 1  acc:  7190 /  7535 =  95.421
1, 0  acc:  1943 /  2480 =  78.347
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 18074 / 19962 =  90.542
Robust  acc:    93 /   180 =  51.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8848 /  9767 =  90.591
0, 1  acc:  7190 /  7535 =  95.421
1, 0  acc:  1943 /  2480 =  78.347
1, 1  acc:    93 /   180 =  51.667
------------------------------------
Average acc: 18074 / 19962 =  90.542
Robust  acc:    93 /   180 =  51.667
------------------------------------
Epoch:  37 | Train Loss: 0.000 | Train Acc: 97.446 | Val Loss: 0.001 | Val Acc: 90.527
Training:
Accuracies by groups:
0, 0  acc: 64236 / 66035 =  97.276
0, 1  acc: 16334 / 16955 =  96.337
1, 0  acc: 61350 / 62930 =  97.489
1, 1  acc: 16693 / 16850 =  99.068
--------------------------------------
Average acc: 158613 / 162770 =  97.446
Robust  acc: 16334 / 16955 =  96.337
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7586 /  8535 =  88.881
0, 1  acc:  7983 /  8276 =  96.460
1, 0  acc:  2324 /  2874 =  80.863
1, 1  acc:    92 /   182 =  50.549
------------------------------------
Average acc: 17985 / 19867 =  90.527
Robust  acc:    92 /   182 =  50.549
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.068
Robust Acc: 47.778 | Best Acc: 96.231
-------------------------------------
Training, Epoch 36:
Accuracies by groups:
0, 0  acc:  8867 /  9767 =  90.785
0, 1  acc:  7251 /  7535 =  96.231
1, 0  acc:  1975 /  2480 =  79.637
1, 1  acc:    86 /   180 =  47.778
------------------------------------
Average acc: 18179 / 19962 =  91.068
Robust  acc:    86 /   180 =  47.778
------------------------------------
Accuracies by groups:
0, 0  acc:  8867 /  9767 =  90.785
0, 1  acc:  7251 /  7535 =  96.231
1, 0  acc:  1975 /  2480 =  79.637
1, 1  acc:    86 /   180 =  47.778
------------------------------------
Average acc: 18179 / 19962 =  91.068
Robust  acc:    86 /   180 =  47.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8867 /  9767 =  90.785
0, 1  acc:  7251 /  7535 =  96.231
1, 0  acc:  1975 /  2480 =  79.637
1, 1  acc:    86 /   180 =  47.778
------------------------------------
Average acc: 18179 / 19962 =  91.068
Robust  acc:    86 /   180 =  47.778
------------------------------------
Epoch:  38 | Train Loss: 0.000 | Train Acc: 97.518 | Val Loss: 0.001 | Val Acc: 91.856
Training:
Accuracies by groups:
0, 0  acc: 64109 / 65915 =  97.260
0, 1  acc: 16341 / 16938 =  96.475
1, 0  acc: 61685 / 63167 =  97.654
1, 1  acc: 16595 / 16750 =  99.075
--------------------------------------
Average acc: 158730 / 162770 =  97.518
Robust  acc: 16341 / 16938 =  96.475
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7961 /  8535 =  93.275
0, 1  acc:  8100 /  8276 =  97.873
1, 0  acc:  2119 /  2874 =  73.730
1, 1  acc:    69 /   182 =  37.912
------------------------------------
Average acc: 18249 / 19867 =  91.856
Robust  acc:    69 /   182 =  37.912
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.416
Robust Acc: 36.667 | Best Acc: 98.182
-------------------------------------
Training, Epoch 37:
Accuracies by groups:
0, 0  acc:  9234 /  9767 =  94.543
0, 1  acc:  7398 /  7535 =  98.182
1, 0  acc:  1750 /  2480 =  70.565
1, 1  acc:    66 /   180 =  36.667
------------------------------------
Average acc: 18448 / 19962 =  92.416
Robust  acc:    66 /   180 =  36.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9234 /  9767 =  94.543
0, 1  acc:  7398 /  7535 =  98.182
1, 0  acc:  1750 /  2480 =  70.565
1, 1  acc:    66 /   180 =  36.667
------------------------------------
Average acc: 18448 / 19962 =  92.416
Robust  acc:    66 /   180 =  36.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9234 /  9767 =  94.543
0, 1  acc:  7398 /  7535 =  98.182
1, 0  acc:  1750 /  2480 =  70.565
1, 1  acc:    66 /   180 =  36.667
------------------------------------
Average acc: 18448 / 19962 =  92.416
Robust  acc:    66 /   180 =  36.667
------------------------------------
Epoch:  39 | Train Loss: 0.000 | Train Acc: 97.579 | Val Loss: 0.001 | Val Acc: 90.975
Training:
Accuracies by groups:
0, 0  acc: 64311 / 66052 =  97.364
0, 1  acc: 16286 / 16879 =  96.487
1, 0  acc: 61548 / 62989 =  97.712
1, 1  acc: 16685 / 16850 =  99.021
--------------------------------------
Average acc: 158830 / 162770 =  97.579
Robust  acc: 16286 / 16879 =  96.487
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7892 /  8535 =  92.466
0, 1  acc:  8032 /  8276 =  97.052
1, 0  acc:  2069 /  2874 =  71.990
1, 1  acc:    81 /   182 =  44.505
------------------------------------
Average acc: 18074 / 19867 =  90.975
Robust  acc:    81 /   182 =  44.505
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.283
Robust Acc: 37.222 | Best Acc: 97.094
-------------------------------------
Training, Epoch 38:
Accuracies by groups:
0, 0  acc:  9161 /  9767 =  93.795
0, 1  acc:  7316 /  7535 =  97.094
1, 0  acc:  1678 /  2480 =  67.661
1, 1  acc:    67 /   180 =  37.222
------------------------------------
Average acc: 18222 / 19962 =  91.283
Robust  acc:    67 /   180 =  37.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9161 /  9767 =  93.795
0, 1  acc:  7316 /  7535 =  97.094
1, 0  acc:  1678 /  2480 =  67.661
1, 1  acc:    67 /   180 =  37.222
------------------------------------
Average acc: 18222 / 19962 =  91.283
Robust  acc:    67 /   180 =  37.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9161 /  9767 =  93.795
0, 1  acc:  7316 /  7535 =  97.094
1, 0  acc:  1678 /  2480 =  67.661
1, 1  acc:    67 /   180 =  37.222
------------------------------------
Average acc: 18222 / 19962 =  91.283
Robust  acc:    67 /   180 =  37.222
------------------------------------
Epoch:  40 | Train Loss: 0.000 | Train Acc: 97.745 | Val Loss: 0.001 | Val Acc: 89.153
Training:
Accuracies by groups:
0, 0  acc: 64434 / 66077 =  97.514
0, 1  acc: 16387 / 16915 =  96.879
1, 0  acc: 61617 / 62953 =  97.878
1, 1  acc: 16661 / 16825 =  99.025
--------------------------------------
Average acc: 159099 / 162770 =  97.745
Robust  acc: 16387 / 16915 =  96.879
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7318 /  8535 =  85.741
0, 1  acc:  7774 /  8276 =  93.934
1, 0  acc:  2508 /  2874 =  87.265
1, 1  acc:   112 /   182 =  61.538
------------------------------------
Average acc: 17712 / 19867 =  89.153
Robust  acc:   112 /   182 =  61.538
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.151
Robust Acc: 57.778 | Best Acc: 94.240
-------------------------------------
Training, Epoch 39:
Accuracies by groups:
0, 0  acc:  8656 /  9767 =  88.625
0, 1  acc:  7101 /  7535 =  94.240
1, 0  acc:  2135 /  2480 =  86.089
1, 1  acc:   104 /   180 =  57.778
------------------------------------
Average acc: 17996 / 19962 =  90.151
Robust  acc:   104 /   180 =  57.778
------------------------------------
Accuracies by groups:
0, 0  acc:  8656 /  9767 =  88.625
0, 1  acc:  7101 /  7535 =  94.240
1, 0  acc:  2135 /  2480 =  86.089
1, 1  acc:   104 /   180 =  57.778
------------------------------------
Average acc: 17996 / 19962 =  90.151
Robust  acc:   104 /   180 =  57.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8656 /  9767 =  88.625
0, 1  acc:  7101 /  7535 =  94.240
1, 0  acc:  2135 /  2480 =  86.089
1, 1  acc:   104 /   180 =  57.778
------------------------------------
Average acc: 17996 / 19962 =  90.151
Robust  acc:   104 /   180 =  57.778
------------------------------------
Epoch:  41 | Train Loss: 0.000 | Train Acc: 97.671 | Val Loss: 0.001 | Val Acc: 90.049
Training:
Accuracies by groups:
0, 0  acc: 64436 / 66091 =  97.496
0, 1  acc: 16452 / 17052 =  96.481
1, 0  acc: 61472 / 62853 =  97.803
1, 1  acc: 16619 / 16774 =  99.076
--------------------------------------
Average acc: 158979 / 162770 =  97.671
Robust  acc: 16452 / 17052 =  96.481
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7665 /  8535 =  89.807
0, 1  acc:  7936 /  8276 =  95.892
1, 0  acc:  2204 /  2874 =  76.688
1, 1  acc:    85 /   182 =  46.703
------------------------------------
Average acc: 17890 / 19867 =  90.049
Robust  acc:    85 /   182 =  46.703
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.642
Robust Acc: 45.000 | Best Acc: 95.899
-------------------------------------
Training, Epoch 40:
Accuracies by groups:
0, 0  acc:  8961 /  9767 =  91.748
0, 1  acc:  7226 /  7535 =  95.899
1, 0  acc:  1826 /  2480 =  73.629
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18094 / 19962 =  90.642
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  8961 /  9767 =  91.748
0, 1  acc:  7226 /  7535 =  95.899
1, 0  acc:  1826 /  2480 =  73.629
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18094 / 19962 =  90.642
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8961 /  9767 =  91.748
0, 1  acc:  7226 /  7535 =  95.899
1, 0  acc:  1826 /  2480 =  73.629
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18094 / 19962 =  90.642
Robust  acc:    81 /   180 =  45.000
------------------------------------
Epoch:  42 | Train Loss: 0.000 | Train Acc: 97.872 | Val Loss: 0.001 | Val Acc: 90.613
Training:
Accuracies by groups:
0, 0  acc: 64477 / 65970 =  97.737
0, 1  acc: 16376 / 16916 =  96.808
1, 0  acc: 62054 / 63324 =  97.994
1, 1  acc: 16399 / 16560 =  99.028
--------------------------------------
Average acc: 159306 / 162770 =  97.872
Robust  acc: 16376 / 16916 =  96.808
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7633 /  8535 =  89.432
0, 1  acc:  7930 /  8276 =  95.819
1, 0  acc:  2339 /  2874 =  81.385
1, 1  acc:   100 /   182 =  54.945
------------------------------------
Average acc: 18002 / 19867 =  90.613
Robust  acc:   100 /   182 =  54.945
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.313
Robust Acc: 54.444 | Best Acc: 95.806
-------------------------------------
Training, Epoch 41:
Accuracies by groups:
0, 0  acc:  8964 /  9767 =  91.778
0, 1  acc:  7219 /  7535 =  95.806
1, 0  acc:  1947 /  2480 =  78.508
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 18228 / 19962 =  91.313
Robust  acc:    98 /   180 =  54.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8964 /  9767 =  91.778
0, 1  acc:  7219 /  7535 =  95.806
1, 0  acc:  1947 /  2480 =  78.508
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 18228 / 19962 =  91.313
Robust  acc:    98 /   180 =  54.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8964 /  9767 =  91.778
0, 1  acc:  7219 /  7535 =  95.806
1, 0  acc:  1947 /  2480 =  78.508
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 18228 / 19962 =  91.313
Robust  acc:    98 /   180 =  54.444
------------------------------------
Epoch:  43 | Train Loss: 0.000 | Train Acc: 97.878 | Val Loss: 0.001 | Val Acc: 90.864
Training:
Accuracies by groups:
0, 0  acc: 64539 / 66040 =  97.727
0, 1  acc: 16323 / 16867 =  96.775
1, 0  acc: 62006 / 63269 =  98.004
1, 1  acc: 16448 / 16594 =  99.120
--------------------------------------
Average acc: 159316 / 162770 =  97.878
Robust  acc: 16323 / 16867 =  96.775
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7652 /  8535 =  89.654
0, 1  acc:  8012 /  8276 =  96.810
1, 0  acc:  2297 /  2874 =  79.923
1, 1  acc:    91 /   182 =  50.000
------------------------------------
Average acc: 18052 / 19867 =  90.864
Robust  acc:    91 /   182 =  50.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.349
Robust Acc: 48.333 | Best Acc: 96.642
-------------------------------------
Training, Epoch 42:
Accuracies by groups:
0, 0  acc:  8954 /  9767 =  91.676
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  1912 /  2480 =  77.097
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18235 / 19962 =  91.349
Robust  acc:    87 /   180 =  48.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8954 /  9767 =  91.676
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  1912 /  2480 =  77.097
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18235 / 19962 =  91.349
Robust  acc:    87 /   180 =  48.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8954 /  9767 =  91.676
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  1912 /  2480 =  77.097
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18235 / 19962 =  91.349
Robust  acc:    87 /   180 =  48.333
------------------------------------
Epoch:  44 | Train Loss: 0.000 | Train Acc: 98.073 | Val Loss: 0.001 | Val Acc: 91.277
Training:
Accuracies by groups:
0, 0  acc: 64596 / 66016 =  97.849
0, 1  acc: 16416 / 16861 =  97.361
1, 0  acc: 61985 / 63143 =  98.166
1, 1  acc: 16636 / 16750 =  99.319
--------------------------------------
Average acc: 159633 / 162770 =  98.073
Robust  acc: 16416 / 16861 =  97.361
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7734 /  8535 =  90.615
0, 1  acc:  8016 /  8276 =  96.858
1, 0  acc:  2293 /  2874 =  79.784
1, 1  acc:    91 /   182 =  50.000
------------------------------------
Average acc: 18134 / 19867 =  91.277
Robust  acc:    91 /   182 =  50.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.935
Robust Acc: 46.111 | Best Acc: 96.987
-------------------------------------
Training, Epoch 43:
Accuracies by groups:
0, 0  acc:  9059 /  9767 =  92.751
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  1902 /  2480 =  76.694
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 18352 / 19962 =  91.935
Robust  acc:    83 /   180 =  46.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9059 /  9767 =  92.751
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  1902 /  2480 =  76.694
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 18352 / 19962 =  91.935
Robust  acc:    83 /   180 =  46.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9059 /  9767 =  92.751
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  1902 /  2480 =  76.694
1, 1  acc:    83 /   180 =  46.111
------------------------------------
Average acc: 18352 / 19962 =  91.935
Robust  acc:    83 /   180 =  46.111
------------------------------------
Epoch:  45 | Train Loss: 0.000 | Train Acc: 98.011 | Val Loss: 0.001 | Val Acc: 91.644
Training:
Accuracies by groups:
0, 0  acc: 64713 / 66177 =  97.788
0, 1  acc: 16402 / 16887 =  97.128
1, 0  acc: 61779 / 62936 =  98.162
1, 1  acc: 16639 / 16770 =  99.219
--------------------------------------
Average acc: 159533 / 162770 =  98.011
Robust  acc: 16402 / 16887 =  97.128
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7875 /  8535 =  92.267
0, 1  acc:  8084 /  8276 =  97.680
1, 0  acc:  2172 /  2874 =  75.574
1, 1  acc:    76 /   182 =  41.758
------------------------------------
Average acc: 18207 / 19867 =  91.644
Robust  acc:    76 /   182 =  41.758
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.245
Robust Acc: 40.000 | Best Acc: 97.850
-------------------------------------
Training, Epoch 44:
Accuracies by groups:
0, 0  acc:  9156 /  9767 =  93.744
0, 1  acc:  7373 /  7535 =  97.850
1, 0  acc:  1813 /  2480 =  73.105
1, 1  acc:    72 /   180 =  40.000
------------------------------------
Average acc: 18414 / 19962 =  92.245
Robust  acc:    72 /   180 =  40.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9156 /  9767 =  93.744
0, 1  acc:  7373 /  7535 =  97.850
1, 0  acc:  1813 /  2480 =  73.105
1, 1  acc:    72 /   180 =  40.000
------------------------------------
Average acc: 18414 / 19962 =  92.245
Robust  acc:    72 /   180 =  40.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9156 /  9767 =  93.744
0, 1  acc:  7373 /  7535 =  97.850
1, 0  acc:  1813 /  2480 =  73.105
1, 1  acc:    72 /   180 =  40.000
------------------------------------
Average acc: 18414 / 19962 =  92.245
Robust  acc:    72 /   180 =  40.000
------------------------------------
Epoch:  46 | Train Loss: 0.000 | Train Acc: 98.070 | Val Loss: 0.001 | Val Acc: 91.347
Training:
Accuracies by groups:
0, 0  acc: 65027 / 66435 =  97.881
0, 1  acc: 16584 / 17041 =  97.318
1, 0  acc: 61740 / 62875 =  98.195
1, 1  acc: 16278 / 16419 =  99.141
--------------------------------------
Average acc: 159629 / 162770 =  98.070
Robust  acc: 16584 / 17041 =  97.318
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7825 /  8535 =  91.681
0, 1  acc:  8044 /  8276 =  97.197
1, 0  acc:  2202 /  2874 =  76.618
1, 1  acc:    77 /   182 =  42.308
------------------------------------
Average acc: 18148 / 19867 =  91.347
Robust  acc:    77 /   182 =  42.308
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.719
Robust Acc: 39.444 | Best Acc: 96.987
-------------------------------------
Training, Epoch 45:
Accuracies by groups:
0, 0  acc:  9104 /  9767 =  93.212
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  1826 /  2480 =  73.629
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18309 / 19962 =  91.719
Robust  acc:    71 /   180 =  39.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9104 /  9767 =  93.212
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  1826 /  2480 =  73.629
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18309 / 19962 =  91.719
Robust  acc:    71 /   180 =  39.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9104 /  9767 =  93.212
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  1826 /  2480 =  73.629
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18309 / 19962 =  91.719
Robust  acc:    71 /   180 =  39.444
------------------------------------
Epoch:  47 | Train Loss: 0.000 | Train Acc: 98.125 | Val Loss: 0.001 | Val Acc: 91.337
Training:
Accuracies by groups:
0, 0  acc: 64906 / 66238 =  97.989
0, 1  acc: 16326 / 16810 =  97.121
1, 0  acc: 61897 / 62986 =  98.271
1, 1  acc: 16589 / 16736 =  99.122
--------------------------------------
Average acc: 159718 / 162770 =  98.125
Robust  acc: 16326 / 16810 =  97.121
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7813 /  8535 =  91.541
0, 1  acc:  8052 /  8276 =  97.293
1, 0  acc:  2198 /  2874 =  76.479
1, 1  acc:    83 /   182 =  45.604
------------------------------------
Average acc: 18146 / 19867 =  91.337
Robust  acc:    83 /   182 =  45.604
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.965
Robust Acc: 39.444 | Best Acc: 97.293
-------------------------------------
Training, Epoch 46:
Accuracies by groups:
0, 0  acc:  9141 /  9767 =  93.591
0, 1  acc:  7331 /  7535 =  97.293
1, 0  acc:  1815 /  2480 =  73.185
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18358 / 19962 =  91.965
Robust  acc:    71 /   180 =  39.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9141 /  9767 =  93.591
0, 1  acc:  7331 /  7535 =  97.293
1, 0  acc:  1815 /  2480 =  73.185
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18358 / 19962 =  91.965
Robust  acc:    71 /   180 =  39.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9141 /  9767 =  93.591
0, 1  acc:  7331 /  7535 =  97.293
1, 0  acc:  1815 /  2480 =  73.185
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18358 / 19962 =  91.965
Robust  acc:    71 /   180 =  39.444
------------------------------------
Epoch:  48 | Train Loss: 0.000 | Train Acc: 98.302 | Val Loss: 0.001 | Val Acc: 90.180
Training:
Accuracies by groups:
0, 0  acc: 65132 / 66351 =  98.163
0, 1  acc: 16525 / 16966 =  97.401
1, 0  acc: 61635 / 62627 =  98.416
1, 1  acc: 16714 / 16826 =  99.334
--------------------------------------
Average acc: 160006 / 162770 =  98.302
Robust  acc: 16525 / 16966 =  97.401
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7516 /  8535 =  88.061
0, 1  acc:  7939 /  8276 =  95.928
1, 0  acc:  2363 /  2874 =  82.220
1, 1  acc:    98 /   182 =  53.846
------------------------------------
Average acc: 17916 / 19867 =  90.180
Robust  acc:    98 /   182 =  53.846
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.707
Robust Acc: 47.778 | Best Acc: 95.620
-------------------------------------
Training, Epoch 47:
Accuracies by groups:
0, 0  acc:  8837 /  9767 =  90.478
0, 1  acc:  7205 /  7535 =  95.620
1, 0  acc:  1979 /  2480 =  79.798
1, 1  acc:    86 /   180 =  47.778
------------------------------------
Average acc: 18107 / 19962 =  90.707
Robust  acc:    86 /   180 =  47.778
------------------------------------
Accuracies by groups:
0, 0  acc:  8837 /  9767 =  90.478
0, 1  acc:  7205 /  7535 =  95.620
1, 0  acc:  1979 /  2480 =  79.798
1, 1  acc:    86 /   180 =  47.778
------------------------------------
Average acc: 18107 / 19962 =  90.707
Robust  acc:    86 /   180 =  47.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8837 /  9767 =  90.478
0, 1  acc:  7205 /  7535 =  95.620
1, 0  acc:  1979 /  2480 =  79.798
1, 1  acc:    86 /   180 =  47.778
------------------------------------
Average acc: 18107 / 19962 =  90.707
Robust  acc:    86 /   180 =  47.778
------------------------------------
Epoch:  49 | Train Loss: 0.000 | Train Acc: 98.389 | Val Loss: 0.001 | Val Acc: 91.901
Training:
Accuracies by groups:
0, 0  acc: 65339 / 66515 =  98.232
0, 1  acc: 16289 / 16715 =  97.451
1, 0  acc: 62008 / 62918 =  98.554
1, 1  acc: 16511 / 16622 =  99.332
--------------------------------------
Average acc: 160147 / 162770 =  98.389
Robust  acc: 16289 / 16715 =  97.451
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7907 /  8535 =  92.642
0, 1  acc:  8087 /  8276 =  97.716
1, 0  acc:  2198 /  2874 =  76.479
1, 1  acc:    66 /   182 =  36.264
------------------------------------
Average acc: 18258 / 19867 =  91.901
Robust  acc:    66 /   182 =  36.264
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.365
Robust Acc: 40.000 | Best Acc: 97.651
-------------------------------------
Training, Epoch 48:
Accuracies by groups:
0, 0  acc:  9173 /  9767 =  93.918
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  1835 /  2480 =  73.992
1, 1  acc:    72 /   180 =  40.000
------------------------------------
Average acc: 18438 / 19962 =  92.365
Robust  acc:    72 /   180 =  40.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9173 /  9767 =  93.918
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  1835 /  2480 =  73.992
1, 1  acc:    72 /   180 =  40.000
------------------------------------
Average acc: 18438 / 19962 =  92.365
Robust  acc:    72 /   180 =  40.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9173 /  9767 =  93.918
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  1835 /  2480 =  73.992
1, 1  acc:    72 /   180 =  40.000
------------------------------------
Average acc: 18438 / 19962 =  92.365
Robust  acc:    72 /   180 =  40.000
------------------------------------
Epoch:  50 | Train Loss: 0.000 | Train Acc: 98.366 | Val Loss: 0.001 | Val Acc: 91.916
Training:
Accuracies by groups:
0, 0  acc: 64957 / 66106 =  98.262
0, 1  acc: 16304 / 16729 =  97.460
1, 0  acc: 62140 / 63120 =  98.447
1, 1  acc: 16709 / 16815 =  99.370
--------------------------------------
Average acc: 160110 / 162770 =  98.366
Robust  acc: 16304 / 16729 =  97.460
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7942 /  8535 =  93.052
0, 1  acc:  8105 /  8276 =  97.934
1, 0  acc:  2145 /  2874 =  74.635
1, 1  acc:    69 /   182 =  37.912
------------------------------------
Average acc: 18261 / 19867 =  91.916
Robust  acc:    69 /   182 =  37.912
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.456
Robust Acc: 39.444 | Best Acc: 97.969
-------------------------------------
Training, Epoch 49:
Accuracies by groups:
0, 0  acc:  9245 /  9767 =  94.655
0, 1  acc:  7382 /  7535 =  97.969
1, 0  acc:  1758 /  2480 =  70.887
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18456 / 19962 =  92.456
Robust  acc:    71 /   180 =  39.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9245 /  9767 =  94.655
0, 1  acc:  7382 /  7535 =  97.969
1, 0  acc:  1758 /  2480 =  70.887
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18456 / 19962 =  92.456
Robust  acc:    71 /   180 =  39.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9245 /  9767 =  94.655
0, 1  acc:  7382 /  7535 =  97.969
1, 0  acc:  1758 /  2480 =  70.887
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18456 / 19962 =  92.456
Robust  acc:    71 /   180 =  39.444
------------------------------------
Epoch:  51 | Train Loss: 0.000 | Train Acc: 98.497 | Val Loss: 0.001 | Val Acc: 89.968
Training:
Accuracies by groups:
0, 0  acc: 65015 / 66108 =  98.347
0, 1  acc: 16496 / 16896 =  97.633
1, 0  acc: 62130 / 62992 =  98.632
1, 1  acc: 16682 / 16774 =  99.452
--------------------------------------
Average acc: 160323 / 162770 =  98.497
Robust  acc: 16496 / 16896 =  97.633
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7503 /  8535 =  87.909
0, 1  acc:  7879 /  8276 =  95.203
1, 0  acc:  2397 /  2874 =  83.403
1, 1  acc:    95 /   182 =  52.198
------------------------------------
Average acc: 17874 / 19867 =  89.968
Robust  acc:    95 /   182 =  52.198
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.762
Robust Acc: 52.222 | Best Acc: 95.355
-------------------------------------
Training, Epoch 50:
Accuracies by groups:
0, 0  acc:  8810 /  9767 =  90.202
0, 1  acc:  7185 /  7535 =  95.355
1, 0  acc:  2029 /  2480 =  81.815
1, 1  acc:    94 /   180 =  52.222
------------------------------------
Average acc: 18118 / 19962 =  90.762
Robust  acc:    94 /   180 =  52.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8810 /  9767 =  90.202
0, 1  acc:  7185 /  7535 =  95.355
1, 0  acc:  2029 /  2480 =  81.815
1, 1  acc:    94 /   180 =  52.222
------------------------------------
Average acc: 18118 / 19962 =  90.762
Robust  acc:    94 /   180 =  52.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8810 /  9767 =  90.202
0, 1  acc:  7185 /  7535 =  95.355
1, 0  acc:  2029 /  2480 =  81.815
1, 1  acc:    94 /   180 =  52.222
------------------------------------
Average acc: 18118 / 19962 =  90.762
Robust  acc:    94 /   180 =  52.222
------------------------------------
Epoch:  52 | Train Loss: 0.000 | Train Acc: 98.518 | Val Loss: 0.001 | Val Acc: 92.173
Training:
Accuracies by groups:
0, 0  acc: 65122 / 66215 =  98.349
0, 1  acc: 16397 / 16801 =  97.595
1, 0  acc: 62221 / 63045 =  98.693
1, 1  acc: 16617 / 16709 =  99.449
--------------------------------------
Average acc: 160357 / 162770 =  98.518
Robust  acc: 16397 / 16801 =  97.595
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7968 /  8535 =  93.357
0, 1  acc:  8108 /  8276 =  97.970
1, 0  acc:  2165 /  2874 =  75.331
1, 1  acc:    71 /   182 =  39.011
------------------------------------
Average acc: 18312 / 19867 =  92.173
Robust  acc:    71 /   182 =  39.011
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.581
Robust Acc: 39.444 | Best Acc: 98.023
-------------------------------------
Training, Epoch 51:
Accuracies by groups:
0, 0  acc:  9229 /  9767 =  94.492
0, 1  acc:  7386 /  7535 =  98.023
1, 0  acc:  1795 /  2480 =  72.379
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18481 / 19962 =  92.581
Robust  acc:    71 /   180 =  39.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9229 /  9767 =  94.492
0, 1  acc:  7386 /  7535 =  98.023
1, 0  acc:  1795 /  2480 =  72.379
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18481 / 19962 =  92.581
Robust  acc:    71 /   180 =  39.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9229 /  9767 =  94.492
0, 1  acc:  7386 /  7535 =  98.023
1, 0  acc:  1795 /  2480 =  72.379
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18481 / 19962 =  92.581
Robust  acc:    71 /   180 =  39.444
------------------------------------
Epoch:  53 | Train Loss: 0.000 | Train Acc: 98.545 | Val Loss: 0.001 | Val Acc: 91.946
Training:
Accuracies by groups:
0, 0  acc: 64955 / 66061 =  98.326
0, 1  acc: 16660 / 17020 =  97.885
1, 0  acc: 62210 / 63023 =  98.710
1, 1  acc: 16577 / 16666 =  99.466
--------------------------------------
Average acc: 160402 / 162770 =  98.545
Robust  acc: 16660 / 17020 =  97.885
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7929 /  8535 =  92.900
0, 1  acc:  8128 /  8276 =  98.212
1, 0  acc:  2147 /  2874 =  74.704
1, 1  acc:    63 /   182 =  34.615
------------------------------------
Average acc: 18267 / 19867 =  91.946
Robust  acc:    63 /   182 =  34.615
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.075
Robust Acc: 33.333 | Best Acc: 97.969
-------------------------------------
Training, Epoch 52:
Accuracies by groups:
0, 0  acc:  9201 /  9767 =  94.205
0, 1  acc:  7382 /  7535 =  97.969
1, 0  acc:  1737 /  2480 =  70.040
1, 1  acc:    60 /   180 =  33.333
------------------------------------
Average acc: 18380 / 19962 =  92.075
Robust  acc:    60 /   180 =  33.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9201 /  9767 =  94.205
0, 1  acc:  7382 /  7535 =  97.969
1, 0  acc:  1737 /  2480 =  70.040
1, 1  acc:    60 /   180 =  33.333
------------------------------------
Average acc: 18380 / 19962 =  92.075
Robust  acc:    60 /   180 =  33.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9201 /  9767 =  94.205
0, 1  acc:  7382 /  7535 =  97.969
1, 0  acc:  1737 /  2480 =  70.040
1, 1  acc:    60 /   180 =  33.333
------------------------------------
Average acc: 18380 / 19962 =  92.075
Robust  acc:    60 /   180 =  33.333
------------------------------------
Epoch:  54 | Train Loss: 0.000 | Train Acc: 98.623 | Val Loss: 0.001 | Val Acc: 89.254
Training:
Accuracies by groups:
0, 0  acc: 64639 / 65636 =  98.481
0, 1  acc: 16741 / 17115 =  97.815
1, 0  acc: 62635 / 63420 =  98.762
1, 1  acc: 16514 / 16599 =  99.488
--------------------------------------
Average acc: 160529 / 162770 =  98.623
Robust  acc: 16741 / 17115 =  97.815
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7267 /  8535 =  85.144
0, 1  acc:  7805 /  8276 =  94.309
1, 0  acc:  2555 /  2874 =  88.900
1, 1  acc:   105 /   182 =  57.692
------------------------------------
Average acc: 17732 / 19867 =  89.254
Robust  acc:   105 /   182 =  57.692
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.362
Robust Acc: 62.222 | Best Acc: 94.386
-------------------------------------
Training, Epoch 53:
Accuracies by groups:
0, 0  acc:  8642 /  9767 =  88.482
0, 1  acc:  7112 /  7535 =  94.386
1, 0  acc:  2172 /  2480 =  87.581
1, 1  acc:   112 /   180 =  62.222
------------------------------------
Average acc: 18038 / 19962 =  90.362
Robust  acc:   112 /   180 =  62.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8642 /  9767 =  88.482
0, 1  acc:  7112 /  7535 =  94.386
1, 0  acc:  2172 /  2480 =  87.581
1, 1  acc:   112 /   180 =  62.222
------------------------------------
Average acc: 18038 / 19962 =  90.362
Robust  acc:   112 /   180 =  62.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8642 /  9767 =  88.482
0, 1  acc:  7112 /  7535 =  94.386
1, 0  acc:  2172 /  2480 =  87.581
1, 1  acc:   112 /   180 =  62.222
------------------------------------
Average acc: 18038 / 19962 =  90.362
Robust  acc:   112 /   180 =  62.222
------------------------------------
Epoch:  55 | Train Loss: 0.000 | Train Acc: 98.709 | Val Loss: 0.001 | Val Acc: 90.396
Training:
Accuracies by groups:
0, 0  acc: 65256 / 66208 =  98.562
0, 1  acc: 16693 / 17044 =  97.941
1, 0  acc: 62121 / 62836 =  98.862
1, 1  acc: 16598 / 16682 =  99.496
--------------------------------------
Average acc: 160668 / 162770 =  98.709
Robust  acc: 16693 / 17044 =  97.941
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7566 /  8535 =  88.647
0, 1  acc:  7934 /  8276 =  95.868
1, 0  acc:  2363 /  2874 =  82.220
1, 1  acc:    96 /   182 =  52.747
------------------------------------
Average acc: 17959 / 19867 =  90.396
Robust  acc:    96 /   182 =  52.747
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.258
Robust Acc: 50.000 | Best Acc: 95.713
-------------------------------------
Training, Epoch 54:
Accuracies by groups:
0, 0  acc:  8928 /  9767 =  91.410
0, 1  acc:  7212 /  7535 =  95.713
1, 0  acc:  1987 /  2480 =  80.121
1, 1  acc:    90 /   180 =  50.000
------------------------------------
Average acc: 18217 / 19962 =  91.258
Robust  acc:    90 /   180 =  50.000
------------------------------------
Accuracies by groups:
0, 0  acc:  8928 /  9767 =  91.410
0, 1  acc:  7212 /  7535 =  95.713
1, 0  acc:  1987 /  2480 =  80.121
1, 1  acc:    90 /   180 =  50.000
------------------------------------
Average acc: 18217 / 19962 =  91.258
Robust  acc:    90 /   180 =  50.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8928 /  9767 =  91.410
0, 1  acc:  7212 /  7535 =  95.713
1, 0  acc:  1987 /  2480 =  80.121
1, 1  acc:    90 /   180 =  50.000
------------------------------------
Average acc: 18217 / 19962 =  91.258
Robust  acc:    90 /   180 =  50.000
------------------------------------
Epoch:  56 | Train Loss: 0.000 | Train Acc: 98.778 | Val Loss: 0.002 | Val Acc: 86.923
Training:
Accuracies by groups:
0, 0  acc: 65372 / 66296 =  98.606
0, 1  acc: 16598 / 16926 =  98.062
1, 0  acc: 62129 / 62815 =  98.908
1, 1  acc: 16682 / 16733 =  99.695
--------------------------------------
Average acc: 160781 / 162770 =  98.778
Robust  acc: 16598 / 16926 =  98.062
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6966 /  8535 =  81.617
0, 1  acc:  7614 /  8276 =  92.001
1, 0  acc:  2566 /  2874 =  89.283
1, 1  acc:   123 /   182 =  67.582
------------------------------------
Average acc: 17269 / 19867 =  86.923
Robust  acc:   123 /   182 =  67.582
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 87.772
Robust Acc: 66.667 | Best Acc: 91.493
-------------------------------------
Training, Epoch 55:
Accuracies by groups:
0, 0  acc:  8326 /  9767 =  85.246
0, 1  acc:  6894 /  7535 =  91.493
1, 0  acc:  2181 /  2480 =  87.944
1, 1  acc:   120 /   180 =  66.667
------------------------------------
Average acc: 17521 / 19962 =  87.772
Robust  acc:   120 /   180 =  66.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8326 /  9767 =  85.246
0, 1  acc:  6894 /  7535 =  91.493
1, 0  acc:  2181 /  2480 =  87.944
1, 1  acc:   120 /   180 =  66.667
------------------------------------
Average acc: 17521 / 19962 =  87.772
Robust  acc:   120 /   180 =  66.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8326 /  9767 =  85.246
0, 1  acc:  6894 /  7535 =  91.493
1, 0  acc:  2181 /  2480 =  87.944
1, 1  acc:   120 /   180 =  66.667
------------------------------------
Average acc: 17521 / 19962 =  87.772
Robust  acc:   120 /   180 =  66.667
------------------------------------
Epoch:  57 | Train Loss: 0.000 | Train Acc: 98.787 | Val Loss: 0.001 | Val Acc: 91.207
Training:
Accuracies by groups:
0, 0  acc: 64913 / 65807 =  98.641
0, 1  acc: 16847 / 17199 =  97.953
1, 0  acc: 62441 / 63100 =  98.956
1, 1  acc: 16595 / 16664 =  99.586
--------------------------------------
Average acc: 160796 / 162770 =  98.787
Robust  acc: 16847 / 17199 =  97.953
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7625 /  8535 =  89.338
0, 1  acc:  8028 /  8276 =  97.003
1, 0  acc:  2380 /  2874 =  82.811
1, 1  acc:    87 /   182 =  47.802
------------------------------------
Average acc: 18120 / 19867 =  91.207
Robust  acc:    87 /   182 =  47.802
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.829
Robust Acc: 50.556 | Best Acc: 96.841
-------------------------------------
Training, Epoch 56:
Accuracies by groups:
0, 0  acc:  8957 /  9767 =  91.707
0, 1  acc:  7297 /  7535 =  96.841
1, 0  acc:  1986 /  2480 =  80.081
1, 1  acc:    91 /   180 =  50.556
------------------------------------
Average acc: 18331 / 19962 =  91.829
Robust  acc:    91 /   180 =  50.556
------------------------------------
Accuracies by groups:
0, 0  acc:  8957 /  9767 =  91.707
0, 1  acc:  7297 /  7535 =  96.841
1, 0  acc:  1986 /  2480 =  80.081
1, 1  acc:    91 /   180 =  50.556
------------------------------------
Average acc: 18331 / 19962 =  91.829
Robust  acc:    91 /   180 =  50.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8957 /  9767 =  91.707
0, 1  acc:  7297 /  7535 =  96.841
1, 0  acc:  1986 /  2480 =  80.081
1, 1  acc:    91 /   180 =  50.556
------------------------------------
Average acc: 18331 / 19962 =  91.829
Robust  acc:    91 /   180 =  50.556
------------------------------------
Epoch:  58 | Train Loss: 0.000 | Train Acc: 98.819 | Val Loss: 0.001 | Val Acc: 90.572
Training:
Accuracies by groups:
0, 0  acc: 65280 / 66158 =  98.673
0, 1  acc: 16586 / 16923 =  98.009
1, 0  acc: 62342 / 62974 =  98.996
1, 1  acc: 16640 / 16715 =  99.551
--------------------------------------
Average acc: 160848 / 162770 =  98.819
Robust  acc: 16586 / 16923 =  98.009
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7717 /  8535 =  90.416
0, 1  acc:  7979 /  8276 =  96.411
1, 0  acc:  2222 /  2874 =  77.314
1, 1  acc:    76 /   182 =  41.758
------------------------------------
Average acc: 17994 / 19867 =  90.572
Robust  acc:    76 /   182 =  41.758
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.053
Robust Acc: 42.778 | Best Acc: 96.364
-------------------------------------
Training, Epoch 57:
Accuracies by groups:
0, 0  acc:  8989 /  9767 =  92.034
0, 1  acc:  7261 /  7535 =  96.364
1, 0  acc:  1849 /  2480 =  74.556
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18176 / 19962 =  91.053
Robust  acc:    77 /   180 =  42.778
------------------------------------
Accuracies by groups:
0, 0  acc:  8989 /  9767 =  92.034
0, 1  acc:  7261 /  7535 =  96.364
1, 0  acc:  1849 /  2480 =  74.556
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18176 / 19962 =  91.053
Robust  acc:    77 /   180 =  42.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8989 /  9767 =  92.034
0, 1  acc:  7261 /  7535 =  96.364
1, 0  acc:  1849 /  2480 =  74.556
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18176 / 19962 =  91.053
Robust  acc:    77 /   180 =  42.778
------------------------------------
Epoch:  59 | Train Loss: 0.000 | Train Acc: 98.867 | Val Loss: 0.001 | Val Acc: 90.029
Training:
Accuracies by groups:
0, 0  acc: 65286 / 66146 =  98.700
0, 1  acc: 16571 / 16916 =  97.961
1, 0  acc: 62491 / 63073 =  99.077
1, 1  acc: 16578 / 16635 =  99.657
--------------------------------------
Average acc: 160926 / 162770 =  98.867
Robust  acc: 16571 / 16916 =  97.961
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7386 /  8535 =  86.538
0, 1  acc:  7883 /  8276 =  95.251
1, 0  acc:  2512 /  2874 =  87.404
1, 1  acc:   105 /   182 =  57.692
------------------------------------
Average acc: 17886 / 19867 =  90.029
Robust  acc:   105 /   182 =  57.692
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.672
Robust Acc: 60.000 | Best Acc: 95.116
-------------------------------------
Training, Epoch 58:
Accuracies by groups:
0, 0  acc:  8698 /  9767 =  89.055
0, 1  acc:  7167 /  7535 =  95.116
1, 0  acc:  2127 /  2480 =  85.766
1, 1  acc:   108 /   180 =  60.000
------------------------------------
Average acc: 18100 / 19962 =  90.672
Robust  acc:   108 /   180 =  60.000
------------------------------------
Accuracies by groups:
0, 0  acc:  8698 /  9767 =  89.055
0, 1  acc:  7167 /  7535 =  95.116
1, 0  acc:  2127 /  2480 =  85.766
1, 1  acc:   108 /   180 =  60.000
------------------------------------
Average acc: 18100 / 19962 =  90.672
Robust  acc:   108 /   180 =  60.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8698 /  9767 =  89.055
0, 1  acc:  7167 /  7535 =  95.116
1, 0  acc:  2127 /  2480 =  85.766
1, 1  acc:   108 /   180 =  60.000
------------------------------------
Average acc: 18100 / 19962 =  90.672
Robust  acc:   108 /   180 =  60.000
------------------------------------
Epoch:  60 | Train Loss: 0.000 | Train Acc: 98.878 | Val Loss: 0.001 | Val Acc: 92.002
Training:
Accuracies by groups:
0, 0  acc: 65102 / 65969 =  98.686
0, 1  acc: 16523 / 16806 =  98.316
1, 0  acc: 62561 / 63166 =  99.042
1, 1  acc: 16757 / 16829 =  99.572
--------------------------------------
Average acc: 160943 / 162770 =  98.878
Robust  acc: 16523 / 16806 =  98.316
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7844 /  8535 =  91.904
0, 1  acc:  8088 /  8276 =  97.728
1, 0  acc:  2266 /  2874 =  78.845
1, 1  acc:    80 /   182 =  43.956
------------------------------------
Average acc: 18278 / 19867 =  92.002
Robust  acc:    80 /   182 =  43.956
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.541
Robust Acc: 41.667 | Best Acc: 97.797
-------------------------------------
Training, Epoch 59:
Accuracies by groups:
0, 0  acc:  9134 /  9767 =  93.519
0, 1  acc:  7369 /  7535 =  97.797
1, 0  acc:  1895 /  2480 =  76.411
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18473 / 19962 =  92.541
Robust  acc:    75 /   180 =  41.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9134 /  9767 =  93.519
0, 1  acc:  7369 /  7535 =  97.797
1, 0  acc:  1895 /  2480 =  76.411
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18473 / 19962 =  92.541
Robust  acc:    75 /   180 =  41.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9134 /  9767 =  93.519
0, 1  acc:  7369 /  7535 =  97.797
1, 0  acc:  1895 /  2480 =  76.411
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18473 / 19962 =  92.541
Robust  acc:    75 /   180 =  41.667
------------------------------------
Epoch:  61 | Train Loss: 0.000 | Train Acc: 98.956 | Val Loss: 0.001 | Val Acc: 92.334
Training:
Accuracies by groups:
0, 0  acc: 65323 / 66130 =  98.780
0, 1  acc: 16537 / 16825 =  98.288
1, 0  acc: 62420 / 62969 =  99.128
1, 1  acc: 16790 / 16846 =  99.668
--------------------------------------
Average acc: 161070 / 162770 =  98.956
Robust  acc: 16537 / 16825 =  98.288
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8079 /  8535 =  94.657
0, 1  acc:  8166 /  8276 =  98.671
1, 0  acc:  2045 /  2874 =  71.155
1, 1  acc:    54 /   182 =  29.670
------------------------------------
Average acc: 18344 / 19867 =  92.334
Robust  acc:    54 /   182 =  29.670
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.731
Robust Acc: 33.889 | Best Acc: 98.567
-------------------------------------
Training, Epoch 60:
Accuracies by groups:
0, 0  acc:  9352 /  9767 =  95.751
0, 1  acc:  7427 /  7535 =  98.567
1, 0  acc:  1671 /  2480 =  67.379
1, 1  acc:    61 /   180 =  33.889
------------------------------------
Average acc: 18511 / 19962 =  92.731
Robust  acc:    61 /   180 =  33.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9352 /  9767 =  95.751
0, 1  acc:  7427 /  7535 =  98.567
1, 0  acc:  1671 /  2480 =  67.379
1, 1  acc:    61 /   180 =  33.889
------------------------------------
Average acc: 18511 / 19962 =  92.731
Robust  acc:    61 /   180 =  33.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9352 /  9767 =  95.751
0, 1  acc:  7427 /  7535 =  98.567
1, 0  acc:  1671 /  2480 =  67.379
1, 1  acc:    61 /   180 =  33.889
------------------------------------
Average acc: 18511 / 19962 =  92.731
Robust  acc:    61 /   180 =  33.889
------------------------------------
Epoch:  62 | Train Loss: 0.000 | Train Acc: 99.021 | Val Loss: 0.001 | Val Acc: 91.514
Training:
Accuracies by groups:
0, 0  acc: 65367 / 66127 =  98.851
0, 1  acc: 16484 / 16767 =  98.312
1, 0  acc: 62696 / 63197 =  99.207
1, 1  acc: 16629 / 16679 =  99.700
--------------------------------------
Average acc: 161176 / 162770 =  99.021
Robust  acc: 16484 / 16767 =  98.312
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7706 /  8535 =  90.287
0, 1  acc:  8032 /  8276 =  97.052
1, 0  acc:  2365 /  2874 =  82.289
1, 1  acc:    78 /   182 =  42.857
------------------------------------
Average acc: 18181 / 19867 =  91.514
Robust  acc:    78 /   182 =  42.857
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.310
Robust Acc: 48.889 | Best Acc: 97.094
-------------------------------------
Training, Epoch 61:
Accuracies by groups:
0, 0  acc:  9019 /  9767 =  92.342
0, 1  acc:  7316 /  7535 =  97.094
1, 0  acc:  2004 /  2480 =  80.806
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18427 / 19962 =  92.310
Robust  acc:    88 /   180 =  48.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9019 /  9767 =  92.342
0, 1  acc:  7316 /  7535 =  97.094
1, 0  acc:  2004 /  2480 =  80.806
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18427 / 19962 =  92.310
Robust  acc:    88 /   180 =  48.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9019 /  9767 =  92.342
0, 1  acc:  7316 /  7535 =  97.094
1, 0  acc:  2004 /  2480 =  80.806
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18427 / 19962 =  92.310
Robust  acc:    88 /   180 =  48.889
------------------------------------
Epoch:  63 | Train Loss: 0.000 | Train Acc: 99.026 | Val Loss: 0.001 | Val Acc: 91.483
Training:
Accuracies by groups:
0, 0  acc: 65606 / 66379 =  98.835
0, 1  acc: 16506 / 16772 =  98.414
1, 0  acc: 62347 / 62852 =  99.197
1, 1  acc: 16726 / 16767 =  99.755
--------------------------------------
Average acc: 161185 / 162770 =  99.026
Robust  acc: 16506 / 16772 =  98.414
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7692 /  8535 =  90.123
0, 1  acc:  7991 /  8276 =  96.556
1, 0  acc:  2394 /  2874 =  83.299
1, 1  acc:    98 /   182 =  53.846
------------------------------------
Average acc: 18175 / 19867 =  91.483
Robust  acc:    98 /   182 =  53.846
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.280
Robust Acc: 51.111 | Best Acc: 96.642
-------------------------------------
Training, Epoch 62:
Accuracies by groups:
0, 0  acc:  8990 /  9767 =  92.045
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  2057 /  2480 =  82.944
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18421 / 19962 =  92.280
Robust  acc:    92 /   180 =  51.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8990 /  9767 =  92.045
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  2057 /  2480 =  82.944
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18421 / 19962 =  92.280
Robust  acc:    92 /   180 =  51.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8990 /  9767 =  92.045
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  2057 /  2480 =  82.944
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18421 / 19962 =  92.280
Robust  acc:    92 /   180 =  51.111
------------------------------------
Epoch:  64 | Train Loss: 0.000 | Train Acc: 99.096 | Val Loss: 0.001 | Val Acc: 91.599
Training:
Accuracies by groups:
0, 0  acc: 65428 / 66101 =  98.982
0, 1  acc: 16692 / 16966 =  98.385
1, 0  acc: 62635 / 63116 =  99.238
1, 1  acc: 16544 / 16587 =  99.741
--------------------------------------
Average acc: 161299 / 162770 =  99.096
Robust  acc: 16692 / 16966 =  98.385
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7704 /  8535 =  90.264
0, 1  acc:  8020 /  8276 =  96.907
1, 0  acc:  2389 /  2874 =  83.125
1, 1  acc:    85 /   182 =  46.703
------------------------------------
Average acc: 18198 / 19867 =  91.599
Robust  acc:    85 /   182 =  46.703
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.335
Robust Acc: 50.000 | Best Acc: 96.894
-------------------------------------
Training, Epoch 63:
Accuracies by groups:
0, 0  acc:  9024 /  9767 =  92.393
0, 1  acc:  7301 /  7535 =  96.894
1, 0  acc:  2017 /  2480 =  81.331
1, 1  acc:    90 /   180 =  50.000
------------------------------------
Average acc: 18432 / 19962 =  92.335
Robust  acc:    90 /   180 =  50.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9024 /  9767 =  92.393
0, 1  acc:  7301 /  7535 =  96.894
1, 0  acc:  2017 /  2480 =  81.331
1, 1  acc:    90 /   180 =  50.000
------------------------------------
Average acc: 18432 / 19962 =  92.335
Robust  acc:    90 /   180 =  50.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9024 /  9767 =  92.393
0, 1  acc:  7301 /  7535 =  96.894
1, 0  acc:  2017 /  2480 =  81.331
1, 1  acc:    90 /   180 =  50.000
------------------------------------
Average acc: 18432 / 19962 =  92.335
Robust  acc:    90 /   180 =  50.000
------------------------------------
Epoch:  65 | Train Loss: 0.000 | Train Acc: 99.100 | Val Loss: 0.001 | Val Acc: 92.243
Training:
Accuracies by groups:
0, 0  acc: 65215 / 65937 =  98.905
0, 1  acc: 16463 / 16704 =  98.557
1, 0  acc: 62922 / 63387 =  99.266
1, 1  acc: 16705 / 16742 =  99.779
--------------------------------------
Average acc: 161305 / 162770 =  99.100
Robust  acc: 16463 / 16704 =  98.557
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7915 /  8535 =  92.736
0, 1  acc:  8105 /  8276 =  97.934
1, 0  acc:  2234 /  2874 =  77.731
1, 1  acc:    72 /   182 =  39.560
------------------------------------
Average acc: 18326 / 19867 =  92.243
Robust  acc:    72 /   182 =  39.560
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.741
Robust Acc: 45.556 | Best Acc: 97.903
-------------------------------------
Training, Epoch 64:
Accuracies by groups:
0, 0  acc:  9193 /  9767 =  94.123
0, 1  acc:  7377 /  7535 =  97.903
1, 0  acc:  1861 /  2480 =  75.040
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18513 / 19962 =  92.741
Robust  acc:    82 /   180 =  45.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9193 /  9767 =  94.123
0, 1  acc:  7377 /  7535 =  97.903
1, 0  acc:  1861 /  2480 =  75.040
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18513 / 19962 =  92.741
Robust  acc:    82 /   180 =  45.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9193 /  9767 =  94.123
0, 1  acc:  7377 /  7535 =  97.903
1, 0  acc:  1861 /  2480 =  75.040
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18513 / 19962 =  92.741
Robust  acc:    82 /   180 =  45.556
------------------------------------
Epoch:  66 | Train Loss: 0.000 | Train Acc: 99.201 | Val Loss: 0.001 | Val Acc: 90.915
Training:
Accuracies by groups:
0, 0  acc: 65468 / 66073 =  99.084
0, 1  acc: 16752 / 17028 =  98.379
1, 0  acc: 62623 / 63000 =  99.402
1, 1  acc: 16627 / 16669 =  99.748
--------------------------------------
Average acc: 161470 / 162770 =  99.201
Robust  acc: 16752 / 17028 =  98.379
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7517 /  8535 =  88.073
0, 1  acc:  7982 /  8276 =  96.448
1, 0  acc:  2469 /  2874 =  85.908
1, 1  acc:    94 /   182 =  51.648
------------------------------------
Average acc: 18062 / 19867 =  90.915
Robust  acc:    94 /   182 =  51.648
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.734
Robust Acc: 51.111 | Best Acc: 96.403
-------------------------------------
Training, Epoch 65:
Accuracies by groups:
0, 0  acc:  8864 /  9767 =  90.755
0, 1  acc:  7264 /  7535 =  96.403
1, 0  acc:  2092 /  2480 =  84.355
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18312 / 19962 =  91.734
Robust  acc:    92 /   180 =  51.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8864 /  9767 =  90.755
0, 1  acc:  7264 /  7535 =  96.403
1, 0  acc:  2092 /  2480 =  84.355
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18312 / 19962 =  91.734
Robust  acc:    92 /   180 =  51.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8864 /  9767 =  90.755
0, 1  acc:  7264 /  7535 =  96.403
1, 0  acc:  2092 /  2480 =  84.355
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18312 / 19962 =  91.734
Robust  acc:    92 /   180 =  51.111
------------------------------------
Epoch:  67 | Train Loss: 0.000 | Train Acc: 99.162 | Val Loss: 0.001 | Val Acc: 91.931
Training:
Accuracies by groups:
0, 0  acc: 65684 / 66372 =  98.963
0, 1  acc: 16571 / 16795 =  98.666
1, 0  acc: 62507 / 62911 =  99.358
1, 1  acc: 16644 / 16692 =  99.712
--------------------------------------
Average acc: 161406 / 162770 =  99.162
Robust  acc: 16571 / 16795 =  98.666
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7813 /  8535 =  91.541
0, 1  acc:  8088 /  8276 =  97.728
1, 0  acc:  2282 /  2874 =  79.402
1, 1  acc:    81 /   182 =  44.505
------------------------------------
Average acc: 18264 / 19867 =  91.931
Robust  acc:    81 /   182 =  44.505
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.541
Robust Acc: 43.889 | Best Acc: 97.704
-------------------------------------
Training, Epoch 66:
Accuracies by groups:
0, 0  acc:  9130 /  9767 =  93.478
0, 1  acc:  7362 /  7535 =  97.704
1, 0  acc:  1902 /  2480 =  76.694
1, 1  acc:    79 /   180 =  43.889
------------------------------------
Average acc: 18473 / 19962 =  92.541
Robust  acc:    79 /   180 =  43.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9130 /  9767 =  93.478
0, 1  acc:  7362 /  7535 =  97.704
1, 0  acc:  1902 /  2480 =  76.694
1, 1  acc:    79 /   180 =  43.889
------------------------------------
Average acc: 18473 / 19962 =  92.541
Robust  acc:    79 /   180 =  43.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9130 /  9767 =  93.478
0, 1  acc:  7362 /  7535 =  97.704
1, 0  acc:  1902 /  2480 =  76.694
1, 1  acc:    79 /   180 =  43.889
------------------------------------
Average acc: 18473 / 19962 =  92.541
Robust  acc:    79 /   180 =  43.889
------------------------------------
Epoch:  68 | Train Loss: 0.000 | Train Acc: 99.255 | Val Loss: 0.001 | Val Acc: 91.272
Training:
Accuracies by groups:
0, 0  acc: 65899 / 66483 =  99.122
0, 1  acc: 16593 / 16815 =  98.680
1, 0  acc: 62322 / 62693 =  99.408
1, 1  acc: 16743 / 16779 =  99.785
--------------------------------------
Average acc: 161557 / 162770 =  99.255
Robust  acc: 16593 / 16815 =  98.680
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7619 /  8535 =  89.268
0, 1  acc:  8034 /  8276 =  97.076
1, 0  acc:  2394 /  2874 =  83.299
1, 1  acc:    86 /   182 =  47.253
------------------------------------
Average acc: 18133 / 19867 =  91.272
Robust  acc:    86 /   182 =  47.253
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.020
Robust Acc: 48.889 | Best Acc: 96.987
-------------------------------------
Training, Epoch 67:
Accuracies by groups:
0, 0  acc:  8938 /  9767 =  91.512
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  2035 /  2480 =  82.056
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18369 / 19962 =  92.020
Robust  acc:    88 /   180 =  48.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8938 /  9767 =  91.512
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  2035 /  2480 =  82.056
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18369 / 19962 =  92.020
Robust  acc:    88 /   180 =  48.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8938 /  9767 =  91.512
0, 1  acc:  7308 /  7535 =  96.987
1, 0  acc:  2035 /  2480 =  82.056
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18369 / 19962 =  92.020
Robust  acc:    88 /   180 =  48.889
------------------------------------
Epoch:  69 | Train Loss: 0.000 | Train Acc: 99.270 | Val Loss: 0.001 | Val Acc: 92.319
Training:
Accuracies by groups:
0, 0  acc: 65313 / 65885 =  99.132
0, 1  acc: 16552 / 16771 =  98.694
1, 0  acc: 63038 / 63408 =  99.416
1, 1  acc: 16679 / 16706 =  99.838
--------------------------------------
Average acc: 161582 / 162770 =  99.270
Robust  acc: 16552 / 16771 =  98.694
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7865 /  8535 =  92.150
0, 1  acc:  8102 /  8276 =  97.898
1, 0  acc:  2298 /  2874 =  79.958
1, 1  acc:    76 /   182 =  41.758
------------------------------------
Average acc: 18341 / 19867 =  92.319
Robust  acc:    76 /   182 =  41.758
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.836
Robust Acc: 44.444 | Best Acc: 97.823
-------------------------------------
Training, Epoch 68:
Accuracies by groups:
0, 0  acc:  9176 /  9767 =  93.949
0, 1  acc:  7371 /  7535 =  97.823
1, 0  acc:  1905 /  2480 =  76.815
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18532 / 19962 =  92.836
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9176 /  9767 =  93.949
0, 1  acc:  7371 /  7535 =  97.823
1, 0  acc:  1905 /  2480 =  76.815
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18532 / 19962 =  92.836
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9176 /  9767 =  93.949
0, 1  acc:  7371 /  7535 =  97.823
1, 0  acc:  1905 /  2480 =  76.815
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18532 / 19962 =  92.836
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  70 | Train Loss: 0.000 | Train Acc: 99.325 | Val Loss: 0.001 | Val Acc: 92.027
Training:
Accuracies by groups:
0, 0  acc: 65267 / 65837 =  99.134
0, 1  acc: 16652 / 16849 =  98.831
1, 0  acc: 63084 / 63386 =  99.524
1, 1  acc: 16669 / 16698 =  99.826
--------------------------------------
Average acc: 161672 / 162770 =  99.325
Robust  acc: 16652 / 16849 =  98.831
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7813 /  8535 =  91.541
0, 1  acc:  8057 /  8276 =  97.354
1, 0  acc:  2327 /  2874 =  80.967
1, 1  acc:    86 /   182 =  47.253
------------------------------------
Average acc: 18283 / 19867 =  92.027
Robust  acc:    86 /   182 =  47.253
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.621
Robust Acc: 48.889 | Best Acc: 97.306
-------------------------------------
Training, Epoch 69:
Accuracies by groups:
0, 0  acc:  9104 /  9767 =  93.212
0, 1  acc:  7332 /  7535 =  97.306
1, 0  acc:  1965 /  2480 =  79.234
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18489 / 19962 =  92.621
Robust  acc:    88 /   180 =  48.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9104 /  9767 =  93.212
0, 1  acc:  7332 /  7535 =  97.306
1, 0  acc:  1965 /  2480 =  79.234
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18489 / 19962 =  92.621
Robust  acc:    88 /   180 =  48.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9104 /  9767 =  93.212
0, 1  acc:  7332 /  7535 =  97.306
1, 0  acc:  1965 /  2480 =  79.234
1, 1  acc:    88 /   180 =  48.889
------------------------------------
Average acc: 18489 / 19962 =  92.621
Robust  acc:    88 /   180 =  48.889
------------------------------------
Epoch:  71 | Train Loss: 0.000 | Train Acc: 99.319 | Val Loss: 0.001 | Val Acc: 92.389
Training:
Accuracies by groups:
0, 0  acc: 65990 / 66547 =  99.163
0, 1  acc: 16614 / 16816 =  98.799
1, 0  acc: 62401 / 62718 =  99.495
1, 1  acc: 16656 / 16689 =  99.802
--------------------------------------
Average acc: 161661 / 162770 =  99.319
Robust  acc: 16614 / 16816 =  98.799
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7907 /  8535 =  92.642
0, 1  acc:  8111 /  8276 =  98.006
1, 0  acc:  2262 /  2874 =  78.706
1, 1  acc:    75 /   182 =  41.209
------------------------------------
Average acc: 18355 / 19867 =  92.389
Robust  acc:    75 /   182 =  41.209
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.881
Robust Acc: 43.333 | Best Acc: 97.983
-------------------------------------
Training, Epoch 70:
Accuracies by groups:
0, 0  acc:  9200 /  9767 =  94.195
0, 1  acc:  7383 /  7535 =  97.983
1, 0  acc:  1880 /  2480 =  75.806
1, 1  acc:    78 /   180 =  43.333
------------------------------------
Average acc: 18541 / 19962 =  92.881
Robust  acc:    78 /   180 =  43.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9200 /  9767 =  94.195
0, 1  acc:  7383 /  7535 =  97.983
1, 0  acc:  1880 /  2480 =  75.806
1, 1  acc:    78 /   180 =  43.333
------------------------------------
Average acc: 18541 / 19962 =  92.881
Robust  acc:    78 /   180 =  43.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9200 /  9767 =  94.195
0, 1  acc:  7383 /  7535 =  97.983
1, 0  acc:  1880 /  2480 =  75.806
1, 1  acc:    78 /   180 =  43.333
------------------------------------
Average acc: 18541 / 19962 =  92.881
Robust  acc:    78 /   180 =  43.333
------------------------------------
Epoch:  72 | Train Loss: 0.000 | Train Acc: 99.344 | Val Loss: 0.001 | Val Acc: 92.359
Training:
Accuracies by groups:
0, 0  acc: 65784 / 66324 =  99.186
0, 1  acc: 16728 / 16919 =  98.871
1, 0  acc: 62602 / 62905 =  99.518
1, 1  acc: 16589 / 16622 =  99.801
--------------------------------------
Average acc: 161703 / 162770 =  99.344
Robust  acc: 16728 / 16919 =  98.871
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7874 /  8535 =  92.255
0, 1  acc:  8113 /  8276 =  98.030
1, 0  acc:  2289 /  2874 =  79.645
1, 1  acc:    73 /   182 =  40.110
------------------------------------
Average acc: 18349 / 19867 =  92.359
Robust  acc:    73 /   182 =  40.110
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.002
Robust Acc: 43.889 | Best Acc: 97.916
-------------------------------------
Training, Epoch 71:
Accuracies by groups:
0, 0  acc:  9172 /  9767 =  93.908
0, 1  acc:  7378 /  7535 =  97.916
1, 0  acc:  1936 /  2480 =  78.065
1, 1  acc:    79 /   180 =  43.889
------------------------------------
Average acc: 18565 / 19962 =  93.002
Robust  acc:    79 /   180 =  43.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9172 /  9767 =  93.908
0, 1  acc:  7378 /  7535 =  97.916
1, 0  acc:  1936 /  2480 =  78.065
1, 1  acc:    79 /   180 =  43.889
------------------------------------
Average acc: 18565 / 19962 =  93.002
Robust  acc:    79 /   180 =  43.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9172 /  9767 =  93.908
0, 1  acc:  7378 /  7535 =  97.916
1, 0  acc:  1936 /  2480 =  78.065
1, 1  acc:    79 /   180 =  43.889
------------------------------------
Average acc: 18565 / 19962 =  93.002
Robust  acc:    79 /   180 =  43.889
------------------------------------
Epoch:  73 | Train Loss: 0.000 | Train Acc: 99.424 | Val Loss: 0.001 | Val Acc: 91.498
Training:
Accuracies by groups:
0, 0  acc: 65347 / 65811 =  99.295
0, 1  acc: 16735 / 16909 =  98.971
1, 0  acc: 63138 / 63417 =  99.560
1, 1  acc: 16612 / 16633 =  99.874
--------------------------------------
Average acc: 161832 / 162770 =  99.424
Robust  acc: 16735 / 16909 =  98.971
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7713 /  8535 =  90.369
0, 1  acc:  8041 /  8276 =  97.160
1, 0  acc:  2342 /  2874 =  81.489
1, 1  acc:    82 /   182 =  45.055
------------------------------------
Average acc: 18178 / 19867 =  91.498
Robust  acc:    82 /   182 =  45.055
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.000
Robust Acc: 49.444 | Best Acc: 96.961
-------------------------------------
Training, Epoch 72:
Accuracies by groups:
0, 0  acc:  9007 /  9767 =  92.219
0, 1  acc:  7306 /  7535 =  96.961
1, 0  acc:  1963 /  2480 =  79.153
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18365 / 19962 =  92.000
Robust  acc:    89 /   180 =  49.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9007 /  9767 =  92.219
0, 1  acc:  7306 /  7535 =  96.961
1, 0  acc:  1963 /  2480 =  79.153
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18365 / 19962 =  92.000
Robust  acc:    89 /   180 =  49.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9007 /  9767 =  92.219
0, 1  acc:  7306 /  7535 =  96.961
1, 0  acc:  1963 /  2480 =  79.153
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18365 / 19962 =  92.000
Robust  acc:    89 /   180 =  49.444
------------------------------------
Epoch:  74 | Train Loss: 0.000 | Train Acc: 99.431 | Val Loss: 0.001 | Val Acc: 92.309
Training:
Accuracies by groups:
0, 0  acc: 65882 / 66350 =  99.295
0, 1  acc: 16685 / 16854 =  98.997
1, 0  acc: 62616 / 62887 =  99.569
1, 1  acc: 16661 / 16679 =  99.892
--------------------------------------
Average acc: 161844 / 162770 =  99.431
Robust  acc: 16685 / 16854 =  98.997
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7829 /  8535 =  91.728
0, 1  acc:  8091 /  8276 =  97.765
1, 0  acc:  2342 /  2874 =  81.489
1, 1  acc:    77 /   182 =  42.308
------------------------------------
Average acc: 18339 / 19867 =  92.309
Robust  acc:    77 /   182 =  42.308
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.967
Robust Acc: 46.667 | Best Acc: 97.810
-------------------------------------
Training, Epoch 73:
Accuracies by groups:
0, 0  acc:  9127 /  9767 =  93.447
0, 1  acc:  7370 /  7535 =  97.810
1, 0  acc:  1977 /  2480 =  79.718
1, 1  acc:    84 /   180 =  46.667
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    84 /   180 =  46.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9127 /  9767 =  93.447
0, 1  acc:  7370 /  7535 =  97.810
1, 0  acc:  1977 /  2480 =  79.718
1, 1  acc:    84 /   180 =  46.667
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    84 /   180 =  46.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9127 /  9767 =  93.447
0, 1  acc:  7370 /  7535 =  97.810
1, 0  acc:  1977 /  2480 =  79.718
1, 1  acc:    84 /   180 =  46.667
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    84 /   180 =  46.667
------------------------------------
Epoch:  75 | Train Loss: 0.000 | Train Acc: 99.454 | Val Loss: 0.001 | Val Acc: 92.339
Training:
Accuracies by groups:
0, 0  acc: 66376 / 66860 =  99.276
0, 1  acc: 16671 / 16833 =  99.038
1, 0  acc: 62085 / 62310 =  99.639
1, 1  acc: 16749 / 16767 =  99.893
--------------------------------------
Average acc: 161881 / 162770 =  99.454
Robust  acc: 16671 / 16833 =  99.038
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7869 /  8535 =  92.197
0, 1  acc:  8096 /  8276 =  97.825
1, 0  acc:  2301 /  2874 =  80.063
1, 1  acc:    79 /   182 =  43.407
------------------------------------
Average acc: 18345 / 19867 =  92.339
Robust  acc:    79 /   182 =  43.407
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.897
Robust Acc: 42.222 | Best Acc: 97.863
-------------------------------------
Training, Epoch 74:
Accuracies by groups:
0, 0  acc:  9160 /  9767 =  93.785
0, 1  acc:  7374 /  7535 =  97.863
1, 0  acc:  1934 /  2480 =  77.984
1, 1  acc:    76 /   180 =  42.222
------------------------------------
Average acc: 18544 / 19962 =  92.897
Robust  acc:    76 /   180 =  42.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9160 /  9767 =  93.785
0, 1  acc:  7374 /  7535 =  97.863
1, 0  acc:  1934 /  2480 =  77.984
1, 1  acc:    76 /   180 =  42.222
------------------------------------
Average acc: 18544 / 19962 =  92.897
Robust  acc:    76 /   180 =  42.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9160 /  9767 =  93.785
0, 1  acc:  7374 /  7535 =  97.863
1, 0  acc:  1934 /  2480 =  77.984
1, 1  acc:    76 /   180 =  42.222
------------------------------------
Average acc: 18544 / 19962 =  92.897
Robust  acc:    76 /   180 =  42.222
------------------------------------
Epoch:  76 | Train Loss: 0.000 | Train Acc: 99.486 | Val Loss: 0.001 | Val Acc: 91.378
Training:
Accuracies by groups:
0, 0  acc: 65740 / 66172 =  99.347
0, 1  acc: 16690 / 16849 =  99.056
1, 0  acc: 62819 / 63042 =  99.646
1, 1  acc: 16684 / 16707 =  99.862
--------------------------------------
Average acc: 161933 / 162770 =  99.486
Robust  acc: 16690 / 16849 =  99.056
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7620 /  8535 =  89.279
0, 1  acc:  8004 /  8276 =  96.713
1, 0  acc:  2437 /  2874 =  84.795
1, 1  acc:    93 /   182 =  51.099
------------------------------------
Average acc: 18154 / 19867 =  91.378
Robust  acc:    93 /   182 =  51.099
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.905
Robust Acc: 53.889 | Best Acc: 96.443
-------------------------------------
Training, Epoch 75:
Accuracies by groups:
0, 0  acc:  8929 /  9767 =  91.420
0, 1  acc:  7267 /  7535 =  96.443
1, 0  acc:  2053 /  2480 =  82.782
1, 1  acc:    97 /   180 =  53.889
------------------------------------
Average acc: 18346 / 19962 =  91.905
Robust  acc:    97 /   180 =  53.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8929 /  9767 =  91.420
0, 1  acc:  7267 /  7535 =  96.443
1, 0  acc:  2053 /  2480 =  82.782
1, 1  acc:    97 /   180 =  53.889
------------------------------------
Average acc: 18346 / 19962 =  91.905
Robust  acc:    97 /   180 =  53.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8929 /  9767 =  91.420
0, 1  acc:  7267 /  7535 =  96.443
1, 0  acc:  2053 /  2480 =  82.782
1, 1  acc:    97 /   180 =  53.889
------------------------------------
Average acc: 18346 / 19962 =  91.905
Robust  acc:    97 /   180 =  53.889
------------------------------------
Epoch:  77 | Train Loss: 0.000 | Train Acc: 99.497 | Val Loss: 0.001 | Val Acc: 92.852
Training:
Accuracies by groups:
0, 0  acc: 65615 / 66030 =  99.371
0, 1  acc: 16722 / 16916 =  98.853
1, 0  acc: 62669 / 62850 =  99.712
1, 1  acc: 16946 / 16974 =  99.835
--------------------------------------
Average acc: 161952 / 162770 =  99.497
Robust  acc: 16722 / 16916 =  98.853
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8154 /  8535 =  95.536
0, 1  acc:  8203 /  8276 =  99.118
1, 0  acc:  2038 /  2874 =  70.912
1, 1  acc:    52 /   182 =  28.571
------------------------------------
Average acc: 18447 / 19867 =  92.852
Robust  acc:    52 /   182 =  28.571
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.317
Robust Acc: 34.444 | Best Acc: 99.084
-------------------------------------
Training, Epoch 76:
Accuracies by groups:
0, 0  acc:  9427 /  9767 =  96.519
0, 1  acc:  7466 /  7535 =  99.084
1, 0  acc:  1673 /  2480 =  67.460
1, 1  acc:    62 /   180 =  34.444
------------------------------------
Average acc: 18628 / 19962 =  93.317
Robust  acc:    62 /   180 =  34.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9427 /  9767 =  96.519
0, 1  acc:  7466 /  7535 =  99.084
1, 0  acc:  1673 /  2480 =  67.460
1, 1  acc:    62 /   180 =  34.444
------------------------------------
Average acc: 18628 / 19962 =  93.317
Robust  acc:    62 /   180 =  34.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9427 /  9767 =  96.519
0, 1  acc:  7466 /  7535 =  99.084
1, 0  acc:  1673 /  2480 =  67.460
1, 1  acc:    62 /   180 =  34.444
------------------------------------
Average acc: 18628 / 19962 =  93.317
Robust  acc:    62 /   180 =  34.444
------------------------------------
Epoch:  78 | Train Loss: 0.000 | Train Acc: 99.496 | Val Loss: 0.001 | Val Acc: 92.686
Training:
Accuracies by groups:
0, 0  acc: 65898 / 66357 =  99.308
0, 1  acc: 16704 / 16857 =  99.092
1, 0  acc: 62778 / 62969 =  99.697
1, 1  acc: 16570 / 16587 =  99.898
--------------------------------------
Average acc: 161950 / 162770 =  99.496
Robust  acc: 16704 / 16857 =  99.092
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8008 /  8535 =  93.825
0, 1  acc:  8149 /  8276 =  98.465
1, 0  acc:  2192 /  2874 =  76.270
1, 1  acc:    65 /   182 =  35.714
------------------------------------
Average acc: 18414 / 19867 =  92.686
Robust  acc:    65 /   182 =  35.714
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.237
Robust Acc: 39.444 | Best Acc: 98.461
-------------------------------------
Training, Epoch 77:
Accuracies by groups:
0, 0  acc:  9304 /  9767 =  95.260
0, 1  acc:  7419 /  7535 =  98.461
1, 0  acc:  1818 /  2480 =  73.306
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18612 / 19962 =  93.237
Robust  acc:    71 /   180 =  39.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9304 /  9767 =  95.260
0, 1  acc:  7419 /  7535 =  98.461
1, 0  acc:  1818 /  2480 =  73.306
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18612 / 19962 =  93.237
Robust  acc:    71 /   180 =  39.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9304 /  9767 =  95.260
0, 1  acc:  7419 /  7535 =  98.461
1, 0  acc:  1818 /  2480 =  73.306
1, 1  acc:    71 /   180 =  39.444
------------------------------------
Average acc: 18612 / 19962 =  93.237
Robust  acc:    71 /   180 =  39.444
------------------------------------
Epoch:  79 | Train Loss: 0.000 | Train Acc: 99.532 | Val Loss: 0.001 | Val Acc: 92.339
Training:
Accuracies by groups:
0, 0  acc: 65652 / 66061 =  99.381
0, 1  acc: 16885 / 17036 =  99.114
1, 0  acc: 62874 / 63063 =  99.700
1, 1  acc: 16597 / 16610 =  99.922
--------------------------------------
Average acc: 162008 / 162770 =  99.532
Robust  acc: 16885 / 17036 =  99.114
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7831 /  8535 =  91.752
0, 1  acc:  8096 /  8276 =  97.825
1, 0  acc:  2338 /  2874 =  81.350
1, 1  acc:    80 /   182 =  43.956
------------------------------------
Average acc: 18345 / 19867 =  92.339
Robust  acc:    80 /   182 =  43.956
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.997
Robust Acc: 44.444 | Best Acc: 97.744
-------------------------------------
Training, Epoch 78:
Accuracies by groups:
0, 0  acc:  9131 /  9767 =  93.488
0, 1  acc:  7365 /  7535 =  97.744
1, 0  acc:  1988 /  2480 =  80.161
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18564 / 19962 =  92.997
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9131 /  9767 =  93.488
0, 1  acc:  7365 /  7535 =  97.744
1, 0  acc:  1988 /  2480 =  80.161
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18564 / 19962 =  92.997
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9131 /  9767 =  93.488
0, 1  acc:  7365 /  7535 =  97.744
1, 0  acc:  1988 /  2480 =  80.161
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18564 / 19962 =  92.997
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  80 | Train Loss: 0.000 | Train Acc: 99.532 | Val Loss: 0.001 | Val Acc: 92.168
Training:
Accuracies by groups:
0, 0  acc: 65807 / 66211 =  99.390
0, 1  acc: 16749 / 16899 =  99.112
1, 0  acc: 62672 / 62866 =  99.691
1, 1  acc: 16781 / 16794 =  99.923
--------------------------------------
Average acc: 162009 / 162770 =  99.532
Robust  acc: 16749 / 16899 =  99.112
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7787 /  8535 =  91.236
0, 1  acc:  8083 /  8276 =  97.668
1, 0  acc:  2362 /  2874 =  82.185
1, 1  acc:    79 /   182 =  43.407
------------------------------------
Average acc: 18311 / 19867 =  92.168
Robust  acc:    79 /   182 =  43.407
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.831
Robust Acc: 46.667 | Best Acc: 97.638
-------------------------------------
Training, Epoch 79:
Accuracies by groups:
0, 0  acc:  9107 /  9767 =  93.243
0, 1  acc:  7357 /  7535 =  97.638
1, 0  acc:  1983 /  2480 =  79.960
1, 1  acc:    84 /   180 =  46.667
------------------------------------
Average acc: 18531 / 19962 =  92.831
Robust  acc:    84 /   180 =  46.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9107 /  9767 =  93.243
0, 1  acc:  7357 /  7535 =  97.638
1, 0  acc:  1983 /  2480 =  79.960
1, 1  acc:    84 /   180 =  46.667
------------------------------------
Average acc: 18531 / 19962 =  92.831
Robust  acc:    84 /   180 =  46.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9107 /  9767 =  93.243
0, 1  acc:  7357 /  7535 =  97.638
1, 0  acc:  1983 /  2480 =  79.960
1, 1  acc:    84 /   180 =  46.667
------------------------------------
Average acc: 18531 / 19962 =  92.831
Robust  acc:    84 /   180 =  46.667
------------------------------------
Epoch:  81 | Train Loss: 0.000 | Train Acc: 99.587 | Val Loss: 0.001 | Val Acc: 91.921
Training:
Accuracies by groups:
0, 0  acc: 65796 / 66165 =  99.442
0, 1  acc: 16974 / 17104 =  99.240
1, 0  acc: 62704 / 62866 =  99.742
1, 1  acc: 16624 / 16635 =  99.934
--------------------------------------
Average acc: 162098 / 162770 =  99.587
Robust  acc: 16974 / 17104 =  99.240
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7701 /  8535 =  90.228
0, 1  acc:  8050 /  8276 =  97.269
1, 0  acc:  2421 /  2874 =  84.238
1, 1  acc:    90 /   182 =  49.451
------------------------------------
Average acc: 18262 / 19867 =  91.921
Robust  acc:    90 /   182 =  49.451
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.340
Robust Acc: 49.444 | Best Acc: 96.974
-------------------------------------
Training, Epoch 80:
Accuracies by groups:
0, 0  acc:  9000 /  9767 =  92.147
0, 1  acc:  7307 /  7535 =  96.974
1, 0  acc:  2037 /  2480 =  82.137
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18433 / 19962 =  92.340
Robust  acc:    89 /   180 =  49.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9000 /  9767 =  92.147
0, 1  acc:  7307 /  7535 =  96.974
1, 0  acc:  2037 /  2480 =  82.137
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18433 / 19962 =  92.340
Robust  acc:    89 /   180 =  49.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9000 /  9767 =  92.147
0, 1  acc:  7307 /  7535 =  96.974
1, 0  acc:  2037 /  2480 =  82.137
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18433 / 19962 =  92.340
Robust  acc:    89 /   180 =  49.444
------------------------------------
Epoch:  82 | Train Loss: 0.000 | Train Acc: 99.573 | Val Loss: 0.001 | Val Acc: 92.404
Training:
Accuracies by groups:
0, 0  acc: 65563 / 65933 =  99.439
0, 1  acc: 17036 / 17179 =  99.168
1, 0  acc: 62717 / 62883 =  99.736
1, 1  acc: 16759 / 16775 =  99.905
--------------------------------------
Average acc: 162075 / 162770 =  99.573
Robust  acc: 17036 / 17179 =  99.168
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7906 /  8535 =  92.630
0, 1  acc:  8103 /  8276 =  97.910
1, 0  acc:  2283 /  2874 =  79.436
1, 1  acc:    66 /   182 =  36.264
------------------------------------
Average acc: 18358 / 19867 =  92.404
Robust  acc:    66 /   182 =  36.264
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.927
Robust Acc: 41.111 | Best Acc: 97.956
-------------------------------------
Training, Epoch 81:
Accuracies by groups:
0, 0  acc:  9188 /  9767 =  94.072
0, 1  acc:  7381 /  7535 =  97.956
1, 0  acc:  1907 /  2480 =  76.895
1, 1  acc:    74 /   180 =  41.111
------------------------------------
Average acc: 18550 / 19962 =  92.927
Robust  acc:    74 /   180 =  41.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9188 /  9767 =  94.072
0, 1  acc:  7381 /  7535 =  97.956
1, 0  acc:  1907 /  2480 =  76.895
1, 1  acc:    74 /   180 =  41.111
------------------------------------
Average acc: 18550 / 19962 =  92.927
Robust  acc:    74 /   180 =  41.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9188 /  9767 =  94.072
0, 1  acc:  7381 /  7535 =  97.956
1, 0  acc:  1907 /  2480 =  76.895
1, 1  acc:    74 /   180 =  41.111
------------------------------------
Average acc: 18550 / 19962 =  92.927
Robust  acc:    74 /   180 =  41.111
------------------------------------
Epoch:  83 | Train Loss: 0.000 | Train Acc: 99.584 | Val Loss: 0.001 | Val Acc: 92.188
Training:
Accuracies by groups:
0, 0  acc: 65599 / 65980 =  99.423
0, 1  acc: 16925 / 17072 =  99.139
1, 0  acc: 62743 / 62879 =  99.784
1, 1  acc: 16826 / 16839 =  99.923
--------------------------------------
Average acc: 162093 / 162770 =  99.584
Robust  acc: 16925 / 17072 =  99.139
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7798 /  8535 =  91.365
0, 1  acc:  8065 /  8276 =  97.450
1, 0  acc:  2373 /  2874 =  82.568
1, 1  acc:    79 /   182 =  43.407
------------------------------------
Average acc: 18315 / 19867 =  92.188
Robust  acc:    79 /   182 =  43.407
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.696
Robust Acc: 48.333 | Best Acc: 97.478
-------------------------------------
Training, Epoch 82:
Accuracies by groups:
0, 0  acc:  9099 /  9767 =  93.161
0, 1  acc:  7345 /  7535 =  97.478
1, 0  acc:  1973 /  2480 =  79.556
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18504 / 19962 =  92.696
Robust  acc:    87 /   180 =  48.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9099 /  9767 =  93.161
0, 1  acc:  7345 /  7535 =  97.478
1, 0  acc:  1973 /  2480 =  79.556
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18504 / 19962 =  92.696
Robust  acc:    87 /   180 =  48.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9099 /  9767 =  93.161
0, 1  acc:  7345 /  7535 =  97.478
1, 0  acc:  1973 /  2480 =  79.556
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18504 / 19962 =  92.696
Robust  acc:    87 /   180 =  48.333
------------------------------------
Epoch:  84 | Train Loss: 0.000 | Train Acc: 99.634 | Val Loss: 0.001 | Val Acc: 92.389
Training:
Accuracies by groups:
0, 0  acc: 65722 / 66068 =  99.476
0, 1  acc: 16738 / 16850 =  99.335
1, 0  acc: 63012 / 63137 =  99.802
1, 1  acc: 16703 / 16715 =  99.928
--------------------------------------
Average acc: 162175 / 162770 =  99.634
Robust  acc: 16738 / 16850 =  99.335
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7860 /  8535 =  92.091
0, 1  acc:  8088 /  8276 =  97.728
1, 0  acc:  2330 /  2874 =  81.072
1, 1  acc:    77 /   182 =  42.308
------------------------------------
Average acc: 18355 / 19867 =  92.389
Robust  acc:    77 /   182 =  42.308
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.851
Robust Acc: 41.667 | Best Acc: 97.810
-------------------------------------
Training, Epoch 83:
Accuracies by groups:
0, 0  acc:  9149 /  9767 =  93.673
0, 1  acc:  7370 /  7535 =  97.810
1, 0  acc:  1941 /  2480 =  78.266
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18535 / 19962 =  92.851
Robust  acc:    75 /   180 =  41.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9149 /  9767 =  93.673
0, 1  acc:  7370 /  7535 =  97.810
1, 0  acc:  1941 /  2480 =  78.266
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18535 / 19962 =  92.851
Robust  acc:    75 /   180 =  41.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9149 /  9767 =  93.673
0, 1  acc:  7370 /  7535 =  97.810
1, 0  acc:  1941 /  2480 =  78.266
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18535 / 19962 =  92.851
Robust  acc:    75 /   180 =  41.667
------------------------------------
Epoch:  85 | Train Loss: 0.000 | Train Acc: 99.607 | Val Loss: 0.001 | Val Acc: 92.128
Training:
Accuracies by groups:
0, 0  acc: 65730 / 66103 =  99.436
0, 1  acc: 16792 / 16908 =  99.314
1, 0  acc: 63002 / 63144 =  99.775
1, 1  acc: 16606 / 16615 =  99.946
--------------------------------------
Average acc: 162130 / 162770 =  99.607
Robust  acc: 16792 / 16908 =  99.314
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7745 /  8535 =  90.744
0, 1  acc:  8060 /  8276 =  97.390
1, 0  acc:  2410 /  2874 =  83.855
1, 1  acc:    88 /   182 =  48.352
------------------------------------
Average acc: 18303 / 19867 =  92.128
Robust  acc:    88 /   182 =  48.352
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.561
Robust Acc: 48.333 | Best Acc: 97.186
-------------------------------------
Training, Epoch 84:
Accuracies by groups:
0, 0  acc:  9044 /  9767 =  92.598
0, 1  acc:  7323 /  7535 =  97.186
1, 0  acc:  2023 /  2480 =  81.573
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18477 / 19962 =  92.561
Robust  acc:    87 /   180 =  48.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9044 /  9767 =  92.598
0, 1  acc:  7323 /  7535 =  97.186
1, 0  acc:  2023 /  2480 =  81.573
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18477 / 19962 =  92.561
Robust  acc:    87 /   180 =  48.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9044 /  9767 =  92.598
0, 1  acc:  7323 /  7535 =  97.186
1, 0  acc:  2023 /  2480 =  81.573
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18477 / 19962 =  92.561
Robust  acc:    87 /   180 =  48.333
------------------------------------
Epoch:  86 | Train Loss: 0.000 | Train Acc: 99.626 | Val Loss: 0.001 | Val Acc: 92.289
Training:
Accuracies by groups:
0, 0  acc: 65763 / 66117 =  99.465
0, 1  acc: 16679 / 16798 =  99.292
1, 0  acc: 63015 / 63137 =  99.807
1, 1  acc: 16704 / 16718 =  99.916
--------------------------------------
Average acc: 162161 / 162770 =  99.626
Robust  acc: 16679 / 16798 =  99.292
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7824 /  8535 =  91.670
0, 1  acc:  8081 /  8276 =  97.644
1, 0  acc:  2350 /  2874 =  81.768
1, 1  acc:    80 /   182 =  43.956
------------------------------------
Average acc: 18335 / 19867 =  92.289
Robust  acc:    80 /   182 =  43.956
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.791
Robust Acc: 45.556 | Best Acc: 97.624
-------------------------------------
Training, Epoch 85:
Accuracies by groups:
0, 0  acc:  9128 /  9767 =  93.458
0, 1  acc:  7356 /  7535 =  97.624
1, 0  acc:  1957 /  2480 =  78.911
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18523 / 19962 =  92.791
Robust  acc:    82 /   180 =  45.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9128 /  9767 =  93.458
0, 1  acc:  7356 /  7535 =  97.624
1, 0  acc:  1957 /  2480 =  78.911
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18523 / 19962 =  92.791
Robust  acc:    82 /   180 =  45.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9128 /  9767 =  93.458
0, 1  acc:  7356 /  7535 =  97.624
1, 0  acc:  1957 /  2480 =  78.911
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18523 / 19962 =  92.791
Robust  acc:    82 /   180 =  45.556
------------------------------------
Epoch:  87 | Train Loss: 0.000 | Train Acc: 99.633 | Val Loss: 0.001 | Val Acc: 92.475
Training:
Accuracies by groups:
0, 0  acc: 66124 / 66462 =  99.491
0, 1  acc: 16789 / 16919 =  99.232
1, 0  acc: 62555 / 62680 =  99.801
1, 1  acc: 16705 / 16709 =  99.976
--------------------------------------
Average acc: 162173 / 162770 =  99.633
Robust  acc: 16789 / 16919 =  99.232
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7875 /  8535 =  92.267
0, 1  acc:  8098 /  8276 =  97.849
1, 0  acc:  2327 /  2874 =  80.967
1, 1  acc:    72 /   182 =  39.560
------------------------------------
Average acc: 18372 / 19867 =  92.475
Robust  acc:    72 /   182 =  39.560
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.907
Robust Acc: 42.778 | Best Acc: 97.837
-------------------------------------
Training, Epoch 86:
Accuracies by groups:
0, 0  acc:  9155 /  9767 =  93.734
0, 1  acc:  7372 /  7535 =  97.837
1, 0  acc:  1942 /  2480 =  78.306
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18546 / 19962 =  92.907
Robust  acc:    77 /   180 =  42.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9155 /  9767 =  93.734
0, 1  acc:  7372 /  7535 =  97.837
1, 0  acc:  1942 /  2480 =  78.306
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18546 / 19962 =  92.907
Robust  acc:    77 /   180 =  42.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9155 /  9767 =  93.734
0, 1  acc:  7372 /  7535 =  97.837
1, 0  acc:  1942 /  2480 =  78.306
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18546 / 19962 =  92.907
Robust  acc:    77 /   180 =  42.778
------------------------------------
Epoch:  88 | Train Loss: 0.000 | Train Acc: 99.657 | Val Loss: 0.001 | Val Acc: 92.525
Training:
Accuracies by groups:
0, 0  acc: 65829 / 66144 =  99.524
0, 1  acc: 16717 / 16830 =  99.329
1, 0  acc: 62806 / 62919 =  99.820
1, 1  acc: 16859 / 16877 =  99.893
--------------------------------------
Average acc: 162211 / 162770 =  99.657
Robust  acc: 16717 / 16830 =  99.329
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7904 /  8535 =  92.607
0, 1  acc:  8121 /  8276 =  98.127
1, 0  acc:  2288 /  2874 =  79.610
1, 1  acc:    69 /   182 =  37.912
------------------------------------
Average acc: 18382 / 19867 =  92.525
Robust  acc:    69 /   182 =  37.912
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.997
Robust Acc: 41.667 | Best Acc: 98.089
-------------------------------------
Training, Epoch 87:
Accuracies by groups:
0, 0  acc:  9198 /  9767 =  94.174
0, 1  acc:  7391 /  7535 =  98.089
1, 0  acc:  1900 /  2480 =  76.613
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18564 / 19962 =  92.997
Robust  acc:    75 /   180 =  41.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9198 /  9767 =  94.174
0, 1  acc:  7391 /  7535 =  98.089
1, 0  acc:  1900 /  2480 =  76.613
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18564 / 19962 =  92.997
Robust  acc:    75 /   180 =  41.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9198 /  9767 =  94.174
0, 1  acc:  7391 /  7535 =  98.089
1, 0  acc:  1900 /  2480 =  76.613
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18564 / 19962 =  92.997
Robust  acc:    75 /   180 =  41.667
------------------------------------
Epoch:  89 | Train Loss: 0.000 | Train Acc: 99.662 | Val Loss: 0.001 | Val Acc: 92.289
Training:
Accuracies by groups:
0, 0  acc: 65683 / 65987 =  99.539
0, 1  acc: 16982 / 17113 =  99.235
1, 0  acc: 62832 / 62945 =  99.820
1, 1  acc: 16723 / 16725 =  99.988
--------------------------------------
Average acc: 162220 / 162770 =  99.662
Robust  acc: 16982 / 17113 =  99.235
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7840 /  8535 =  91.857
0, 1  acc:  8089 /  8276 =  97.740
1, 0  acc:  2330 /  2874 =  81.072
1, 1  acc:    76 /   182 =  41.758
------------------------------------
Average acc: 18335 / 19867 =  92.289
Robust  acc:    76 /   182 =  41.758
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.806
Robust Acc: 44.444 | Best Acc: 97.691
-------------------------------------
Training, Epoch 88:
Accuracies by groups:
0, 0  acc:  9140 /  9767 =  93.580
0, 1  acc:  7361 /  7535 =  97.691
1, 0  acc:  1945 /  2480 =  78.427
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18526 / 19962 =  92.806
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9140 /  9767 =  93.580
0, 1  acc:  7361 /  7535 =  97.691
1, 0  acc:  1945 /  2480 =  78.427
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18526 / 19962 =  92.806
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9140 /  9767 =  93.580
0, 1  acc:  7361 /  7535 =  97.691
1, 0  acc:  1945 /  2480 =  78.427
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18526 / 19962 =  92.806
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  90 | Train Loss: 0.000 | Train Acc: 99.659 | Val Loss: 0.001 | Val Acc: 92.425
Training:
Accuracies by groups:
0, 0  acc: 65788 / 66103 =  99.523
0, 1  acc: 16694 / 16815 =  99.280
1, 0  acc: 62894 / 62995 =  99.840
1, 1  acc: 16839 / 16857 =  99.893
--------------------------------------
Average acc: 162215 / 162770 =  99.659
Robust  acc: 16694 / 16815 =  99.280
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7843 /  8535 =  91.892
0, 1  acc:  8094 /  8276 =  97.801
1, 0  acc:  2348 /  2874 =  81.698
1, 1  acc:    77 /   182 =  42.308
------------------------------------
Average acc: 18362 / 19867 =  92.425
Robust  acc:    77 /   182 =  42.308
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.967
Robust Acc: 45.000 | Best Acc: 97.770
-------------------------------------
Training, Epoch 89:
Accuracies by groups:
0, 0  acc:  9137 /  9767 =  93.550
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1973 /  2480 =  79.556
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9137 /  9767 =  93.550
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1973 /  2480 =  79.556
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9137 /  9767 =  93.550
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1973 /  2480 =  79.556
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    81 /   180 =  45.000
------------------------------------
Epoch:  91 | Train Loss: 0.000 | Train Acc: 99.668 | Val Loss: 0.001 | Val Acc: 92.425
Training:
Accuracies by groups:
0, 0  acc: 65418 / 65735 =  99.518
0, 1  acc: 17052 / 17165 =  99.342
1, 0  acc: 62863 / 62959 =  99.848
1, 1  acc: 16897 / 16911 =  99.917
--------------------------------------
Average acc: 162230 / 162770 =  99.668
Robust  acc: 17052 / 17165 =  99.342
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7840 /  8535 =  91.857
0, 1  acc:  8082 /  8276 =  97.656
1, 0  acc:  2358 /  2874 =  82.046
1, 1  acc:    82 /   182 =  45.055
------------------------------------
Average acc: 18362 / 19867 =  92.425
Robust  acc:    82 /   182 =  45.055
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.876
Robust Acc: 45.000 | Best Acc: 97.664
-------------------------------------
Training, Epoch 90:
Accuracies by groups:
0, 0  acc:  9124 /  9767 =  93.417
0, 1  acc:  7359 /  7535 =  97.664
1, 0  acc:  1976 /  2480 =  79.677
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18540 / 19962 =  92.876
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9124 /  9767 =  93.417
0, 1  acc:  7359 /  7535 =  97.664
1, 0  acc:  1976 /  2480 =  79.677
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18540 / 19962 =  92.876
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9124 /  9767 =  93.417
0, 1  acc:  7359 /  7535 =  97.664
1, 0  acc:  1976 /  2480 =  79.677
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18540 / 19962 =  92.876
Robust  acc:    81 /   180 =  45.000
------------------------------------
Epoch:  92 | Train Loss: 0.000 | Train Acc: 99.700 | Val Loss: 0.001 | Val Acc: 92.485
Training:
Accuracies by groups:
0, 0  acc: 65428 / 65709 =  99.572
0, 1  acc: 16879 / 16986 =  99.370
1, 0  acc: 63165 / 63254 =  99.859
1, 1  acc: 16810 / 16821 =  99.935
--------------------------------------
Average acc: 162282 / 162770 =  99.700
Robust  acc: 16879 / 16986 =  99.370
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7854 /  8535 =  92.021
0, 1  acc:  8091 /  8276 =  97.765
1, 0  acc:  2353 /  2874 =  81.872
1, 1  acc:    76 /   182 =  41.758
------------------------------------
Average acc: 18374 / 19867 =  92.485
Robust  acc:    76 /   182 =  41.758
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.962
Robust Acc: 44.444 | Best Acc: 97.770
-------------------------------------
Training, Epoch 91:
Accuracies by groups:
0, 0  acc:  9136 /  9767 =  93.539
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18557 / 19962 =  92.962
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9136 /  9767 =  93.539
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18557 / 19962 =  92.962
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9136 /  9767 =  93.539
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18557 / 19962 =  92.962
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  93 | Train Loss: 0.000 | Train Acc: 99.679 | Val Loss: 0.001 | Val Acc: 92.480
Training:
Accuracies by groups:
0, 0  acc: 65781 / 66091 =  99.531
0, 1  acc: 16774 / 16885 =  99.343
1, 0  acc: 62955 / 63051 =  99.848
1, 1  acc: 16738 / 16743 =  99.970
--------------------------------------
Average acc: 162248 / 162770 =  99.679
Robust  acc: 16774 / 16885 =  99.343
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7870 /  8535 =  92.209
0, 1  acc:  8104 /  8276 =  97.922
1, 0  acc:  2328 /  2874 =  81.002
1, 1  acc:    71 /   182 =  39.011
------------------------------------
Average acc: 18373 / 19867 =  92.480
Robust  acc:    71 /   182 =  39.011
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.942
Robust Acc: 42.778 | Best Acc: 97.890
-------------------------------------
Training, Epoch 92:
Accuracies by groups:
0, 0  acc:  9159 /  9767 =  93.775
0, 1  acc:  7376 /  7535 =  97.890
1, 0  acc:  1941 /  2480 =  78.266
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18553 / 19962 =  92.942
Robust  acc:    77 /   180 =  42.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9159 /  9767 =  93.775
0, 1  acc:  7376 /  7535 =  97.890
1, 0  acc:  1941 /  2480 =  78.266
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18553 / 19962 =  92.942
Robust  acc:    77 /   180 =  42.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9159 /  9767 =  93.775
0, 1  acc:  7376 /  7535 =  97.890
1, 0  acc:  1941 /  2480 =  78.266
1, 1  acc:    77 /   180 =  42.778
------------------------------------
Average acc: 18553 / 19962 =  92.942
Robust  acc:    77 /   180 =  42.778
------------------------------------
Epoch:  94 | Train Loss: 0.000 | Train Acc: 99.697 | Val Loss: 0.001 | Val Acc: 92.445
Training:
Accuracies by groups:
0, 0  acc: 65963 / 66243 =  99.577
0, 1  acc: 16723 / 16839 =  99.311
1, 0  acc: 62652 / 62746 =  99.850
1, 1  acc: 16938 / 16942 =  99.976
--------------------------------------
Average acc: 162276 / 162770 =  99.697
Robust  acc: 16723 / 16839 =  99.311
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7839 /  8535 =  91.845
0, 1  acc:  8091 /  8276 =  97.765
1, 0  acc:  2358 /  2874 =  82.046
1, 1  acc:    78 /   182 =  42.857
------------------------------------
Average acc: 18366 / 19867 =  92.445
Robust  acc:    78 /   182 =  42.857
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.846
Robust Acc: 45.000 | Best Acc: 97.624
-------------------------------------
Training, Epoch 93:
Accuracies by groups:
0, 0  acc:  9133 /  9767 =  93.509
0, 1  acc:  7356 /  7535 =  97.624
1, 0  acc:  1964 /  2480 =  79.194
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18534 / 19962 =  92.846
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9133 /  9767 =  93.509
0, 1  acc:  7356 /  7535 =  97.624
1, 0  acc:  1964 /  2480 =  79.194
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18534 / 19962 =  92.846
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9133 /  9767 =  93.509
0, 1  acc:  7356 /  7535 =  97.624
1, 0  acc:  1964 /  2480 =  79.194
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18534 / 19962 =  92.846
Robust  acc:    81 /   180 =  45.000
------------------------------------
Epoch:  95 | Train Loss: 0.000 | Train Acc: 99.685 | Val Loss: 0.001 | Val Acc: 92.480
Training:
Accuracies by groups:
0, 0  acc: 65987 / 66307 =  99.517
0, 1  acc: 16739 / 16841 =  99.394
1, 0  acc: 62916 / 63000 =  99.867
1, 1  acc: 16616 / 16622 =  99.964
--------------------------------------
Average acc: 162258 / 162770 =  99.685
Robust  acc: 16739 / 16841 =  99.394
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7864 /  8535 =  92.138
0, 1  acc:  8097 /  8276 =  97.837
1, 0  acc:  2338 /  2874 =  81.350
1, 1  acc:    74 /   182 =  40.659
------------------------------------
Average acc: 18373 / 19867 =  92.480
Robust  acc:    74 /   182 =  40.659
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.947
Robust Acc: 45.000 | Best Acc: 97.770
-------------------------------------
Training, Epoch 94:
Accuracies by groups:
0, 0  acc:  9155 /  9767 =  93.734
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1951 /  2480 =  78.669
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18554 / 19962 =  92.947
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9155 /  9767 =  93.734
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1951 /  2480 =  78.669
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18554 / 19962 =  92.947
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9155 /  9767 =  93.734
0, 1  acc:  7367 /  7535 =  97.770
1, 0  acc:  1951 /  2480 =  78.669
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18554 / 19962 =  92.947
Robust  acc:    81 /   180 =  45.000
------------------------------------
Epoch:  96 | Train Loss: 0.000 | Train Acc: 99.692 | Val Loss: 0.001 | Val Acc: 92.520
Training:
Accuracies by groups:
0, 0  acc: 65790 / 66098 =  99.534
0, 1  acc: 16691 / 16794 =  99.387
1, 0  acc: 63071 / 63156 =  99.865
1, 1  acc: 16717 / 16722 =  99.970
--------------------------------------
Average acc: 162269 / 162770 =  99.692
Robust  acc: 16691 / 16794 =  99.387
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7872 /  8535 =  92.232
0, 1  acc:  8102 /  8276 =  97.898
1, 0  acc:  2335 /  2874 =  81.246
1, 1  acc:    72 /   182 =  39.560
------------------------------------
Average acc: 18381 / 19867 =  92.520
Robust  acc:    72 /   182 =  39.560
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.012
Robust Acc: 44.444 | Best Acc: 97.863
-------------------------------------
Training, Epoch 95:
Accuracies by groups:
0, 0  acc:  9159 /  9767 =  93.775
0, 1  acc:  7374 /  7535 =  97.863
1, 0  acc:  1954 /  2480 =  78.790
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18567 / 19962 =  93.012
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9159 /  9767 =  93.775
0, 1  acc:  7374 /  7535 =  97.863
1, 0  acc:  1954 /  2480 =  78.790
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18567 / 19962 =  93.012
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9159 /  9767 =  93.775
0, 1  acc:  7374 /  7535 =  97.863
1, 0  acc:  1954 /  2480 =  78.790
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18567 / 19962 =  93.012
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  97 | Train Loss: 0.000 | Train Acc: 99.688 | Val Loss: 0.001 | Val Acc: 92.465
Training:
Accuracies by groups:
0, 0  acc: 66137 / 66431 =  99.557
0, 1  acc: 16668 / 16787 =  99.291
1, 0  acc: 62706 / 62791 =  99.865
1, 1  acc: 16751 / 16761 =  99.940
--------------------------------------
Average acc: 162262 / 162770 =  99.688
Robust  acc: 16668 / 16787 =  99.291
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7856 /  8535 =  92.045
0, 1  acc:  8095 /  8276 =  97.813
1, 0  acc:  2342 /  2874 =  81.489
1, 1  acc:    77 /   182 =  42.308
------------------------------------
Average acc: 18370 / 19867 =  92.465
Robust  acc:    77 /   182 =  42.308
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.937
Robust Acc: 44.444 | Best Acc: 97.717
-------------------------------------
Training, Epoch 96:
Accuracies by groups:
0, 0  acc:  9150 /  9767 =  93.683
0, 1  acc:  7363 /  7535 =  97.717
1, 0  acc:  1959 /  2480 =  78.992
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18552 / 19962 =  92.937
Robust  acc:    80 /   180 =  44.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9150 /  9767 =  93.683
0, 1  acc:  7363 /  7535 =  97.717
1, 0  acc:  1959 /  2480 =  78.992
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18552 / 19962 =  92.937
Robust  acc:    80 /   180 =  44.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9150 /  9767 =  93.683
0, 1  acc:  7363 /  7535 =  97.717
1, 0  acc:  1959 /  2480 =  78.992
1, 1  acc:    80 /   180 =  44.444
------------------------------------
Average acc: 18552 / 19962 =  92.937
Robust  acc:    80 /   180 =  44.444
------------------------------------
Epoch:  98 | Train Loss: 0.000 | Train Acc: 99.697 | Val Loss: 0.001 | Val Acc: 92.495
Training:
Accuracies by groups:
0, 0  acc: 65829 / 66127 =  99.549
0, 1  acc: 16967 / 17070 =  99.397
1, 0  acc: 62688 / 62774 =  99.863
1, 1  acc: 16793 / 16799 =  99.964
--------------------------------------
Average acc: 162277 / 162770 =  99.697
Robust  acc: 16967 / 17070 =  99.397
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7865 /  8535 =  92.150
0, 1  acc:  8101 /  8276 =  97.885
1, 0  acc:  2339 /  2874 =  81.385
1, 1  acc:    71 /   182 =  39.011
------------------------------------
Average acc: 18376 / 19867 =  92.495
Robust  acc:    71 /   182 =  39.011
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.022
Robust Acc: 43.333 | Best Acc: 97.903
-------------------------------------
Training, Epoch 97:
Accuracies by groups:
0, 0  acc:  9157 /  9767 =  93.754
0, 1  acc:  7377 /  7535 =  97.903
1, 0  acc:  1957 /  2480 =  78.911
1, 1  acc:    78 /   180 =  43.333
------------------------------------
Average acc: 18569 / 19962 =  93.022
Robust  acc:    78 /   180 =  43.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9157 /  9767 =  93.754
0, 1  acc:  7377 /  7535 =  97.903
1, 0  acc:  1957 /  2480 =  78.911
1, 1  acc:    78 /   180 =  43.333
------------------------------------
Average acc: 18569 / 19962 =  93.022
Robust  acc:    78 /   180 =  43.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9157 /  9767 =  93.754
0, 1  acc:  7377 /  7535 =  97.903
1, 0  acc:  1957 /  2480 =  78.911
1, 1  acc:    78 /   180 =  43.333
------------------------------------
Average acc: 18569 / 19962 =  93.022
Robust  acc:    78 /   180 =  43.333
------------------------------------
Epoch:  99 | Train Loss: 0.000 | Train Acc: 99.706 | Val Loss: 0.001 | Val Acc: 92.535
Training:
Accuracies by groups:
0, 0  acc: 65859 / 66123 =  99.601
0, 1  acc: 16656 / 16755 =  99.409
1, 0  acc: 62961 / 63065 =  99.835
1, 1  acc: 16816 / 16827 =  99.935
--------------------------------------
Average acc: 162292 / 162770 =  99.706
Robust  acc: 16656 / 16755 =  99.409
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7877 /  8535 =  92.291
0, 1  acc:  8110 /  8276 =  97.994
1, 0  acc:  2326 /  2874 =  80.932
1, 1  acc:    71 /   182 =  39.011
------------------------------------
Average acc: 18384 / 19867 =  92.535
Robust  acc:    71 /   182 =  39.011
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.982
Robust Acc: 42.222 | Best Acc: 97.877
-------------------------------------
Training, Epoch 98:
Accuracies by groups:
0, 0  acc:  9164 /  9767 =  93.826
0, 1  acc:  7375 /  7535 =  97.877
1, 0  acc:  1946 /  2480 =  78.468
1, 1  acc:    76 /   180 =  42.222
------------------------------------
Average acc: 18561 / 19962 =  92.982
Robust  acc:    76 /   180 =  42.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9164 /  9767 =  93.826
0, 1  acc:  7375 /  7535 =  97.877
1, 0  acc:  1946 /  2480 =  78.468
1, 1  acc:    76 /   180 =  42.222
------------------------------------
Average acc: 18561 / 19962 =  92.982
Robust  acc:    76 /   180 =  42.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9164 /  9767 =  93.826
0, 1  acc:  7375 /  7535 =  97.877
1, 0  acc:  1946 /  2480 =  78.468
1, 1  acc:    76 /   180 =  42.222
------------------------------------
Average acc: 18561 / 19962 =  92.982
Robust  acc:    76 /   180 =  42.222
------------------------------------
Epoch: 100 | Train Loss: 0.000 | Train Acc: 99.710 | Val Loss: 0.001 | Val Acc: 92.455
Training:
Accuracies by groups:
0, 0  acc: 65726 / 66004 =  99.579
0, 1  acc: 16826 / 16926 =  99.409
1, 0  acc: 62954 / 63044 =  99.857
1, 1  acc: 16792 / 16796 =  99.976
--------------------------------------
Average acc: 162298 / 162770 =  99.710
Robust  acc: 16826 / 16926 =  99.409
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7836 /  8535 =  91.810
0, 1  acc:  8099 /  8276 =  97.861
1, 0  acc:  2354 /  2874 =  81.907
1, 1  acc:    79 /   182 =  43.407
------------------------------------
Average acc: 18368 / 19867 =  92.455
Robust  acc:    79 /   182 =  43.407
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.871
Robust Acc: 45.000 | Best Acc: 97.651
-------------------------------------
Training, Epoch 99:
Accuracies by groups:
0, 0  acc:  9133 /  9767 =  93.509
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  1967 /  2480 =  79.315
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18539 / 19962 =  92.871
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9133 /  9767 =  93.509
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  1967 /  2480 =  79.315
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18539 / 19962 =  92.871
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9133 /  9767 =  93.509
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  1967 /  2480 =  79.315
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18539 / 19962 =  92.871
Robust  acc:    81 /   180 =  45.000
------------------------------------
replace: True
-> Updating checkpoint debias-end_seed0.pt...
Checkpoint saved at ./model/celebA/config/debias-end_seed0.pt
 18623 / 19962 =  93.292
Robust  acc:    73 /   180 =  40.556
------------------------------------
replace: True
-> Updating checkpoint debias-end_seed0.pt...
Checkpoint saved at ./model/celebA/config/debias-end_seed0.pt
 0  acc:  1982 /  2480 =  79.919
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18591 / 19962 =  93.132
Robust  acc:    82 /   180 =  45.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9152 /  9767 =  93.703
0, 1  acc:  7375 /  7535 =  97.877
1, 0  acc:  1982 /  2480 =  79.919
1, 1  acc:    82 /   180 =  45.556
------------------------------------
Average acc: 18591 / 19962 =  93.132
Robust  acc:    82 /   180 =  45.556
------------------------------------
replace: True
-> Updating checkpoint debias-end_seed0.pt...
Checkpoint saved at ./model/celebA/config/debias-end_seed0.pt
pt
                                                                                                                                                                                                                     