Arch: bert-base-uncased_pt
Bs trn: 16
Bs val: 16
Hidden dim: 256
Dataset: civilcomments
Resample class: 
Slice with: rep
Rep cluster method: gmm
Num anchor: 32
Num positive: 32
Num negative: 32
Num negative easy: 0
Weight anc by loss: False
Weight pos by loss: False
Weight neg by loss: False
Anc loss temp: 0.5
Pos loss temp: 0.5
Neg loss temp: 0.5
Data wide pos: False
Target sample ratio: 1
Balance targets: False
Additional negatives: False
Hard negative factor: 0
Full contrastive: False
Train encoder: False
No projection head: False
Projection dim: 128
Batch factor: None
Temperature: 0.05
Single pos: False
Supervised linear scale up: False
Supervised update delay: 0
Contrastive weight: 0.5
Classifier update interval: 8
Optim: AdamW
Max epoch: 5
Lr: 1e-05
Momentum: 0.9
Weight decay: 0.01
Weight decay c: 0.01
Stopping window: 30
Load encoder: 
Freeze encoder: False
Finetune epochs: 0
Clip grad norm: True
Lr scheduler classifier: 
Lr scheduler: 
Grad clip grad norm: False
Erm: False
Erm only: False
Pretrained spurious path: ./model/civilcomments/config/no_gce/JTT_sgd_no_gce_model_b_epoch0_seed45.pt
Max epoch s: 1
Bs trn s: 32
Lr s: 0.001
Momentum s: 0.9
Weight decay s: 0.0005
Slice temp: 10
Log loss interval: 10
Checkpoint interval: 50
Grad checkpoint interval: 50
Log visual interval: 100
Log grad visual interval: 50
Verbose: True
Seed: 45
Replicate: 0
No cuda: False
Resume: False
New slice: False
Num workers: 12
Evaluate: False
Data cmap: hsv
Test cmap: 
P correlation: 0.9
P corr by class: None
Train classes: ['non_toxic', 'toxic']
Train class ratios: None
Test shift: random
Flipped: False
Q: 0.7
Pretrained bmodel: True
Cosine: False
Exp: JTT_sgd_no_gce_JTT_adamW
Supervised contrast: True
Prioritize spurious pos: False
Contrastive type: cnc
Compute auroc: False
Model type: bert-base-uncased_pt_cnc
Criterion: cross_entropy
Pretrained: False
Max grad norm: 1.0
Adam epsilon: 1e-08
Warmup steps: 0
Max grad norm s: 1.0
Adam epsilon s: 1e-08
Warmup steps s: 0
Grad max grad norm: 1.0
Grad adam epsilon: 1e-08
Grad warmup steps: 0
Device: cuda
Img file type: .png
Display image: False
Image path: ./images/civilcomments/civilcomments/config/contrastive_umaps
Log interval: 1
Log path: ./logs/civilcomments/config
Results path: ./results/civilcomments/config
Model path: ./model/civilcomments/config
Loss factor: 1
Supersample labels: False
Subsample labels: False
Weigh slice samples by loss: True
Val split: 0.1
Spurious train split: 0.2
Subsample groups: False
Train method: sc
Max robust acc: -1
Max robust epoch: -1
Max robust group acc: (None, None)
Root dir: ./datasets/data/CivilComments/
Target name: toxic
Confounder names: ['identities']
Image mean: 0
Image std: 0
Augment data: False
Max token length: 300
Task: civilcomments
Num classes: 2
Experiment configs: config
Experiment name: cnc-civilcomments-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=5-bst=16-o=AdamW-lr=1e-05-mo=0.9-wd=0.01-wdc=0.01-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=45-r=0
Mi resampled: None

------------------------
> Loading spurious model
------------------------
Pretrained model loaded from ./model/civilcomments/config/no_gce/JTT_sgd_no_gce_model_b_epoch0_seed45.pt
======
# Calculate probability ...
======
======
# Load biased model ...
======

t_total is 10


t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   1 | Train Loss: 0.018 | Train Acc: 88.429 | Val Loss: 0.000 | Val Acc: 91.668
Training:
Accuracies by groups:
0, 0  acc: 70674 / 77798 =  90.843
0, 1  acc:  4977 /  5776 =  86.167
0, 2  acc:  7640 /  9190 =  83.134
0, 3  acc:  3722 /  4460 =  83.453
0, 4  acc:   966 /  1830 =  52.787
0, 5  acc:    89 /   225 =  39.556
0, 6  acc:   142 /   219 =  64.840
0, 7  acc:   140 /   264 =  53.030
0, 8  acc:  6891 /  7707 =  89.412
0, 9  acc:   401 /   479 =  83.716
0, 10  acc:   439 /   504 =  87.103
0, 11  acc:   316 /   365 =  86.575
0, 12  acc:   189 /   332 =  56.928
0, 13  acc:    18 /    40 =  45.000
0, 14  acc:    37 /    51 =  72.549
0, 15  acc:    15 /    29 =  51.724
0, 16  acc:  2487 /  3799 =  65.465
0, 17  acc:    62 /   118 =  52.542
0, 18  acc:   251 /   378 =  66.402
0, 19  acc:    63 /    94 =  67.021
0, 20  acc:    20 /    69 =  28.986
0, 21  acc:     2 /     7 =  28.571
0, 22  acc:    14 /    34 =  41.176
0, 23  acc:     2 /     4 =  50.000
0, 24  acc:   302 /   473 =  63.848
0, 25  acc:    11 /    18 =  61.111
0, 26  acc:    28 /    46 =  60.870
0, 27  acc:    13 /    22 =  59.091
0, 28  acc:     9 /    23 =  39.130
0, 29  acc:     2 /     4 =  50.000
0, 30  acc:     2 /     6 =  33.333
0, 31  acc:     1 /     3 =  33.333
0, 32  acc:  1199 /  1441 =  83.206
0, 33  acc:    54 /    69 =  78.261
0, 34  acc:    49 /    63 =  77.778
0, 35  acc:    19 /    25 =  76.000
0, 36  acc:    11 /    23 =  47.826
0, 37  acc:     2 /     3 =  66.667
0, 38  acc:     4 /     7 =  57.143
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   376 /   438 =  85.845
0, 41  acc:    17 /    17 = 100.000
0, 42  acc:    14 /    16 =  87.500
0, 43  acc:    22 /    22 = 100.000
0, 44  acc:    10 /    16 =  62.500
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     1 /     2 =  50.000
0, 47  acc:     1 /     1 = 100.000
0, 48  acc:   148 /   257 =  57.588
0, 49  acc:     4 /     4 = 100.000
0, 50  acc:    14 /    19 =  73.684
0, 51  acc:     7 /    11 =  63.636
0, 52  acc:     5 /     6 =  83.333
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     1 /     2 =  50.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   189 /   257 =  73.541
0, 57  acc:     3 /     7 =  42.857
0, 58  acc:     7 /    14 =  50.000
0, 59  acc:    10 /    14 =  71.429
0, 60  acc:     4 /     8 =  50.000
0, 61  acc:     1 /     1 = 100.000
0, 62  acc:     0 /     2 =   0.000
0, 63  acc:     1 /     2 =  50.000
0, 64  acc:   982 /  1785 =  55.014
0, 65  acc:    87 /   209 =  41.627
0, 66  acc:    89 /   156 =  57.051
0, 67  acc:    48 /    86 =  55.814
0, 68  acc:    17 /    41 =  41.463
0, 69  acc:     1 /     2 =  50.000
0, 70  acc:     8 /    17 =  47.059
0, 71  acc:     6 /     8 =  75.000
0, 72  acc:    19 /    28 =  67.857
0, 73  acc:     2 /     5 =  40.000
0, 74  acc:     5 /     5 = 100.000
0, 75  acc:     2 /     3 =  66.667
0, 76  acc:     1 /     3 =  33.333
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     1 /     1 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    18 /    44 =  40.909
0, 81  acc:     3 /     8 =  37.500
0, 82  acc:     6 /     8 =  75.000
0, 83  acc:     1 /     6 =  16.667
0, 84  acc:     1 /     1 = 100.000
0, 85  acc:     0 /     1 =   0.000
0, 86  acc:     0 /     1 =   0.000
0, 87  acc:     2 /     3 =  66.667
0, 88  acc:     4 /     7 =  57.143
0, 89  acc:     0 /     0 =     nan
0, 90  acc:     1 /     1 = 100.000
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     1 =   0.000
0, 94  acc:    18 /    32 =  56.250
0, 95  acc:     1 /     1 = 100.000
0, 96  acc:     0 /     5 =   0.000
0, 97  acc:     0 /     0 =     nan
0, 98  acc:     4 /     7 =  57.143
0, 99  acc:     6 /     6 = 100.000
0, 100  acc:     0 /     2 =   0.000
0, 101  acc:     3 /     8 =  37.500
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     0 /     0 =     nan
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:     5 /    12 =  41.667
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     0 /     6 =   0.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     3 /     3 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     1 /     1 = 100.000
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  2361 /  3855 =  61.245
0, 118  acc:   508 /   887 =  57.272
0, 119  acc:   137 /   228 =  60.088
0, 120  acc:   151 /   234 =  64.530
0, 121  acc:    19 /    43 =  44.186
0, 122  acc:     6 /    11 =  54.545
0, 123  acc:     4 /     6 =  66.667
0, 124  acc:     7 /    10 =  70.000
0, 125  acc:   145 /   221 =  65.611
0, 126  acc:    35 /    66 =  53.030
0, 127  acc:     9 /    10 =  90.000
0, 128  acc:    11 /    19 =  57.895
0, 129  acc:     2 /     3 =  66.667
0, 130  acc:     2 /     4 =  50.000
0, 131  acc:     1 /     1 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:    40 /   119 =  33.613
0, 134  acc:    10 /    26 =  38.462
0, 135  acc:     4 /     9 =  44.444
0, 136  acc:     3 /    13 =  23.077
0, 137  acc:     1 /     2 =  50.000
0, 138  acc:     0 /     1 =   0.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:     8 /    20 =  40.000
0, 142  acc:     0 /     3 =   0.000
0, 143  acc:     0 /     3 =   0.000
0, 144  acc:     1 /     4 =  25.000
0, 145  acc:     0 /     2 =   0.000
0, 146  acc:     0 /     0 =     nan
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    41 /    64 =  64.062
0, 149  acc:     3 /     7 =  42.857
0, 150  acc:     1 /     1 = 100.000
0, 151  acc:     3 /     9 =  33.333
0, 152  acc:     0 /     1 =   0.000
0, 153  acc:     1 /     2 =  50.000
0, 154  acc:    15 /    26 =  57.692
0, 155  acc:     2 /     2 = 100.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     0 /     1 =   0.000
0, 159  acc:     8 /    16 =  50.000
0, 160  acc:     0 /     0 =     nan
0, 161  acc:     0 /     0 =     nan
0, 162  acc:     0 /     1 =   0.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:     5 /     9 =  55.556
0, 165  acc:     0 /     0 =     nan
0, 166  acc:     1 /     3 =  33.333
0, 167  acc:     0 /     1 =   0.000
0, 168  acc:     0 /     1 =   0.000
0, 169  acc:   472 /  1032 =  45.736
0, 170  acc:    74 /   201 =  36.816
0, 171  acc:    30 /    73 =  41.096
0, 172  acc:    42 /   110 =  38.182
0, 173  acc:     6 /    14 =  42.857
0, 174  acc:     0 /     3 =   0.000
0, 175  acc:     0 /     1 =   0.000
0, 176  acc:     4 /    13 =  30.769
0, 177  acc:    28 /    48 =  58.333
0, 178  acc:     5 /     8 =  62.500
0, 179  acc:     1 /     2 =  50.000
0, 180  acc:     4 /     4 = 100.000
0, 181  acc:     1 /     2 =  50.000
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     0 /     0 =     nan
0, 184  acc:     5 /    23 =  21.739
0, 185  acc:     0 /     3 =   0.000
0, 186  acc:     2 /     6 =  33.333
0, 187  acc:     1 /     4 =  25.000
0, 188  acc:     0 /     2 =   0.000
0, 189  acc:     0 /     0 =     nan
0, 190  acc:     0 /     0 =     nan
0, 191  acc:     4 /    10 =  40.000
0, 192  acc:     0 /     1 =   0.000
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     0 /     0 =     nan
0, 196  acc:    10 /    20 =  50.000
0, 197  acc:     1 /     6 =  16.667
0, 198  acc:     0 /     4 =   0.000
0, 199  acc:     0 /     1 =   0.000
0, 200  acc:     1 /     2 =  50.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     0 /     0 =     nan
0, 204  acc:     6 /    11 =  54.545
0, 205  acc:     0 /     0 =     nan
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     3 /     3 = 100.000
0, 208  acc:     1 /     1 = 100.000
0, 209  acc:     1 /     2 =  50.000
0, 210  acc:     0 /     2 =   0.000
0, 211  acc:     0 /     2 =   0.000
0, 212  acc:     0 /     1 =   0.000
0, 213  acc:     0 /     1 =   0.000
0, 214  acc:     0 /     1 =   0.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     0 /     1 =   0.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     0 /     2 =   0.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     1 /     3 =  33.333
1, 0  acc: 54293 / 59301 =  91.555
1, 1  acc:  6075 /  6592 =  92.157
1, 2  acc: 10185 / 11187 =  91.043
1, 3  acc:  3991 /  4481 =  89.065
1, 4  acc:  4973 /  5304 =  93.759
1, 5  acc:   929 /   975 =  95.282
1, 6  acc:   502 /   528 =  95.076
1, 7  acc:   597 /   628 =  95.064
1, 8  acc:  4541 /  5236 =  86.727
1, 9  acc:   314 /   353 =  88.952
1, 10  acc:   420 /   470 =  89.362
1, 11  acc:   205 /   234 =  87.607
1, 12  acc:   808 /   860 =  93.953
1, 13  acc:   114 /   125 =  91.200
1, 14  acc:   131 /   160 =  81.875
1, 15  acc:    95 /   116 =  81.897
1, 16  acc:  7826 /  8570 =  91.319
1, 17  acc:   326 /   344 =  94.767
1, 18  acc:   608 /   657 =  92.542
1, 19  acc:   222 /   250 =  88.800
1, 20  acc:   346 /   356 =  97.191
1, 21  acc:    37 /    37 = 100.000
1, 22  acc:   119 /   127 =  93.701
1, 23  acc:    69 /    69 = 100.000
1, 24  acc:   961 /  1070 =  89.813
1, 25  acc:    32 /    35 =  91.429
1, 26  acc:   111 /   118 =  94.068
1, 27  acc:    16 /    18 =  88.889
1, 28  acc:   160 /   163 =  98.160
1, 29  acc:    13 /    13 = 100.000
1, 30  acc:    27 /    27 = 100.000
1, 31  acc:    10 /    10 = 100.000
1, 32  acc:  1542 /  1727 =  89.288
1, 33  acc:    79 /    88 =  89.773
1, 34  acc:    55 /    62 =  88.710
1, 35  acc:    20 /    22 =  90.909
1, 36  acc:    53 /    56 =  94.643
1, 37  acc:     7 /     7 = 100.000
1, 38  acc:    39 /    40 =  97.500
1, 39  acc:     6 /     6 = 100.000
1, 40  acc:   339 /   384 =  88.281
1, 41  acc:    13 /    13 = 100.000
1, 42  acc:    14 /    16 =  87.500
1, 43  acc:    14 /    19 =  73.684
1, 44  acc:    24 /    26 =  92.308
1, 45  acc:     3 /     4 =  75.000
1, 46  acc:    12 /    15 =  80.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   516 /   560 =  92.143
1, 49  acc:    11 /    11 = 100.000
1, 50  acc:    40 /    45 =  88.889
1, 51  acc:    20 /    20 = 100.000
1, 52  acc:    16 /    17 =  94.118
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    39 /    41 =  95.122
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   372 /   407 =  91.400
1, 57  acc:    13 /    13 = 100.000
1, 58  acc:    15 /    15 = 100.000
1, 59  acc:     8 /     9 =  88.889
1, 60  acc:    44 /    44 = 100.000
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    21 /    21 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5265 /  5610 =  93.850
1, 65  acc:   778 /   832 =  93.510
1, 66  acc:   467 /   505 =  92.475
1, 67  acc:   185 /   198 =  93.434
1, 68  acc:   232 /   244 =  95.082
1, 69  acc:    36 /    36 = 100.000
1, 70  acc:    74 /    77 =  96.104
1, 71  acc:    25 /    26 =  96.154
1, 72  acc:   106 /   108 =  98.148
1, 73  acc:     1 /     2 =  50.000
1, 74  acc:     4 /     5 =  80.000
1, 75  acc:     2 /     2 = 100.000
1, 76  acc:    24 /    25 =  96.000
1, 77  acc:     2 /     3 =  66.667
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     1 /     1 = 100.000
1, 80  acc:   195 /   201 =  97.015
1, 81  acc:    26 /    27 =  96.296
1, 82  acc:    59 /    61 =  96.721
1, 83  acc:     8 /     8 = 100.000
1, 84  acc:     9 /     9 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    27 /    27 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    30 /    31 =  96.774
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     3 /     3 = 100.000
1, 93  acc:     5 /     5 = 100.000
1, 94  acc:   160 /   175 =  91.429
1, 95  acc:    27 /    27 = 100.000
1, 96  acc:     8 /     8 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    21 /    21 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    18 /    18 = 100.000
1, 101  acc:     6 /     6 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     2 /     2 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    38 /    44 =  86.364
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    27 /    29 =  93.103
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     7 /     7 = 100.000
1, 111  acc:     4 /     4 = 100.000
1, 112  acc:    18 /    18 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8743 /  9475 =  92.274
1, 118  acc:  2122 /  2260 =  93.894
1, 119  acc:   561 /   597 =  93.970
1, 120  acc:   516 /   567 =  91.005
1, 121  acc:   178 /   183 =  97.268
1, 122  acc:    68 /    77 =  88.312
1, 123  acc:    40 /    42 =  95.238
1, 124  acc:    38 /    39 =  97.436
1, 125  acc:   530 /   574 =  92.334
1, 126  acc:   137 /   143 =  95.804
1, 127  acc:    23 /    29 =  79.310
1, 128  acc:    41 /    49 =  83.673
1, 129  acc:    24 /    24 = 100.000
1, 130  acc:     7 /     7 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     4 /     5 =  80.000
1, 133  acc:   433 /   456 =  94.956
1, 134  acc:    92 /    95 =  96.842
1, 135  acc:    55 /    55 = 100.000
1, 136  acc:    41 /    45 =  91.111
1, 137  acc:     5 /     5 = 100.000
1, 138  acc:     1 /     3 =  33.333
1, 139  acc:     5 /     5 = 100.000
1, 140  acc:     0 /     0 =     nan
1, 141  acc:   128 /   137 =  93.431
1, 142  acc:    19 /    21 =  90.476
1, 143  acc:     3 /     3 = 100.000
1, 144  acc:     1 /     1 = 100.000
1, 145  acc:    11 /    11 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     3 /     4 =  75.000
1, 148  acc:   213 /   236 =  90.254
1, 149  acc:    24 /    25 =  96.000
1, 150  acc:    17 /    17 = 100.000
1, 151  acc:     7 /    14 =  50.000
1, 152  acc:     4 /     4 = 100.000
1, 153  acc:     2 /     2 = 100.000
1, 154  acc:    46 /    48 =  95.833
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     8 /     9 =  88.889
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    38 /    40 =  95.000
1, 160  acc:     0 /     0 =     nan
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     8 /     8 = 100.000
1, 164  acc:    29 /    35 =  82.857
1, 165  acc:     2 /     3 =  66.667
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3740 /  3930 =  95.165
1, 170  acc:   709 /   733 =  96.726
1, 171  acc:   260 /   275 =  94.545
1, 172  acc:   229 /   242 =  94.628
1, 173  acc:    60 /    64 =  93.750
1, 174  acc:    14 /    14 = 100.000
1, 175  acc:     8 /     9 =  88.889
1, 176  acc:    60 /    72 =  83.333
1, 177  acc:    72 /    78 =  92.308
1, 178  acc:    10 /    12 =  83.333
1, 179  acc:     4 /     4 = 100.000
1, 180  acc:     4 /     4 = 100.000
1, 181  acc:     7 /     7 = 100.000
1, 182  acc:     7 /     7 = 100.000
1, 183  acc:    18 /    19 =  94.737
1, 184  acc:   125 /   131 =  95.420
1, 185  acc:    28 /    30 =  93.333
1, 186  acc:    23 /    24 =  95.833
1, 187  acc:     9 /     9 = 100.000
1, 188  acc:     6 /     6 = 100.000
1, 189  acc:     2 /     2 = 100.000
1, 190  acc:    12 /    12 = 100.000
1, 191  acc:     7 /     7 = 100.000
1, 192  acc:     8 /     8 = 100.000
1, 193  acc:     9 /     9 = 100.000
1, 194  acc:     6 /     6 = 100.000
1, 195  acc:     1 /     1 = 100.000
1, 196  acc:   123 /   128 =  96.094
1, 197  acc:    14 /    14 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     5 /     5 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    13 /    17 =  76.471
1, 205  acc:     5 /     5 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    35 /    35 = 100.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     1 /     1 = 100.000
1, 212  acc:     6 /     6 = 100.000
1, 213  acc:    18 /    18 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     3 /     3 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    16 /    16 = 100.000
1, 218  acc:    12 /    12 = 100.000
1, 219  acc:     6 /     6 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 237907 / 269038 =  88.429
Robust  acc:     0 /     2 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 23173 / 25373 =  91.329
0, 1  acc: 28642 / 31282 =  91.561
0, 2  acc:  5640 /  6155 =  91.633
0, 3  acc: 22280 / 24292 =  91.717
0, 4  acc:  9922 / 10829 =  91.624
0, 5  acc:  5042 /  5541 =  90.994
0, 6  acc:  6211 /  6785 =  91.540
0, 7  acc: 11012 / 12016 =  91.644
1, 0  acc:  4081 /  4437 =  91.977
1, 1  acc:  4557 /  4962 =  91.838
1, 2  acc:  2063 /  2265 =  91.082
1, 3  acc:  2247 /  2446 =  91.864
1, 4  acc:  2866 /  3125 =  91.712
1, 5  acc:   918 /  1003 =  91.525
1, 6  acc:  2818 /  3111 =  90.582
1, 7  acc:  4258 /  4682 =  90.944
--------------------------------------
Average acc: 135730 / 148304 =  91.521
Robust  acc:  2818 /  3111 =  90.582
--------------------------------------
New max robust acc: 90.58180649308903
debias model - Saving best checkpoint at epoch 0
replace: True
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed45.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 43.478 | Best Acc: 93.559
-------------------------------------
Training, Epoch 0:
Accuracies by groups:
0, 0  acc:  9201 / 12092 =  76.092
0, 1  acc: 11061 / 14179 =  78.010
0, 2  acc:  1534 /  3210 =  47.788
0, 3  acc: 10185 / 12101 =  84.167
0, 4  acc:  3160 /  5355 =  59.010
0, 5  acc:  2234 /  2980 =  74.966
0, 6  acc:  1450 /  3335 =  43.478
0, 7  acc:  2913 /  5723 =  50.900
1, 0  acc:  1976 /  2203 =  89.696
1, 1  acc:  1982 /  2270 =  87.313
1, 2  acc:  1119 /  1216 =  92.023
1, 3  acc:  1093 /  1260 =  86.746
1, 4  acc:  1465 /  1627 =  90.043
1, 5  acc:   447 /   520 =  85.962
1, 6  acc:  1438 /  1537 =  93.559
1, 7  acc:  2060 /  2246 =  91.719
------------------------------------
Average acc: 53318 / 71854 =  74.203
Robust  acc:  1450 /  3335 =  43.478
------------------------------------
Accuracies by groups:
0, 0  acc:  9201 / 12092 =  76.092
0, 1  acc: 11061 / 14179 =  78.010
0, 2  acc:  1534 /  3210 =  47.788
0, 3  acc: 10185 / 12101 =  84.167
0, 4  acc:  3160 /  5355 =  59.010
0, 5  acc:  2234 /  2980 =  74.966
0, 6  acc:  1450 /  3335 =  43.478
0, 7  acc:  2913 /  5723 =  50.900
1, 0  acc:  1976 /  2203 =  89.696
1, 1  acc:  1982 /  2270 =  87.313
1, 2  acc:  1119 /  1216 =  92.023
1, 3  acc:  1093 /  1260 =  86.746
1, 4  acc:  1465 /  1627 =  90.043
1, 5  acc:   447 /   520 =  85.962
1, 6  acc:  1438 /  1537 =  93.559
1, 7  acc:  2060 /  2246 =  91.719
------------------------------------
Average acc: 53318 / 71854 =  74.203
Robust  acc:  1450 /  3335 =  43.478
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9201 / 12092 =  76.092
0, 1  acc: 11061 / 14179 =  78.010
0, 2  acc:  1534 /  3210 =  47.788
0, 3  acc: 10185 / 12101 =  84.167
0, 4  acc:  3160 /  5355 =  59.010
0, 5  acc:  2234 /  2980 =  74.966
0, 6  acc:  1450 /  3335 =  43.478
0, 7  acc:  2913 /  5723 =  50.900
1, 0  acc:  1976 /  2203 =  89.696
1, 1  acc:  1982 /  2270 =  87.313
1, 2  acc:  1119 /  1216 =  92.023
1, 3  acc:  1093 /  1260 =  86.746
1, 4  acc:  1465 /  1627 =  90.043
1, 5  acc:   447 /   520 =  85.962
1, 6  acc:  1438 /  1537 =  93.559
1, 7  acc:  2060 /  2246 =  91.719
------------------------------------
Average acc: 53318 / 71854 =  74.203
Robust  acc:  1450 /  3335 =  43.478
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   2 | Train Loss: 0.011 | Train Acc: 94.372 | Val Loss: 0.000 | Val Acc: 96.590
Training:
Accuracies by groups:
0, 0  acc: 74076 / 77834 =  95.172
0, 1  acc:  5283 /  5685 =  92.929
0, 2  acc:  8112 /  8957 =  90.566
0, 3  acc:  4074 /  4497 =  90.594
0, 4  acc:  1424 /  1874 =  75.987
0, 5  acc:   123 /   185 =  66.486
0, 6  acc:   188 /   227 =  82.819
0, 7  acc:   186 /   246 =  75.610
0, 8  acc:  7314 /  7762 =  94.228
0, 9  acc:   469 /   511 =  91.781
0, 10  acc:   492 /   535 =  91.963
0, 11  acc:   325 /   350 =  92.857
0, 12  acc:   271 /   360 =  75.278
0, 13  acc:    27 /    37 =  72.973
0, 14  acc:    48 /    58 =  82.759
0, 15  acc:    25 /    30 =  83.333
0, 16  acc:  3181 /  3893 =  81.711
0, 17  acc:    84 /   104 =  80.769
0, 18  acc:   326 /   390 =  83.590
0, 19  acc:   102 /   122 =  83.607
0, 20  acc:    42 /    69 =  60.870
0, 21  acc:     5 /     6 =  83.333
0, 22  acc:    19 /    28 =  67.857
0, 23  acc:     0 /     7 =   0.000
0, 24  acc:   412 /   517 =  79.691
0, 25  acc:    18 /    25 =  72.000
0, 26  acc:    27 /    32 =  84.375
0, 27  acc:    14 /    17 =  82.353
0, 28  acc:    11 /    22 =  50.000
0, 29  acc:     2 /     4 =  50.000
0, 30  acc:     4 /     6 =  66.667
0, 31  acc:     1 /     4 =  25.000
0, 32  acc:  1210 /  1327 =  91.183
0, 33  acc:    49 /    55 =  89.091
0, 34  acc:    48 /    54 =  88.889
0, 35  acc:    19 /    20 =  95.000
0, 36  acc:    16 /    22 =  72.727
0, 37  acc:     2 /     3 =  66.667
0, 38  acc:     3 /     5 =  60.000
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   375 /   405 =  92.593
0, 41  acc:    21 /    22 =  95.455
0, 42  acc:    12 /    14 =  85.714
0, 43  acc:    21 /    21 = 100.000
0, 44  acc:    17 /    18 =  94.444
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     7 /     8 =  87.500
0, 47  acc:     1 /     1 = 100.000
0, 48  acc:   190 /   244 =  77.869
0, 49  acc:     0 /     0 =     nan
0, 50  acc:    16 /    19 =  84.211
0, 51  acc:    12 /    13 =  92.308
0, 52  acc:     4 /     5 =  80.000
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     2 /     2 = 100.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   259 /   292 =  88.699
0, 57  acc:     5 /     5 = 100.000
0, 58  acc:    10 /    12 =  83.333
0, 59  acc:    13 /    15 =  86.667
0, 60  acc:     6 /    11 =  54.545
0, 61  acc:     2 /     3 =  66.667
0, 62  acc:     2 /     3 =  66.667
0, 63  acc:     3 /     3 = 100.000
0, 64  acc:  1283 /  1697 =  75.604
0, 65  acc:   159 /   220 =  72.273
0, 66  acc:   128 /   164 =  78.049
0, 67  acc:    69 /    82 =  84.146
0, 68  acc:    28 /    42 =  66.667
0, 69  acc:     1 /     1 = 100.000
0, 70  acc:     6 /     9 =  66.667
0, 71  acc:     5 /     6 =  83.333
0, 72  acc:    34 /    39 =  87.179
0, 73  acc:     3 /     4 =  75.000
0, 74  acc:     3 /     3 = 100.000
0, 75  acc:     7 /     8 =  87.500
0, 76  acc:     2 /     4 =  50.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     2 /     2 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    35 /    57 =  61.404
0, 81  acc:     5 /     7 =  71.429
0, 82  acc:     8 /    10 =  80.000
0, 83  acc:     2 /     2 = 100.000
0, 84  acc:     2 /     5 =  40.000
0, 85  acc:     0 /     0 =     nan
0, 86  acc:     2 /     4 =  50.000
0, 87  acc:     3 /     3 = 100.000
0, 88  acc:     2 /     3 =  66.667
0, 89  acc:     0 /     1 =   0.000
0, 90  acc:     2 /     2 = 100.000
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     2 =   0.000
0, 94  acc:    23 /    36 =  63.889
0, 95  acc:     2 /     5 =  40.000
0, 96  acc:     4 /     4 = 100.000
0, 97  acc:     0 /     0 =     nan
0, 98  acc:     8 /    10 =  80.000
0, 99  acc:     3 /     3 = 100.000
0, 100  acc:     1 /     2 =  50.000
0, 101  acc:     6 /     7 =  85.714
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     2 /     3 =  66.667
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     2 /     2 = 100.000
0, 106  acc:    10 /    14 =  71.429
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     0 /     2 =   0.000
0, 111  acc:     0 /     2 =   0.000
0, 112  acc:     4 /     6 =  66.667
0, 113  acc:     1 /     1 = 100.000
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  2845 /  3671 =  77.499
0, 118  acc:   646 /   843 =  76.631
0, 119  acc:   180 /   230 =  78.261
0, 120  acc:   167 /   216 =  77.315
0, 121  acc:    28 /    44 =  63.636
0, 122  acc:     4 /     7 =  57.143
0, 123  acc:     4 /     8 =  50.000
0, 124  acc:    11 /    14 =  78.571
0, 125  acc:   194 /   251 =  77.291
0, 126  acc:    44 /    50 =  88.000
0, 127  acc:     9 /    11 =  81.818
0, 128  acc:    14 /    21 =  66.667
0, 129  acc:     5 /     5 = 100.000
0, 130  acc:     2 /     2 = 100.000
0, 131  acc:     2 /     2 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:    67 /   110 =  60.909
0, 134  acc:    12 /    33 =  36.364
0, 135  acc:     9 /    16 =  56.250
0, 136  acc:     5 /     8 =  62.500
0, 137  acc:     1 /     3 =  33.333
0, 138  acc:     0 /     0 =     nan
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    18 /    31 =  58.065
0, 142  acc:     0 /     3 =   0.000
0, 143  acc:     0 /     2 =   0.000
0, 144  acc:     2 /     2 = 100.000
0, 145  acc:     0 /     1 =   0.000
0, 146  acc:     0 /     0 =     nan
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    47 /    66 =  71.212
0, 149  acc:     5 /     6 =  83.333
0, 150  acc:     1 /     1 = 100.000
0, 151  acc:     3 /     9 =  33.333
0, 152  acc:     0 /     0 =     nan
0, 153  acc:     1 /     1 = 100.000
0, 154  acc:     9 /    13 =  69.231
0, 155  acc:     0 /     1 =   0.000
0, 156  acc:     0 /     0 =     nan
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     0 /     1 =   0.000
0, 159  acc:     5 /     8 =  62.500
0, 160  acc:     0 /     0 =     nan
0, 161  acc:     0 /     0 =     nan
0, 162  acc:     0 /     2 =   0.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:     4 /     6 =  66.667
0, 165  acc:     0 /     1 =   0.000
0, 166  acc:     2 /     2 = 100.000
0, 167  acc:     1 /     1 = 100.000
0, 168  acc:     0 /     2 =   0.000
0, 169  acc:   662 /   995 =  66.533
0, 170  acc:   129 /   210 =  61.429
0, 171  acc:    48 /    65 =  73.846
0, 172  acc:    68 /   100 =  68.000
0, 173  acc:     6 /    11 =  54.545
0, 174  acc:     2 /     2 = 100.000
0, 175  acc:     1 /     2 =  50.000
0, 176  acc:     6 /    11 =  54.545
0, 177  acc:    35 /    43 =  81.395
0, 178  acc:     3 /     8 =  37.500
0, 179  acc:     0 /     3 =   0.000
0, 180  acc:     3 /     3 = 100.000
0, 181  acc:     0 /     0 =     nan
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     3 /     3 = 100.000
0, 184  acc:    12 /    18 =  66.667
0, 185  acc:     2 /     3 =  66.667
0, 186  acc:     7 /     7 = 100.000
0, 187  acc:     0 /     0 =     nan
0, 188  acc:     1 /     1 = 100.000
0, 189  acc:     0 /     1 =   0.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    13 /    20 =  65.000
0, 192  acc:     0 /     0 =     nan
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     0 /     2 =   0.000
0, 196  acc:    10 /    18 =  55.556
0, 197  acc:     3 /     6 =  50.000
0, 198  acc:     0 /     3 =   0.000
0, 199  acc:     2 /     2 = 100.000
0, 200  acc:     0 /     0 =     nan
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     0 /     0 =     nan
0, 204  acc:     5 /    12 =  41.667
0, 205  acc:     0 /     0 =     nan
0, 206  acc:     2 /     2 = 100.000
0, 207  acc:     0 /     0 =     nan
0, 208  acc:     0 /     1 =   0.000
0, 209  acc:     1 /     2 =  50.000
0, 210  acc:     0 /     0 =     nan
0, 211  acc:     0 /     2 =   0.000
0, 212  acc:     0 /     0 =     nan
0, 213  acc:     0 /     1 =   0.000
0, 214  acc:     0 /     0 =     nan
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     1 /     3 =  33.333
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     2 /     3 =  66.667
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     0 /     0 =     nan
1, 0  acc: 57614 / 59345 =  97.083
1, 1  acc:  6318 /  6500 =  97.200
1, 2  acc: 10763 / 11170 =  96.356
1, 3  acc:  4396 /  4566 =  96.277
1, 4  acc:  5117 /  5289 =  96.748
1, 5  acc:   929 /   951 =  97.687
1, 6  acc:   525 /   538 =  97.584
1, 7  acc:   648 /   661 =  98.033
1, 8  acc:  4964 /  5215 =  95.187
1, 9  acc:   354 /   371 =  95.418
1, 10  acc:   471 /   496 =  94.960
1, 11  acc:   229 /   241 =  95.021
1, 12  acc:   776 /   804 =  96.517
1, 13  acc:   100 /   108 =  92.593
1, 14  acc:   127 /   133 =  95.489
1, 15  acc:   150 /   162 =  92.593
1, 16  acc:  8320 /  8670 =  95.963
1, 17  acc:   326 /   332 =  98.193
1, 18  acc:   651 /   670 =  97.164
1, 19  acc:   268 /   274 =  97.810
1, 20  acc:   329 /   333 =  98.799
1, 21  acc:    54 /    54 = 100.000
1, 22  acc:   171 /   179 =  95.531
1, 23  acc:    50 /    50 = 100.000
1, 24  acc:   988 /  1036 =  95.367
1, 25  acc:    24 /    25 =  96.000
1, 26  acc:   107 /   110 =  97.273
1, 27  acc:    17 /    17 = 100.000
1, 28  acc:   162 /   164 =  98.780
1, 29  acc:    10 /    10 = 100.000
1, 30  acc:    27 /    27 = 100.000
1, 31  acc:     9 /    10 =  90.000
1, 32  acc:  1670 /  1732 =  96.420
1, 33  acc:    63 /    71 =  88.732
1, 34  acc:    72 /    77 =  93.506
1, 35  acc:    30 /    30 = 100.000
1, 36  acc:    60 /    64 =  93.750
1, 37  acc:     7 /     7 = 100.000
1, 38  acc:    30 /    30 = 100.000
1, 39  acc:     1 /     1 = 100.000
1, 40  acc:   386 /   409 =  94.377
1, 41  acc:    14 /    14 = 100.000
1, 42  acc:    13 /    14 =  92.857
1, 43  acc:    21 /    23 =  91.304
1, 44  acc:    28 /    29 =  96.552
1, 45  acc:     4 /     4 = 100.000
1, 46  acc:    13 /    14 =  92.857
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   521 /   544 =  95.772
1, 49  acc:    16 /    16 = 100.000
1, 50  acc:    46 /    47 =  97.872
1, 51  acc:    19 /    22 =  86.364
1, 52  acc:    17 /    17 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    44 /    44 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   437 /   458 =  95.415
1, 57  acc:    12 /    12 = 100.000
1, 58  acc:    14 /    14 = 100.000
1, 59  acc:    18 /    19 =  94.737
1, 60  acc:    29 /    29 = 100.000
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    21 /    21 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5573 /  5734 =  97.192
1, 65  acc:   808 /   832 =  97.115
1, 66  acc:   489 /   506 =  96.640
1, 67  acc:   207 /   216 =  95.833
1, 68  acc:   287 /   294 =  97.619
1, 69  acc:    43 /    44 =  97.727
1, 70  acc:    73 /    76 =  96.053
1, 71  acc:    23 /    24 =  95.833
1, 72  acc:   110 /   112 =  98.214
1, 73  acc:     1 /     1 = 100.000
1, 74  acc:     7 /     8 =  87.500
1, 75  acc:     3 /     3 = 100.000
1, 76  acc:    24 /    24 = 100.000
1, 77  acc:     3 /     3 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     0 /     0 =     nan
1, 80  acc:   192 /   197 =  97.462
1, 81  acc:    32 /    33 =  96.970
1, 82  acc:    52 /    55 =  94.545
1, 83  acc:    11 /    12 =  91.667
1, 84  acc:     6 /     6 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    19 /    19 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    19 /    20 =  95.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     4 /     4 = 100.000
1, 93  acc:     1 /     1 = 100.000
1, 94  acc:   168 /   176 =  95.455
1, 95  acc:    16 /    18 =  88.889
1, 96  acc:     7 /     8 =  87.500
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    16 /    16 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    20 /    20 = 100.000
1, 101  acc:     9 /     9 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     3 /     3 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    26 /    26 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    22 /    22 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:    10 /    10 = 100.000
1, 111  acc:     4 /     4 = 100.000
1, 112  acc:    14 /    15 =  93.333
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  9226 /  9572 =  96.385
1, 118  acc:  2189 /  2256 =  97.030
1, 119  acc:   560 /   584 =  95.890
1, 120  acc:   613 /   633 =  96.840
1, 121  acc:   172 /   176 =  97.727
1, 122  acc:    88 /    91 =  96.703
1, 123  acc:    29 /    31 =  93.548
1, 124  acc:    36 /    37 =  97.297
1, 125  acc:   579 /   592 =  97.804
1, 126  acc:   121 /   126 =  96.032
1, 127  acc:    38 /    42 =  90.476
1, 128  acc:    42 /    45 =  93.333
1, 129  acc:    16 /    16 = 100.000
1, 130  acc:    12 /    12 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    11 /    13 =  84.615
1, 133  acc:   478 /   497 =  96.177
1, 134  acc:    92 /    96 =  95.833
1, 135  acc:    43 /    44 =  97.727
1, 136  acc:    37 /    39 =  94.872
1, 137  acc:    11 /    11 = 100.000
1, 138  acc:     0 /     1 =   0.000
1, 139  acc:     9 /     9 = 100.000
1, 140  acc:     3 /     3 = 100.000
1, 141  acc:   137 /   140 =  97.857
1, 142  acc:    21 /    22 =  95.455
1, 143  acc:     4 /     4 = 100.000
1, 144  acc:     2 /     2 = 100.000
1, 145  acc:     3 /     3 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     5 /     5 = 100.000
1, 148  acc:   223 /   230 =  96.957
1, 149  acc:    12 /    12 = 100.000
1, 150  acc:    11 /    11 = 100.000
1, 151  acc:    15 /    17 =  88.235
1, 152  acc:     7 /     7 = 100.000
1, 153  acc:     4 /     4 = 100.000
1, 154  acc:    56 /    57 =  98.246
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     9 /     9 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    37 /    38 =  97.368
1, 160  acc:     6 /     8 =  75.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     9 /     9 = 100.000
1, 164  acc:    24 /    25 =  96.000
1, 165  acc:     4 /     4 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3767 /  3876 =  97.188
1, 170  acc:   696 /   717 =  97.071
1, 171  acc:   263 /   280 =  93.929
1, 172  acc:   236 /   245 =  96.327
1, 173  acc:    66 /    66 = 100.000
1, 174  acc:    15 /    15 = 100.000
1, 175  acc:     8 /     8 = 100.000
1, 176  acc:    63 /    65 =  96.923
1, 177  acc:    88 /    92 =  95.652
1, 178  acc:     6 /     9 =  66.667
1, 179  acc:     2 /     4 =  50.000
1, 180  acc:    14 /    16 =  87.500
1, 181  acc:     5 /     5 = 100.000
1, 182  acc:    12 /    12 = 100.000
1, 183  acc:     9 /     9 = 100.000
1, 184  acc:   153 /   156 =  98.077
1, 185  acc:    34 /    34 = 100.000
1, 186  acc:    24 /    26 =  92.308
1, 187  acc:     6 /     6 = 100.000
1, 188  acc:     4 /     5 =  80.000
1, 189  acc:     6 /     7 =  85.714
1, 190  acc:    14 /    14 = 100.000
1, 191  acc:    11 /    11 = 100.000
1, 192  acc:     8 /     8 = 100.000
1, 193  acc:     6 /     6 = 100.000
1, 194  acc:     2 /     2 = 100.000
1, 195  acc:     7 /     7 = 100.000
1, 196  acc:   105 /   109 =  96.330
1, 197  acc:    16 /    18 =  88.889
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     4 /     4 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    12 /    15 =  80.000
1, 205  acc:     8 /     8 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    26 /    26 = 100.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     1 /     1 = 100.000
1, 212  acc:     3 /     3 = 100.000
1, 213  acc:    11 /    11 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     3 /     3 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    18 /    18 = 100.000
1, 218  acc:    12 /    12 = 100.000
1, 219  acc:    13 /    13 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 253896 / 269038 =  94.372
Robust  acc:     0 /     7 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 24449 / 25373 =  96.358
0, 1  acc: 30193 / 31282 =  96.519
0, 2  acc:  5956 /  6155 =  96.767
0, 3  acc: 23453 / 24292 =  96.546
0, 4  acc: 10474 / 10829 =  96.722
0, 5  acc:  5325 /  5541 =  96.102
0, 6  acc:  6577 /  6785 =  96.934
0, 7  acc: 11622 / 12016 =  96.721
1, 0  acc:  4299 /  4437 =  96.890
1, 1  acc:  4794 /  4962 =  96.614
1, 2  acc:  2187 /  2265 =  96.556
1, 3  acc:  2376 /  2446 =  97.138
1, 4  acc:  3016 /  3125 =  96.512
1, 5  acc:   967 /  1003 =  96.411
1, 6  acc:  3022 /  3111 =  97.139
1, 7  acc:  4533 /  4682 =  96.818
--------------------------------------
Average acc: 143243 / 148304 =  96.587
Robust  acc:  5325 /  5541 =  96.102
--------------------------------------
New max robust acc: 96.1017866811045
debias model - Saving best checkpoint at epoch 1
replace: True
-> Updating checkpoint debias-wga-best_seed45.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed45.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 68.546 | Best Acc: 91.174
-------------------------------------
Training, Epoch 1:
Accuracies by groups:
0, 0  acc: 10559 / 12092 =  87.322
0, 1  acc: 12601 / 14179 =  88.871
0, 2  acc:  2427 /  3210 =  75.607
0, 3  acc: 11033 / 12101 =  91.174
0, 4  acc:  4166 /  5355 =  77.796
0, 5  acc:  2549 /  2980 =  85.537
0, 6  acc:  2286 /  3335 =  68.546
0, 7  acc:  4092 /  5723 =  71.501
1, 0  acc:  1658 /  2203 =  75.261
1, 1  acc:  1666 /  2270 =  73.392
1, 2  acc:   905 /  1216 =  74.424
1, 3  acc:   915 /  1260 =  72.619
1, 4  acc:  1253 /  1627 =  77.013
1, 5  acc:   388 /   520 =  74.615
1, 6  acc:  1269 /  1537 =  82.563
1, 7  acc:  1798 /  2246 =  80.053
------------------------------------
Average acc: 59565 / 71854 =  82.897
Robust  acc:  2286 /  3335 =  68.546
------------------------------------
Accuracies by groups:
0, 0  acc: 10559 / 12092 =  87.322
0, 1  acc: 12601 / 14179 =  88.871
0, 2  acc:  2427 /  3210 =  75.607
0, 3  acc: 11033 / 12101 =  91.174
0, 4  acc:  4166 /  5355 =  77.796
0, 5  acc:  2549 /  2980 =  85.537
0, 6  acc:  2286 /  3335 =  68.546
0, 7  acc:  4092 /  5723 =  71.501
1, 0  acc:  1658 /  2203 =  75.261
1, 1  acc:  1666 /  2270 =  73.392
1, 2  acc:   905 /  1216 =  74.424
1, 3  acc:   915 /  1260 =  72.619
1, 4  acc:  1253 /  1627 =  77.013
1, 5  acc:   388 /   520 =  74.615
1, 6  acc:  1269 /  1537 =  82.563
1, 7  acc:  1798 /  2246 =  80.053
------------------------------------
Average acc: 59565 / 71854 =  82.897
Robust  acc:  2286 /  3335 =  68.546
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10559 / 12092 =  87.322
0, 1  acc: 12601 / 14179 =  88.871
0, 2  acc:  2427 /  3210 =  75.607
0, 3  acc: 11033 / 12101 =  91.174
0, 4  acc:  4166 /  5355 =  77.796
0, 5  acc:  2549 /  2980 =  85.537
0, 6  acc:  2286 /  3335 =  68.546
0, 7  acc:  4092 /  5723 =  71.501
1, 0  acc:  1658 /  2203 =  75.261
1, 1  acc:  1666 /  2270 =  73.392
1, 2  acc:   905 /  1216 =  74.424
1, 3  acc:   915 /  1260 =  72.619
1, 4  acc:  1253 /  1627 =  77.013
1, 5  acc:   388 /   520 =  74.615
1, 6  acc:  1269 /  1537 =  82.563
1, 7  acc:  1798 /  2246 =  80.053
------------------------------------
Average acc: 59565 / 71854 =  82.897
Robust  acc:  2286 /  3335 =  68.546
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   3 | Train Loss: 0.008 | Train Acc: 96.648 | Val Loss: 0.000 | Val Acc: 97.613
Training:
Accuracies by groups:
0, 0  acc: 75301 / 77574 =  97.070
0, 1  acc:  5459 /  5731 =  95.254
0, 2  acc:  8645 /  9142 =  94.564
0, 3  acc:  4383 /  4626 =  94.747
0, 4  acc:  1491 /  1759 =  84.764
0, 5  acc:   158 /   199 =  79.397
0, 6  acc:   216 /   246 =  87.805
0, 7  acc:   213 /   243 =  87.654
0, 8  acc:  7488 /  7760 =  96.495
0, 9  acc:   432 /   461 =  93.709
0, 10  acc:   528 /   549 =  96.175
0, 11  acc:   345 /   372 =  92.742
0, 12  acc:   326 /   378 =  86.243
0, 13  acc:    38 /    42 =  90.476
0, 14  acc:    63 /    67 =  94.030
0, 15  acc:    22 /    29 =  75.862
0, 16  acc:  3385 /  3784 =  89.456
0, 17  acc:   113 /   130 =  86.923
0, 18  acc:   345 /   368 =  93.750
0, 19  acc:    91 /   109 =  83.486
0, 20  acc:    52 /    70 =  74.286
0, 21  acc:     7 /    10 =  70.000
0, 22  acc:    17 /    22 =  77.273
0, 23  acc:     3 /     5 =  60.000
0, 24  acc:   426 /   493 =  86.410
0, 25  acc:    24 /    28 =  85.714
0, 26  acc:    47 /    53 =  88.679
0, 27  acc:    18 /    23 =  78.261
0, 28  acc:    20 /    25 =  80.000
0, 29  acc:     0 /     0 =     nan
0, 30  acc:     4 /     5 =  80.000
0, 31  acc:     3 /     3 = 100.000
0, 32  acc:  1316 /  1389 =  94.744
0, 33  acc:    61 /    65 =  93.846
0, 34  acc:    61 /    62 =  98.387
0, 35  acc:    21 /    22 =  95.455
0, 36  acc:    21 /    23 =  91.304
0, 37  acc:     3 /     4 =  75.000
0, 38  acc:     5 /     6 =  83.333
0, 39  acc:     3 /     3 = 100.000
0, 40  acc:   441 /   465 =  94.839
0, 41  acc:    15 /    15 = 100.000
0, 42  acc:    15 /    16 =  93.750
0, 43  acc:    17 /    17 = 100.000
0, 44  acc:    11 /    11 = 100.000
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     2 /     2 = 100.000
0, 47  acc:     1 /     1 = 100.000
0, 48  acc:   233 /   263 =  88.593
0, 49  acc:     2 /     2 = 100.000
0, 50  acc:     8 /     9 =  88.889
0, 51  acc:    11 /    11 = 100.000
0, 52  acc:     6 /    10 =  60.000
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     1 /     2 =  50.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   222 /   246 =  90.244
0, 57  acc:     4 /     4 = 100.000
0, 58  acc:     3 /     6 =  50.000
0, 59  acc:     9 /     9 = 100.000
0, 60  acc:     6 /     8 =  75.000
0, 61  acc:     1 /     1 = 100.000
0, 62  acc:     4 /     6 =  66.667
0, 63  acc:     1 /     1 = 100.000
0, 64  acc:  1440 /  1698 =  84.806
0, 65  acc:   218 /   262 =  83.206
0, 66  acc:   135 /   178 =  75.843
0, 67  acc:    72 /    81 =  88.889
0, 68  acc:    39 /    43 =  90.698
0, 69  acc:     0 /     2 =   0.000
0, 70  acc:    11 /    13 =  84.615
0, 71  acc:    10 /    10 = 100.000
0, 72  acc:    44 /    48 =  91.667
0, 73  acc:     0 /     0 =     nan
0, 74  acc:     3 /     3 = 100.000
0, 75  acc:     6 /     7 =  85.714
0, 76  acc:     0 /     3 =   0.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     0 /     0 =     nan
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    37 /    49 =  75.510
0, 81  acc:     4 /     4 = 100.000
0, 82  acc:     9 /     9 = 100.000
0, 83  acc:     1 /     4 =  25.000
0, 84  acc:     2 /     2 = 100.000
0, 85  acc:     0 /     0 =     nan
0, 86  acc:     1 /     3 =  33.333
0, 87  acc:     1 /     2 =  50.000
0, 88  acc:     2 /     4 =  50.000
0, 89  acc:     0 /     0 =     nan
0, 90  acc:     4 /     4 = 100.000
0, 91  acc:     2 /     2 = 100.000
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    42 /    52 =  80.769
0, 95  acc:     3 /     4 =  75.000
0, 96  acc:     3 /     3 = 100.000
0, 97  acc:     0 /     0 =     nan
0, 98  acc:     7 /     8 =  87.500
0, 99  acc:     1 /     1 = 100.000
0, 100  acc:     1 /     1 = 100.000
0, 101  acc:     4 /     4 = 100.000
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:     5 /    10 =  50.000
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     4 /     4 = 100.000
0, 110  acc:     2 /     4 =  50.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     3 /     4 =  75.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     1 /     1 = 100.000
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  3245 /  3723 =  87.161
0, 118  acc:   738 /   869 =  84.925
0, 119  acc:   199 /   222 =  89.640
0, 120  acc:   208 /   237 =  87.764
0, 121  acc:    48 /    66 =  72.727
0, 122  acc:     6 /     7 =  85.714
0, 123  acc:     7 /     8 =  87.500
0, 124  acc:    11 /    14 =  78.571
0, 125  acc:   201 /   241 =  83.402
0, 126  acc:    53 /    63 =  84.127
0, 127  acc:     4 /     5 =  80.000
0, 128  acc:    17 /    20 =  85.000
0, 129  acc:     0 /     0 =     nan
0, 130  acc:     2 /     2 = 100.000
0, 131  acc:     0 /     1 =   0.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:    94 /   119 =  78.992
0, 134  acc:    16 /    21 =  76.190
0, 135  acc:     8 /    10 =  80.000
0, 136  acc:    14 /    18 =  77.778
0, 137  acc:     3 /     7 =  42.857
0, 138  acc:     0 /     0 =     nan
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    20 /    25 =  80.000
0, 142  acc:     1 /     2 =  50.000
0, 143  acc:     1 /     3 =  33.333
0, 144  acc:     0 /     1 =   0.000
0, 145  acc:     0 /     1 =   0.000
0, 146  acc:     0 /     0 =     nan
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    38 /    44 =  86.364
0, 149  acc:    12 /    13 =  92.308
0, 150  acc:     2 /     2 = 100.000
0, 151  acc:     1 /     4 =  25.000
0, 152  acc:     1 /     1 = 100.000
0, 153  acc:     0 /     0 =     nan
0, 154  acc:    15 /    21 =  71.429
0, 155  acc:     2 /     4 =  50.000
0, 156  acc:     0 /     0 =     nan
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     2 /     2 = 100.000
0, 159  acc:    11 /    14 =  78.571
0, 160  acc:     0 /     0 =     nan
0, 161  acc:     0 /     0 =     nan
0, 162  acc:     3 /     3 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:     6 /     8 =  75.000
0, 165  acc:     2 /     2 = 100.000
0, 166  acc:     5 /     5 = 100.000
0, 167  acc:     1 /     1 = 100.000
0, 168  acc:     1 /     1 = 100.000
0, 169  acc:   822 /  1014 =  81.065
0, 170  acc:   164 /   215 =  76.279
0, 171  acc:    71 /    87 =  81.609
0, 172  acc:    91 /   114 =  79.825
0, 173  acc:     5 /     8 =  62.500
0, 174  acc:     1 /     2 =  50.000
0, 175  acc:     1 /     1 = 100.000
0, 176  acc:     5 /     8 =  62.500
0, 177  acc:    43 /    48 =  89.583
0, 178  acc:     5 /     6 =  83.333
0, 179  acc:     4 /     6 =  66.667
0, 180  acc:     0 /     1 =   0.000
0, 181  acc:     2 /     2 = 100.000
0, 182  acc:     1 /     1 = 100.000
0, 183  acc:     2 /     4 =  50.000
0, 184  acc:    25 /    32 =  78.125
0, 185  acc:     1 /     2 =  50.000
0, 186  acc:     6 /     6 = 100.000
0, 187  acc:     1 /     4 =  25.000
0, 188  acc:     1 /     2 =  50.000
0, 189  acc:     0 /     0 =     nan
0, 190  acc:     0 /     0 =     nan
0, 191  acc:     8 /    16 =  50.000
0, 192  acc:     0 /     0 =     nan
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     0 /     0 =     nan
0, 196  acc:    16 /    24 =  66.667
0, 197  acc:     2 /     3 =  66.667
0, 198  acc:     2 /     2 = 100.000
0, 199  acc:     1 /     2 =  50.000
0, 200  acc:     1 /     2 =  50.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     0 /     1 =   0.000
0, 204  acc:     8 /    10 =  80.000
0, 205  acc:     2 /     2 = 100.000
0, 206  acc:     2 /     2 = 100.000
0, 207  acc:     0 /     0 =     nan
0, 208  acc:     3 /     3 = 100.000
0, 209  acc:     5 /     6 =  83.333
0, 210  acc:     0 /     0 =     nan
0, 211  acc:     0 /     0 =     nan
0, 212  acc:     2 /     2 = 100.000
0, 213  acc:     0 /     0 =     nan
0, 214  acc:     0 /     0 =     nan
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     2 /     4 =  50.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     2 /     2 = 100.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     2 /     2 = 100.000
0, 221  acc:     1 /     1 = 100.000
1, 0  acc: 58554 / 59540 =  98.344
1, 1  acc:  6340 /  6439 =  98.462
1, 2  acc: 10844 / 11042 =  98.207
1, 3  acc:  4684 /  4796 =  97.665
1, 4  acc:  5149 /  5254 =  98.002
1, 5  acc:   968 /   980 =  98.776
1, 6  acc:   577 /   586 =  98.464
1, 7  acc:   599 /   611 =  98.036
1, 8  acc:  5121 /  5248 =  97.580
1, 9  acc:   349 /   356 =  98.034
1, 10  acc:   455 /   465 =  97.849
1, 11  acc:   230 /   236 =  97.458
1, 12  acc:   812 /   826 =  98.305
1, 13  acc:    94 /    96 =  97.917
1, 14  acc:   147 /   151 =  97.351
1, 15  acc:   125 /   128 =  97.656
1, 16  acc:  8251 /  8428 =  97.900
1, 17  acc:   307 /   313 =  98.083
1, 18  acc:   694 /   706 =  98.300
1, 19  acc:   272 /   279 =  97.491
1, 20  acc:   327 /   337 =  97.033
1, 21  acc:    55 /    56 =  98.214
1, 22  acc:   145 /   150 =  96.667
1, 23  acc:    58 /    60 =  96.667
1, 24  acc:  1082 /  1102 =  98.185
1, 25  acc:    20 /    20 = 100.000
1, 26  acc:    84 /    85 =  98.824
1, 27  acc:    20 /    20 = 100.000
1, 28  acc:   171 /   175 =  97.714
1, 29  acc:     8 /     8 = 100.000
1, 30  acc:    32 /    32 = 100.000
1, 31  acc:    10 /    10 = 100.000
1, 32  acc:  1798 /  1838 =  97.824
1, 33  acc:    81 /    81 = 100.000
1, 34  acc:    65 /    69 =  94.203
1, 35  acc:    22 /    22 = 100.000
1, 36  acc:    53 /    54 =  98.148
1, 37  acc:    11 /    11 = 100.000
1, 38  acc:    32 /    35 =  91.429
1, 39  acc:     7 /     7 = 100.000
1, 40  acc:   411 /   422 =  97.393
1, 41  acc:    17 /    17 = 100.000
1, 42  acc:    11 /    12 =  91.667
1, 43  acc:    18 /    18 = 100.000
1, 44  acc:    23 /    23 = 100.000
1, 45  acc:     2 /     2 = 100.000
1, 46  acc:    16 /    16 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   546 /   556 =  98.201
1, 49  acc:    12 /    13 =  92.308
1, 50  acc:    42 /    44 =  95.455
1, 51  acc:    28 /    28 = 100.000
1, 52  acc:    11 /    11 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    40 /    41 =  97.561
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   405 /   416 =  97.356
1, 57  acc:    14 /    15 =  93.333
1, 58  acc:    16 /    17 =  94.118
1, 59  acc:    18 /    18 = 100.000
1, 60  acc:    43 /    43 = 100.000
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    29 /    29 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5682 /  5778 =  98.339
1, 65  acc:   728 /   748 =  97.326
1, 66  acc:   441 /   455 =  96.923
1, 67  acc:   213 /   219 =  97.260
1, 68  acc:   264 /   271 =  97.417
1, 69  acc:    50 /    51 =  98.039
1, 70  acc:    82 /    83 =  98.795
1, 71  acc:    29 /    29 = 100.000
1, 72  acc:   108 /   110 =  98.182
1, 73  acc:     3 /     3 = 100.000
1, 74  acc:     9 /     9 = 100.000
1, 75  acc:     7 /     7 = 100.000
1, 76  acc:    22 /    22 = 100.000
1, 77  acc:     2 /     2 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     5 /     5 = 100.000
1, 80  acc:   199 /   204 =  97.549
1, 81  acc:    29 /    29 = 100.000
1, 82  acc:    65 /    66 =  98.485
1, 83  acc:     8 /     8 = 100.000
1, 84  acc:    11 /    11 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    22 /    23 =  95.652
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    19 /    20 =  95.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     4 /     4 = 100.000
1, 93  acc:     2 /     2 = 100.000
1, 94  acc:   171 /   171 = 100.000
1, 95  acc:    21 /    22 =  95.455
1, 96  acc:     8 /     8 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    21 /    21 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    20 /    20 = 100.000
1, 101  acc:     4 /     4 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     4 /     4 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    22 /    23 =  95.652
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    19 /    19 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     9 /     9 = 100.000
1, 111  acc:     2 /     2 = 100.000
1, 112  acc:    18 /    19 =  94.737
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  9232 /  9433 =  97.869
1, 118  acc:  2191 /  2240 =  97.812
1, 119  acc:   546 /   552 =  98.913
1, 120  acc:   588 /   602 =  97.674
1, 121  acc:   149 /   151 =  98.675
1, 122  acc:    83 /    84 =  98.810
1, 123  acc:    37 /    39 =  94.872
1, 124  acc:    33 /    35 =  94.286
1, 125  acc:   594 /   612 =  97.059
1, 126  acc:   124 /   125 =  99.200
1, 127  acc:    31 /    31 = 100.000
1, 128  acc:    44 /    44 = 100.000
1, 129  acc:    19 /    20 =  95.000
1, 130  acc:     2 /     2 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    10 /    10 = 100.000
1, 133  acc:   481 /   487 =  98.768
1, 134  acc:    99 /   100 =  99.000
1, 135  acc:    49 /    50 =  98.000
1, 136  acc:    38 /    39 =  97.436
1, 137  acc:    10 /    10 = 100.000
1, 138  acc:     2 /     4 =  50.000
1, 139  acc:     3 /     3 = 100.000
1, 140  acc:     7 /     7 = 100.000
1, 141  acc:   120 /   121 =  99.174
1, 142  acc:    22 /    24 =  91.667
1, 143  acc:     7 /     7 = 100.000
1, 144  acc:     6 /     6 = 100.000
1, 145  acc:     5 /     5 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     6 /     6 = 100.000
1, 148  acc:   196 /   201 =  97.512
1, 149  acc:    21 /    21 = 100.000
1, 150  acc:     9 /    10 =  90.000
1, 151  acc:    18 /    21 =  85.714
1, 152  acc:     6 /     6 = 100.000
1, 153  acc:     2 /     2 = 100.000
1, 154  acc:    46 /    48 =  95.833
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     9 /     9 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    44 /    45 =  97.778
1, 160  acc:     2 /     2 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     2 /     2 = 100.000
1, 164  acc:    23 /    25 =  92.000
1, 165  acc:     3 /     4 =  75.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3787 /  3857 =  98.185
1, 170  acc:   729 /   739 =  98.647
1, 171  acc:   269 /   277 =  97.112
1, 172  acc:   249 /   255 =  97.647
1, 173  acc:    79 /    82 =  96.341
1, 174  acc:    27 /    28 =  96.429
1, 175  acc:    10 /    11 =  90.909
1, 176  acc:    60 /    62 =  96.774
1, 177  acc:    72 /    76 =  94.737
1, 178  acc:     9 /     9 = 100.000
1, 179  acc:     8 /     9 =  88.889
1, 180  acc:    12 /    12 = 100.000
1, 181  acc:     9 /     9 = 100.000
1, 182  acc:     3 /     3 = 100.000
1, 183  acc:    18 /    19 =  94.737
1, 184  acc:   158 /   161 =  98.137
1, 185  acc:    32 /    33 =  96.970
1, 186  acc:    21 /    21 = 100.000
1, 187  acc:    10 /    10 = 100.000
1, 188  acc:     5 /     5 = 100.000
1, 189  acc:     4 /     5 =  80.000
1, 190  acc:    14 /    14 = 100.000
1, 191  acc:     4 /     4 = 100.000
1, 192  acc:    17 /    17 = 100.000
1, 193  acc:     4 /     4 = 100.000
1, 194  acc:     5 /     5 = 100.000
1, 195  acc:     2 /     2 = 100.000
1, 196  acc:   103 /   107 =  96.262
1, 197  acc:     6 /     6 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     4 /     4 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    13 /    15 =  86.667
1, 205  acc:     3 /     3 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    30 /    30 = 100.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     2 /     2 = 100.000
1, 212  acc:     6 /     6 = 100.000
1, 213  acc:    10 /    10 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     2 /     2 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     9 /     9 = 100.000
1, 218  acc:    11 /    11 = 100.000
1, 219  acc:    14 /    14 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 260021 / 269038 =  96.648
Robust  acc:     0 /     2 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 24738 / 25373 =  97.497
0, 1  acc: 30545 / 31282 =  97.644
0, 2  acc:  5978 /  6155 =  97.124
0, 3  acc: 23727 / 24292 =  97.674
0, 4  acc: 10582 / 10829 =  97.719
0, 5  acc:  5422 /  5541 =  97.852
0, 6  acc:  6627 /  6785 =  97.671
0, 7  acc: 11725 / 12016 =  97.578
1, 0  acc:  4315 /  4437 =  97.250
1, 1  acc:  4853 /  4962 =  97.803
1, 2  acc:  2217 /  2265 =  97.881
1, 3  acc:  2399 /  2446 =  98.078
1, 4  acc:  3057 /  3125 =  97.824
1, 5  acc:   963 /  1003 =  96.012
1, 6  acc:  3030 /  3111 =  97.396
1, 7  acc:  4571 /  4682 =  97.629
--------------------------------------
Average acc: 144749 / 148304 =  97.603
Robust  acc:   963 /  1003 =  96.012
--------------------------------------
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 72.143 | Best Acc: 91.835
-------------------------------------
Training, Epoch 2:
Accuracies by groups:
0, 0  acc: 10585 / 12092 =  87.537
0, 1  acc: 12584 / 14179 =  88.751
0, 2  acc:  2410 /  3210 =  75.078
0, 3  acc: 11113 / 12101 =  91.835
0, 4  acc:  4307 /  5355 =  80.430
0, 5  acc:  2542 /  2980 =  85.302
0, 6  acc:  2431 /  3335 =  72.894
0, 7  acc:  4338 /  5723 =  75.799
1, 0  acc:  1652 /  2203 =  74.989
1, 1  acc:  1693 /  2270 =  74.581
1, 2  acc:   915 /  1216 =  75.247
1, 3  acc:   909 /  1260 =  72.143
1, 4  acc:  1182 /  1627 =  72.649
1, 5  acc:   380 /   520 =  73.077
1, 6  acc:  1193 /  1537 =  77.619
1, 7  acc:  1708 /  2246 =  76.046
------------------------------------
Average acc: 59942 / 71854 =  83.422
Robust  acc:   909 /  1260 =  72.143
------------------------------------
Accuracies by groups:
0, 0  acc: 10585 / 12092 =  87.537
0, 1  acc: 12584 / 14179 =  88.751
0, 2  acc:  2410 /  3210 =  75.078
0, 3  acc: 11113 / 12101 =  91.835
0, 4  acc:  4307 /  5355 =  80.430
0, 5  acc:  2542 /  2980 =  85.302
0, 6  acc:  2431 /  3335 =  72.894
0, 7  acc:  4338 /  5723 =  75.799
1, 0  acc:  1652 /  2203 =  74.989
1, 1  acc:  1693 /  2270 =  74.581
1, 2  acc:   915 /  1216 =  75.247
1, 3  acc:   909 /  1260 =  72.143
1, 4  acc:  1182 /  1627 =  72.649
1, 5  acc:   380 /   520 =  73.077
1, 6  acc:  1193 /  1537 =  77.619
1, 7  acc:  1708 /  2246 =  76.046
------------------------------------
Average acc: 59942 / 71854 =  83.422
Robust  acc:   909 /  1260 =  72.143
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10585 / 12092 =  87.537
0, 1  acc: 12584 / 14179 =  88.751
0, 2  acc:  2410 /  3210 =  75.078
0, 3  acc: 11113 / 12101 =  91.835
0, 4  acc:  4307 /  5355 =  80.430
0, 5  acc:  2542 /  2980 =  85.302
0, 6  acc:  2431 /  3335 =  72.894
0, 7  acc:  4338 /  5723 =  75.799
1, 0  acc:  1652 /  2203 =  74.989
1, 1  acc:  1693 /  2270 =  74.581
1, 2  acc:   915 /  1216 =  75.247
1, 3  acc:   909 /  1260 =  72.143
1, 4  acc:  1182 /  1627 =  72.649
1, 5  acc:   380 /   520 =  73.077
1, 6  acc:  1193 /  1537 =  77.619
1, 7  acc:  1708 /  2246 =  76.046
------------------------------------
Average acc: 59942 / 71854 =  83.422
Robust  acc:   909 /  1260 =  72.143
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   4 | Train Loss: 0.006 | Train Acc: 97.802 | Val Loss: 0.000 | Val Acc: 98.202
Training:
Accuracies by groups:
0, 0  acc: 76182 / 77731 =  98.007
0, 1  acc:  5519 /  5708 =  96.689
0, 2  acc:  8783 /  9113 =  96.379
0, 3  acc:  4390 /  4559 =  96.293
0, 4  acc:  1654 /  1826 =  90.581
0, 5  acc:   214 /   244 =  87.705
0, 6  acc:   195 /   221 =  88.235
0, 7  acc:   217 /   231 =  93.939
0, 8  acc:  7594 /  7762 =  97.836
0, 9  acc:   484 /   503 =  96.223
0, 10  acc:   464 /   482 =  96.266
0, 11  acc:   340 /   350 =  97.143
0, 12  acc:   328 /   357 =  91.877
0, 13  acc:    50 /    52 =  96.154
0, 14  acc:    56 /    59 =  94.915
0, 15  acc:    37 /    40 =  92.500
0, 16  acc:  3610 /  3885 =  92.921
0, 17  acc:   120 /   132 =  90.909
0, 18  acc:   337 /   361 =  93.352
0, 19  acc:   102 /   119 =  85.714
0, 20  acc:    56 /    70 =  80.000
0, 21  acc:     9 /    10 =  90.000
0, 22  acc:    13 /    20 =  65.000
0, 23  acc:     1 /     6 =  16.667
0, 24  acc:   467 /   508 =  91.929
0, 25  acc:    29 /    30 =  96.667
0, 26  acc:    48 /    49 =  97.959
0, 27  acc:    16 /    16 = 100.000
0, 28  acc:    23 /    28 =  82.143
0, 29  acc:     0 /     0 =     nan
0, 30  acc:     2 /     3 =  66.667
0, 31  acc:     3 /     3 = 100.000
0, 32  acc:  1309 /  1354 =  96.677
0, 33  acc:    56 /    58 =  96.552
0, 34  acc:    43 /    43 = 100.000
0, 35  acc:    11 /    11 = 100.000
0, 36  acc:    14 /    16 =  87.500
0, 37  acc:     4 /     6 =  66.667
0, 38  acc:     8 /     8 = 100.000
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   399 /   408 =  97.794
0, 41  acc:    29 /    30 =  96.667
0, 42  acc:    23 /    23 = 100.000
0, 43  acc:    28 /    28 = 100.000
0, 44  acc:    15 /    17 =  88.235
0, 45  acc:     1 /     1 = 100.000
0, 46  acc:     5 /     5 = 100.000
0, 47  acc:     0 /     1 =   0.000
0, 48  acc:   236 /   254 =  92.913
0, 49  acc:     1 /     1 = 100.000
0, 50  acc:    10 /    11 =  90.909
0, 51  acc:    10 /    11 =  90.909
0, 52  acc:     6 /     6 = 100.000
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     1 /     1 = 100.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   245 /   251 =  97.610
0, 57  acc:     9 /     9 = 100.000
0, 58  acc:    10 /    14 =  71.429
0, 59  acc:    15 /    15 = 100.000
0, 60  acc:     9 /    13 =  69.231
0, 61  acc:     2 /     2 = 100.000
0, 62  acc:     3 /     4 =  75.000
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  1523 /  1681 =  90.601
0, 65  acc:   192 /   221 =  86.878
0, 66  acc:   155 /   174 =  89.080
0, 67  acc:    61 /    65 =  93.846
0, 68  acc:    38 /    43 =  88.372
0, 69  acc:     1 /     1 = 100.000
0, 70  acc:    15 /    16 =  93.750
0, 71  acc:     6 /     6 = 100.000
0, 72  acc:    48 /    50 =  96.000
0, 73  acc:     0 /     1 =   0.000
0, 74  acc:     4 /     4 = 100.000
0, 75  acc:    11 /    11 = 100.000
0, 76  acc:     2 /     3 =  66.667
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     1 /     1 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    38 /    41 =  92.683
0, 81  acc:     4 /     6 =  66.667
0, 82  acc:    12 /    12 = 100.000
0, 83  acc:     3 /     5 =  60.000
0, 84  acc:     3 /     6 =  50.000
0, 85  acc:     0 /     0 =     nan
0, 86  acc:     4 /     4 = 100.000
0, 87  acc:     3 /     3 = 100.000
0, 88  acc:     1 /     2 =  50.000
0, 89  acc:     0 /     1 =   0.000
0, 90  acc:     2 /     2 = 100.000
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    28 /    34 =  82.353
0, 95  acc:     4 /     4 = 100.000
0, 96  acc:     0 /     0 =     nan
0, 97  acc:     0 /     0 =     nan
0, 98  acc:     5 /     5 = 100.000
0, 99  acc:     0 /     0 =     nan
0, 100  acc:     1 /     1 = 100.000
0, 101  acc:     3 /     5 =  60.000
0, 102  acc:     1 /     1 = 100.000
0, 103  acc:     6 /     6 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     1 /     1 = 100.000
0, 106  acc:     8 /    11 =  72.727
0, 107  acc:     1 /     1 = 100.000
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     0 /     1 =   0.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     3 /     3 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     1 /     1 = 100.000
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  3437 /  3745 =  91.776
0, 118  acc:   762 /   830 =  91.807
0, 119  acc:   222 /   241 =  92.116
0, 120  acc:   202 /   216 =  93.519
0, 121  acc:    27 /    35 =  77.143
0, 122  acc:    13 /    14 =  92.857
0, 123  acc:     4 /     4 = 100.000
0, 124  acc:     9 /    11 =  81.818
0, 125  acc:   216 /   227 =  95.154
0, 126  acc:    60 /    65 =  92.308
0, 127  acc:    15 /    17 =  88.235
0, 128  acc:    13 /    15 =  86.667
0, 129  acc:     4 /     5 =  80.000
0, 130  acc:     3 /     3 = 100.000
0, 131  acc:     1 /     1 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   103 /   119 =  86.555
0, 134  acc:    25 /    29 =  86.207
0, 135  acc:    10 /    11 =  90.909
0, 136  acc:    13 /    17 =  76.471
0, 137  acc:     2 /     2 = 100.000
0, 138  acc:     0 /     0 =     nan
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    23 /    26 =  88.462
0, 142  acc:     4 /     4 = 100.000
0, 143  acc:     2 /     3 =  66.667
0, 144  acc:     5 /     6 =  83.333
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     0 /     1 =   0.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    55 /    58 =  94.828
0, 149  acc:     6 /     7 =  85.714
0, 150  acc:     3 /     4 =  75.000
0, 151  acc:     4 /     7 =  57.143
0, 152  acc:     1 /     1 = 100.000
0, 153  acc:     1 /     1 = 100.000
0, 154  acc:    15 /    17 =  88.235
0, 155  acc:     4 /     4 = 100.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     2 /     2 = 100.000
0, 159  acc:     6 /     8 =  75.000
0, 160  acc:     0 /     0 =     nan
0, 161  acc:     0 /     0 =     nan
0, 162  acc:     2 /     2 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:     8 /    10 =  80.000
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:     2 /     2 = 100.000
0, 167  acc:     3 /     3 = 100.000
0, 168  acc:     2 /     2 = 100.000
0, 169  acc:   882 /  1017 =  86.726
0, 170  acc:   186 /   211 =  88.152
0, 171  acc:    65 /    70 =  92.857
0, 172  acc:   101 /   108 =  93.519
0, 173  acc:     8 /    10 =  80.000
0, 174  acc:     1 /     1 = 100.000
0, 175  acc:     0 /     0 =     nan
0, 176  acc:     5 /    10 =  50.000
0, 177  acc:    44 /    49 =  89.796
0, 178  acc:     8 /     8 = 100.000
0, 179  acc:     5 /     6 =  83.333
0, 180  acc:     4 /     4 = 100.000
0, 181  acc:     2 /     2 = 100.000
0, 182  acc:     1 /     1 = 100.000
0, 183  acc:     0 /     0 =     nan
0, 184  acc:    25 /    31 =  80.645
0, 185  acc:     4 /     4 = 100.000
0, 186  acc:     6 /     6 = 100.000
0, 187  acc:     1 /     2 =  50.000
0, 188  acc:     0 /     1 =   0.000
0, 189  acc:     1 /     1 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    11 /    14 =  78.571
0, 192  acc:     0 /     1 =   0.000
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     2 /     2 = 100.000
0, 195  acc:     0 /     1 =   0.000
0, 196  acc:    17 /    20 =  85.000
0, 197  acc:     3 /     4 =  75.000
0, 198  acc:     1 /     3 =  33.333
0, 199  acc:     3 /     4 =  75.000
0, 200  acc:     0 /     0 =     nan
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     1 /     1 = 100.000
0, 204  acc:     8 /    11 =  72.727
0, 205  acc:     2 /     2 = 100.000
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     0 /     0 =     nan
0, 208  acc:     2 /     3 =  66.667
0, 209  acc:     3 /     4 =  75.000
0, 210  acc:     0 /     1 =   0.000
0, 211  acc:     0 /     0 =     nan
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     0 /     1 =   0.000
0, 214  acc:     0 /     0 =     nan
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     3 /     3 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     4 /     4 = 100.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     1 /     1 = 100.000
0, 221  acc:     0 /     0 =     nan
1, 0  acc: 58874 / 59551 =  98.863
1, 1  acc:  6492 /  6576 =  98.723
1, 2  acc: 10980 / 11111 =  98.821
1, 3  acc:  4456 /  4511 =  98.781
1, 4  acc:  5230 /  5284 =  98.978
1, 5  acc:   936 /   951 =  98.423
1, 6  acc:   544 /   546 =  99.634
1, 7  acc:   626 /   631 =  99.208
1, 8  acc:  5260 /  5347 =  98.373
1, 9  acc:   357 /   361 =  98.892
1, 10  acc:   464 /   472 =  98.305
1, 11  acc:   214 /   221 =  96.833
1, 12  acc:   817 /   825 =  99.030
1, 13  acc:   100 /   101 =  99.010
1, 14  acc:   139 /   142 =  97.887
1, 15  acc:   147 /   149 =  98.658
1, 16  acc:  8485 /  8579 =  98.904
1, 17  acc:   318 /   324 =  98.148
1, 18  acc:   646 /   657 =  98.326
1, 19  acc:   266 /   270 =  98.519
1, 20  acc:   319 /   322 =  99.068
1, 21  acc:    70 /    70 = 100.000
1, 22  acc:   139 /   141 =  98.582
1, 23  acc:    50 /    51 =  98.039
1, 24  acc:  1080 /  1096 =  98.540
1, 25  acc:    23 /    23 = 100.000
1, 26  acc:    86 /    89 =  96.629
1, 27  acc:    12 /    12 = 100.000
1, 28  acc:   181 /   182 =  99.451
1, 29  acc:    13 /    13 = 100.000
1, 30  acc:    25 /    26 =  96.154
1, 31  acc:    12 /    12 = 100.000
1, 32  acc:  1691 /  1710 =  98.889
1, 33  acc:    84 /    85 =  98.824
1, 34  acc:    56 /    58 =  96.552
1, 35  acc:    26 /    26 = 100.000
1, 36  acc:    52 /    53 =  98.113
1, 37  acc:     9 /     9 = 100.000
1, 38  acc:    29 /    29 = 100.000
1, 39  acc:     7 /     7 = 100.000
1, 40  acc:   419 /   425 =  98.588
1, 41  acc:    22 /    22 = 100.000
1, 42  acc:    13 /    14 =  92.857
1, 43  acc:    11 /    11 = 100.000
1, 44  acc:    43 /    43 = 100.000
1, 45  acc:     8 /     8 = 100.000
1, 46  acc:    10 /    10 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   586 /   593 =  98.820
1, 49  acc:    13 /    13 = 100.000
1, 50  acc:    40 /    42 =  95.238
1, 51  acc:    27 /    27 = 100.000
1, 52  acc:    13 /    13 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    21 /    21 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   402 /   411 =  97.810
1, 57  acc:    21 /    22 =  95.455
1, 58  acc:    15 /    15 = 100.000
1, 59  acc:    14 /    14 = 100.000
1, 60  acc:    27 /    28 =  96.429
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    32 /    33 =  96.970
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5652 /  5733 =  98.587
1, 65  acc:   770 /   777 =  99.099
1, 66  acc:   505 /   511 =  98.826
1, 67  acc:   192 /   194 =  98.969
1, 68  acc:   288 /   289 =  99.654
1, 69  acc:    52 /    53 =  98.113
1, 70  acc:    91 /    91 = 100.000
1, 71  acc:    28 /    28 = 100.000
1, 72  acc:   117 /   118 =  99.153
1, 73  acc:     2 /     3 =  66.667
1, 74  acc:     4 /     4 = 100.000
1, 75  acc:     6 /     6 = 100.000
1, 76  acc:    15 /    15 = 100.000
1, 77  acc:     1 /     1 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     4 /     4 = 100.000
1, 80  acc:   200 /   201 =  99.502
1, 81  acc:    21 /    22 =  95.455
1, 82  acc:    59 /    59 = 100.000
1, 83  acc:     7 /     7 = 100.000
1, 84  acc:     6 /     6 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    21 /    22 =  95.455
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    22 /    23 =  95.652
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     2 /     2 = 100.000
1, 93  acc:     4 /     4 = 100.000
1, 94  acc:   157 /   161 =  97.516
1, 95  acc:    23 /    23 = 100.000
1, 96  acc:    16 /    16 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    21 /    21 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    25 /    26 =  96.154
1, 101  acc:     7 /     7 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     7 /     7 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    24 /    24 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    22 /    22 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:    22 /    22 = 100.000
1, 111  acc:     3 /     3 = 100.000
1, 112  acc:    11 /    12 =  91.667
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  9404 /  9530 =  98.678
1, 118  acc:  2163 /  2193 =  98.632
1, 119  acc:   546 /   557 =  98.025
1, 120  acc:   579 /   589 =  98.302
1, 121  acc:   174 /   174 = 100.000
1, 122  acc:    99 /    99 = 100.000
1, 123  acc:    30 /    30 = 100.000
1, 124  acc:    36 /    37 =  97.297
1, 125  acc:   607 /   618 =  98.220
1, 126  acc:   151 /   154 =  98.052
1, 127  acc:    25 /    26 =  96.154
1, 128  acc:    49 /    50 =  98.000
1, 129  acc:    23 /    23 = 100.000
1, 130  acc:    15 /    15 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     5 /     6 =  83.333
1, 133  acc:   509 /   513 =  99.220
1, 134  acc:    61 /    61 = 100.000
1, 135  acc:    44 /    44 = 100.000
1, 136  acc:    34 /    34 = 100.000
1, 137  acc:    11 /    11 = 100.000
1, 138  acc:     3 /     3 = 100.000
1, 139  acc:     5 /     5 = 100.000
1, 140  acc:     1 /     1 = 100.000
1, 141  acc:   120 /   120 = 100.000
1, 142  acc:    17 /    17 = 100.000
1, 143  acc:     3 /     3 = 100.000
1, 144  acc:     4 /     4 = 100.000
1, 145  acc:     3 /     3 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     4 /     5 =  80.000
1, 148  acc:   212 /   219 =  96.804
1, 149  acc:    22 /    23 =  95.652
1, 150  acc:     6 /     6 = 100.000
1, 151  acc:    13 /    14 =  92.857
1, 152  acc:     3 /     3 = 100.000
1, 153  acc:     6 /     6 = 100.000
1, 154  acc:    55 /    56 =  98.214
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:    10 /    10 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    34 /    34 = 100.000
1, 160  acc:     4 /     4 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     3 /     3 = 100.000
1, 164  acc:    34 /    34 = 100.000
1, 165  acc:     1 /     1 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3790 /  3844 =  98.595
1, 170  acc:   699 /   710 =  98.451
1, 171  acc:   269 /   274 =  98.175
1, 172  acc:   229 /   232 =  98.707
1, 173  acc:    72 /    72 = 100.000
1, 174  acc:    11 /    11 = 100.000
1, 175  acc:    14 /    14 = 100.000
1, 176  acc:    41 /    42 =  97.619
1, 177  acc:   100 /   102 =  98.039
1, 178  acc:    16 /    16 = 100.000
1, 179  acc:     9 /     9 = 100.000
1, 180  acc:     6 /     6 = 100.000
1, 181  acc:    14 /    15 =  93.333
1, 182  acc:     3 /     3 = 100.000
1, 183  acc:    18 /    18 = 100.000
1, 184  acc:   147 /   148 =  99.324
1, 185  acc:    34 /    34 = 100.000
1, 186  acc:    24 /    25 =  96.000
1, 187  acc:     5 /     5 = 100.000
1, 188  acc:     3 /     3 = 100.000
1, 189  acc:     4 /     4 = 100.000
1, 190  acc:     8 /     8 = 100.000
1, 191  acc:    10 /    10 = 100.000
1, 192  acc:    16 /    16 = 100.000
1, 193  acc:     4 /     4 = 100.000
1, 194  acc:     5 /     5 = 100.000
1, 195  acc:     5 /     5 = 100.000
1, 196  acc:   136 /   136 = 100.000
1, 197  acc:     7 /     8 =  87.500
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     7 /     7 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    17 /    17 = 100.000
1, 205  acc:     4 /     4 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    20 /    20 = 100.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     5 /     5 = 100.000
1, 212  acc:     6 /     6 = 100.000
1, 213  acc:     9 /    11 =  81.818
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     3 /     3 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    13 /    13 = 100.000
1, 218  acc:     7 /     7 = 100.000
1, 219  acc:    10 /    10 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 263124 / 269038 =  97.802
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 24900 / 25373 =  98.136
0, 1  acc: 30705 / 31282 =  98.155
0, 2  acc:  6042 /  6155 =  98.164
0, 3  acc: 23856 / 24292 =  98.205
0, 4  acc: 10626 / 10829 =  98.125
0, 5  acc:  5442 /  5541 =  98.213
0, 6  acc:  6667 /  6785 =  98.261
0, 7  acc: 11793 / 12016 =  98.144
1, 0  acc:  4340 /  4437 =  97.814
1, 1  acc:  4869 /  4962 =  98.126
1, 2  acc:  2224 /  2265 =  98.190
1, 3  acc:  2413 /  2446 =  98.651
1, 4  acc:  3066 /  3125 =  98.112
1, 5  acc:   991 /  1003 =  98.804
1, 6  acc:  3053 /  3111 =  98.136
1, 7  acc:  4582 /  4682 =  97.864
--------------------------------------
Average acc: 145569 / 148304 =  98.156
Robust  acc:  4340 /  4437 =  97.814
--------------------------------------
New max robust acc: 97.81383817894974
debias model - Saving best checkpoint at epoch 3
replace: True
-> Updating checkpoint debias-wga-best_seed45.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed45.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 67.226 | Best Acc: 91.083
-------------------------------------
Training, Epoch 3:
Accuracies by groups:
0, 0  acc: 10553 / 12092 =  87.273
0, 1  acc: 12587 / 14179 =  88.772
0, 2  acc:  2369 /  3210 =  73.801
0, 3  acc: 11022 / 12101 =  91.083
0, 4  acc:  4282 /  5355 =  79.963
0, 5  acc:  2510 /  2980 =  84.228
0, 6  acc:  2242 /  3335 =  67.226
0, 7  acc:  4110 /  5723 =  71.815
1, 0  acc:  1647 /  2203 =  74.762
1, 1  acc:  1658 /  2270 =  73.040
1, 2  acc:   902 /  1216 =  74.178
1, 3  acc:   904 /  1260 =  71.746
1, 4  acc:  1177 /  1627 =  72.342
1, 5  acc:   383 /   520 =  73.654
1, 6  acc:  1227 /  1537 =  79.831
1, 7  acc:  1738 /  2246 =  77.382
------------------------------------
Average acc: 59311 / 71854 =  82.544
Robust  acc:  2242 /  3335 =  67.226
------------------------------------
Accuracies by groups:
0, 0  acc: 10553 / 12092 =  87.273
0, 1  acc: 12587 / 14179 =  88.772
0, 2  acc:  2369 /  3210 =  73.801
0, 3  acc: 11022 / 12101 =  91.083
0, 4  acc:  4282 /  5355 =  79.963
0, 5  acc:  2510 /  2980 =  84.228
0, 6  acc:  2242 /  3335 =  67.226
0, 7  acc:  4110 /  5723 =  71.815
1, 0  acc:  1647 /  2203 =  74.762
1, 1  acc:  1658 /  2270 =  73.040
1, 2  acc:   902 /  1216 =  74.178
1, 3  acc:   904 /  1260 =  71.746
1, 4  acc:  1177 /  1627 =  72.342
1, 5  acc:   383 /   520 =  73.654
1, 6  acc:  1227 /  1537 =  79.831
1, 7  acc:  1738 /  2246 =  77.382
------------------------------------
Average acc: 59311 / 71854 =  82.544
Robust  acc:  2242 /  3335 =  67.226
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10553 / 12092 =  87.273
0, 1  acc: 12587 / 14179 =  88.772
0, 2  acc:  2369 /  3210 =  73.801
0, 3  acc: 11022 / 12101 =  91.083
0, 4  acc:  4282 /  5355 =  79.963
0, 5  acc:  2510 /  2980 =  84.228
0, 6  acc:  2242 /  3335 =  67.226
0, 7  acc:  4110 /  5723 =  71.815
1, 0  acc:  1647 /  2203 =  74.762
1, 1  acc:  1658 /  2270 =  73.040
1, 2  acc:   902 /  1216 =  74.178
1, 3  acc:   904 /  1260 =  71.746
1, 4  acc:  1177 /  1627 =  72.342
1, 5  acc:   383 /   520 =  73.654
1, 6  acc:  1227 /  1537 =  79.831
1, 7  acc:  1738 /  2246 =  77.382
------------------------------------
Average acc: 59311 / 71854 =  82.544
Robust  acc:  2242 /  3335 =  67.226
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   5 | Train Loss: 0.004 | Train Acc: 98.488 | Val Loss: 0.000 | Val Acc: 98.851
Training:
Accuracies by groups:
0, 0  acc: 76746 / 77761 =  98.695
0, 1  acc:  5695 /  5802 =  98.156
0, 2  acc:  8928 /  9146 =  97.616
0, 3  acc:  4391 /  4502 =  97.534
0, 4  acc:  1726 /  1850 =  93.297
0, 5  acc:   189 /   206 =  91.748
0, 6  acc:   245 /   259 =  94.595
0, 7  acc:   234 /   244 =  95.902
0, 8  acc:  7599 /  7737 =  98.216
0, 9  acc:   448 /   467 =  95.931
0, 10  acc:   477 /   489 =  97.546
0, 11  acc:   379 /   388 =  97.680
0, 12  acc:   316 /   333 =  94.895
0, 13  acc:    32 /    34 =  94.118
0, 14  acc:    47 /    48 =  97.917
0, 15  acc:    32 /    35 =  91.429
0, 16  acc:  3712 /  3886 =  95.522
0, 17  acc:   122 /   131 =  93.130
0, 18  acc:   388 /   403 =  96.278
0, 19  acc:   110 /   114 =  96.491
0, 20  acc:    59 /    69 =  85.507
0, 21  acc:     8 /     8 = 100.000
0, 22  acc:    29 /    30 =  96.667
0, 23  acc:     3 /     5 =  60.000
0, 24  acc:   442 /   474 =  93.249
0, 25  acc:    23 /    23 = 100.000
0, 26  acc:    45 /    46 =  97.826
0, 27  acc:    17 /    18 =  94.444
0, 28  acc:    24 /    29 =  82.759
0, 29  acc:     1 /     2 =  50.000
0, 30  acc:     4 /     6 =  66.667
0, 31  acc:     3 /     3 = 100.000
0, 32  acc:  1350 /  1384 =  97.543
0, 33  acc:    59 /    60 =  98.333
0, 34  acc:    55 /    57 =  96.491
0, 35  acc:    22 /    22 = 100.000
0, 36  acc:    19 /    20 =  95.000
0, 37  acc:     3 /     3 = 100.000
0, 38  acc:     7 /     7 = 100.000
0, 39  acc:     1 /     1 = 100.000
0, 40  acc:   380 /   391 =  97.187
0, 41  acc:    13 /    13 = 100.000
0, 42  acc:    16 /    16 = 100.000
0, 43  acc:    18 /    18 = 100.000
0, 44  acc:    10 /    10 = 100.000
0, 45  acc:     1 /     1 = 100.000
0, 46  acc:     2 /     2 = 100.000
0, 47  acc:     3 /     3 = 100.000
0, 48  acc:   241 /   252 =  95.635
0, 49  acc:     1 /     1 = 100.000
0, 50  acc:    13 /    15 =  86.667
0, 51  acc:    12 /    12 = 100.000
0, 52  acc:     1 /     1 = 100.000
0, 53  acc:     1 /     1 = 100.000
0, 54  acc:     0 /     0 =     nan
0, 55  acc:     2 /     2 = 100.000
0, 56  acc:   213 /   223 =  95.516
0, 57  acc:     8 /     8 = 100.000
0, 58  acc:    15 /    16 =  93.750
0, 59  acc:    22 /    22 = 100.000
0, 60  acc:     9 /    10 =  90.000
0, 61  acc:     1 /     1 = 100.000
0, 62  acc:     2 /     4 =  50.000
0, 63  acc:     2 /     2 = 100.000
0, 64  acc:  1613 /  1713 =  94.162
0, 65  acc:   190 /   200 =  95.000
0, 66  acc:   159 /   170 =  93.529
0, 67  acc:    50 /    54 =  92.593
0, 68  acc:    37 /    40 =  92.500
0, 69  acc:     4 /     4 = 100.000
0, 70  acc:    13 /    15 =  86.667
0, 71  acc:     4 /     4 = 100.000
0, 72  acc:    49 /    49 = 100.000
0, 73  acc:     3 /     3 = 100.000
0, 74  acc:     5 /     5 = 100.000
0, 75  acc:     8 /     8 = 100.000
0, 76  acc:     3 /     3 = 100.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     1 /     1 = 100.000
0, 79  acc:     1 /     1 = 100.000
0, 80  acc:    42 /    48 =  87.500
0, 81  acc:     3 /     5 =  60.000
0, 82  acc:     4 /     4 = 100.000
0, 83  acc:     5 /     6 =  83.333
0, 84  acc:     3 /     3 = 100.000
0, 85  acc:     1 /     2 =  50.000
0, 86  acc:     1 /     1 = 100.000
0, 87  acc:     0 /     0 =     nan
0, 88  acc:     5 /     5 = 100.000
0, 89  acc:     0 /     1 =   0.000
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    36 /    41 =  87.805
0, 95  acc:     6 /     6 = 100.000
0, 96  acc:     3 /     3 = 100.000
0, 97  acc:     0 /     0 =     nan
0, 98  acc:     8 /     9 =  88.889
0, 99  acc:     0 /     0 =     nan
0, 100  acc:     2 /     2 = 100.000
0, 101  acc:     3 /     4 =  75.000
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:     8 /     9 =  88.889
0, 107  acc:     1 /     1 = 100.000
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     1 /     2 =  50.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     3 /     4 =  75.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     1 /     1 = 100.000
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  3532 /  3723 =  94.870
0, 118  acc:   828 /   876 =  94.521
0, 119  acc:   228 /   243 =  93.827
0, 120  acc:   204 /   219 =  93.151
0, 121  acc:    43 /    47 =  91.489
0, 122  acc:    13 /    15 =  86.667
0, 123  acc:     8 /     8 = 100.000
0, 124  acc:     8 /     8 = 100.000
0, 125  acc:   212 /   222 =  95.495
0, 126  acc:    59 /    62 =  95.161
0, 127  acc:    14 /    17 =  82.353
0, 128  acc:    21 /    23 =  91.304
0, 129  acc:     1 /     1 = 100.000
0, 130  acc:     3 /     4 =  75.000
0, 131  acc:     0 /     0 =     nan
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   106 /   117 =  90.598
0, 134  acc:    17 /    24 =  70.833
0, 135  acc:     9 /     9 = 100.000
0, 136  acc:     9 /    10 =  90.000
0, 137  acc:     5 /     6 =  83.333
0, 138  acc:     0 /     0 =     nan
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    20 /    22 =  90.909
0, 142  acc:     4 /     5 =  80.000
0, 143  acc:     3 /     3 = 100.000
0, 144  acc:     3 /     3 = 100.000
0, 145  acc:     2 /     2 = 100.000
0, 146  acc:     1 /     1 = 100.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    49 /    55 =  89.091
0, 149  acc:     6 /     7 =  85.714
0, 150  acc:     3 /     4 =  75.000
0, 151  acc:     3 /     4 =  75.000
0, 152  acc:     1 /     1 = 100.000
0, 153  acc:     0 /     0 =     nan
0, 154  acc:    12 /    13 =  92.308
0, 155  acc:     0 /     0 =     nan
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     2 /     2 = 100.000
0, 159  acc:    13 /    13 = 100.000
0, 160  acc:     2 /     2 = 100.000
0, 161  acc:     2 /     2 = 100.000
0, 162  acc:     2 /     2 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:     9 /     9 = 100.000
0, 165  acc:     0 /     0 =     nan
0, 166  acc:     3 /     3 = 100.000
0, 167  acc:     1 /     1 = 100.000
0, 168  acc:     1 /     1 = 100.000
0, 169  acc:   857 /   926 =  92.549
0, 170  acc:   191 /   208 =  91.827
0, 171  acc:    66 /    72 =  91.667
0, 172  acc:   108 /   115 =  93.913
0, 173  acc:     8 /     9 =  88.889
0, 174  acc:     2 /     2 = 100.000
0, 175  acc:     3 /     4 =  75.000
0, 176  acc:    11 /    13 =  84.615
0, 177  acc:    43 /    44 =  97.727
0, 178  acc:     5 /     6 =  83.333
0, 179  acc:     2 /     2 = 100.000
0, 180  acc:     1 /     1 = 100.000
0, 181  acc:     0 /     0 =     nan
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     3 /     3 = 100.000
0, 184  acc:    16 /    19 =  84.211
0, 185  acc:     6 /     6 = 100.000
0, 186  acc:     3 /     3 = 100.000
0, 187  acc:     8 /     8 = 100.000
0, 188  acc:     1 /     1 = 100.000
0, 189  acc:     0 /     0 =     nan
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    16 /    16 = 100.000
0, 192  acc:     0 /     0 =     nan
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     0 /     0 =     nan
0, 195  acc:     1 /     1 = 100.000
0, 196  acc:    22 /    24 =  91.667
0, 197  acc:     3 /     4 =  75.000
0, 198  acc:     6 /     6 = 100.000
0, 199  acc:     6 /     6 = 100.000
0, 200  acc:     1 /     2 =  50.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     2 /     2 = 100.000
0, 204  acc:    13 /    17 =  76.471
0, 205  acc:     0 /     0 =     nan
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     1 /     1 = 100.000
0, 208  acc:     2 /     2 = 100.000
0, 209  acc:     2 /     3 =  66.667
0, 210  acc:     0 /     0 =     nan
0, 211  acc:     1 /     1 = 100.000
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     1 /     2 =  50.000
0, 214  acc:     0 /     1 =   0.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     2 /     2 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     4 /     4 = 100.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     1 /     1 = 100.000
0, 221  acc:     0 /     0 =     nan
1, 0  acc: 58723 / 59207 =  99.183
1, 1  acc:  6542 /  6597 =  99.166
1, 2  acc: 10830 / 10938 =  99.013
1, 3  acc:  4571 /  4616 =  99.025
1, 4  acc:  5196 /  5257 =  98.840
1, 5  acc:   922 /   932 =  98.927
1, 6  acc:   567 /   570 =  99.474
1, 7  acc:   624 /   630 =  99.048
1, 8  acc:  5241 /  5320 =  98.515
1, 9  acc:   354 /   359 =  98.607
1, 10  acc:   486 /   490 =  99.184
1, 11  acc:   231 /   236 =  97.881
1, 12  acc:   762 /   775 =  98.323
1, 13  acc:   113 /   114 =  99.123
1, 14  acc:   133 /   135 =  98.519
1, 15  acc:   142 /   143 =  99.301
1, 16  acc:  8423 /  8516 =  98.908
1, 17  acc:   316 /   321 =  98.442
1, 18  acc:   653 /   656 =  99.543
1, 19  acc:   245 /   251 =  97.610
1, 20  acc:   339 /   340 =  99.706
1, 21  acc:    44 /    44 = 100.000
1, 22  acc:   166 /   168 =  98.810
1, 23  acc:    48 /    49 =  97.959
1, 24  acc:  1049 /  1056 =  99.337
1, 25  acc:    23 /    23 = 100.000
1, 26  acc:   124 /   125 =  99.200
1, 27  acc:    22 /    22 = 100.000
1, 28  acc:   141 /   144 =  97.917
1, 29  acc:    11 /    11 = 100.000
1, 30  acc:    28 /    29 =  96.552
1, 31  acc:    10 /    10 = 100.000
1, 32  acc:  1718 /  1735 =  99.020
1, 33  acc:    89 /    89 = 100.000
1, 34  acc:    56 /    56 = 100.000
1, 35  acc:    24 /    25 =  96.000
1, 36  acc:    51 /    51 = 100.000
1, 37  acc:     7 /     7 = 100.000
1, 38  acc:    38 /    38 = 100.000
1, 39  acc:     3 /     3 = 100.000
1, 40  acc:   417 /   417 = 100.000
1, 41  acc:    15 /    15 = 100.000
1, 42  acc:    14 /    14 = 100.000
1, 43  acc:    28 /    28 = 100.000
1, 44  acc:    32 /    32 = 100.000
1, 45  acc:     4 /     4 = 100.000
1, 46  acc:    11 /    11 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   556 /   563 =  98.757
1, 49  acc:     9 /     9 = 100.000
1, 50  acc:    49 /    49 = 100.000
1, 51  acc:    23 /    23 = 100.000
1, 52  acc:    15 /    15 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    30 /    30 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   454 /   463 =  98.056
1, 57  acc:    24 /    24 = 100.000
1, 58  acc:    14 /    14 = 100.000
1, 59  acc:    18 /    18 = 100.000
1, 60  acc:    38 /    41 =  92.683
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    19 /    19 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5692 /  5738 =  99.198
1, 65  acc:   750 /   756 =  99.206
1, 66  acc:   445 /   451 =  98.670
1, 67  acc:   209 /   211 =  99.052
1, 68  acc:   248 /   250 =  99.200
1, 69  acc:    42 /    42 = 100.000
1, 70  acc:    78 /    78 = 100.000
1, 71  acc:    27 /    28 =  96.429
1, 72  acc:   143 /   144 =  99.306
1, 73  acc:     6 /     6 = 100.000
1, 74  acc:     2 /     2 = 100.000
1, 75  acc:     5 /     5 = 100.000
1, 76  acc:    32 /    33 =  96.970
1, 77  acc:     3 /     3 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     6 /     6 = 100.000
1, 80  acc:   217 /   220 =  98.636
1, 81  acc:    26 /    26 = 100.000
1, 82  acc:    51 /    52 =  98.077
1, 83  acc:     7 /     7 = 100.000
1, 84  acc:     5 /     5 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    30 /    30 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    29 /    29 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     2 /     2 = 100.000
1, 93  acc:     4 /     4 = 100.000
1, 94  acc:   167 /   168 =  99.405
1, 95  acc:    18 /    18 = 100.000
1, 96  acc:    17 /    17 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    18 /    18 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    22 /    22 = 100.000
1, 101  acc:     4 /     4 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     5 /     5 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    25 /    25 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    24 /    24 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     9 /     9 = 100.000
1, 111  acc:     5 /     5 = 100.000
1, 112  acc:    12 /    12 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  9693 /  9788 =  99.029
1, 118  acc:  2312 /  2333 =  99.100
1, 119  acc:   554 /   563 =  98.401
1, 120  acc:   622 /   627 =  99.203
1, 121  acc:   159 /   160 =  99.375
1, 122  acc:    74 /    78 =  94.872
1, 123  acc:    45 /    45 = 100.000
1, 124  acc:    39 /    39 = 100.000
1, 125  acc:   559 /   564 =  99.113
1, 126  acc:   135 /   137 =  98.540
1, 127  acc:    26 /    26 = 100.000
1, 128  acc:    47 /    49 =  95.918
1, 129  acc:    19 /    20 =  95.000
1, 130  acc:     5 /     5 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     8 /     9 =  88.889
1, 133  acc:   560 /   562 =  99.644
1, 134  acc:    91 /    91 = 100.000
1, 135  acc:    50 /    50 = 100.000
1, 136  acc:    42 /    43 =  97.674
1, 137  acc:     6 /     6 = 100.000
1, 138  acc:     8 /     8 = 100.000
1, 139  acc:     4 /     4 = 100.000
1, 140  acc:     4 /     4 = 100.000
1, 141  acc:   125 /   126 =  99.206
1, 142  acc:    23 /    23 = 100.000
1, 143  acc:     8 /     8 = 100.000
1, 144  acc:     2 /     2 = 100.000
1, 145  acc:     3 /     3 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     4 /     4 = 100.000
1, 148  acc:   233 /   235 =  99.149
1, 149  acc:    17 /    17 = 100.000
1, 150  acc:    16 /    16 = 100.000
1, 151  acc:    21 /    22 =  95.455
1, 152  acc:     8 /     8 = 100.000
1, 153  acc:     1 /     1 = 100.000
1, 154  acc:    37 /    39 =  94.872
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:    14 /    14 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    30 /    30 = 100.000
1, 160  acc:     7 /     7 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     3 /     3 = 100.000
1, 164  acc:    39 /    39 = 100.000
1, 165  acc:     2 /     2 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3869 /  3896 =  99.307
1, 170  acc:   723 /   731 =  98.906
1, 171  acc:   287 /   292 =  98.288
1, 172  acc:   225 /   230 =  97.826
1, 173  acc:    72 /    72 = 100.000
1, 174  acc:    20 /    20 = 100.000
1, 175  acc:    13 /    13 = 100.000
1, 176  acc:    61 /    63 =  96.825
1, 177  acc:    92 /    93 =  98.925
1, 178  acc:    12 /    12 = 100.000
1, 179  acc:     6 /     7 =  85.714
1, 180  acc:     7 /     7 = 100.000
1, 181  acc:    13 /    13 = 100.000
1, 182  acc:     3 /     3 = 100.000
1, 183  acc:    20 /    20 = 100.000
1, 184  acc:   151 /   151 = 100.000
1, 185  acc:    36 /    37 =  97.297
1, 186  acc:    12 /    12 = 100.000
1, 187  acc:     8 /     9 =  88.889
1, 188  acc:     4 /     4 = 100.000
1, 189  acc:     2 /     2 = 100.000
1, 190  acc:     7 /     7 = 100.000
1, 191  acc:     7 /     7 = 100.000
1, 192  acc:    14 /    14 = 100.000
1, 193  acc:     7 /     7 = 100.000
1, 194  acc:     4 /     4 = 100.000
1, 195  acc:     1 /     1 = 100.000
1, 196  acc:   143 /   145 =  98.621
1, 197  acc:    11 /    11 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     4 /     4 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    24 /    24 = 100.000
1, 205  acc:     5 /     5 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    22 /    22 = 100.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     3 /     3 = 100.000
1, 212  acc:     2 /     2 = 100.000
1, 213  acc:    15 /    15 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     9 /     9 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    18 /    18 = 100.000
1, 218  acc:    13 /    13 = 100.000
1, 219  acc:    16 /    16 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 264971 / 269038 =  98.488
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 25074 / 25373 =  98.822
0, 1  acc: 30923 / 31282 =  98.852
0, 2  acc:  6073 /  6155 =  98.668
0, 3  acc: 24003 / 24292 =  98.810
0, 4  acc: 10706 / 10829 =  98.864
0, 5  acc:  5477 /  5541 =  98.845
0, 6  acc:  6717 /  6785 =  98.998
0, 7  acc: 11864 / 12016 =  98.735
1, 0  acc:  4393 /  4437 =  99.008
1, 1  acc:  4908 /  4962 =  98.912
1, 2  acc:  2239 /  2265 =  98.852
1, 3  acc:  2414 /  2446 =  98.692
1, 4  acc:  3083 /  3125 =  98.656
1, 5  acc:   987 /  1003 =  98.405
1, 6  acc:  3072 /  3111 =  98.746
1, 7  acc:  4619 /  4682 =  98.654
--------------------------------------
Average acc: 146552 / 148304 =  98.819
Robust  acc:   987 /  1003 =  98.405
--------------------------------------
New max robust acc: 98.4047856430708
debias model - Saving best checkpoint at epoch 4
replace: True
-> Updating checkpoint debias-wga-best_seed45.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed45.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 65.873 | Best Acc: 93.100
-------------------------------------
Training, Epoch 4:
Accuracies by groups:
0, 0  acc: 10802 / 12092 =  89.332
0, 1  acc: 12872 / 14179 =  90.782
0, 2  acc:  2503 /  3210 =  77.975
0, 3  acc: 11266 / 12101 =  93.100
0, 4  acc:  4428 /  5355 =  82.689
0, 5  acc:  2622 /  2980 =  87.987
0, 6  acc:  2430 /  3335 =  72.864
0, 7  acc:  4483 /  5723 =  78.333
1, 0  acc:  1578 /  2203 =  71.630
1, 1  acc:  1578 /  2270 =  69.515
1, 2  acc:   834 /  1216 =  68.586
1, 3  acc:   830 /  1260 =  65.873
1, 4  acc:  1121 /  1627 =  68.900
1, 5  acc:   358 /   520 =  68.846
1, 6  acc:  1165 /  1537 =  75.797
1, 7  acc:  1600 /  2246 =  71.238
------------------------------------
Average acc: 60470 / 71854 =  84.157
Robust  acc:   830 /  1260 =  65.873
------------------------------------
Accuracies by groups:
0, 0  acc: 10802 / 12092 =  89.332
0, 1  acc: 12872 / 14179 =  90.782
0, 2  acc:  2503 /  3210 =  77.975
0, 3  acc: 11266 / 12101 =  93.100
0, 4  acc:  4428 /  5355 =  82.689
0, 5  acc:  2622 /  2980 =  87.987
0, 6  acc:  2430 /  3335 =  72.864
0, 7  acc:  4483 /  5723 =  78.333
1, 0  acc:  1578 /  2203 =  71.630
1, 1  acc:  1578 /  2270 =  69.515
1, 2  acc:   834 /  1216 =  68.586
1, 3  acc:   830 /  1260 =  65.873
1, 4  acc:  1121 /  1627 =  68.900
1, 5  acc:   358 /   520 =  68.846
1, 6  acc:  1165 /  1537 =  75.797
1, 7  acc:  1600 /  2246 =  71.238
------------------------------------
Average acc: 60470 / 71854 =  84.157
Robust  acc:   830 /  1260 =  65.873
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10802 / 12092 =  89.332
0, 1  acc: 12872 / 14179 =  90.782
0, 2  acc:  2503 /  3210 =  77.975
0, 3  acc: 11266 / 12101 =  93.100
0, 4  acc:  4428 /  5355 =  82.689
0, 5  acc:  2622 /  2980 =  87.987
0, 6  acc:  2430 /  3335 =  72.864
0, 7  acc:  4483 /  5723 =  78.333
1, 0  acc:  1578 /  2203 =  71.630
1, 1  acc:  1578 /  2270 =  69.515
1, 2  acc:   834 /  1216 =  68.586
1, 3  acc:   830 /  1260 =  65.873
1, 4  acc:  1121 /  1627 =  68.900
1, 5  acc:   358 /   520 =  68.846
1, 6  acc:  1165 /  1537 =  75.797
1, 7  acc:  1600 /  2246 =  71.238
------------------------------------
Average acc: 60470 / 71854 =  84.157
Robust  acc:   830 /  1260 =  65.873
------------------------------------
replace: True
Checkpoint saved at ./model/civilcomments/config/debias-end_seed45.pt
