Arch: bert-base-uncased_pt
Bs trn: 16
Bs val: 16
Hidden dim: 256
Dataset: civilcomments
Resample class: 
Slice with: rep
Rep cluster method: gmm
Num anchor: 32
Num positive: 32
Num negative: 32
Num negative easy: 0
Weight anc by loss: False
Weight pos by loss: False
Weight neg by loss: False
Anc loss temp: 0.5
Pos loss temp: 0.5
Neg loss temp: 0.5
Data wide pos: False
Target sample ratio: 1
Balance targets: False
Additional negatives: False
Hard negative factor: 0
Full contrastive: False
Train encoder: False
No projection head: False
Projection dim: 128
Batch factor: None
Temperature: 0.05
Single pos: False
Supervised linear scale up: False
Supervised update delay: 0
Contrastive weight: 0.5
Classifier update interval: 8
Optim: AdamW
Max epoch: 5
Lr: 1e-05
Momentum: 0.9
Weight decay: 0.01
Weight decay c: 0.01
Stopping window: 30
Load encoder: 
Freeze encoder: False
Finetune epochs: 0
Clip grad norm: True
Lr scheduler classifier: 
Lr scheduler: 
Grad clip grad norm: False
Erm: False
Erm only: False
Pretrained spurious path: ./model/civilcomments/config/no_gce/JTT_sgd_no_gce_model_b_epoch0_seed34.pt
Max epoch s: 1
Bs trn s: 32
Lr s: 0.001
Momentum s: 0.9
Weight decay s: 0.0005
Slice temp: 10
Log loss interval: 10
Checkpoint interval: 50
Grad checkpoint interval: 50
Log visual interval: 100
Log grad visual interval: 50
Verbose: True
Seed: 34
Replicate: 0
No cuda: False
Resume: False
New slice: False
Num workers: 12
Evaluate: False
Data cmap: hsv
Test cmap: 
P correlation: 0.9
P corr by class: None
Train classes: ['non_toxic', 'toxic']
Train class ratios: None
Test shift: random
Flipped: False
Q: 0.7
Pretrained bmodel: True
Cosine: False
Exp: JTT_sgd_no_gce_JTT_adamW
Supervised contrast: True
Prioritize spurious pos: False
Contrastive type: cnc
Compute auroc: False
Model type: bert-base-uncased_pt_cnc
Criterion: cross_entropy
Pretrained: False
Max grad norm: 1.0
Adam epsilon: 1e-08
Warmup steps: 0
Max grad norm s: 1.0
Adam epsilon s: 1e-08
Warmup steps s: 0
Grad max grad norm: 1.0
Grad adam epsilon: 1e-08
Grad warmup steps: 0
Device: cuda
Img file type: .png
Display image: False
Image path: ./images/civilcomments/civilcomments/config/contrastive_umaps
Log interval: 1
Log path: ./logs/civilcomments/config
Results path: ./results/civilcomments/config
Model path: ./model/civilcomments/config
Loss factor: 1
Supersample labels: False
Subsample labels: False
Weigh slice samples by loss: True
Val split: 0.1
Spurious train split: 0.2
Subsample groups: False
Train method: sc
Max robust acc: -1
Max robust epoch: -1
Max robust group acc: (None, None)
Root dir: ./datasets/data/CivilComments/
Target name: toxic
Confounder names: ['identities']
Image mean: 0
Image std: 0
Augment data: False
Max token length: 300
Task: civilcomments
Num classes: 2
Experiment configs: config
Experiment name: cnc-civilcomments-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=5-bst=16-o=AdamW-lr=1e-05-mo=0.9-wd=0.01-wdc=0.01-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=34-r=0
Mi resampled: None

------------------------
> Loading spurious model
------------------------
Pretrained model loaded from ./model/civilcomments/config/no_gce/JTT_sgd_no_gce_model_b_epoch0_seed34.pt
======
# Calculate probability ...
======
======
# Load biased model ...
======

t_total is 10


t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   1 | Train Loss: 0.022 | Train Acc: 84.897 | Val Loss: 0.000 | Val Acc: 92.514
Training:
Accuracies by groups:
0, 0  acc: 52045 / 60136 =  86.545
0, 1  acc:  5552 /  6525 =  85.088
0, 2  acc:  8468 / 10280 =  82.374
0, 3  acc:  4006 /  4875 =  82.174
0, 4  acc:   939 /  1904 =  49.317
0, 5  acc:    97 /   233 =  41.631
0, 6  acc:   151 /   263 =  57.414
0, 7  acc:   126 /   242 =  52.066
0, 8  acc:  4685 /  5627 =  83.259
0, 9  acc:   296 /   390 =  75.897
0, 10  acc:   330 /   416 =  79.327
0, 11  acc:   249 /   312 =  79.808
0, 12  acc:   184 /   370 =  49.730
0, 13  acc:    23 /    58 =  39.655
0, 14  acc:    23 /    52 =  44.231
0, 15  acc:     8 /    27 =  29.630
0, 16  acc:  3090 /  4746 =  65.107
0, 17  acc:   103 /   162 =  63.580
0, 18  acc:   317 /   460 =  68.913
0, 19  acc:    88 /   133 =  66.165
0, 20  acc:    58 /   118 =  49.153
0, 21  acc:    10 /    13 =  76.923
0, 22  acc:    25 /    53 =  47.170
0, 23  acc:     3 /    17 =  17.647
0, 24  acc:   384 /   592 =  64.865
0, 25  acc:    26 /    35 =  74.286
0, 26  acc:    41 /    60 =  68.333
0, 27  acc:    19 /    25 =  76.000
0, 28  acc:    17 /    35 =  48.571
0, 29  acc:     1 /     5 =  20.000
0, 30  acc:     2 /     5 =  40.000
0, 31  acc:     3 /     5 =  60.000
0, 32  acc:  1221 /  1521 =  80.276
0, 33  acc:    53 /    69 =  76.812
0, 34  acc:    50 /    63 =  79.365
0, 35  acc:    13 /    17 =  76.471
0, 36  acc:    13 /    30 =  43.333
0, 37  acc:     3 /     9 =  33.333
0, 38  acc:    13 /    20 =  65.000
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   271 /   362 =  74.862
0, 41  acc:    10 /    15 =  66.667
0, 42  acc:     8 /    10 =  80.000
0, 43  acc:     8 /     9 =  88.889
0, 44  acc:     8 /    18 =  44.444
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     1 /     5 =  20.000
0, 47  acc:     0 /     1 =   0.000
0, 48  acc:   205 /   329 =  62.310
0, 49  acc:     0 /     0 =     nan
0, 50  acc:    10 /    15 =  66.667
0, 51  acc:    11 /    17 =  64.706
0, 52  acc:     3 /     7 =  42.857
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     2 /     3 =  66.667
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   169 /   252 =  67.063
0, 57  acc:     4 /     5 =  80.000
0, 58  acc:     7 /    10 =  70.000
0, 59  acc:     7 /     9 =  77.778
0, 60  acc:     9 /    21 =  42.857
0, 61  acc:     1 /     1 = 100.000
0, 62  acc:     2 /     6 =  33.333
0, 63  acc:     0 /     1 =   0.000
0, 64  acc:  1300 /  2237 =  58.114
0, 65  acc:   223 /   378 =  58.995
0, 66  acc:   128 /   240 =  53.333
0, 67  acc:    75 /   117 =  64.103
0, 68  acc:    26 /    46 =  56.522
0, 69  acc:     1 /     4 =  25.000
0, 70  acc:     8 /    23 =  34.783
0, 71  acc:     0 /     5 =   0.000
0, 72  acc:    40 /    57 =  70.175
0, 73  acc:     4 /     8 =  50.000
0, 74  acc:     6 /     9 =  66.667
0, 75  acc:     4 /     5 =  80.000
0, 76  acc:     1 /     6 =  16.667
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     2 /     3 =  66.667
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    52 /    92 =  56.522
0, 81  acc:     2 /     8 =  25.000
0, 82  acc:     4 /     7 =  57.143
0, 83  acc:     8 /    11 =  72.727
0, 84  acc:     2 /     7 =  28.571
0, 85  acc:     0 /     0 =     nan
0, 86  acc:     2 /     8 =  25.000
0, 87  acc:     1 /     2 =  50.000
0, 88  acc:     6 /     7 =  85.714
0, 89  acc:     2 /     2 = 100.000
0, 90  acc:     1 /     1 = 100.000
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    39 /    66 =  59.091
0, 95  acc:     4 /     4 = 100.000
0, 96  acc:     0 /     2 =   0.000
0, 97  acc:     1 /     1 = 100.000
0, 98  acc:    11 /    21 =  52.381
0, 99  acc:     0 /     1 =   0.000
0, 100  acc:     0 /     0 =     nan
0, 101  acc:    10 /    11 =  90.909
0, 102  acc:     1 /     1 = 100.000
0, 103  acc:     0 /     1 =   0.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    10 /    15 =  66.667
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     0 /     6 =   0.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     2 /     5 =  40.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  4639 /  6504 =  71.325
0, 118  acc:  1123 /  1626 =  69.065
0, 119  acc:   259 /   377 =  68.700
0, 120  acc:   207 /   283 =  73.145
0, 121  acc:    26 /    56 =  46.429
0, 122  acc:    21 /    34 =  61.765
0, 123  acc:     5 /     8 =  62.500
0, 124  acc:    13 /    20 =  65.000
0, 125  acc:   240 /   361 =  66.482
0, 126  acc:    88 /   132 =  66.667
0, 127  acc:    20 /    28 =  71.429
0, 128  acc:    33 /    46 =  71.739
0, 129  acc:     1 /     1 = 100.000
0, 130  acc:     1 /     4 =  25.000
0, 131  acc:     0 /     1 =   0.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   143 /   238 =  60.084
0, 134  acc:    34 /    70 =  48.571
0, 135  acc:    11 /    16 =  68.750
0, 136  acc:    27 /    40 =  67.500
0, 137  acc:     5 /    10 =  50.000
0, 138  acc:     0 /     2 =   0.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    38 /    75 =  50.667
0, 142  acc:     5 /    15 =  33.333
0, 143  acc:     1 /     2 =  50.000
0, 144  acc:    10 /    12 =  83.333
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     0 /     1 =   0.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    79 /    97 =  81.443
0, 149  acc:     9 /    15 =  60.000
0, 150  acc:     4 /     6 =  66.667
0, 151  acc:    17 /    27 =  62.963
0, 152  acc:     4 /     5 =  80.000
0, 153  acc:     0 /     0 =     nan
0, 154  acc:    34 /    45 =  75.556
0, 155  acc:     4 /     7 =  57.143
0, 156  acc:     3 /     4 =  75.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     6 /     6 = 100.000
0, 159  acc:    15 /    28 =  53.571
0, 160  acc:     3 /     3 = 100.000
0, 161  acc:     4 /     5 =  80.000
0, 162  acc:     0 /     1 =   0.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    10 /    12 =  83.333
0, 165  acc:     1 /     2 =  50.000
0, 166  acc:     9 /    11 =  81.818
0, 167  acc:     0 /     1 =   0.000
0, 168  acc:     1 /     1 = 100.000
0, 169  acc:   889 /  1653 =  53.781
0, 170  acc:   191 /   380 =  50.263
0, 171  acc:    49 /    84 =  58.333
0, 172  acc:   107 /   176 =  60.795
0, 173  acc:    14 /    24 =  58.333
0, 174  acc:     1 /     5 =  20.000
0, 175  acc:     8 /    11 =  72.727
0, 176  acc:     6 /    11 =  54.545
0, 177  acc:    52 /    78 =  66.667
0, 178  acc:     8 /    10 =  80.000
0, 179  acc:     2 /     2 = 100.000
0, 180  acc:     5 /     5 = 100.000
0, 181  acc:     0 /     0 =     nan
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     0 /     0 =     nan
0, 184  acc:    45 /    75 =  60.000
0, 185  acc:     3 /     6 =  50.000
0, 186  acc:     4 /    10 =  40.000
0, 187  acc:     3 /     6 =  50.000
0, 188  acc:     0 /     3 =   0.000
0, 189  acc:     5 /     7 =  71.429
0, 190  acc:     0 /     0 =     nan
0, 191  acc:     7 /    30 =  23.333
0, 192  acc:     0 /     0 =     nan
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     0 /     0 =     nan
0, 195  acc:     0 /     0 =     nan
0, 196  acc:    33 /    62 =  53.226
0, 197  acc:    16 /    17 =  94.118
0, 198  acc:     1 /     4 =  25.000
0, 199  acc:     6 /     9 =  66.667
0, 200  acc:     2 /     4 =  50.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     0 /     2 =   0.000
0, 204  acc:    13 /    21 =  61.905
0, 205  acc:     3 /     3 = 100.000
0, 206  acc:     1 /     2 =  50.000
0, 207  acc:     3 /     4 =  75.000
0, 208  acc:     2 /     3 =  66.667
0, 209  acc:     4 /     9 =  44.444
0, 210  acc:     3 /     5 =  60.000
0, 211  acc:     3 /     4 =  75.000
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     0 /     1 =   0.000
0, 214  acc:     0 /     1 =   0.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     3 /     8 =  37.500
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     1 /     3 =  33.333
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     2 /     3 =  66.667
1, 0  acc: 59712 / 66126 =  90.300
1, 1  acc:  5966 /  6831 =  87.337
1, 2  acc:  9995 / 11621 =  86.008
1, 3  acc:  4088 /  4826 =  84.708
1, 4  acc:  5368 /  5759 =  93.211
1, 5  acc:   878 /   945 =  92.910
1, 6  acc:   494 /   558 =  88.530
1, 7  acc:   585 /   643 =  90.980
1, 8  acc:  5138 /  6005 =  85.562
1, 9  acc:   402 /   449 =  89.532
1, 10  acc:   413 /   491 =  84.114
1, 11  acc:   218 /   264 =  82.576
1, 12  acc:   827 /   871 =  94.948
1, 13  acc:   131 /   140 =  93.571
1, 14  acc:   100 /   127 =  78.740
1, 15  acc:   140 /   162 =  86.420
1, 16  acc:  7806 /  8917 =  87.541
1, 17  acc:   267 /   301 =  88.704
1, 18  acc:   570 /   679 =  83.947
1, 19  acc:   217 /   259 =  83.784
1, 20  acc:   265 /   284 =  93.310
1, 21  acc:    51 /    54 =  94.444
1, 22  acc:   127 /   137 =  92.701
1, 23  acc:    30 /    37 =  81.081
1, 24  acc:   980 /  1141 =  85.890
1, 25  acc:    23 /    28 =  82.143
1, 26  acc:   109 /   118 =  92.373
1, 27  acc:    18 /    19 =  94.737
1, 28  acc:   166 /   176 =  94.318
1, 29  acc:    15 /    16 =  93.750
1, 30  acc:    14 /    15 =  93.333
1, 31  acc:     8 /     8 = 100.000
1, 32  acc:  1588 /  1855 =  85.606
1, 33  acc:    78 /    93 =  83.871
1, 34  acc:    53 /    68 =  77.941
1, 35  acc:    25 /    29 =  86.207
1, 36  acc:    58 /    60 =  96.667
1, 37  acc:     7 /     8 =  87.500
1, 38  acc:    26 /    30 =  86.667
1, 39  acc:     3 /     3 = 100.000
1, 40  acc:   409 /   465 =  87.957
1, 41  acc:    14 /    17 =  82.353
1, 42  acc:    14 /    20 =  70.000
1, 43  acc:    24 /    28 =  85.714
1, 44  acc:    24 /    29 =  82.759
1, 45  acc:     2 /     5 =  40.000
1, 46  acc:     7 /    11 =  63.636
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   506 /   584 =  86.644
1, 49  acc:     3 /     6 =  50.000
1, 50  acc:    34 /    43 =  79.070
1, 51  acc:    27 /    28 =  96.429
1, 52  acc:    10 /    11 =  90.909
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    49 /    51 =  96.078
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   418 /   473 =  88.372
1, 57  acc:    16 /    18 =  88.889
1, 58  acc:    21 /    21 = 100.000
1, 59  acc:    12 /    14 =  85.714
1, 60  acc:    22 /    30 =  73.333
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    25 /    27 =  92.593
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5501 /  5984 =  91.928
1, 65  acc:   757 /   842 =  89.905
1, 66  acc:   462 /   521 =  88.676
1, 67  acc:   177 /   214 =  82.710
1, 68  acc:   255 /   272 =  93.750
1, 69  acc:    37 /    38 =  97.368
1, 70  acc:    88 /    93 =  94.624
1, 71  acc:    22 /    23 =  95.652
1, 72  acc:   120 /   130 =  92.308
1, 73  acc:     3 /     3 = 100.000
1, 74  acc:     0 /     2 =   0.000
1, 75  acc:     2 /     2 = 100.000
1, 76  acc:    25 /    26 =  96.154
1, 77  acc:     3 /     3 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     7 /     7 = 100.000
1, 80  acc:   205 /   223 =  91.928
1, 81  acc:    28 /    31 =  90.323
1, 82  acc:    49 /    55 =  89.091
1, 83  acc:     2 /     3 =  66.667
1, 84  acc:    12 /    12 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    30 /    30 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    19 /    29 =  65.517
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     4 /     4 = 100.000
1, 93  acc:     4 /     4 = 100.000
1, 94  acc:   153 /   169 =  90.533
1, 95  acc:    12 /    18 =  66.667
1, 96  acc:    14 /    14 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    17 /    17 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    24 /    24 = 100.000
1, 101  acc:     6 /     6 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     3 /     3 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    32 /    35 =  91.429
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    22 /    24 =  91.667
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     7 /     7 = 100.000
1, 111  acc:     4 /     5 =  80.000
1, 112  acc:    20 /    21 =  95.238
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  7666 /  9205 =  83.281
1, 118  acc:  1845 /  2203 =  83.749
1, 119  acc:   441 /   520 =  84.808
1, 120  acc:   510 /   605 =  84.298
1, 121  acc:   159 /   176 =  90.341
1, 122  acc:    75 /    84 =  89.286
1, 123  acc:    12 /    20 =  60.000
1, 124  acc:    34 /    38 =  89.474
1, 125  acc:   446 /   555 =  80.360
1, 126  acc:   148 /   168 =  88.095
1, 127  acc:    28 /    37 =  75.676
1, 128  acc:    37 /    54 =  68.519
1, 129  acc:    16 /    16 = 100.000
1, 130  acc:     5 /     7 =  71.429
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     7 /     8 =  87.500
1, 133  acc:   394 /   457 =  86.214
1, 134  acc:    75 /    89 =  84.270
1, 135  acc:    41 /    45 =  91.111
1, 136  acc:    25 /    33 =  75.758
1, 137  acc:     4 /     4 = 100.000
1, 138  acc:     2 /     4 =  50.000
1, 139  acc:     4 /     4 = 100.000
1, 140  acc:     1 /     1 = 100.000
1, 141  acc:    76 /   109 =  69.725
1, 142  acc:    20 /    24 =  83.333
1, 143  acc:     4 /     4 = 100.000
1, 144  acc:     1 /     2 =  50.000
1, 145  acc:     1 /     1 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     3 /     6 =  50.000
1, 148  acc:   176 /   223 =  78.924
1, 149  acc:    12 /    18 =  66.667
1, 150  acc:    10 /    11 =  90.909
1, 151  acc:     4 /    22 =  18.182
1, 152  acc:     3 /     5 =  60.000
1, 153  acc:     5 /    11 =  45.455
1, 154  acc:    27 /    32 =  84.375
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:    10 /    12 =  83.333
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    36 /    39 =  92.308
1, 160  acc:     3 /     5 =  60.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     4 /     4 = 100.000
1, 164  acc:    22 /    29 =  75.862
1, 165  acc:     3 /     3 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3402 /  3808 =  89.338
1, 170  acc:   656 /   721 =  90.985
1, 171  acc:   250 /   287 =  87.108
1, 172  acc:   191 /   220 =  86.818
1, 173  acc:    57 /    63 =  90.476
1, 174  acc:    11 /    16 =  68.750
1, 175  acc:     7 /     8 =  87.500
1, 176  acc:    40 /    55 =  72.727
1, 177  acc:    77 /    84 =  91.667
1, 178  acc:     9 /    12 =  75.000
1, 179  acc:     1 /     3 =  33.333
1, 180  acc:     5 /     6 =  83.333
1, 181  acc:     9 /     9 = 100.000
1, 182  acc:     3 /     5 =  60.000
1, 183  acc:    18 /    19 =  94.737
1, 184  acc:   152 /   165 =  92.121
1, 185  acc:    41 /    44 =  93.182
1, 186  acc:    12 /    15 =  80.000
1, 187  acc:    11 /    12 =  91.667
1, 188  acc:     0 /     1 =   0.000
1, 189  acc:     2 /     4 =  50.000
1, 190  acc:     7 /     8 =  87.500
1, 191  acc:     9 /    11 =  81.818
1, 192  acc:    10 /    10 = 100.000
1, 193  acc:    11 /    11 = 100.000
1, 194  acc:     0 /     0 =     nan
1, 195  acc:     2 /     2 = 100.000
1, 196  acc:   100 /   115 =  86.957
1, 197  acc:    11 /    13 =  84.615
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     3 /     3 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    20 /    23 =  86.957
1, 205  acc:     1 /     1 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    17 /    18 =  94.444
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     5 /     5 = 100.000
1, 212  acc:     1 /     1 = 100.000
1, 213  acc:    10 /    11 =  90.909
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     2 /     2 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     9 /     9 = 100.000
1, 218  acc:     8 /     9 =  88.889
1, 219  acc:    11 /    11 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 228405 / 269038 =  84.897
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 23445 / 25373 =  92.401
0, 1  acc: 28986 / 31282 =  92.660
0, 2  acc:  5694 /  6155 =  92.510
0, 3  acc: 22491 / 24292 =  92.586
0, 4  acc: 10044 / 10829 =  92.751
0, 5  acc:  5148 /  5541 =  92.907
0, 6  acc:  6309 /  6785 =  92.985
0, 7  acc: 11089 / 12016 =  92.285
1, 0  acc:  4111 /  4437 =  92.653
1, 1  acc:  4606 /  4962 =  92.825
1, 2  acc:  2095 /  2265 =  92.494
1, 3  acc:  2259 /  2446 =  92.355
1, 4  acc:  2914 /  3125 =  93.248
1, 5  acc:   925 /  1003 =  92.223
1, 6  acc:  2895 /  3111 =  93.057
1, 7  acc:  4345 /  4682 =  92.802
--------------------------------------
Average acc: 137356 / 148304 =  92.618
Robust  acc:   925 /  1003 =  92.223
--------------------------------------
New max robust acc: 92.2233300099701
debias model - Saving best checkpoint at epoch 0
replace: True
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed34.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 54.642 | Best Acc: 85.671
-------------------------------------
Training, Epoch 0:
Accuracies by groups:
0, 0  acc: 10151 / 12092 =  83.948
0, 1  acc: 12011 / 14179 =  84.710
0, 2  acc:  1754 /  3210 =  54.642
0, 3  acc: 10367 / 12101 =  85.671
0, 4  acc:  3959 /  5355 =  73.931
0, 5  acc:  2381 /  2980 =  79.899
0, 6  acc:  2232 /  3335 =  66.927
0, 7  acc:  4072 /  5723 =  71.151
1, 0  acc:  1653 /  2203 =  75.034
1, 1  acc:  1694 /  2270 =  74.626
1, 2  acc:  1022 /  1216 =  84.046
1, 3  acc:   965 /  1260 =  76.587
1, 4  acc:  1169 /  1627 =  71.850
1, 5  acc:   390 /   520 =  75.000
1, 6  acc:  1141 /  1537 =  74.236
1, 7  acc:  1578 /  2246 =  70.258
------------------------------------
Average acc: 56539 / 71854 =  78.686
Robust  acc:  1754 /  3210 =  54.642
------------------------------------
Accuracies by groups:
0, 0  acc: 10151 / 12092 =  83.948
0, 1  acc: 12011 / 14179 =  84.710
0, 2  acc:  1754 /  3210 =  54.642
0, 3  acc: 10367 / 12101 =  85.671
0, 4  acc:  3959 /  5355 =  73.931
0, 5  acc:  2381 /  2980 =  79.899
0, 6  acc:  2232 /  3335 =  66.927
0, 7  acc:  4072 /  5723 =  71.151
1, 0  acc:  1653 /  2203 =  75.034
1, 1  acc:  1694 /  2270 =  74.626
1, 2  acc:  1022 /  1216 =  84.046
1, 3  acc:   965 /  1260 =  76.587
1, 4  acc:  1169 /  1627 =  71.850
1, 5  acc:   390 /   520 =  75.000
1, 6  acc:  1141 /  1537 =  74.236
1, 7  acc:  1578 /  2246 =  70.258
------------------------------------
Average acc: 56539 / 71854 =  78.686
Robust  acc:  1754 /  3210 =  54.642
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10151 / 12092 =  83.948
0, 1  acc: 12011 / 14179 =  84.710
0, 2  acc:  1754 /  3210 =  54.642
0, 3  acc: 10367 / 12101 =  85.671
0, 4  acc:  3959 /  5355 =  73.931
0, 5  acc:  2381 /  2980 =  79.899
0, 6  acc:  2232 /  3335 =  66.927
0, 7  acc:  4072 /  5723 =  71.151
1, 0  acc:  1653 /  2203 =  75.034
1, 1  acc:  1694 /  2270 =  74.626
1, 2  acc:  1022 /  1216 =  84.046
1, 3  acc:   965 /  1260 =  76.587
1, 4  acc:  1169 /  1627 =  71.850
1, 5  acc:   390 /   520 =  75.000
1, 6  acc:  1141 /  1537 =  74.236
1, 7  acc:  1578 /  2246 =  70.258
------------------------------------
Average acc: 56539 / 71854 =  78.686
Robust  acc:  1754 /  3210 =  54.642
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   2 | Train Loss: 0.012 | Train Acc: 94.021 | Val Loss: 0.000 | Val Acc: 95.744
Training:
Accuracies by groups:
0, 0  acc: 56349 / 60079 =  93.792
0, 1  acc:  6128 /  6545 =  93.629
0, 2  acc:  9400 / 10215 =  92.022
0, 3  acc:  4584 /  4968 =  92.271
0, 4  acc:  1572 /  2022 =  77.745
0, 5  acc:   183 /   254 =  72.047
0, 6  acc:   207 /   265 =  78.113
0, 7  acc:   208 /   256 =  81.250
0, 8  acc:  5065 /  5542 =  91.393
0, 9  acc:   382 /   430 =  88.837
0, 10  acc:   372 /   428 =  86.916
0, 11  acc:   236 /   269 =  87.732
0, 12  acc:   294 /   374 =  78.610
0, 13  acc:    23 /    29 =  79.310
0, 14  acc:    34 /    41 =  82.927
0, 15  acc:    15 /    27 =  55.556
0, 16  acc:  4039 /  4732 =  85.355
0, 17  acc:   165 /   195 =  84.615
0, 18  acc:   398 /   444 =  89.640
0, 19  acc:   116 /   135 =  85.926
0, 20  acc:   105 /   134 =  78.358
0, 21  acc:    15 /    21 =  71.429
0, 22  acc:    44 /    52 =  84.615
0, 23  acc:     9 /    17 =  52.941
0, 24  acc:   473 /   571 =  82.837
0, 25  acc:    37 /    39 =  94.872
0, 26  acc:    56 /    62 =  90.323
0, 27  acc:    18 /    18 = 100.000
0, 28  acc:    46 /    49 =  93.878
0, 29  acc:     2 /     3 =  66.667
0, 30  acc:     2 /     9 =  22.222
0, 31  acc:    10 /    12 =  83.333
0, 32  acc:  1363 /  1495 =  91.171
0, 33  acc:    71 /    74 =  95.946
0, 34  acc:    70 /    77 =  90.909
0, 35  acc:    11 /    11 = 100.000
0, 36  acc:    36 /    40 =  90.000
0, 37  acc:    10 /    11 =  90.909
0, 38  acc:     9 /    11 =  81.818
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   335 /   362 =  92.541
0, 41  acc:     9 /    10 =  90.000
0, 42  acc:     5 /     7 =  71.429
0, 43  acc:    11 /    11 = 100.000
0, 44  acc:    16 /    20 =  80.000
0, 45  acc:     1 /     1 = 100.000
0, 46  acc:    14 /    15 =  93.333
0, 47  acc:     2 /     2 = 100.000
0, 48  acc:   282 /   332 =  84.940
0, 49  acc:     1 /     1 = 100.000
0, 50  acc:    14 /    15 =  93.333
0, 51  acc:    15 /    15 = 100.000
0, 52  acc:     3 /     4 =  75.000
0, 53  acc:     1 /     1 = 100.000
0, 54  acc:     4 /     5 =  80.000
0, 55  acc:     1 /     1 = 100.000
0, 56  acc:   204 /   241 =  84.647
0, 57  acc:     6 /     7 =  85.714
0, 58  acc:     7 /    11 =  63.636
0, 59  acc:    10 /    12 =  83.333
0, 60  acc:    11 /    15 =  73.333
0, 61  acc:     0 /     0 =     nan
0, 62  acc:     7 /     8 =  87.500
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  1872 /  2314 =  80.899
0, 65  acc:   294 /   350 =  84.000
0, 66  acc:   190 /   235 =  80.851
0, 67  acc:    75 /    87 =  86.207
0, 68  acc:    37 /    53 =  69.811
0, 69  acc:     3 /     3 = 100.000
0, 70  acc:    10 /    12 =  83.333
0, 71  acc:    10 /    10 = 100.000
0, 72  acc:    54 /    61 =  88.525
0, 73  acc:     5 /     6 =  83.333
0, 74  acc:     4 /     4 = 100.000
0, 75  acc:     9 /    10 =  90.000
0, 76  acc:     2 /     3 =  66.667
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     0 /     0 =     nan
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    61 /    78 =  78.205
0, 81  acc:     8 /    14 =  57.143
0, 82  acc:    10 /    12 =  83.333
0, 83  acc:     7 /    10 =  70.000
0, 84  acc:     6 /     6 = 100.000
0, 85  acc:     2 /     2 = 100.000
0, 86  acc:     6 /     8 =  75.000
0, 87  acc:     0 /     0 =     nan
0, 88  acc:     6 /     7 =  85.714
0, 89  acc:     0 /     0 =     nan
0, 90  acc:     1 /     1 = 100.000
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    70 /    81 =  86.420
0, 95  acc:     5 /     5 = 100.000
0, 96  acc:     5 /     7 =  71.429
0, 97  acc:     3 /     3 = 100.000
0, 98  acc:    15 /    17 =  88.235
0, 99  acc:     2 /     2 = 100.000
0, 100  acc:     1 /     3 =  33.333
0, 101  acc:     9 /     9 = 100.000
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:     8 /    13 =  61.538
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     2 /     2 = 100.000
0, 110  acc:     0 /     2 =   0.000
0, 111  acc:     0 /     1 =   0.000
0, 112  acc:     9 /    11 =  81.818
0, 113  acc:     1 /     1 = 100.000
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     1 /     1 = 100.000
0, 117  acc:  5687 /  6451 =  88.157
0, 118  acc:  1405 /  1594 =  88.143
0, 119  acc:   355 /   394 =  90.102
0, 120  acc:   293 /   334 =  87.725
0, 121  acc:    53 /    70 =  75.714
0, 122  acc:    34 /    37 =  91.892
0, 123  acc:     8 /    10 =  80.000
0, 124  acc:    19 /    21 =  90.476
0, 125  acc:   328 /   376 =  87.234
0, 126  acc:   113 /   125 =  90.400
0, 127  acc:    27 /    32 =  84.375
0, 128  acc:    50 /    56 =  89.286
0, 129  acc:     2 /     3 =  66.667
0, 130  acc:     6 /     7 =  85.714
0, 131  acc:     0 /     1 =   0.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   180 /   215 =  83.721
0, 134  acc:    55 /    73 =  75.342
0, 135  acc:    12 /    13 =  92.308
0, 136  acc:    16 /    20 =  80.000
0, 137  acc:     8 /    12 =  66.667
0, 138  acc:     0 /     0 =     nan
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    42 /    56 =  75.000
0, 142  acc:     9 /    11 =  81.818
0, 143  acc:     1 /     4 =  25.000
0, 144  acc:    10 /    10 = 100.000
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     0 /     1 =   0.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    87 /    97 =  89.691
0, 149  acc:    16 /    19 =  84.211
0, 150  acc:     2 /     5 =  40.000
0, 151  acc:    14 /    18 =  77.778
0, 152  acc:     3 /     3 = 100.000
0, 153  acc:     0 /     1 =   0.000
0, 154  acc:    33 /    35 =  94.286
0, 155  acc:     5 /     7 =  71.429
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     6 /     6 = 100.000
0, 159  acc:    24 /    24 = 100.000
0, 160  acc:     0 /     0 =     nan
0, 161  acc:     2 /     2 = 100.000
0, 162  acc:     1 /     3 =  33.333
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    14 /    17 =  82.353
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:     6 /     6 = 100.000
0, 167  acc:     1 /     2 =  50.000
0, 168  acc:     1 /     1 = 100.000
0, 169  acc:  1327 /  1612 =  82.320
0, 170  acc:   315 /   393 =  80.153
0, 171  acc:    74 /   101 =  73.267
0, 172  acc:   137 /   166 =  82.530
0, 173  acc:    11 /    16 =  68.750
0, 174  acc:     8 /     9 =  88.889
0, 175  acc:     2 /     2 = 100.000
0, 176  acc:     5 /    14 =  35.714
0, 177  acc:    42 /    52 =  80.769
0, 178  acc:    10 /    14 =  71.429
0, 179  acc:     4 /     6 =  66.667
0, 180  acc:     7 /     8 =  87.500
0, 181  acc:     0 /     0 =     nan
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     2 /     3 =  66.667
0, 184  acc:    58 /    64 =  90.625
0, 185  acc:     6 /     7 =  85.714
0, 186  acc:     2 /     3 =  66.667
0, 187  acc:     5 /    11 =  45.455
0, 188  acc:     1 /     2 =  50.000
0, 189  acc:     7 /     7 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    26 /    32 =  81.250
0, 192  acc:     1 /     2 =  50.000
0, 193  acc:     0 /     2 =   0.000
0, 194  acc:     0 /     0 =     nan
0, 195  acc:     2 /     4 =  50.000
0, 196  acc:    31 /    37 =  83.784
0, 197  acc:     9 /    11 =  81.818
0, 198  acc:     3 /     7 =  42.857
0, 199  acc:    11 /    12 =  91.667
0, 200  acc:     4 /     5 =  80.000
0, 201  acc:     0 /     1 =   0.000
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     3 /     3 = 100.000
0, 204  acc:    19 /    24 =  79.167
0, 205  acc:     7 /     7 = 100.000
0, 206  acc:     1 /     1 = 100.000
0, 207  acc:     3 /     3 = 100.000
0, 208  acc:     4 /     4 = 100.000
0, 209  acc:     3 /     4 =  75.000
0, 210  acc:     1 /     1 = 100.000
0, 211  acc:     0 /     0 =     nan
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     3 /     4 =  75.000
0, 214  acc:     0 /     2 =   0.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     9 /    10 =  90.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     0 /     1 =   0.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     2 /     2 = 100.000
0, 221  acc:     0 /     0 =     nan
1, 0  acc: 64201 / 66114 =  97.107
1, 1  acc:  6622 /  6857 =  96.573
1, 2  acc: 11281 / 11757 =  95.951
1, 3  acc:  4606 /  4818 =  95.600
1, 4  acc:  5561 /  5757 =  96.595
1, 5  acc:   990 /  1021 =  96.964
1, 6  acc:   537 /   557 =  96.409
1, 7  acc:   677 /   707 =  95.757
1, 8  acc:  5692 /  5931 =  95.970
1, 9  acc:   422 /   436 =  96.789
1, 10  acc:   462 /   495 =  93.333
1, 11  acc:   232 /   245 =  94.694
1, 12  acc:   821 /   855 =  96.023
1, 13  acc:   105 /   111 =  94.595
1, 14  acc:   137 /   144 =  95.139
1, 15  acc:   137 /   149 =  91.946
1, 16  acc:  8394 /  8783 =  95.571
1, 17  acc:   302 /   315 =  95.873
1, 18  acc:   613 /   646 =  94.892
1, 19  acc:   231 /   245 =  94.286
1, 20  acc:   322 /   334 =  96.407
1, 21  acc:    41 /    42 =  97.619
1, 22  acc:   144 /   153 =  94.118
1, 23  acc:    32 /    33 =  96.970
1, 24  acc:  1006 /  1066 =  94.371
1, 25  acc:    27 /    28 =  96.429
1, 26  acc:   103 /   105 =  98.095
1, 27  acc:    20 /    21 =  95.238
1, 28  acc:   168 /   174 =  96.552
1, 29  acc:     9 /     9 = 100.000
1, 30  acc:    32 /    32 = 100.000
1, 31  acc:     7 /     7 = 100.000
1, 32  acc:  1773 /  1858 =  95.425
1, 33  acc:    84 /    91 =  92.308
1, 34  acc:    49 /    59 =  83.051
1, 35  acc:    29 /    30 =  96.667
1, 36  acc:    44 /    44 = 100.000
1, 37  acc:     8 /     8 = 100.000
1, 38  acc:    36 /    38 =  94.737
1, 39  acc:     0 /     1 =   0.000
1, 40  acc:   419 /   435 =  96.322
1, 41  acc:    12 /    12 = 100.000
1, 42  acc:    11 /    15 =  73.333
1, 43  acc:    38 /    38 = 100.000
1, 44  acc:    34 /    36 =  94.444
1, 45  acc:    10 /    10 = 100.000
1, 46  acc:     5 /     7 =  71.429
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   584 /   609 =  95.895
1, 49  acc:     5 /     5 = 100.000
1, 50  acc:    51 /    55 =  92.727
1, 51  acc:    27 /    27 = 100.000
1, 52  acc:    18 /    18 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    43 /    43 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   457 /   489 =  93.456
1, 57  acc:    19 /    20 =  95.000
1, 58  acc:    21 /    21 = 100.000
1, 59  acc:    13 /    15 =  86.667
1, 60  acc:    39 /    43 =  90.698
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    25 /    27 =  92.593
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5778 /  5991 =  96.445
1, 65  acc:   805 /   839 =  95.948
1, 66  acc:   486 /   506 =  96.047
1, 67  acc:   189 /   201 =  94.030
1, 68  acc:   243 /   255 =  95.294
1, 69  acc:    49 /    49 = 100.000
1, 70  acc:    89 /    90 =  98.889
1, 71  acc:    32 /    32 = 100.000
1, 72  acc:   139 /   141 =  98.582
1, 73  acc:     6 /     6 = 100.000
1, 74  acc:     0 /     3 =   0.000
1, 75  acc:     0 /     0 =     nan
1, 76  acc:    25 /    26 =  96.154
1, 77  acc:     6 /     7 =  85.714
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     6 /     6 = 100.000
1, 80  acc:   216 /   222 =  97.297
1, 81  acc:    31 /    35 =  88.571
1, 82  acc:    64 /    67 =  95.522
1, 83  acc:     0 /     1 =   0.000
1, 84  acc:     9 /     9 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    35 /    35 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    23 /    23 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     8 /     8 = 100.000
1, 93  acc:     1 /     1 = 100.000
1, 94  acc:   152 /   168 =  90.476
1, 95  acc:    17 /    18 =  94.444
1, 96  acc:    14 /    14 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    23 /    23 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    25 /    25 = 100.000
1, 101  acc:     5 /     5 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     6 /     6 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    33 /    34 =  97.059
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    14 /    14 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     9 /     9 = 100.000
1, 111  acc:     3 /     3 = 100.000
1, 112  acc:    16 /    17 =  94.118
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8533 /  9079 =  93.986
1, 118  acc:  2179 /  2280 =  95.570
1, 119  acc:   523 /   551 =  94.918
1, 120  acc:   520 /   553 =  94.033
1, 121  acc:   161 /   165 =  97.576
1, 122  acc:    86 /    92 =  93.478
1, 123  acc:    37 /    41 =  90.244
1, 124  acc:    38 /    43 =  88.372
1, 125  acc:   529 /   558 =  94.803
1, 126  acc:   143 /   148 =  96.622
1, 127  acc:    32 /    33 =  96.970
1, 128  acc:    45 /    49 =  91.837
1, 129  acc:    20 /    20 = 100.000
1, 130  acc:     6 /     8 =  75.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     9 /     9 = 100.000
1, 133  acc:   463 /   496 =  93.347
1, 134  acc:    94 /   102 =  92.157
1, 135  acc:    29 /    32 =  90.625
1, 136  acc:    17 /    21 =  80.952
1, 137  acc:     3 /     3 = 100.000
1, 138  acc:     6 /     6 = 100.000
1, 139  acc:     3 /     3 = 100.000
1, 140  acc:     1 /     1 = 100.000
1, 141  acc:   109 /   120 =  90.833
1, 142  acc:    26 /    29 =  89.655
1, 143  acc:     7 /     7 = 100.000
1, 144  acc:     2 /     3 =  66.667
1, 145  acc:     1 /     1 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     5 /     6 =  83.333
1, 148  acc:   188 /   204 =  92.157
1, 149  acc:    25 /    27 =  92.593
1, 150  acc:    16 /    17 =  94.118
1, 151  acc:     6 /    13 =  46.154
1, 152  acc:     4 /     5 =  80.000
1, 153  acc:     0 /     1 =   0.000
1, 154  acc:    44 /    47 =  93.617
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     8 /     9 =  88.889
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    25 /    25 = 100.000
1, 160  acc:     1 /     2 =  50.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     6 /     6 = 100.000
1, 164  acc:    29 /    30 =  96.667
1, 165  acc:     2 /     3 =  66.667
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3642 /  3871 =  94.084
1, 170  acc:   699 /   742 =  94.205
1, 171  acc:   291 /   303 =  96.040
1, 172  acc:   222 /   237 =  93.671
1, 173  acc:    71 /    74 =  95.946
1, 174  acc:    17 /    18 =  94.444
1, 175  acc:    13 /    13 = 100.000
1, 176  acc:    62 /    67 =  92.537
1, 177  acc:   106 /   110 =  96.364
1, 178  acc:    13 /    14 =  92.857
1, 179  acc:     5 /     6 =  83.333
1, 180  acc:     6 /     7 =  85.714
1, 181  acc:     7 /     8 =  87.500
1, 182  acc:     6 /     6 = 100.000
1, 183  acc:    14 /    15 =  93.333
1, 184  acc:   125 /   132 =  94.697
1, 185  acc:    41 /    43 =  95.349
1, 186  acc:    13 /    15 =  86.667
1, 187  acc:    14 /    15 =  93.333
1, 188  acc:     2 /     3 =  66.667
1, 189  acc:     5 /     6 =  83.333
1, 190  acc:    13 /    13 = 100.000
1, 191  acc:     5 /     5 = 100.000
1, 192  acc:     7 /     7 = 100.000
1, 193  acc:     5 /     5 = 100.000
1, 194  acc:     0 /     1 =   0.000
1, 195  acc:     1 /     1 = 100.000
1, 196  acc:   127 /   139 =  91.367
1, 197  acc:     8 /     8 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     4 /     4 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    14 /    15 =  93.333
1, 205  acc:     3 /     3 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:     9 /    11 =  81.818
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     1 /     1 = 100.000
1, 212  acc:     1 /     1 = 100.000
1, 213  acc:     8 /     8 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     2 /     2 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    13 /    13 = 100.000
1, 218  acc:     9 /     9 = 100.000
1, 219  acc:     7 /     8 =  87.500
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 252953 / 269038 =  94.021
Robust  acc:     0 /     2 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 24249 / 25373 =  95.570
0, 1  acc: 29928 / 31282 =  95.672
0, 2  acc:  5885 /  6155 =  95.613
0, 3  acc: 23256 / 24292 =  95.735
0, 4  acc: 10388 / 10829 =  95.928
0, 5  acc:  5323 /  5541 =  96.066
0, 6  acc:  6506 /  6785 =  95.888
0, 7  acc: 11505 / 12016 =  95.747
1, 0  acc:  4239 /  4437 =  95.538
1, 1  acc:  4748 /  4962 =  95.687
1, 2  acc:  2165 /  2265 =  95.585
1, 3  acc:  2339 /  2446 =  95.626
1, 4  acc:  2986 /  3125 =  95.552
1, 5  acc:   966 /  1003 =  96.311
1, 6  acc:  2967 /  3111 =  95.371
1, 7  acc:  4471 /  4682 =  95.493
--------------------------------------
Average acc: 141921 / 148304 =  95.696
Robust  acc:  2967 /  3111 =  95.371
--------------------------------------
New max robust acc: 95.37126325940211
debias model - Saving best checkpoint at epoch 1
replace: True
-> Updating checkpoint debias-wga-best_seed34.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed34.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 57.601 | Best Acc: 86.117
-------------------------------------
Training, Epoch 1:
Accuracies by groups:
0, 0  acc: 10006 / 12092 =  82.749
0, 1  acc: 11998 / 14179 =  84.618
0, 2  acc:  1865 /  3210 =  58.100
0, 3  acc: 10421 / 12101 =  86.117
0, 4  acc:  3818 /  5355 =  71.298
0, 5  acc:  2379 /  2980 =  79.832
0, 6  acc:  1921 /  3335 =  57.601
0, 7  acc:  3960 /  5723 =  69.194
1, 0  acc:  1735 /  2203 =  78.756
1, 1  acc:  1745 /  2270 =  76.872
1, 2  acc:   995 /  1216 =  81.826
1, 3  acc:   985 /  1260 =  78.175
1, 4  acc:  1261 /  1627 =  77.505
1, 5  acc:   402 /   520 =  77.308
1, 6  acc:  1266 /  1537 =  82.368
1, 7  acc:  1715 /  2246 =  76.358
------------------------------------
Average acc: 56472 / 71854 =  78.593
Robust  acc:  1921 /  3335 =  57.601
------------------------------------
Accuracies by groups:
0, 0  acc: 10006 / 12092 =  82.749
0, 1  acc: 11998 / 14179 =  84.618
0, 2  acc:  1865 /  3210 =  58.100
0, 3  acc: 10421 / 12101 =  86.117
0, 4  acc:  3818 /  5355 =  71.298
0, 5  acc:  2379 /  2980 =  79.832
0, 6  acc:  1921 /  3335 =  57.601
0, 7  acc:  3960 /  5723 =  69.194
1, 0  acc:  1735 /  2203 =  78.756
1, 1  acc:  1745 /  2270 =  76.872
1, 2  acc:   995 /  1216 =  81.826
1, 3  acc:   985 /  1260 =  78.175
1, 4  acc:  1261 /  1627 =  77.505
1, 5  acc:   402 /   520 =  77.308
1, 6  acc:  1266 /  1537 =  82.368
1, 7  acc:  1715 /  2246 =  76.358
------------------------------------
Average acc: 56472 / 71854 =  78.593
Robust  acc:  1921 /  3335 =  57.601
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10006 / 12092 =  82.749
0, 1  acc: 11998 / 14179 =  84.618
0, 2  acc:  1865 /  3210 =  58.100
0, 3  acc: 10421 / 12101 =  86.117
0, 4  acc:  3818 /  5355 =  71.298
0, 5  acc:  2379 /  2980 =  79.832
0, 6  acc:  1921 /  3335 =  57.601
0, 7  acc:  3960 /  5723 =  69.194
1, 0  acc:  1735 /  2203 =  78.756
1, 1  acc:  1745 /  2270 =  76.872
1, 2  acc:   995 /  1216 =  81.826
1, 3  acc:   985 /  1260 =  78.175
1, 4  acc:  1261 /  1627 =  77.505
1, 5  acc:   402 /   520 =  77.308
1, 6  acc:  1266 /  1537 =  82.368
1, 7  acc:  1715 /  2246 =  76.358
------------------------------------
Average acc: 56472 / 71854 =  78.593
Robust  acc:  1921 /  3335 =  57.601
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   3 | Train Loss: 0.008 | Train Acc: 96.763 | Val Loss: 0.000 | Val Acc: 98.179
Training:
Accuracies by groups:
0, 0  acc: 57807 / 59947 =  96.430
0, 1  acc:  6379 /  6611 =  96.491
0, 2  acc:  9872 / 10331 =  95.557
0, 3  acc:  4683 /  4918 =  95.222
0, 4  acc:  1723 /  1972 =  87.373
0, 5  acc:   223 /   262 =  85.115
0, 6  acc:   271 /   301 =  90.033
0, 7  acc:   215 /   249 =  86.345
0, 8  acc:  5403 /  5654 =  95.561
0, 9  acc:   376 /   406 =  92.611
0, 10  acc:   411 /   431 =  95.360
0, 11  acc:   294 /   307 =  95.765
0, 12  acc:   354 /   408 =  86.765
0, 13  acc:    30 /    38 =  78.947
0, 14  acc:    26 /    35 =  74.286
0, 15  acc:    22 /    32 =  68.750
0, 16  acc:  4423 /  4825 =  91.668
0, 17  acc:   164 /   176 =  93.182
0, 18  acc:   416 /   448 =  92.857
0, 19  acc:   110 /   123 =  89.431
0, 20  acc:   128 /   144 =  88.889
0, 21  acc:    23 /    24 =  95.833
0, 22  acc:    57 /    61 =  93.443
0, 23  acc:    12 /    17 =  70.588
0, 24  acc:   563 /   626 =  89.936
0, 25  acc:    37 /    38 =  97.368
0, 26  acc:    63 /    65 =  96.923
0, 27  acc:    20 /    22 =  90.909
0, 28  acc:    27 /    32 =  84.375
0, 29  acc:     2 /     3 =  66.667
0, 30  acc:     5 /     8 =  62.500
0, 31  acc:     6 /     6 = 100.000
0, 32  acc:  1435 /  1509 =  95.096
0, 33  acc:    74 /    76 =  97.368
0, 34  acc:    72 /    76 =  94.737
0, 35  acc:    20 /    21 =  95.238
0, 36  acc:    34 /    38 =  89.474
0, 37  acc:     8 /     8 = 100.000
0, 38  acc:    17 /    19 =  89.474
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   314 /   336 =  93.452
0, 41  acc:    20 /    22 =  90.909
0, 42  acc:     6 /     7 =  85.714
0, 43  acc:    11 /    12 =  91.667
0, 44  acc:    14 /    17 =  82.353
0, 45  acc:     0 /     0 =     nan
0, 46  acc:    11 /    11 = 100.000
0, 47  acc:     0 /     0 =     nan
0, 48  acc:   286 /   311 =  91.961
0, 49  acc:     4 /     5 =  80.000
0, 50  acc:    12 /    13 =  92.308
0, 51  acc:    18 /    19 =  94.737
0, 52  acc:     7 /     7 = 100.000
0, 53  acc:     1 /     1 = 100.000
0, 54  acc:     4 /     4 = 100.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   231 /   246 =  93.902
0, 57  acc:    11 /    11 = 100.000
0, 58  acc:     7 /    10 =  70.000
0, 59  acc:    10 /    10 = 100.000
0, 60  acc:    15 /    19 =  78.947
0, 61  acc:     0 /     0 =     nan
0, 62  acc:    10 /    12 =  83.333
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  2057 /  2298 =  89.513
0, 65  acc:   294 /   329 =  89.362
0, 66  acc:   240 /   264 =  90.909
0, 67  acc:   100 /   111 =  90.090
0, 68  acc:    44 /    51 =  86.275
0, 69  acc:     7 /     7 = 100.000
0, 70  acc:    14 /    15 =  93.333
0, 71  acc:     6 /     6 = 100.000
0, 72  acc:    66 /    68 =  97.059
0, 73  acc:     5 /     5 = 100.000
0, 74  acc:     3 /     3 = 100.000
0, 75  acc:     8 /     8 = 100.000
0, 76  acc:     1 /     2 =  50.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     0 /     0 =     nan
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    64 /    75 =  85.333
0, 81  acc:     4 /     7 =  57.143
0, 82  acc:    13 /    13 = 100.000
0, 83  acc:     9 /     9 = 100.000
0, 84  acc:     5 /     7 =  71.429
0, 85  acc:     0 /     0 =     nan
0, 86  acc:    12 /    13 =  92.308
0, 87  acc:     1 /     1 = 100.000
0, 88  acc:     4 /     6 =  66.667
0, 89  acc:     0 /     0 =     nan
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     1 =   0.000
0, 94  acc:    74 /    82 =  90.244
0, 95  acc:     6 /     6 = 100.000
0, 96  acc:     5 /     5 = 100.000
0, 97  acc:     2 /     2 = 100.000
0, 98  acc:    12 /    13 =  92.308
0, 99  acc:     1 /     1 = 100.000
0, 100  acc:     2 /     2 = 100.000
0, 101  acc:    12 /    15 =  80.000
0, 102  acc:     2 /     2 = 100.000
0, 103  acc:     0 /     0 =     nan
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    16 /    17 =  94.118
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     1 /     1 = 100.000
0, 110  acc:     4 /     8 =  50.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     6 /     6 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     1 /     1 = 100.000
0, 117  acc:  6141 /  6505 =  94.404
0, 118  acc:  1449 /  1527 =  94.892
0, 119  acc:   352 /   374 =  94.118
0, 120  acc:   327 /   347 =  94.236
0, 121  acc:    56 /    66 =  84.848
0, 122  acc:    47 /    48 =  97.917
0, 123  acc:    12 /    14 =  85.714
0, 124  acc:    15 /    21 =  71.429
0, 125  acc:   349 /   371 =  94.070
0, 126  acc:   108 /   114 =  94.737
0, 127  acc:    28 /    30 =  93.333
0, 128  acc:    51 /    52 =  98.077
0, 129  acc:     2 /     2 = 100.000
0, 130  acc:     3 /     5 =  60.000
0, 131  acc:     2 /     2 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   219 /   237 =  92.405
0, 134  acc:    49 /    53 =  92.453
0, 135  acc:    27 /    27 = 100.000
0, 136  acc:    33 /    35 =  94.286
0, 137  acc:    12 /    14 =  85.714
0, 138  acc:     3 /     3 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    66 /    70 =  94.286
0, 142  acc:     9 /     9 = 100.000
0, 143  acc:     3 /     3 = 100.000
0, 144  acc:    14 /    14 = 100.000
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     1 /     1 = 100.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:   107 /   114 =  93.860
0, 149  acc:    15 /    16 =  93.750
0, 150  acc:     2 /     3 =  66.667
0, 151  acc:    13 /    17 =  76.471
0, 152  acc:     1 /     1 = 100.000
0, 153  acc:     1 /     1 = 100.000
0, 154  acc:    33 /    34 =  97.059
0, 155  acc:     3 /     4 =  75.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     3 /     3 = 100.000
0, 159  acc:    17 /    20 =  85.000
0, 160  acc:     1 /     2 =  50.000
0, 161  acc:     2 /     2 = 100.000
0, 162  acc:     2 /     2 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    15 /    17 =  88.235
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:     6 /     6 = 100.000
0, 167  acc:     0 /     1 =   0.000
0, 168  acc:     2 /     2 = 100.000
0, 169  acc:  1506 /  1671 =  90.126
0, 170  acc:   348 /   389 =  89.460
0, 171  acc:    91 /   105 =  86.667
0, 172  acc:   131 /   139 =  94.245
0, 173  acc:     8 /    11 =  72.727
0, 174  acc:     4 /     4 = 100.000
0, 175  acc:     7 /     8 =  87.500
0, 176  acc:    12 /    15 =  80.000
0, 177  acc:    56 /    58 =  96.552
0, 178  acc:     9 /    10 =  90.000
0, 179  acc:     7 /     9 =  77.778
0, 180  acc:     9 /     9 = 100.000
0, 181  acc:     2 /     2 = 100.000
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     2 /     2 = 100.000
0, 184  acc:    60 /    62 =  96.774
0, 185  acc:     6 /     7 =  85.714
0, 186  acc:     4 /     4 = 100.000
0, 187  acc:     8 /     8 = 100.000
0, 188  acc:     1 /     1 = 100.000
0, 189  acc:     5 /     5 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    32 /    33 =  96.970
0, 192  acc:     0 /     0 =     nan
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     0 /     0 =     nan
0, 195  acc:     2 /     2 = 100.000
0, 196  acc:    44 /    46 =  95.652
0, 197  acc:    11 /    11 = 100.000
0, 198  acc:     3 /     4 =  75.000
0, 199  acc:    17 /    17 = 100.000
0, 200  acc:     4 /     4 = 100.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     3 /     3 = 100.000
0, 204  acc:    22 /    25 =  88.000
0, 205  acc:     2 /     2 = 100.000
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     4 /     4 = 100.000
0, 208  acc:     4 /     4 = 100.000
0, 209  acc:     9 /    11 =  81.818
0, 210  acc:     0 /     0 =     nan
0, 211  acc:     4 /     4 = 100.000
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     2 /     2 = 100.000
0, 214  acc:     0 /     0 =     nan
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     9 /     9 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     2 /     2 = 100.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     2 /     2 = 100.000
1, 0  acc: 64658 / 65660 =  98.474
1, 1  acc:  6699 /  6812 =  98.341
1, 2  acc: 11567 / 11804 =  97.992
1, 3  acc:  4741 /  4856 =  97.632
1, 4  acc:  5668 /  5777 =  98.113
1, 5  acc:   928 /   951 =  97.581
1, 6  acc:   557 /   566 =  98.410
1, 7  acc:   668 /   680 =  98.235
1, 8  acc:  5821 /  5954 =  97.766
1, 9  acc:   407 /   418 =  97.368
1, 10  acc:   528 /   540 =  97.778
1, 11  acc:   269 /   277 =  97.112
1, 12  acc:   914 /   934 =  97.859
1, 13  acc:   122 /   124 =  98.387
1, 14  acc:   162 /   166 =  97.590
1, 15  acc:   165 /   171 =  96.491
1, 16  acc:  8868 /  9068 =  97.794
1, 17  acc:   332 /   338 =  98.225
1, 18  acc:   638 /   658 =  96.960
1, 19  acc:   266 /   275 =  96.727
1, 20  acc:   316 /   326 =  96.933
1, 21  acc:    47 /    47 = 100.000
1, 22  acc:   155 /   159 =  97.484
1, 23  acc:    52 /    53 =  98.113
1, 24  acc:  1081 /  1119 =  96.604
1, 25  acc:    19 /    20 =  95.000
1, 26  acc:   112 /   115 =  97.391
1, 27  acc:    13 /    13 = 100.000
1, 28  acc:   162 /   163 =  99.387
1, 29  acc:     6 /     6 = 100.000
1, 30  acc:    27 /    27 = 100.000
1, 31  acc:    10 /    10 = 100.000
1, 32  acc:  1817 /  1858 =  97.793
1, 33  acc:    98 /   100 =  98.000
1, 34  acc:    81 /    82 =  98.780
1, 35  acc:    21 /    21 = 100.000
1, 36  acc:    56 /    59 =  94.915
1, 37  acc:     5 /     6 =  83.333
1, 38  acc:    36 /    37 =  97.297
1, 39  acc:     1 /     2 =  50.000
1, 40  acc:   430 /   440 =  97.727
1, 41  acc:    20 /    20 = 100.000
1, 42  acc:    11 /    12 =  91.667
1, 43  acc:    25 /    26 =  96.154
1, 44  acc:    22 /    22 = 100.000
1, 45  acc:     3 /     3 = 100.000
1, 46  acc:     6 /     6 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   584 /   598 =  97.659
1, 49  acc:    15 /    16 =  93.750
1, 50  acc:    40 /    42 =  95.238
1, 51  acc:    34 /    36 =  94.444
1, 52  acc:    17 /    17 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    37 /    38 =  97.368
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   445 /   453 =  98.234
1, 57  acc:    13 /    13 = 100.000
1, 58  acc:    31 /    31 = 100.000
1, 59  acc:    18 /    18 = 100.000
1, 60  acc:    26 /    27 =  96.296
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    20 /    20 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5864 /  5991 =  97.880
1, 65  acc:   818 /   835 =  97.964
1, 66  acc:   516 /   524 =  98.473
1, 67  acc:   186 /   189 =  98.413
1, 68  acc:   286 /   293 =  97.611
1, 69  acc:    36 /    36 = 100.000
1, 70  acc:    68 /    69 =  98.551
1, 71  acc:    27 /    28 =  96.429
1, 72  acc:   146 /   147 =  99.320
1, 73  acc:    10 /    11 =  90.909
1, 74  acc:     3 /     6 =  50.000
1, 75  acc:     2 /     2 = 100.000
1, 76  acc:    15 /    15 = 100.000
1, 77  acc:     4 /     4 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     1 /     1 = 100.000
1, 80  acc:   228 /   235 =  97.021
1, 81  acc:    20 /    21 =  95.238
1, 82  acc:    52 /    53 =  98.113
1, 83  acc:     5 /     5 = 100.000
1, 84  acc:     8 /     8 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    32 /    32 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    25 /    25 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     5 /     5 = 100.000
1, 93  acc:     3 /     4 =  75.000
1, 94  acc:   141 /   145 =  97.241
1, 95  acc:    17 /    17 = 100.000
1, 96  acc:    10 /    10 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    13 /    13 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    14 /    16 =  87.500
1, 101  acc:     6 /     6 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     7 /     7 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    54 /    54 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    18 /    18 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     6 /     6 = 100.000
1, 111  acc:     4 /     4 = 100.000
1, 112  acc:    21 /    21 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8536 /  8803 =  96.967
1, 118  acc:  2184 /  2240 =  97.500
1, 119  acc:   489 /   501 =  97.605
1, 120  acc:   577 /   591 =  97.631
1, 121  acc:   142 /   145 =  97.931
1, 122  acc:    85 /    87 =  97.701
1, 123  acc:    26 /    26 = 100.000
1, 124  acc:    48 /    49 =  97.959
1, 125  acc:   556 /   569 =  97.715
1, 126  acc:   133 /   137 =  97.080
1, 127  acc:    22 /    24 =  91.667
1, 128  acc:    44 /    44 = 100.000
1, 129  acc:    15 /    17 =  88.235
1, 130  acc:     4 /     5 =  80.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     9 /    11 =  81.818
1, 133  acc:   478 /   489 =  97.751
1, 134  acc:   106 /   108 =  98.148
1, 135  acc:    30 /    31 =  96.774
1, 136  acc:    19 /    22 =  86.364
1, 137  acc:    10 /    10 = 100.000
1, 138  acc:     2 /     2 = 100.000
1, 139  acc:     5 /     5 = 100.000
1, 140  acc:     5 /     6 =  83.333
1, 141  acc:   122 /   123 =  99.187
1, 142  acc:    24 /    24 = 100.000
1, 143  acc:     3 /     3 = 100.000
1, 144  acc:     5 /     5 = 100.000
1, 145  acc:     1 /     1 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     8 /     8 = 100.000
1, 148  acc:   219 /   223 =  98.206
1, 149  acc:    17 /    19 =  89.474
1, 150  acc:    14 /    14 = 100.000
1, 151  acc:    12 /    17 =  70.588
1, 152  acc:     2 /     2 = 100.000
1, 153  acc:     3 /     4 =  75.000
1, 154  acc:    33 /    35 =  94.286
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     6 /     6 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    31 /    32 =  96.875
1, 160  acc:     4 /     6 =  66.667
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     3 /     3 = 100.000
1, 164  acc:    18 /    19 =  94.737
1, 165  acc:     5 /     5 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3753 /  3861 =  97.203
1, 170  acc:   670 /   692 =  96.821
1, 171  acc:   248 /   253 =  98.024
1, 172  acc:   272 /   278 =  97.842
1, 173  acc:    58 /    60 =  96.667
1, 174  acc:    20 /    21 =  95.238
1, 175  acc:    10 /    12 =  83.333
1, 176  acc:    55 /    56 =  98.214
1, 177  acc:   102 /   104 =  98.077
1, 178  acc:    13 /    15 =  86.667
1, 179  acc:     7 /     7 = 100.000
1, 180  acc:     9 /    10 =  90.000
1, 181  acc:     7 /     7 = 100.000
1, 182  acc:     5 /     5 = 100.000
1, 183  acc:    18 /    18 = 100.000
1, 184  acc:   127 /   128 =  99.219
1, 185  acc:    55 /    55 = 100.000
1, 186  acc:    23 /    23 = 100.000
1, 187  acc:    16 /    17 =  94.118
1, 188  acc:     2 /     2 = 100.000
1, 189  acc:     4 /     5 =  80.000
1, 190  acc:    13 /    13 = 100.000
1, 191  acc:    11 /    11 = 100.000
1, 192  acc:    14 /    14 = 100.000
1, 193  acc:    11 /    11 = 100.000
1, 194  acc:     2 /     2 = 100.000
1, 195  acc:     0 /     0 =     nan
1, 196  acc:   119 /   123 =  96.748
1, 197  acc:    13 /    14 =  92.857
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     2 /     2 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    20 /    21 =  95.238
1, 205  acc:     2 /     2 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    14 /    17 =  82.353
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     4 /     4 = 100.000
1, 212  acc:     2 /     2 = 100.000
1, 213  acc:    18 /    19 =  94.737
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     7 /     7 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    13 /    13 = 100.000
1, 218  acc:    12 /    12 = 100.000
1, 219  acc:     9 /     9 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 260330 / 269038 =  96.763
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 24907 / 25373 =  98.163
0, 1  acc: 30718 / 31282 =  98.197
0, 2  acc:  6046 /  6155 =  98.229
0, 3  acc: 23851 / 24292 =  98.185
0, 4  acc: 10654 / 10829 =  98.384
0, 5  acc:  5433 /  5541 =  98.051
0, 6  acc:  6658 /  6785 =  98.128
0, 7  acc: 11801 / 12016 =  98.211
1, 0  acc:  4348 /  4437 =  97.994
1, 1  acc:  4878 /  4962 =  98.307
1, 2  acc:  2225 /  2265 =  98.234
1, 3  acc:  2401 /  2446 =  98.160
1, 4  acc:  3059 /  3125 =  97.888
1, 5  acc:   988 /  1003 =  98.504
1, 6  acc:  3071 /  3111 =  98.714
1, 7  acc:  4600 /  4682 =  98.249
--------------------------------------
Average acc: 145638 / 148304 =  98.202
Robust  acc:  3059 /  3125 =  97.888
--------------------------------------
New max robust acc: 97.88799999999999
debias model - Saving best checkpoint at epoch 2
replace: True
-> Updating checkpoint debias-wga-best_seed34.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed34.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 65.765 | Best Acc: 91.083
-------------------------------------
Training, Epoch 2:
Accuracies by groups:
0, 0  acc: 10647 / 12092 =  88.050
0, 1  acc: 12587 / 14179 =  88.772
0, 2  acc:  2168 /  3210 =  67.539
0, 3  acc: 11022 / 12101 =  91.083
0, 4  acc:  4356 /  5355 =  81.345
0, 5  acc:  2561 /  2980 =  85.940
0, 6  acc:  2388 /  3335 =  71.604
0, 7  acc:  4441 /  5723 =  77.599
1, 0  acc:  1548 /  2203 =  70.268
1, 1  acc:  1587 /  2270 =  69.912
1, 2  acc:   918 /  1216 =  75.493
1, 3  acc:   861 /  1260 =  68.333
1, 4  acc:  1070 /  1627 =  65.765
1, 5  acc:   358 /   520 =  68.846
1, 6  acc:  1110 /  1537 =  72.219
1, 7  acc:  1502 /  2246 =  66.874
------------------------------------
Average acc: 59124 / 71854 =  82.284
Robust  acc:  1070 /  1627 =  65.765
------------------------------------
Accuracies by groups:
0, 0  acc: 10647 / 12092 =  88.050
0, 1  acc: 12587 / 14179 =  88.772
0, 2  acc:  2168 /  3210 =  67.539
0, 3  acc: 11022 / 12101 =  91.083
0, 4  acc:  4356 /  5355 =  81.345
0, 5  acc:  2561 /  2980 =  85.940
0, 6  acc:  2388 /  3335 =  71.604
0, 7  acc:  4441 /  5723 =  77.599
1, 0  acc:  1548 /  2203 =  70.268
1, 1  acc:  1587 /  2270 =  69.912
1, 2  acc:   918 /  1216 =  75.493
1, 3  acc:   861 /  1260 =  68.333
1, 4  acc:  1070 /  1627 =  65.765
1, 5  acc:   358 /   520 =  68.846
1, 6  acc:  1110 /  1537 =  72.219
1, 7  acc:  1502 /  2246 =  66.874
------------------------------------
Average acc: 59124 / 71854 =  82.284
Robust  acc:  1070 /  1627 =  65.765
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10647 / 12092 =  88.050
0, 1  acc: 12587 / 14179 =  88.772
0, 2  acc:  2168 /  3210 =  67.539
0, 3  acc: 11022 / 12101 =  91.083
0, 4  acc:  4356 /  5355 =  81.345
0, 5  acc:  2561 /  2980 =  85.940
0, 6  acc:  2388 /  3335 =  71.604
0, 7  acc:  4441 /  5723 =  77.599
1, 0  acc:  1548 /  2203 =  70.268
1, 1  acc:  1587 /  2270 =  69.912
1, 2  acc:   918 /  1216 =  75.493
1, 3  acc:   861 /  1260 =  68.333
1, 4  acc:  1070 /  1627 =  65.765
1, 5  acc:   358 /   520 =  68.846
1, 6  acc:  1110 /  1537 =  72.219
1, 7  acc:  1502 /  2246 =  66.874
------------------------------------
Average acc: 59124 / 71854 =  82.284
Robust  acc:  1070 /  1627 =  65.765
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   4 | Train Loss: 0.006 | Train Acc: 97.947 | Val Loss: 0.000 | Val Acc: 98.905
Training:
Accuracies by groups:
0, 0  acc: 58863 / 60233 =  97.725
0, 1  acc:  6231 /  6380 =  97.665
0, 2  acc:  9856 / 10136 =  97.238
0, 3  acc:  4776 /  4927 =  96.935
0, 4  acc:  1817 /  1962 =  92.610
0, 5  acc:   223 /   254 =  87.795
0, 6  acc:   274 /   290 =  94.483
0, 7  acc:   222 /   244 =  90.984
0, 8  acc:  5390 /  5554 =  97.047
0, 9  acc:   406 /   425 =  95.529
0, 10  acc:   397 /   407 =  97.543
0, 11  acc:   262 /   274 =  95.620
0, 12  acc:   376 /   405 =  92.840
0, 13  acc:    35 /    39 =  89.744
0, 14  acc:    46 /    50 =  92.000
0, 15  acc:    21 /    23 =  91.304
0, 16  acc:  4571 /  4824 =  94.755
0, 17  acc:   169 /   175 =  96.571
0, 18  acc:   448 /   470 =  95.319
0, 19  acc:   105 /   113 =  92.920
0, 20  acc:   116 /   125 =  92.800
0, 21  acc:    16 /    17 =  94.118
0, 22  acc:    39 /    39 = 100.000
0, 23  acc:    14 /    15 =  93.333
0, 24  acc:   583 /   620 =  94.032
0, 25  acc:    23 /    24 =  95.833
0, 26  acc:    46 /    47 =  97.872
0, 27  acc:    20 /    21 =  95.238
0, 28  acc:    42 /    45 =  93.333
0, 29  acc:     1 /     1 = 100.000
0, 30  acc:     9 /     9 = 100.000
0, 31  acc:     4 /     4 = 100.000
0, 32  acc:  1495 /  1542 =  96.952
0, 33  acc:    49 /    53 =  92.453
0, 34  acc:    69 /    70 =  98.571
0, 35  acc:    21 /    21 = 100.000
0, 36  acc:    29 /    31 =  93.548
0, 37  acc:     5 /     5 = 100.000
0, 38  acc:    26 /    27 =  96.296
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   348 /   361 =  96.399
0, 41  acc:    24 /    24 = 100.000
0, 42  acc:     8 /     9 =  88.889
0, 43  acc:    11 /    11 = 100.000
0, 44  acc:    24 /    24 = 100.000
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     9 /    10 =  90.000
0, 47  acc:     6 /     6 = 100.000
0, 48  acc:   285 /   303 =  94.059
0, 49  acc:     1 /     1 = 100.000
0, 50  acc:    16 /    19 =  84.211
0, 51  acc:    16 /    16 = 100.000
0, 52  acc:     4 /     4 = 100.000
0, 53  acc:     1 /     1 = 100.000
0, 54  acc:     3 /     3 = 100.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   213 /   221 =  96.380
0, 57  acc:    15 /    15 = 100.000
0, 58  acc:    13 /    13 = 100.000
0, 59  acc:    12 /    12 = 100.000
0, 60  acc:    14 /    15 =  93.333
0, 61  acc:     3 /     3 = 100.000
0, 62  acc:     9 /     9 = 100.000
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  2179 /  2329 =  93.559
0, 65  acc:   357 /   380 =  93.947
0, 66  acc:   230 /   243 =  94.650
0, 67  acc:   119 /   127 =  93.701
0, 68  acc:    56 /    62 =  90.323
0, 69  acc:     7 /     7 = 100.000
0, 70  acc:    19 /    21 =  90.476
0, 71  acc:     3 /     3 = 100.000
0, 72  acc:    52 /    55 =  94.545
0, 73  acc:     2 /     2 = 100.000
0, 74  acc:    10 /    10 = 100.000
0, 75  acc:     7 /     7 = 100.000
0, 76  acc:     8 /    10 =  80.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     0 /     0 =     nan
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    82 /    87 =  94.253
0, 81  acc:    10 /    12 =  83.333
0, 82  acc:     9 /     9 = 100.000
0, 83  acc:    16 /    17 =  94.118
0, 84  acc:     4 /     5 =  80.000
0, 85  acc:     3 /     3 = 100.000
0, 86  acc:    21 /    21 = 100.000
0, 87  acc:     0 /     1 =   0.000
0, 88  acc:    10 /    11 =  90.909
0, 89  acc:     5 /     6 =  83.333
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     1 /     1 = 100.000
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    73 /    77 =  94.805
0, 95  acc:     0 /     0 =     nan
0, 96  acc:     1 /     1 = 100.000
0, 97  acc:     2 /     2 = 100.000
0, 98  acc:    13 /    13 = 100.000
0, 99  acc:     0 /     0 =     nan
0, 100  acc:     2 /     2 = 100.000
0, 101  acc:     7 /     7 = 100.000
0, 102  acc:     1 /     1 = 100.000
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     1 /     1 = 100.000
0, 106  acc:    12 /    14 =  85.714
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     5 /     5 = 100.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:    11 /    11 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     1 /     2 =  50.000
0, 117  acc:  6204 /  6450 =  96.186
0, 118  acc:  1518 /  1574 =  96.442
0, 119  acc:   374 /   388 =  96.392
0, 120  acc:   298 /   311 =  95.820
0, 121  acc:    52 /    60 =  86.667
0, 122  acc:    42 /    44 =  95.455
0, 123  acc:     7 /     7 = 100.000
0, 124  acc:    21 /    22 =  95.455
0, 125  acc:   344 /   355 =  96.901
0, 126  acc:    96 /   101 =  95.050
0, 127  acc:    21 /    23 =  91.304
0, 128  acc:    34 /    35 =  97.143
0, 129  acc:     4 /     4 = 100.000
0, 130  acc:     6 /     6 = 100.000
0, 131  acc:     2 /     2 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   241 /   250 =  96.400
0, 134  acc:    54 /    55 =  98.182
0, 135  acc:    25 /    25 = 100.000
0, 136  acc:    37 /    37 = 100.000
0, 137  acc:     9 /    11 =  81.818
0, 138  acc:     3 /     3 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    49 /    52 =  94.231
0, 142  acc:    12 /    12 = 100.000
0, 143  acc:     5 /     5 = 100.000
0, 144  acc:    10 /    10 = 100.000
0, 145  acc:     0 /     1 =   0.000
0, 146  acc:     1 /     1 = 100.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    97 /   102 =  95.098
0, 149  acc:    15 /    15 = 100.000
0, 150  acc:     3 /     3 = 100.000
0, 151  acc:     8 /    14 =  57.143
0, 152  acc:     3 /     3 = 100.000
0, 153  acc:     2 /     2 = 100.000
0, 154  acc:    43 /    44 =  97.727
0, 155  acc:     8 /     9 =  88.889
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     7 /     7 = 100.000
0, 159  acc:    33 /    34 =  97.059
0, 160  acc:     2 /     2 = 100.000
0, 161  acc:     1 /     2 =  50.000
0, 162  acc:     5 /     5 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    13 /    14 =  92.857
0, 165  acc:     4 /     4 = 100.000
0, 166  acc:     7 /     7 = 100.000
0, 167  acc:     0 /     0 =     nan
0, 168  acc:     1 /     1 = 100.000
0, 169  acc:  1495 /  1591 =  93.966
0, 170  acc:   381 /   394 =  96.701
0, 171  acc:    87 /    91 =  95.604
0, 172  acc:   153 /   161 =  95.031
0, 173  acc:    12 /    14 =  85.714
0, 174  acc:     5 /     5 = 100.000
0, 175  acc:     5 /     6 =  83.333
0, 176  acc:    11 /    12 =  91.667
0, 177  acc:    57 /    61 =  93.443
0, 178  acc:    22 /    22 = 100.000
0, 179  acc:     6 /     7 =  85.714
0, 180  acc:     6 /     6 = 100.000
0, 181  acc:     2 /     3 =  66.667
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     5 /     6 =  83.333
0, 184  acc:    57 /    59 =  96.610
0, 185  acc:     4 /     4 = 100.000
0, 186  acc:     4 /     4 = 100.000
0, 187  acc:     7 /     8 =  87.500
0, 188  acc:     2 /     2 = 100.000
0, 189  acc:     6 /     6 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    35 /    35 = 100.000
0, 192  acc:     1 /     1 = 100.000
0, 193  acc:     0 /     1 =   0.000
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     1 /     1 = 100.000
0, 196  acc:    33 /    35 =  94.286
0, 197  acc:    11 /    11 = 100.000
0, 198  acc:     3 /     3 = 100.000
0, 199  acc:     7 /     7 = 100.000
0, 200  acc:     4 /     4 = 100.000
0, 201  acc:     1 /     1 = 100.000
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     4 /     4 = 100.000
0, 204  acc:    21 /    23 =  91.304
0, 205  acc:     9 /     9 = 100.000
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     4 /     4 = 100.000
0, 208  acc:     4 /     4 = 100.000
0, 209  acc:     3 /     4 =  75.000
0, 210  acc:     1 /     1 = 100.000
0, 211  acc:     3 /     3 = 100.000
0, 212  acc:     0 /     0 =     nan
0, 213  acc:     3 /     4 =  75.000
0, 214  acc:     0 /     0 =     nan
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     6 /     6 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     3 /     3 = 100.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     0 /     0 =     nan
1, 0  acc: 65477 / 66116 =  99.034
1, 1  acc:  6683 /  6761 =  98.846
1, 2  acc: 11554 / 11703 =  98.727
1, 3  acc:  4797 /  4867 =  98.562
1, 4  acc:  5551 /  5626 =  98.667
1, 5  acc:   968 /   981 =  98.675
1, 6  acc:   565 /   571 =  98.949
1, 7  acc:   702 /   714 =  98.319
1, 8  acc:  5932 /  6030 =  98.375
1, 9  acc:   423 /   428 =  98.832
1, 10  acc:   493 /   504 =  97.817
1, 11  acc:   293 /   297 =  98.653
1, 12  acc:   854 /   863 =  98.957
1, 13  acc:   123 /   124 =  99.194
1, 14  acc:   143 /   145 =  98.621
1, 15  acc:   147 /   149 =  98.658
1, 16  acc:  8844 /  9001 =  98.256
1, 17  acc:   329 /   333 =  98.799
1, 18  acc:   647 /   654 =  98.930
1, 19  acc:   286 /   294 =  97.279
1, 20  acc:   314 /   317 =  99.054
1, 21  acc:    44 /    45 =  97.778
1, 22  acc:   160 /   161 =  99.379
1, 23  acc:    40 /    41 =  97.561
1, 24  acc:  1165 /  1186 =  98.229
1, 25  acc:    29 /    29 = 100.000
1, 26  acc:   107 /   108 =  99.074
1, 27  acc:    18 /    18 = 100.000
1, 28  acc:   175 /   178 =  98.315
1, 29  acc:    13 /    13 = 100.000
1, 30  acc:    27 /    27 = 100.000
1, 31  acc:     8 /     9 =  88.889
1, 32  acc:  1821 /  1839 =  99.021
1, 33  acc:    94 /    95 =  98.947
1, 34  acc:    61 /    61 = 100.000
1, 35  acc:    32 /    32 = 100.000
1, 36  acc:    57 /    57 = 100.000
1, 37  acc:     7 /     7 = 100.000
1, 38  acc:    42 /    42 = 100.000
1, 39  acc:     4 /     4 = 100.000
1, 40  acc:   420 /   423 =  99.291
1, 41  acc:    17 /    17 = 100.000
1, 42  acc:    15 /    17 =  88.235
1, 43  acc:    34 /    34 = 100.000
1, 44  acc:    31 /    32 =  96.875
1, 45  acc:     5 /     6 =  83.333
1, 46  acc:    10 /    10 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   584 /   594 =  98.316
1, 49  acc:    20 /    20 = 100.000
1, 50  acc:    41 /    41 = 100.000
1, 51  acc:    21 /    21 = 100.000
1, 52  acc:    19 /    19 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    38 /    38 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   488 /   498 =  97.992
1, 57  acc:    16 /    17 =  94.118
1, 58  acc:    23 /    23 = 100.000
1, 59  acc:    17 /    18 =  94.444
1, 60  acc:    25 /    27 =  92.593
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    15 /    15 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5830 /  5925 =  98.397
1, 65  acc:   850 /   859 =  98.952
1, 66  acc:   520 /   529 =  98.299
1, 67  acc:   230 /   231 =  99.567
1, 68  acc:   281 /   285 =  98.596
1, 69  acc:    44 /    44 = 100.000
1, 70  acc:    85 /    86 =  98.837
1, 71  acc:    28 /    28 = 100.000
1, 72  acc:   128 /   129 =  99.225
1, 73  acc:     7 /     7 = 100.000
1, 74  acc:     6 /     6 = 100.000
1, 75  acc:     4 /     4 = 100.000
1, 76  acc:    35 /    35 = 100.000
1, 77  acc:     3 /     3 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     5 /     5 = 100.000
1, 80  acc:   245 /   246 =  99.593
1, 81  acc:    30 /    32 =  93.750
1, 82  acc:    54 /    55 =  98.182
1, 83  acc:     5 /     5 = 100.000
1, 84  acc:     9 /     9 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    27 /    27 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    24 /    24 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     2 /     2 = 100.000
1, 93  acc:     3 /     3 = 100.000
1, 94  acc:   158 /   159 =  99.371
1, 95  acc:    19 /    20 =  95.000
1, 96  acc:    15 /    15 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    18 /    18 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    27 /    28 =  96.429
1, 101  acc:     3 /     3 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     4 /     4 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    38 /    38 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    17 /    17 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:    13 /    13 = 100.000
1, 111  acc:     0 /     0 =     nan
1, 112  acc:    16 /    16 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8805 /  8979 =  98.062
1, 118  acc:  2205 /  2242 =  98.350
1, 119  acc:   489 /   498 =  98.193
1, 120  acc:   551 /   560 =  98.393
1, 121  acc:   151 /   152 =  99.342
1, 122  acc:    82 /    83 =  98.795
1, 123  acc:    37 /    40 =  92.500
1, 124  acc:    39 /    39 = 100.000
1, 125  acc:   612 /   618 =  99.029
1, 126  acc:   115 /   117 =  98.291
1, 127  acc:    29 /    32 =  90.625
1, 128  acc:    54 /    54 = 100.000
1, 129  acc:    18 /    19 =  94.737
1, 130  acc:     5 /     6 =  83.333
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    12 /    13 =  92.308
1, 133  acc:   473 /   478 =  98.954
1, 134  acc:   100 /   100 = 100.000
1, 135  acc:    33 /    33 = 100.000
1, 136  acc:    26 /    27 =  96.296
1, 137  acc:     8 /     8 = 100.000
1, 138  acc:     2 /     2 = 100.000
1, 139  acc:     6 /     6 = 100.000
1, 140  acc:     3 /     3 = 100.000
1, 141  acc:   111 /   113 =  98.230
1, 142  acc:    20 /    20 = 100.000
1, 143  acc:     6 /     6 = 100.000
1, 144  acc:     5 /     5 = 100.000
1, 145  acc:     1 /     1 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     2 /     2 = 100.000
1, 148  acc:   205 /   212 =  96.698
1, 149  acc:    20 /    20 = 100.000
1, 150  acc:    19 /    19 = 100.000
1, 151  acc:    27 /    29 =  93.103
1, 152  acc:    10 /    10 = 100.000
1, 153  acc:     6 /     6 = 100.000
1, 154  acc:    47 /    49 =  95.918
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     6 /     6 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    26 /    27 =  96.296
1, 160  acc:     0 /     0 =     nan
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     5 /     5 = 100.000
1, 164  acc:    36 /    36 = 100.000
1, 165  acc:     6 /     6 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3768 /  3828 =  98.433
1, 170  acc:   726 /   735 =  98.776
1, 171  acc:   273 /   275 =  99.273
1, 172  acc:   207 /   209 =  99.043
1, 173  acc:    67 /    68 =  98.529
1, 174  acc:    11 /    11 = 100.000
1, 175  acc:    12 /    12 = 100.000
1, 176  acc:    60 /    61 =  98.361
1, 177  acc:   102 /   103 =  99.029
1, 178  acc:    15 /    15 = 100.000
1, 179  acc:     7 /     7 = 100.000
1, 180  acc:    10 /    10 = 100.000
1, 181  acc:     2 /     3 =  66.667
1, 182  acc:     6 /     6 = 100.000
1, 183  acc:    18 /    18 = 100.000
1, 184  acc:   127 /   130 =  97.692
1, 185  acc:    47 /    47 = 100.000
1, 186  acc:    12 /    14 =  85.714
1, 187  acc:     9 /     9 = 100.000
1, 188  acc:     1 /     1 = 100.000
1, 189  acc:     1 /     1 = 100.000
1, 190  acc:    11 /    11 = 100.000
1, 191  acc:     8 /     8 = 100.000
1, 192  acc:     9 /     9 = 100.000
1, 193  acc:     6 /     6 = 100.000
1, 194  acc:     3 /     3 = 100.000
1, 195  acc:     4 /     4 = 100.000
1, 196  acc:   123 /   125 =  98.400
1, 197  acc:    16 /    16 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     2 /     2 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    22 /    23 =  95.652
1, 205  acc:     4 /     4 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    27 /    29 =  93.103
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     3 /     3 = 100.000
1, 212  acc:     2 /     2 = 100.000
1, 213  acc:    19 /    19 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     5 /     5 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     8 /     8 = 100.000
1, 218  acc:    10 /    10 = 100.000
1, 219  acc:    10 /    10 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 263514 / 269038 =  97.947
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 25114 / 25373 =  98.979
0, 1  acc: 30958 / 31282 =  98.964
0, 2  acc:  6088 /  6155 =  98.911
0, 3  acc: 24031 / 24292 =  98.926
0, 4  acc: 10711 / 10829 =  98.910
0, 5  acc:  5494 /  5541 =  99.152
0, 6  acc:  6717 /  6785 =  98.998
0, 7  acc: 11888 / 12016 =  98.935
1, 0  acc:  4381 /  4437 =  98.738
1, 1  acc:  4907 /  4962 =  98.892
1, 2  acc:  2239 /  2265 =  98.852
1, 3  acc:  2426 /  2446 =  99.182
1, 4  acc:  3094 /  3125 =  99.008
1, 5  acc:   988 /  1003 =  98.504
1, 6  acc:  3068 /  3111 =  98.618
1, 7  acc:  4621 /  4682 =  98.697
--------------------------------------
Average acc: 146725 / 148304 =  98.935
Robust  acc:   988 /  1003 =  98.504
--------------------------------------
New max robust acc: 98.50448654037886
debias model - Saving best checkpoint at epoch 3
replace: True
-> Updating checkpoint debias-wga-best_seed34.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed34.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 64.167 | Best Acc: 92.860
-------------------------------------
Training, Epoch 3:
Accuracies by groups:
0, 0  acc: 10923 / 12092 =  90.332
0, 1  acc: 12962 / 14179 =  91.417
0, 2  acc:  2449 /  3210 =  76.293
0, 3  acc: 11237 / 12101 =  92.860
0, 4  acc:  4474 /  5355 =  83.548
0, 5  acc:  2645 /  2980 =  88.758
0, 6  acc:  2444 /  3335 =  73.283
0, 7  acc:  4510 /  5723 =  78.805
1, 0  acc:  1487 /  2203 =  67.499
1, 1  acc:  1502 /  2270 =  66.167
1, 2  acc:   827 /  1216 =  68.010
1, 3  acc:   816 /  1260 =  64.762
1, 4  acc:  1044 /  1627 =  64.167
1, 5  acc:   337 /   520 =  64.808
1, 6  acc:  1134 /  1537 =  73.780
1, 7  acc:  1519 /  2246 =  67.631
------------------------------------
Average acc: 60310 / 71854 =  83.934
Robust  acc:  1044 /  1627 =  64.167
------------------------------------
Accuracies by groups:
0, 0  acc: 10923 / 12092 =  90.332
0, 1  acc: 12962 / 14179 =  91.417
0, 2  acc:  2449 /  3210 =  76.293
0, 3  acc: 11237 / 12101 =  92.860
0, 4  acc:  4474 /  5355 =  83.548
0, 5  acc:  2645 /  2980 =  88.758
0, 6  acc:  2444 /  3335 =  73.283
0, 7  acc:  4510 /  5723 =  78.805
1, 0  acc:  1487 /  2203 =  67.499
1, 1  acc:  1502 /  2270 =  66.167
1, 2  acc:   827 /  1216 =  68.010
1, 3  acc:   816 /  1260 =  64.762
1, 4  acc:  1044 /  1627 =  64.167
1, 5  acc:   337 /   520 =  64.808
1, 6  acc:  1134 /  1537 =  73.780
1, 7  acc:  1519 /  2246 =  67.631
------------------------------------
Average acc: 60310 / 71854 =  83.934
Robust  acc:  1044 /  1627 =  64.167
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10923 / 12092 =  90.332
0, 1  acc: 12962 / 14179 =  91.417
0, 2  acc:  2449 /  3210 =  76.293
0, 3  acc: 11237 / 12101 =  92.860
0, 4  acc:  4474 /  5355 =  83.548
0, 5  acc:  2645 /  2980 =  88.758
0, 6  acc:  2444 /  3335 =  73.283
0, 7  acc:  4510 /  5723 =  78.805
1, 0  acc:  1487 /  2203 =  67.499
1, 1  acc:  1502 /  2270 =  66.167
1, 2  acc:   827 /  1216 =  68.010
1, 3  acc:   816 /  1260 =  64.762
1, 4  acc:  1044 /  1627 =  64.167
1, 5  acc:   337 /   520 =  64.808
1, 6  acc:  1134 /  1537 =  73.780
1, 7  acc:  1519 /  2246 =  67.631
------------------------------------
Average acc: 60310 / 71854 =  83.934
Robust  acc:  1044 /  1627 =  64.167
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   5 | Train Loss: 0.004 | Train Acc: 98.547 | Val Loss: 0.000 | Val Acc: 99.185
Training:
Accuracies by groups:
0, 0  acc: 59414 / 60403 =  98.363
0, 1  acc:  6341 /  6441 =  98.447
0, 2  acc:  9961 / 10149 =  98.148
0, 3  acc:  4815 /  4929 =  97.687
0, 4  acc:  1921 /  2014 =  95.382
0, 5  acc:   228 /   239 =  95.397
0, 6  acc:   289 /   302 =  95.695
0, 7  acc:   289 /   299 =  96.656
0, 8  acc:  5619 /  5745 =  97.807
0, 9  acc:   409 /   420 =  97.381
0, 10  acc:   381 /   389 =  97.943
0, 11  acc:   268 /   272 =  98.529
0, 12  acc:   365 /   383 =  95.300
0, 13  acc:    36 /    38 =  94.737
0, 14  acc:    47 /    47 = 100.000
0, 15  acc:    28 /    29 =  96.552
0, 16  acc:  4642 /  4791 =  96.890
0, 17  acc:   172 /   176 =  97.727
0, 18  acc:   461 /   474 =  97.257
0, 19  acc:   131 /   136 =  96.324
0, 20  acc:   113 /   120 =  94.167
0, 21  acc:    14 /    14 = 100.000
0, 22  acc:    51 /    53 =  96.226
0, 23  acc:     8 /    10 =  80.000
0, 24  acc:   594 /   615 =  96.585
0, 25  acc:    26 /    27 =  96.296
0, 26  acc:    57 /    57 = 100.000
0, 27  acc:    19 /    19 = 100.000
0, 28  acc:    34 /    35 =  97.143
0, 29  acc:     1 /     1 = 100.000
0, 30  acc:     8 /     8 = 100.000
0, 31  acc:     5 /     6 =  83.333
0, 32  acc:  1442 /  1473 =  97.895
0, 33  acc:    77 /    79 =  97.468
0, 34  acc:    69 /    69 = 100.000
0, 35  acc:    16 /    17 =  94.118
0, 36  acc:    43 /    43 = 100.000
0, 37  acc:     4 /     4 = 100.000
0, 38  acc:    22 /    24 =  91.667
0, 39  acc:     1 /     1 = 100.000
0, 40  acc:   359 /   364 =  98.626
0, 41  acc:    12 /    12 = 100.000
0, 42  acc:    10 /    10 = 100.000
0, 43  acc:     7 /     7 = 100.000
0, 44  acc:    19 /    19 = 100.000
0, 45  acc:     2 /     2 = 100.000
0, 46  acc:     5 /     5 = 100.000
0, 47  acc:     2 /     2 = 100.000
0, 48  acc:   283 /   293 =  96.587
0, 49  acc:     4 /     4 = 100.000
0, 50  acc:    12 /    12 = 100.000
0, 51  acc:    14 /    14 = 100.000
0, 52  acc:     4 /     5 =  80.000
0, 53  acc:     3 /     3 = 100.000
0, 54  acc:     6 /     7 =  85.714
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   221 /   235 =  94.043
0, 57  acc:    11 /    11 = 100.000
0, 58  acc:    16 /    17 =  94.118
0, 59  acc:     7 /     7 = 100.000
0, 60  acc:    14 /    15 =  93.333
0, 61  acc:     1 /     1 = 100.000
0, 62  acc:     8 /     8 = 100.000
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  2140 /  2228 =  96.050
0, 65  acc:   318 /   331 =  96.073
0, 66  acc:   238 /   245 =  97.143
0, 67  acc:    85 /    88 =  96.591
0, 68  acc:    39 /    41 =  95.122
0, 69  acc:     6 /     6 = 100.000
0, 70  acc:    18 /    21 =  85.714
0, 71  acc:    12 /    12 = 100.000
0, 72  acc:    66 /    67 =  98.507
0, 73  acc:     6 /     6 = 100.000
0, 74  acc:    10 /    10 = 100.000
0, 75  acc:     4 /     4 = 100.000
0, 76  acc:     7 /     7 = 100.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     1 /     1 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    76 /    83 =  91.566
0, 81  acc:     7 /     9 =  77.778
0, 82  acc:     7 /     8 =  87.500
0, 83  acc:    11 /    11 = 100.000
0, 84  acc:     4 /     4 = 100.000
0, 85  acc:     0 /     0 =     nan
0, 86  acc:    16 /    16 = 100.000
0, 87  acc:     4 /     4 = 100.000
0, 88  acc:     8 /     9 =  88.889
0, 89  acc:     0 /     0 =     nan
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    57 /    59 =  96.610
0, 95  acc:    11 /    11 = 100.000
0, 96  acc:     3 /     3 = 100.000
0, 97  acc:     2 /     2 = 100.000
0, 98  acc:    15 /    16 =  93.750
0, 99  acc:     0 /     0 =     nan
0, 100  acc:     1 /     1 = 100.000
0, 101  acc:    10 /    10 = 100.000
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    25 /    26 =  96.154
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     1 /     1 = 100.000
0, 110  acc:     5 /     5 = 100.000
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     9 /     9 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  6382 /  6549 =  97.450
0, 118  acc:  1460 /  1503 =  97.139
0, 119  acc:   370 /   377 =  98.143
0, 120  acc:   321 /   333 =  96.396
0, 121  acc:    53 /    62 =  85.484
0, 122  acc:    32 /    33 =  96.970
0, 123  acc:     8 /     8 = 100.000
0, 124  acc:    24 /    24 = 100.000
0, 125  acc:   378 /   386 =  97.927
0, 126  acc:   111 /   113 =  98.230
0, 127  acc:    26 /    28 =  92.857
0, 128  acc:    51 /    51 = 100.000
0, 129  acc:     3 /     3 = 100.000
0, 130  acc:     3 /     3 = 100.000
0, 131  acc:     5 /     5 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   237 /   244 =  97.131
0, 134  acc:    64 /    65 =  98.462
0, 135  acc:    23 /    23 = 100.000
0, 136  acc:    29 /    30 =  96.667
0, 137  acc:    12 /    13 =  92.308
0, 138  acc:     8 /     8 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    63 /    66 =  95.455
0, 142  acc:    14 /    15 =  93.333
0, 143  acc:     5 /     5 = 100.000
0, 144  acc:    18 /    18 = 100.000
0, 145  acc:     1 /     1 = 100.000
0, 146  acc:     2 /     2 = 100.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:   111 /   114 =  97.368
0, 149  acc:    17 /    17 = 100.000
0, 150  acc:     1 /     2 =  50.000
0, 151  acc:     9 /    14 =  64.286
0, 152  acc:     1 /     1 = 100.000
0, 153  acc:     0 /     0 =     nan
0, 154  acc:    38 /    38 = 100.000
0, 155  acc:     6 /     6 = 100.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     6 /     6 = 100.000
0, 159  acc:    15 /    16 =  93.750
0, 160  acc:     2 /     2 = 100.000
0, 161  acc:     4 /     4 = 100.000
0, 162  acc:     1 /     2 =  50.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    16 /    17 =  94.118
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:    11 /    11 = 100.000
0, 167  acc:     0 /     0 =     nan
0, 168  acc:     0 /     0 =     nan
0, 169  acc:  1558 /  1624 =  95.936
0, 170  acc:   343 /   352 =  97.443
0, 171  acc:    97 /   101 =  96.040
0, 172  acc:   158 /   161 =  98.137
0, 173  acc:    24 /    27 =  88.889
0, 174  acc:     3 /     4 =  75.000
0, 175  acc:     5 /     6 =  83.333
0, 176  acc:    13 /    17 =  76.471
0, 177  acc:    69 /    71 =  97.183
0, 178  acc:    14 /    14 = 100.000
0, 179  acc:     8 /     9 =  88.889
0, 180  acc:     6 /     6 = 100.000
0, 181  acc:     0 /     1 =   0.000
0, 182  acc:     1 /     1 = 100.000
0, 183  acc:     2 /     2 = 100.000
0, 184  acc:    61 /    62 =  98.387
0, 185  acc:     4 /     4 = 100.000
0, 186  acc:     5 /     6 =  83.333
0, 187  acc:     4 /     4 = 100.000
0, 188  acc:     1 /     1 = 100.000
0, 189  acc:     8 /     8 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    40 /    41 =  97.561
0, 192  acc:     1 /     1 = 100.000
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     3 /     4 =  75.000
0, 196  acc:    41 /    43 =  95.349
0, 197  acc:    13 /    13 = 100.000
0, 198  acc:     4 /     4 = 100.000
0, 199  acc:    12 /    12 = 100.000
0, 200  acc:     5 /     5 = 100.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     2 /     2 = 100.000
0, 204  acc:    23 /    25 =  92.000
0, 205  acc:     6 /     6 = 100.000
0, 206  acc:     2 /     2 = 100.000
0, 207  acc:     7 /     7 = 100.000
0, 208  acc:     5 /     5 = 100.000
0, 209  acc:     3 /     6 =  50.000
0, 210  acc:     3 /     3 = 100.000
0, 211  acc:     3 /     3 = 100.000
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     2 /     2 = 100.000
0, 214  acc:     2 /     3 =  66.667
0, 215  acc:     0 /     0 =     nan
0, 216  acc:    10 /    10 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     2 /     3 =  66.667
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     1 /     1 = 100.000
0, 221  acc:     4 /     4 = 100.000
1, 0  acc: 65192 / 65696 =  99.233
1, 1  acc:  6645 /  6707 =  99.076
1, 2  acc: 11601 / 11726 =  98.934
1, 3  acc:  4824 /  4877 =  98.913
1, 4  acc:  5723 /  5775 =  99.100
1, 5  acc:  1051 /  1056 =  99.527
1, 6  acc:   574 /   581 =  98.795
1, 7  acc:   705 /   710 =  99.296
1, 8  acc:  5837 /  5897 =  98.983
1, 9  acc:   436 /   438 =  99.543
1, 10  acc:   475 /   482 =  98.548
1, 11  acc:   267 /   270 =  98.889
1, 12  acc:   881 /   886 =  99.436
1, 13  acc:   127 /   129 =  98.450
1, 14  acc:   152 /   153 =  99.346
1, 15  acc:   159 /   162 =  98.148
1, 16  acc:  8975 /  9070 =  98.953
1, 17  acc:   292 /   295 =  98.983
1, 18  acc:   687 /   693 =  99.134
1, 19  acc:   233 /   237 =  98.312
1, 20  acc:   352 /   354 =  99.435
1, 21  acc:    44 /    44 = 100.000
1, 22  acc:   160 /   160 = 100.000
1, 23  acc:    42 /    42 = 100.000
1, 24  acc:  1137 /  1154 =  98.527
1, 25  acc:    18 /    18 = 100.000
1, 26  acc:    94 /    95 =  98.947
1, 27  acc:    16 /    16 = 100.000
1, 28  acc:   145 /   150 =  96.667
1, 29  acc:     9 /     9 = 100.000
1, 30  acc:    29 /    29 = 100.000
1, 31  acc:     8 /     8 = 100.000
1, 32  acc:  1753 /  1774 =  98.816
1, 33  acc:    88 /    89 =  98.876
1, 34  acc:    70 /    72 =  97.222
1, 35  acc:    30 /    31 =  96.774
1, 36  acc:    38 /    39 =  97.436
1, 37  acc:    10 /    10 = 100.000
1, 38  acc:    43 /    43 = 100.000
1, 39  acc:     4 /     4 = 100.000
1, 40  acc:   443 /   446 =  99.327
1, 41  acc:    21 /    21 = 100.000
1, 42  acc:    21 /    21 = 100.000
1, 43  acc:    27 /    28 =  96.429
1, 44  acc:    33 /    34 =  97.059
1, 45  acc:     8 /     8 = 100.000
1, 46  acc:     7 /     7 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   604 /   608 =  99.342
1, 49  acc:    19 /    20 =  95.000
1, 50  acc:    34 /    36 =  94.444
1, 51  acc:    22 /    22 = 100.000
1, 52  acc:    10 /    10 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    36 /    36 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   472 /   476 =  99.160
1, 57  acc:    20 /    20 = 100.000
1, 58  acc:    27 /    27 = 100.000
1, 59  acc:    21 /    21 = 100.000
1, 60  acc:    31 /    32 =  96.875
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    27 /    28 =  96.429
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5993 /  6049 =  99.074
1, 65  acc:   860 /   865 =  99.422
1, 66  acc:   509 /   515 =  98.835
1, 67  acc:   204 /   205 =  99.512
1, 68  acc:   261 /   263 =  99.240
1, 69  acc:    49 /    50 =  98.000
1, 70  acc:   100 /   102 =  98.039
1, 71  acc:    19 /    19 = 100.000
1, 72  acc:   121 /   123 =  98.374
1, 73  acc:     6 /     6 = 100.000
1, 74  acc:     4 /     4 = 100.000
1, 75  acc:     2 /     2 = 100.000
1, 76  acc:    33 /    33 = 100.000
1, 77  acc:     1 /     1 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     3 /     3 = 100.000
1, 80  acc:   195 /   195 = 100.000
1, 81  acc:    24 /    27 =  88.889
1, 82  acc:    48 /    49 =  97.959
1, 83  acc:     5 /     5 = 100.000
1, 84  acc:    11 /    11 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    34 /    34 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    22 /    23 =  95.652
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     2 /     2 = 100.000
1, 93  acc:     4 /     4 = 100.000
1, 94  acc:   132 /   133 =  99.248
1, 95  acc:    10 /    10 = 100.000
1, 96  acc:    21 /    21 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    13 /    14 =  92.857
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    25 /    25 = 100.000
1, 101  acc:     4 /     5 =  80.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     6 /     6 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    43 /    43 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    20 /    20 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:    10 /    11 =  90.909
1, 111  acc:     2 /     2 = 100.000
1, 112  acc:    16 /    16 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8905 /  9031 =  98.605
1, 118  acc:  2184 /  2212 =  98.734
1, 119  acc:   528 /   534 =  98.876
1, 120  acc:   557 /   568 =  98.063
1, 121  acc:   133 /   135 =  98.519
1, 122  acc:    72 /    74 =  97.297
1, 123  acc:    39 /    39 = 100.000
1, 124  acc:    38 /    38 = 100.000
1, 125  acc:   560 /   565 =  99.115
1, 126  acc:   140 /   141 =  99.291
1, 127  acc:    34 /    36 =  94.444
1, 128  acc:    48 /    49 =  97.959
1, 129  acc:    18 /    18 = 100.000
1, 130  acc:    11 /    12 =  91.667
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    14 /    14 = 100.000
1, 133  acc:   448 /   452 =  99.115
1, 134  acc:    98 /   100 =  98.000
1, 135  acc:    33 /    33 = 100.000
1, 136  acc:    24 /    26 =  92.308
1, 137  acc:     6 /     6 = 100.000
1, 138  acc:     3 /     3 = 100.000
1, 139  acc:     5 /     5 = 100.000
1, 140  acc:     2 /     2 = 100.000
1, 141  acc:   111 /   111 = 100.000
1, 142  acc:    28 /    28 = 100.000
1, 143  acc:     5 /     5 = 100.000
1, 144  acc:     3 /     3 = 100.000
1, 145  acc:     1 /     1 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     5 /     5 = 100.000
1, 148  acc:   229 /   230 =  99.565
1, 149  acc:    23 /    24 =  95.833
1, 150  acc:    11 /    11 = 100.000
1, 151  acc:    15 /    18 =  83.333
1, 152  acc:     4 /     5 =  80.000
1, 153  acc:     6 /     6 = 100.000
1, 154  acc:    50 /    51 =  98.039
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     7 /     7 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    45 /    45 = 100.000
1, 160  acc:     4 /     4 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     6 /     6 = 100.000
1, 164  acc:    30 /    30 = 100.000
1, 165  acc:     8 /     8 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3810 /  3858 =  98.756
1, 170  acc:   722 /   729 =  99.040
1, 171  acc:   306 /   307 =  99.674
1, 172  acc:   237 /   240 =  98.750
1, 173  acc:    62 /    64 =  96.875
1, 174  acc:    20 /    20 = 100.000
1, 175  acc:     6 /     6 = 100.000
1, 176  acc:    39 /    41 =  95.122
1, 177  acc:    88 /    90 =  97.778
1, 178  acc:    11 /    11 = 100.000
1, 179  acc:     4 /     4 = 100.000
1, 180  acc:    12 /    12 = 100.000
1, 181  acc:     7 /     7 = 100.000
1, 182  acc:     7 /     7 = 100.000
1, 183  acc:    13 /    13 = 100.000
1, 184  acc:   140 /   141 =  99.291
1, 185  acc:    42 /    42 = 100.000
1, 186  acc:    18 /    18 = 100.000
1, 187  acc:     7 /     7 = 100.000
1, 188  acc:     1 /     1 = 100.000
1, 189  acc:     3 /     3 = 100.000
1, 190  acc:     6 /     6 = 100.000
1, 191  acc:     7 /     7 = 100.000
1, 192  acc:    10 /    10 = 100.000
1, 193  acc:    11 /    11 = 100.000
1, 194  acc:     1 /     1 = 100.000
1, 195  acc:     1 /     1 = 100.000
1, 196  acc:   130 /   134 =  97.015
1, 197  acc:    12 /    12 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     1 /     1 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    23 /    23 = 100.000
1, 205  acc:     3 /     4 =  75.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    24 /    24 = 100.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     2 /     2 = 100.000
1, 212  acc:     0 /     0 =     nan
1, 213  acc:    14 /    14 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     3 /     3 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     8 /     8 = 100.000
1, 218  acc:     7 /     7 = 100.000
1, 219  acc:    12 /    12 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 265130 / 269038 =  98.547
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 25152 / 25373 =  99.129
0, 1  acc: 31024 / 31282 =  99.175
0, 2  acc:  6116 /  6155 =  99.366
0, 3  acc: 24091 / 24292 =  99.173
0, 4  acc: 10737 / 10829 =  99.150
0, 5  acc:  5500 /  5541 =  99.260
0, 6  acc:  6723 /  6785 =  99.086
0, 7  acc: 11926 / 12016 =  99.251
1, 0  acc:  4399 /  4437 =  99.144
1, 1  acc:  4922 /  4962 =  99.194
1, 2  acc:  2244 /  2265 =  99.073
1, 3  acc:  2424 /  2446 =  99.101
1, 4  acc:  3106 /  3125 =  99.392
1, 5  acc:   998 /  1003 =  99.501
1, 6  acc:  3086 /  3111 =  99.196
1, 7  acc:  4649 /  4682 =  99.295
--------------------------------------
Average acc: 147097 / 148304 =  99.186
Robust  acc:  2244 /  2265 =  99.073
--------------------------------------
New max robust acc: 99.0728476821192
debias model - Saving best checkpoint at epoch 4
replace: True
-> Updating checkpoint debias-wga-best_seed34.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed34.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 61.984 | Best Acc: 92.959
-------------------------------------
Training, Epoch 4:
Accuracies by groups:
0, 0  acc: 10883 / 12092 =  90.002
0, 1  acc: 12884 / 14179 =  90.867
0, 2  acc:  2487 /  3210 =  77.477
0, 3  acc: 11249 / 12101 =  92.959
0, 4  acc:  4415 /  5355 =  82.446
0, 5  acc:  2640 /  2980 =  88.591
0, 6  acc:  2525 /  3335 =  75.712
0, 7  acc:  4593 /  5723 =  80.255
1, 0  acc:  1473 /  2203 =  66.863
1, 1  acc:  1494 /  2270 =  65.815
1, 2  acc:   799 /  1216 =  65.707
1, 3  acc:   781 /  1260 =  61.984
1, 4  acc:  1054 /  1627 =  64.782
1, 5  acc:   326 /   520 =  62.692
1, 6  acc:  1094 /  1537 =  71.178
1, 7  acc:  1494 /  2246 =  66.518
------------------------------------
Average acc: 60191 / 71854 =  83.768
Robust  acc:   781 /  1260 =  61.984
------------------------------------
Accuracies by groups:
0, 0  acc: 10883 / 12092 =  90.002
0, 1  acc: 12884 / 14179 =  90.867
0, 2  acc:  2487 /  3210 =  77.477
0, 3  acc: 11249 / 12101 =  92.959
0, 4  acc:  4415 /  5355 =  82.446
0, 5  acc:  2640 /  2980 =  88.591
0, 6  acc:  2525 /  3335 =  75.712
0, 7  acc:  4593 /  5723 =  80.255
1, 0  acc:  1473 /  2203 =  66.863
1, 1  acc:  1494 /  2270 =  65.815
1, 2  acc:   799 /  1216 =  65.707
1, 3  acc:   781 /  1260 =  61.984
1, 4  acc:  1054 /  1627 =  64.782
1, 5  acc:   326 /   520 =  62.692
1, 6  acc:  1094 /  1537 =  71.178
1, 7  acc:  1494 /  2246 =  66.518
------------------------------------
Average acc: 60191 / 71854 =  83.768
Robust  acc:   781 /  1260 =  61.984
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10883 / 12092 =  90.002
0, 1  acc: 12884 / 14179 =  90.867
0, 2  acc:  2487 /  3210 =  77.477
0, 3  acc: 11249 / 12101 =  92.959
0, 4  acc:  4415 /  5355 =  82.446
0, 5  acc:  2640 /  2980 =  88.591
0, 6  acc:  2525 /  3335 =  75.712
0, 7  acc:  4593 /  5723 =  80.255
1, 0  acc:  1473 /  2203 =  66.863
1, 1  acc:  1494 /  2270 =  65.815
1, 2  acc:   799 /  1216 =  65.707
1, 3  acc:   781 /  1260 =  61.984
1, 4  acc:  1054 /  1627 =  64.782
1, 5  acc:   326 /   520 =  62.692
1, 6  acc:  1094 /  1537 =  71.178
1, 7  acc:  1494 /  2246 =  66.518
------------------------------------
Average acc: 60191 / 71854 =  83.768
Robust  acc:   781 /  1260 =  61.984
------------------------------------
replace: True
Checkpoint saved at ./model/civilcomments/config/debias-end_seed34.pt
