binxu commited on
Commit
3417dbe
·
verified ·
1 Parent(s): 08e1f7a

Upload checkpoints/batchtopk_nsd_block9/loss_log.csv with huggingface_hub

Browse files
checkpoints/batchtopk_nsd_block9/loss_log.csv ADDED
@@ -0,0 +1,501 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ step,loss,effective_l0,dead_features
2
+ 200,64779.466716,32,0
3
+ 400,805.032978,32,0
4
+ 600,52.568904,32,0
5
+ 800,46.237452,32,0
6
+ 1000,40.843806,32,0
7
+ 1200,36.822339,32,0
8
+ 1400,34.118932,32,0
9
+ 1600,32.165338,32,0
10
+ 1800,31.008401,32,0
11
+ 2000,29.423791,32,0
12
+ 2200,28.484781,32,0
13
+ 2400,27.681454,32,0
14
+ 2600,26.608662,32,0
15
+ 2800,26.309604,32,0
16
+ 3000,25.810917,32,0
17
+ 3200,25.430363,32,0
18
+ 3400,24.736802,32,0
19
+ 3600,24.462876,32,0
20
+ 3800,24.118015,32,0
21
+ 4000,23.907232,32,0
22
+ 4200,23.627016,32,0
23
+ 4400,23.087678,32,0
24
+ 4600,22.981575,32,0
25
+ 4800,22.863694,32,0
26
+ 5000,22.499358,32,0
27
+ 5200,22.293282,32,0
28
+ 5400,22.106843,32,0
29
+ 5600,21.898689,32,0
30
+ 5800,21.598953,32,0
31
+ 6000,21.676693,32,0
32
+ 6200,21.686606,32,0
33
+ 6400,21.341793,32,0
34
+ 6600,21.408783,32,0
35
+ 6800,21.209614,32,0
36
+ 7000,20.918011,32,0
37
+ 7200,20.903878,32,0
38
+ 7400,20.713018,32,0
39
+ 7600,20.616893,32,0
40
+ 7800,20.717023,32,0
41
+ 8000,20.656321,32,0
42
+ 8200,20.359839,32,0
43
+ 8400,20.345394,32,0
44
+ 8600,20.050380,32,0
45
+ 8800,20.215942,32,0
46
+ 9000,20.160156,32,0
47
+ 9200,20.161202,32,0
48
+ 9400,19.861636,32,0
49
+ 9600,19.991981,32,0
50
+ 9800,19.633803,32,0
51
+ 10000,19.579365,32,0
52
+ 10200,19.702831,32,0
53
+ 10400,19.607301,32,0
54
+ 10600,19.450142,32,0
55
+ 10800,19.446423,32,0
56
+ 11000,19.485812,32,0
57
+ 11200,19.286456,32,0
58
+ 11400,19.194783,32,0
59
+ 11600,19.292863,32,0
60
+ 11800,19.340405,32,0
61
+ 12000,19.130092,32,0
62
+ 12200,19.033732,32,0
63
+ 12400,18.874404,32,0
64
+ 12600,19.157302,32,0
65
+ 12800,19.085717,32,0
66
+ 13000,18.923563,32,0
67
+ 13200,19.061602,32,0
68
+ 13400,18.822767,32,0
69
+ 13600,18.744379,32,0
70
+ 13800,18.968743,32,0
71
+ 14000,18.779247,32,0
72
+ 14200,18.867927,32,0
73
+ 14400,18.782988,32,0
74
+ 14600,18.713171,32,0
75
+ 14800,18.623697,32,0
76
+ 15000,18.559731,32,0
77
+ 15200,18.555848,32,0
78
+ 15400,18.773066,32,0
79
+ 15600,18.393590,32,0
80
+ 15800,18.490226,32,0
81
+ 16000,18.487357,32,0
82
+ 16200,18.422373,32,0
83
+ 16400,18.329287,32,0
84
+ 16600,18.371918,32,0
85
+ 16800,18.329987,32,0
86
+ 17000,18.314671,32,0
87
+ 17200,18.204328,32,0
88
+ 17400,18.277692,32,0
89
+ 17600,18.215417,32,0
90
+ 17800,18.340062,32,0
91
+ 18000,18.148609,32,0
92
+ 18200,18.134543,32,0
93
+ 18400,18.218080,32,0
94
+ 18600,18.041339,32,0
95
+ 18800,18.135066,32,0
96
+ 19000,18.017526,32,0
97
+ 19200,18.024223,32,0
98
+ 19400,17.925945,32,0
99
+ 19600,18.206615,32,0
100
+ 19800,18.114392,32,0
101
+ 20000,17.782632,32,0
102
+ 20200,17.829214,32,0
103
+ 20400,17.803804,32,0
104
+ 20600,17.924114,32,0
105
+ 20800,17.757406,32,0
106
+ 21000,17.883325,32,0
107
+ 21200,17.786761,32,0
108
+ 21400,18.095558,32,0
109
+ 21600,17.998151,32,0
110
+ 21800,17.822869,32,0
111
+ 22000,17.816407,32,0
112
+ 22200,17.772719,32,0
113
+ 22400,17.925086,32,0
114
+ 22600,18.208885,32,0
115
+ 22800,17.703903,32,0
116
+ 23000,17.916768,32,0
117
+ 23200,17.677329,32,0
118
+ 23400,17.711641,32,0
119
+ 23600,17.700802,32,0
120
+ 23800,17.647930,32,0
121
+ 24000,17.638002,32,0
122
+ 24200,17.699037,32,0
123
+ 24400,17.799507,32,0
124
+ 24600,17.771897,32,0
125
+ 24800,17.677132,32,0
126
+ 25000,17.532274,32,0
127
+ 25200,17.469701,32,0
128
+ 25400,17.537251,32,0
129
+ 25600,17.503515,32,0
130
+ 25800,17.606722,32,0
131
+ 26000,17.573844,32,0
132
+ 26200,17.592407,32,0
133
+ 26400,17.670191,32,0
134
+ 26600,17.623524,32,0
135
+ 26800,17.385078,32,0
136
+ 27000,17.245130,32,0
137
+ 27200,17.593533,32,0
138
+ 27400,17.329796,32,0
139
+ 27600,17.439218,32,0
140
+ 27800,17.390078,32,0
141
+ 28000,17.435423,32,0
142
+ 28200,17.313417,32,0
143
+ 28400,17.300488,32,0
144
+ 28600,17.509548,32,0
145
+ 28800,17.436702,32,0
146
+ 29000,17.336681,32,0
147
+ 29200,17.251348,32,0
148
+ 29400,17.504415,32,0
149
+ 29600,17.388678,32,0
150
+ 29800,17.168152,32,0
151
+ 30000,17.058306,32,0
152
+ 30200,17.333170,32,0
153
+ 30400,17.409615,32,0
154
+ 30600,17.277343,32,0
155
+ 30800,17.233568,32,0
156
+ 31000,17.358208,32,0
157
+ 31200,17.286129,32,0
158
+ 31400,17.392404,32,0
159
+ 31600,17.208912,32,0
160
+ 31800,17.115180,32,0
161
+ 32000,17.103263,32,0
162
+ 32200,17.144011,32,0
163
+ 32400,17.228230,32,0
164
+ 32600,17.282630,32,0
165
+ 32800,17.186581,32,0
166
+ 33000,17.121458,32,0
167
+ 33200,17.177952,32,0
168
+ 33400,17.218852,32,0
169
+ 33600,17.227070,32,0
170
+ 33800,17.090003,32,0
171
+ 34000,17.080815,32,0
172
+ 34200,17.256556,32,0
173
+ 34400,16.995802,32,0
174
+ 34600,17.351122,32,0
175
+ 34800,17.151712,32,0
176
+ 35000,17.063844,32,0
177
+ 35200,17.028158,32,0
178
+ 35400,17.145728,32,0
179
+ 35600,16.895626,32,0
180
+ 35800,17.052235,32,0
181
+ 36000,17.186831,32,0
182
+ 36200,17.104756,32,0
183
+ 36400,17.140891,32,0
184
+ 36600,16.967179,32,0
185
+ 36800,17.104124,32,0
186
+ 37000,16.879870,32,0
187
+ 37200,16.895115,32,0
188
+ 37400,17.082599,32,0
189
+ 37600,17.113330,32,0
190
+ 37800,16.857238,32,0
191
+ 38000,17.022678,32,0
192
+ 38200,16.849000,32,0
193
+ 38400,16.862151,32,0
194
+ 38600,16.982600,32,0
195
+ 38800,16.940624,32,0
196
+ 39000,17.099733,32,0
197
+ 39200,17.020286,32,0
198
+ 39400,16.828697,32,0
199
+ 39600,16.770690,32,0
200
+ 39800,16.908971,32,0
201
+ 40000,16.871818,32,0
202
+ 40200,16.854772,32,0
203
+ 40400,16.938103,32,0
204
+ 40600,16.849449,32,0
205
+ 40800,16.845886,32,0
206
+ 41000,16.902555,32,0
207
+ 41200,16.973357,32,0
208
+ 41400,17.063590,32,0
209
+ 41600,16.791407,32,1
210
+ 41800,16.989294,32,0
211
+ 42000,16.850787,32,0
212
+ 42200,16.824641,32,0
213
+ 42400,16.922892,32,0
214
+ 42600,16.879352,32,0
215
+ 42800,16.812973,32,0
216
+ 43000,16.666078,32,0
217
+ 43200,16.934473,32,1
218
+ 43400,16.754675,32,0
219
+ 43600,16.896042,32,0
220
+ 43800,16.869700,32,0
221
+ 44000,16.645611,32,0
222
+ 44200,16.983929,32,0
223
+ 44400,16.735288,32,0
224
+ 44600,16.789575,32,0
225
+ 44800,16.994153,32,0
226
+ 45000,16.687142,32,0
227
+ 45200,16.952146,32,0
228
+ 45400,16.978905,32,0
229
+ 45600,16.841118,32,1
230
+ 45800,16.886251,32,0
231
+ 46000,16.803660,32,0
232
+ 46200,16.775007,32,0
233
+ 46400,16.987827,32,0
234
+ 46600,16.883459,32,0
235
+ 46800,16.838747,32,0
236
+ 47000,16.884218,32,0
237
+ 47200,16.898554,32,0
238
+ 47400,16.851933,32,0
239
+ 47600,16.684315,32,2
240
+ 47800,16.889852,32,0
241
+ 48000,16.816026,32,0
242
+ 48200,16.796485,32,0
243
+ 48400,16.892834,32,1
244
+ 48600,16.629023,32,0
245
+ 48800,16.745564,32,1
246
+ 49000,16.770331,32,0
247
+ 49200,16.845542,32,0
248
+ 49400,16.815470,32,0
249
+ 49600,16.796901,32,0
250
+ 49800,16.902523,32,0
251
+ 50000,16.926199,32,1
252
+ 50200,16.510444,32,0
253
+ 50400,16.857670,32,1
254
+ 50600,16.579549,32,0
255
+ 50800,16.713803,32,0
256
+ 51000,16.822954,32,0
257
+ 51200,16.888689,32,0
258
+ 51400,16.815231,32,0
259
+ 51600,16.845261,32,0
260
+ 51800,16.779555,32,0
261
+ 52000,16.583678,32,1
262
+ 52200,16.628975,32,0
263
+ 52400,16.684924,32,0
264
+ 52600,16.806596,32,0
265
+ 52800,16.823329,32,1
266
+ 53000,16.740844,32,1
267
+ 53200,16.456301,32,0
268
+ 53400,16.892931,32,0
269
+ 53600,16.699750,32,2
270
+ 53800,16.818955,32,3
271
+ 54000,16.624134,32,0
272
+ 54200,16.682519,32,1
273
+ 54400,16.782700,32,0
274
+ 54600,16.519369,32,2
275
+ 54800,16.645884,32,2
276
+ 55000,16.772104,32,0
277
+ 55200,16.491036,32,0
278
+ 55400,16.497195,32,0
279
+ 55600,16.596119,32,0
280
+ 55800,16.776142,32,2
281
+ 56000,16.741057,32,1
282
+ 56200,16.668897,32,0
283
+ 56400,16.684261,32,1
284
+ 56600,16.651270,32,0
285
+ 56800,16.740182,32,0
286
+ 57000,16.645594,32,0
287
+ 57200,16.511678,32,1
288
+ 57400,16.836663,32,0
289
+ 57600,16.523407,32,0
290
+ 57800,16.740287,32,0
291
+ 58000,16.733968,32,0
292
+ 58200,16.798406,32,0
293
+ 58400,16.606703,32,0
294
+ 58600,16.598432,32,2
295
+ 58800,16.600942,32,1
296
+ 59000,16.595670,32,0
297
+ 59200,16.550061,32,1
298
+ 59400,16.571208,32,0
299
+ 59600,16.828193,32,0
300
+ 59800,16.550274,32,0
301
+ 60000,16.620946,32,0
302
+ 60200,16.546156,32,1
303
+ 60400,16.748365,32,2
304
+ 60600,16.297190,32,0
305
+ 60800,16.574833,32,1
306
+ 61000,16.612375,32,1
307
+ 61200,16.645052,32,2
308
+ 61400,16.616018,32,4
309
+ 61600,16.632479,32,0
310
+ 61800,16.586168,32,0
311
+ 62000,16.524087,32,1
312
+ 62200,16.613081,32,0
313
+ 62400,16.654696,32,1
314
+ 62600,16.477135,32,1
315
+ 62800,16.599995,32,0
316
+ 63000,16.655337,32,0
317
+ 63200,16.386333,32,1
318
+ 63400,16.605741,32,0
319
+ 63600,16.541481,32,1
320
+ 63800,16.760633,32,2
321
+ 64000,16.629184,32,2
322
+ 64200,16.533511,32,1
323
+ 64400,16.631918,32,1
324
+ 64600,16.450926,32,1
325
+ 64800,16.619954,32,2
326
+ 65000,16.577368,32,2
327
+ 65200,16.646403,32,3
328
+ 65400,16.558697,32,2
329
+ 65600,16.566594,32,2
330
+ 65800,16.554797,32,0
331
+ 66000,16.440757,32,1
332
+ 66200,16.631791,32,2
333
+ 66400,16.458375,32,1
334
+ 66600,16.390210,32,1
335
+ 66800,16.432676,32,3
336
+ 67000,16.683720,32,0
337
+ 67200,16.589152,32,1
338
+ 67400,16.719327,32,1
339
+ 67600,16.543503,32,1
340
+ 67800,16.669832,32,2
341
+ 68000,16.486624,32,0
342
+ 68200,16.598102,32,3
343
+ 68400,16.652939,32,0
344
+ 68600,16.525382,32,5
345
+ 68800,16.482516,32,4
346
+ 69000,16.580001,32,2
347
+ 69200,16.383131,32,2
348
+ 69400,16.659577,32,0
349
+ 69600,16.591720,32,3
350
+ 69800,16.350742,32,0
351
+ 70000,16.774690,32,0
352
+ 70200,16.577917,32,2
353
+ 70400,16.552270,32,3
354
+ 70600,16.478917,32,3
355
+ 70800,16.470020,32,6
356
+ 71000,16.718369,32,2
357
+ 71200,16.432409,32,4
358
+ 71400,16.554929,32,1
359
+ 71600,16.560154,32,4
360
+ 71800,16.655814,32,1
361
+ 72000,16.470418,32,5
362
+ 72200,16.594256,32,1
363
+ 72400,16.558127,32,3
364
+ 72600,16.231432,32,1
365
+ 72800,16.500999,32,3
366
+ 73000,16.465873,32,1
367
+ 73200,16.542907,32,2
368
+ 73400,16.451622,32,2
369
+ 73600,16.457982,32,3
370
+ 73800,16.504707,32,5
371
+ 74000,16.472764,32,1
372
+ 74200,16.534443,32,1
373
+ 74400,16.518566,32,0
374
+ 74600,16.549816,32,2
375
+ 74800,16.508816,32,2
376
+ 75000,16.263581,32,3
377
+ 75200,16.340197,32,1
378
+ 75400,16.478234,32,4
379
+ 75600,16.596129,32,3
380
+ 75800,16.316830,32,2
381
+ 76000,16.493310,32,0
382
+ 76200,16.520069,32,3
383
+ 76400,16.425794,32,3
384
+ 76600,16.308367,32,3
385
+ 76800,16.526354,32,5
386
+ 77000,16.472334,32,2
387
+ 77200,16.497344,32,3
388
+ 77400,16.408276,32,4
389
+ 77600,16.519705,32,3
390
+ 77800,16.354359,32,7
391
+ 78000,16.508570,32,2
392
+ 78200,16.500393,32,6
393
+ 78400,16.385467,32,5
394
+ 78600,16.570228,32,7
395
+ 78800,16.464583,32,0
396
+ 79000,16.591852,32,5
397
+ 79200,16.509332,32,2
398
+ 79400,16.555620,32,7
399
+ 79600,16.398144,32,5
400
+ 79800,16.296905,32,5
401
+ 80000,16.567968,32,2
402
+ 80200,16.185272,32,6
403
+ 80400,16.406565,32,5
404
+ 80600,16.395021,32,3
405
+ 80800,16.402670,32,8
406
+ 81000,16.388784,32,8
407
+ 81200,16.478252,32,4
408
+ 81400,16.403557,32,3
409
+ 81600,16.514348,32,4
410
+ 81800,16.663636,32,5
411
+ 82000,16.345001,32,5
412
+ 82200,16.475285,32,5
413
+ 82400,16.476218,32,8
414
+ 82600,16.353977,32,3
415
+ 82800,16.433835,32,2
416
+ 83000,16.401945,32,8
417
+ 83200,16.434958,32,3
418
+ 83400,16.282537,32,3
419
+ 83600,16.488147,32,3
420
+ 83800,16.509889,32,5
421
+ 84000,16.368021,32,2
422
+ 84200,16.479271,32,2
423
+ 84400,16.302721,32,6
424
+ 84600,16.617461,32,4
425
+ 84800,16.425734,32,5
426
+ 85000,16.329690,32,2
427
+ 85200,16.205283,32,7
428
+ 85400,16.496279,32,2
429
+ 85600,16.394129,32,5
430
+ 85800,16.268068,32,8
431
+ 86000,16.419126,32,4
432
+ 86200,16.444674,32,4
433
+ 86400,16.398014,32,4
434
+ 86600,16.449028,32,8
435
+ 86800,16.555089,32,8
436
+ 87000,16.312113,32,9
437
+ 87200,16.453976,32,6
438
+ 87400,16.410516,32,3
439
+ 87600,16.569056,32,12
440
+ 87800,16.439785,32,4
441
+ 88000,16.360240,32,4
442
+ 88200,16.395259,32,6
443
+ 88400,16.496047,32,7
444
+ 88600,16.270123,32,6
445
+ 88800,16.370220,32,8
446
+ 89000,16.197291,32,4
447
+ 89200,16.546138,32,6
448
+ 89400,16.513850,32,8
449
+ 89600,16.429480,32,4
450
+ 89800,16.461114,32,7
451
+ 90000,16.344015,32,4
452
+ 90200,16.376569,32,8
453
+ 90400,16.321786,32,10
454
+ 90600,16.139683,32,2
455
+ 90800,16.367749,32,2
456
+ 91000,16.377275,32,6
457
+ 91200,16.397395,32,6
458
+ 91400,16.306178,32,8
459
+ 91600,16.501515,32,3
460
+ 91800,16.249620,32,9
461
+ 92000,16.404248,32,8
462
+ 92200,16.407028,32,6
463
+ 92400,16.249991,32,4
464
+ 92600,16.396212,32,5
465
+ 92800,16.460624,32,6
466
+ 93000,16.461678,32,5
467
+ 93200,16.387539,32,4
468
+ 93400,16.281488,32,9
469
+ 93600,16.371589,32,5
470
+ 93800,16.456105,32,5
471
+ 94000,16.306140,32,3
472
+ 94200,16.428185,32,3
473
+ 94400,16.199130,32,6
474
+ 94600,16.366459,32,6
475
+ 94800,16.396673,32,2
476
+ 95000,16.458004,32,2
477
+ 95200,16.486495,32,7
478
+ 95400,16.401557,32,8
479
+ 95600,16.369070,32,2
480
+ 95800,16.295951,32,4
481
+ 96000,16.289329,32,5
482
+ 96200,16.372672,32,7
483
+ 96400,16.370157,32,5
484
+ 96600,16.276431,32,4
485
+ 96800,16.287050,32,5
486
+ 97000,16.307720,32,1
487
+ 97200,16.294021,32,1
488
+ 97400,16.479319,32,8
489
+ 97600,16.418411,32,1
490
+ 97800,16.481227,32,3
491
+ 98000,16.477432,32,3
492
+ 98200,16.429255,32,5
493
+ 98400,16.280515,32,2
494
+ 98600,16.438228,32,3
495
+ 98800,16.297652,32,5
496
+ 99000,16.188836,32,3
497
+ 99200,16.310157,32,3
498
+ 99400,16.339237,32,4
499
+ 99600,16.510942,32,6
500
+ 99800,16.280800,32,5
501
+ 100000,16.293523,32,5