Commit History

v2 loader: VOCAB 8192 -> 12288 (#8)
8ac5f3f

Compactbot commited on

v2 config: vocab 12288, 56,902,144 params (#7)
3590321

Compactbot commited on

v2 card: 12288-vocab retrain, 56,902,144 params, val 1.3837, measured evals (#6)
95e8efe

Compactbot commited on

v2: 12288-vocab BPE tokenizer (was 8192) (#5)
3ebcad6

Compactbot commited on

v2: retrain with 12288-vocab BPE (was 8192), 56,902,144 params, best val 1.3837 (#4)
b639965

Compactbot commited on

Add weights (54,804,992 params, 99 tensors, float32)
1d462bb
verified

Compactbot commited on

Add BPE-8192 tokenizer
c55f7f9
verified

Compactbot commited on

Add self-contained loader + TinyStoriesGPT class
8cacb5e
verified

Compactbot commited on

Add architecture config (D512/L16/H8/FFN2048/SEQ512/VOCAB8192, weight-tied)
f94f9c1
verified

Compactbot commited on

Add model card: 54.8M from-scratch TinyStories GPT, verified params + held-out PPL 5.24
8af5ac4
verified

Compactbot commited on

initial commit
d2b6b09
verified

Compactbot commited on