pico-llm/transformer-small-1M-embed384-heads6-blocks6-prenorm-posabs-epochs5
49.3M • Updated • 123
pico-llm/transformer-tiny-1M-embed128-heads2-blocks2-prenorm-posabs-epochs5
13.3M • Updated • 150
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-postnorm-posnone-epochs5
6.48M • Updated • 157
pico-llm/gpt2-base-postnorm-absolute
0.2B • Updated • 56
pico-llm/kgram-pico-K1-L1-scaled
3.27M • Updated • 106
pico-llm/kgram-pico-K3-L1-scaled
2.16M • Updated • 86
pico-llm/kgram-small-K5-L5-onehot
77.6M • Updated • 49
pico-llm/kgram-tiny-K5-L3-onehot
19.4M • Updated • 38
pico-llm/kgram-small-K5-L5-scaled
15.9M • Updated • 47
pico-llm/kgram-tiny-K5-L3-scaled
3.89M • Updated • 56
pico-llm/kgram_mlp_pico_5_onehot
9.7M • Updated • 66
pico-llm/kgram_mlp_pico_3_onehot
6.48M • Updated • 56
pico-llm/kgram_mlp_pico_1_onehot
3.27M • Updated • 69
pico-llm/kgram_mlp_pico_5_scaled
1.96M • Updated • 117
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-prenorm-posrotary-epochs5
6.48M • Updated • 61
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-prenorm-posnone-epochs5
6.48M • Updated • 61
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-postnorm-posrotary-epochs5
6.48M • Updated • 54
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-postnorm-posabsolute-epochs5
6.49M • Updated • 101
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-prenorm-posabsolute-epochs5
6.49M • Updated • 61
0.1B • Updated • 59
pico-llm/kgram-base-K3-L5-scaled
74.9M • Updated • 50
26.3M • Updated • 55
6.52M • Updated • 57
3.28M • Updated • 56
pico-llm/kgram-base-K3-L1-onehot
0.2B • Updated • 22
pico-llm/kgram-base-K3-L1-full
0.1B • Updated • 59
pico-llm/kgram-base-K3-L1-scaled
70.7M • Updated • 62