Sequence Modeling Baselines - a puigde Collection

puigde 's Collections

Sequence Modeling Baselines

Sequence Modeling Baselines

updated 21 days ago

Pretrained baselines for sequence modeling research.

puigde/gated-deltanet-360M-15B-slimpajama

Text Generation • 0.4B • Updated 21 days ago • 459
puigde/rwkv7-380M-15B-slimpajama

Text Generation • 0.4B • Updated 24 days ago • 761
puigde/modern-transformer-gqa-370M-15B-slimpajama

Text Generation • 0.4B • Updated 21 days ago • 188
puigde/modern-transformer-mha-370M-15B-slimpajama

Text Generation • 0.4B • Updated 21 days ago • 118