arxiv:2504.18919
Rafael Mosquera
remg1997
AI & ML interests
NLP, Speech, Diffusion
Organizations
models 22
remg1997/modernbert-small-factorized-linear-dual-babylm2026
Fill-Mask • 24.3M • Updated • 16
remg1997/modernbert-small-phase7-zipfian-centering-babylm2026
Fill-Mask • 25.3M • Updated • 25
remg1997/modernbert-small-phase6-composition-frequency-shuffled-babylm2026
Fill-Mask • 25.3M • Updated • 28
remg1997/modernbert-small-phase6-composition-babylm2026
Fill-Mask • 21.4M • Updated • 19
remg1997/modernbert-small-modernbert-small-factorized-linear-babylm2026
Fill-Mask • 35.9M • Updated • 19
remg1997/modernbert-small-phase7-zipfian-whitening-babylm2026
25.3M • Updated • 6
remg1997/modernbert-small-phase6-composition-residual-babylm2026
25.3M • Updated • 6
remg1997/modernbert-small-phase6-composition-frequency-babylm2026
25.3M • Updated • 9
remg1997/modernbert-small-muon-factorized-mlp-dual-babylm2026
24.3M • Updated • 5
remg1997/modernbert-small-muon-factorized-linear-dual-babylm2026
24.3M • Updated • 6