Models of the Paper LogitRouter: a novel Attention variant for reducing Myopic Routing in Mixture of Experts
Felipe Rodríguez Bórquez PRO
feliperodriguezborquez
AI & ML interests
Architectures, pre-training, post-training
Organizations
None yet
models
9
feliperodriguezborquez/OLMoE-0125-base-V1
Text Generation
•
7B
•
Updated
•
1
feliperodriguezborquez/OLMoE-0125-my-V1
7B
•
Updated
•
1
feliperodriguezborquez/OLMoE-0125-attn-rnd-V1
7B
•
Updated
feliperodriguezborquez/OLMoE-0125-base-rnd-V1
Text Generation
•
7B
•
Updated
feliperodriguezborquez/OLMoE-0924-attn-rnd-V1
7B
•
Updated
feliperodriguezborquez/OLMoE-0924-my-rnd-V1
7B
•
Updated
feliperodriguezborquez/OLMoE-0924-base-rnd-V1
Text Generation
•
7B
•
Updated
feliperodriguezborquez/OLMoE-0924-my-V1
7B
•
Updated
feliperodriguezborquez/OLMoE-0924-base-V1
Text Generation
•
7B
•
Updated
datasets
0
None public yet