mikecovlee/tinymixtral
Text Generation • Updated • 848 • 1
Tiny Mixtral
A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.
A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.