Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
Paper • 2502.12947 • Published
ChuGyouk PRO
ChuGyouk
AI & ML interests
LLM(LMM) RL & Medical AI
Recent Activity
updated a model about 21 hours ago
ChuGyouk/F_R1_T3_lower_lr published a model about 22 hours ago
ChuGyouk/F_R1_T3_lower_lr updated a model about 22 hours ago
ChuGyouk/F_R1_1_4b_T5Organizations
None yet
authored a
paper about 1 year ago