Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts
Paper • 2608.20061 • Published • 38
Cheon Jaewon
snob
·
AI & ML interests
Large Language Models
Recent Activity
upvoted a paper 5 months ago
Grounding World Simulation Models in a Real-World Metropolis liked a model 5 months ago
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16Organizations
upvoted a paper 5 days ago
upvoted a paper 5 months ago
liked 5
models 5 months ago
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16
Text Generation • 124B • Updated • 12.3k • 32
moonshotai/Kimi-K2-Base
Text Generation • 1T • Updated • 11.8k • 306
mistralai/Mistral-Large-3-675B-Base-2512
Updated • 78 • 46
zai-org/GLM-4.5-Base
Text Generation • 358B • Updated • 698 • 61
deepseek-ai/DeepSeek-V3.1-Base
Text Generation • 685B • Updated • 29.9k • 1.01k
liked 5
datasets 6 months ago
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 20.6k • 740
open-thoughts/OpenThoughts-114k
Viewer • Updated • 228k • 109k • 907
galaxyMindAiLabs/stem-reasoning-complex
Viewer • Updated • 118k • 243 • 78
nohurry/Opus-4.6-Reasoning-3000x-filtered
Viewer • Updated • 2.33k • 650 • 644
ronantakizawa/github-top-code
Viewer • Updated • 1.12M • 5.42k • 125
updated a
model about 2 years ago
updated 4
datasets about 2 years ago
updated a
model about 2 years ago
updated a
dataset about 2 years ago
updated a
model about 2 years ago