Haoze Wu

WaitHZ's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

commented 3 papers over 1 year ago

HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization

Paper • 2503.04598 • Published Mar 6, 2025 • 22 •

8

HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization

Paper • 2503.04598 • Published Mar 6, 2025 • 22 •

8

Autonomy-of-Experts Models

Paper • 2501.13074 • Published Jan 22, 2025 • 44 •

5

New activity in deepseek-ai/deepseek-moe-16b-base over 2 years ago

A little question about aux_loss

2

#4 opened over 2 years ago by

WaitHZ

A little question about aux_loss

2

#4 opened over 2 years ago by

WaitHZ