Article
Mixture of Experts (MoEs) in Transformers
- +5
•
95
Rohit Chandra
rohitchandra
AI & ML interests
None yet
Recent Activity
upvoted an article 1 day ago
Mixture of Experts (MoEs) in Transformers upvoted an article 8 days ago
Train AI models with Unsloth and Hugging Face Jobs for FREE liked
a Space 10 days ago
nanotron/ultrascale-playbook Organizations
upvoted an article 1 day ago
upvoted an article 8 days ago
Article
Train AI models with Unsloth and Hugging Face Jobs for FREE
- +4
•
79
liked a Space 10 days ago
updated a collection 5 months ago
upvoted a paper 5 months ago
liked a Space 5 months ago
updated a Space 6 months ago
published a Space 6 months ago
upvoted an article 7 months ago
Article
Illustrating Reinforcement Learning from Human Feedback (RLHF)
- +2
•
403
upvoted an article 8 months ago
Article
Let's talk about LLM evaluation
•
207
upvoted an article 11 months ago
Article
The Large Language Model Course
•
222
liked a model about 1 year ago
reacted to chansung's post with 👍 about 1 year ago
Post
4519
A brief summary of the o3-mini
The OpenAI o3-mini model is a significant improvement over the o1-mini, reaching o1 performance levels. While generally good, its performance isn't universally better than previous models (o1, o1-prev.) or GPT-4o across all benchmarks. This means workflows should be re-evaluated with each model upgrade.
The o3-mini has "low," "medium," and "high" versions, with "low" being the base model used for benchmarking. It's speculated that the higher versions simply involve more processing. A fair comparison with other models like Gemini 2.0 Thinking or DeepSeek-R1 would likely need to use the "low" version and a similar "think more" mechanism.
The system card is recommended reading due to its comprehensive benchmark data.
https://openai.com/index/openai-o3-mini/
The OpenAI o3-mini model is a significant improvement over the o1-mini, reaching o1 performance levels. While generally good, its performance isn't universally better than previous models (o1, o1-prev.) or GPT-4o across all benchmarks. This means workflows should be re-evaluated with each model upgrade.
The o3-mini has "low," "medium," and "high" versions, with "low" being the base model used for benchmarking. It's speculated that the higher versions simply involve more processing. A fair comparison with other models like Gemini 2.0 Thinking or DeepSeek-R1 would likely need to use the "low" version and a similar "think more" mechanism.
The system card is recommended reading due to its comprehensive benchmark data.
https://openai.com/index/openai-o3-mini/
liked 2 Spaces over 2 years ago
liked a model over 2 years ago
liked 2 models almost 3 years ago
liked a dataset almost 3 years ago
liked a Space almost 3 years ago