Aquiles-ai/MoonViT-3D
Image Feature Extraction • 0.4B • Updated • 60 • 1
👋 Open to Work
Fredy Rivera
FredyRivera-dev
AI & ML interests
None yet
Recent Activity
updated a model about 6 hours ago
Aquiles-ai/MoonViT-3D liked a model about 7 hours ago
LiquidAI/LFM2.5-2.6B liked a model about 7 hours ago
huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated-v2Organizations
updated a
model about 6 hours ago
liked 2
models about 7 hours ago
liked a
model 2 days ago
published a
model 2 days ago
liked a
model 3 days ago
liked a
model 6 days ago
liked a
model 7 days ago
reacted to their post with 🚀 9 days ago
Post
6300
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
- 3 replies
posted an update 9 days ago
Post
6300
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
- 3 replies
liked a
model 9 days ago
updated 2
datasets 10 days ago
liked a
dataset 10 days ago
liked 3
models 11 days ago
liked 3
datasets 12 days ago