Post
1932
AxiomicLabs released new benchmark, Tiny Theory of Mind, to test your SLM models' Theory of Mind Intuition!
Check it out and like it!
AxiomicLabs/Tiny_Theory_of_Mind
Check it out and like it!
AxiomicLabs/Tiny_Theory_of_Mind
🔄 In a Training Loop
aquilesfd
aquilesfd
AI & ML interests
research
Recent Activity
View all activity
Organizations
reacted to Enderchef's post with 🔥 1 day ago
liked a
model 1 day ago
liked a
model 3 days ago
reacted to Datdanboi25's post with 🔥 3 days ago
Post
2883
ForgePlex-M1-6M first model trained on AxiomicLabs TrainWork
ForgeWorks/ForgePlex-M1-6M just dropped from
ForgeWorks , and is the first model to ever be trained on our TrainWork training framework.
Achieving an Intelligence Index of 6.87 and taking #22 in the <10m category on the AxiomicLabs/Open_SLM_Leaderboard, very impressive work for a first model.
Give it some love!
ForgeWorks/ForgePlex-M1-6M just dropped from
Achieving an Intelligence Index of 6.87 and taking #22 in the <10m category on the AxiomicLabs/Open_SLM_Leaderboard, very impressive work for a first model.
Give it some love!
- 5 replies
liked 4
models 4 days ago
reacted to Banaxi-Tech's post with 👍 5 days ago
Post
2739
We've released @BananaMindBot .
Most things you do on HuggingFace, BananaMindBot can do. Fast
Mention @BananaMindBot on a model, dataset, Space discussion, paper, blog comment, or top-level post and it'll reply there.
It's powered by North Code Mini (Qwen3.8 27B, with GPT OSS 120B as fallback).
A few things it can do:
Search for models and datasets
Look up users and orgs and see what they've published
Read model cards, configs, dataset files, blog posts, and org profiles
Answer questions about what it finds
Write and run its own code in a locked-down sandbox when it needs to verify something
Check things like a model's real parameter count from the safetensors headers instead of just repeating the model card
Remember something for later if you explicitly ask it to
Forward a message to @Banaxi-Tech
Post a daily roundup of developments in the small-language-model space
It won't execute code you give it. It can read and review that code, but anything it runs is code it wrote itself.
It also can't access private data or credentials.
Mention it somewhere.
It's going to also find this post!
(Some parts inspired by CompactBot and @CompactAI Follow them please)
Most things you do on HuggingFace, BananaMindBot can do. Fast
Mention @BananaMindBot on a model, dataset, Space discussion, paper, blog comment, or top-level post and it'll reply there.
It's powered by North Code Mini (Qwen3.8 27B, with GPT OSS 120B as fallback).
A few things it can do:
Search for models and datasets
Look up users and orgs and see what they've published
Read model cards, configs, dataset files, blog posts, and org profiles
Answer questions about what it finds
Write and run its own code in a locked-down sandbox when it needs to verify something
Check things like a model's real parameter count from the safetensors headers instead of just repeating the model card
Remember something for later if you explicitly ask it to
Forward a message to @Banaxi-Tech
Post a daily roundup of developments in the small-language-model space
It won't execute code you give it. It can read and review that code, but anything it runs is code it wrote itself.
It also can't access private data or credentials.
Mention it somewhere.
It's going to also find this post!
(Some parts inspired by CompactBot and @CompactAI Follow them please)
- 37 replies
liked 3
models 5 days ago
replied to Datdanboi25's post 6 days ago
insane data efficiency from Bench. always knew cagliostro had potential. KEEP ON SHIPPING 🗣️
reacted to TobiasLogic's post with 🔥 6 days ago
Post
3443
We’ve been cooking something new at Bench Labs.
Introducing Cagliostro-v3, our new 146M parameter language model trained completely from scratch.
The run isn’t even finished yet.
At the current checkpoint:
• 146M parameters
• 72.7B / 75B tokens trained
• 26.27 Open SLM Index
• 43.80 ArithMark-3
• Trained on a single RTX 5090
• ~90K to 103K tokens/sec during training
• ~9 days for the full run
• Apache 2.0
For some context, SmolLM2-135M scores 27.13 on the same Index after being trained on roughly 2 trillion tokens.
Cagliostro-v3 is currently at 26.27 with only ~72.7B.
That’s around 27x fewer training tokens.
The model also currently Hold the number 3rd spot for ArithMark-3, scoring 43.80
This wasn’t achieved by just throwing more tokens at the model. A huge part of v3 has been figuring out architecture, data mixture, and training dynamics at this scale.
The model uses a custom 30-layer decoder architecture with grouped-query attention and cross-head subspace attenuation, SwiGLU, RMSNorm, RoPE, tied embeddings, and a warmup-stable-decay training schedule.
During cooldown we also substantially shifted the data mixture toward higher-quality synthetic textbook and mathematics data, with the mathematics share increasing from 10% to 28%.
And everything is open.
The repository contains the training history with checkpoints pushed roughly every 30 minutes, so you can inspect how the model evolved throughout training rather than only seeing the final weights.
This is still a pre-final checkpoint. We have roughly 2.3B tokens left and the learning-rate cooldown is still running.
So 26.27 isn’t the final number.
Really excited to see where the last part of the run lands.
Cagliostro-v3:
bench-labs/cagliostro-v3
Built by Bench Labs.
Open SLM Leaderboard:
AxiomicLabs/Open_SLM_Leaderboard
Introducing Cagliostro-v3, our new 146M parameter language model trained completely from scratch.
The run isn’t even finished yet.
At the current checkpoint:
• 146M parameters
• 72.7B / 75B tokens trained
• 26.27 Open SLM Index
• 43.80 ArithMark-3
• Trained on a single RTX 5090
• ~90K to 103K tokens/sec during training
• ~9 days for the full run
• Apache 2.0
For some context, SmolLM2-135M scores 27.13 on the same Index after being trained on roughly 2 trillion tokens.
Cagliostro-v3 is currently at 26.27 with only ~72.7B.
That’s around 27x fewer training tokens.
The model also currently Hold the number 3rd spot for ArithMark-3, scoring 43.80
This wasn’t achieved by just throwing more tokens at the model. A huge part of v3 has been figuring out architecture, data mixture, and training dynamics at this scale.
The model uses a custom 30-layer decoder architecture with grouped-query attention and cross-head subspace attenuation, SwiGLU, RMSNorm, RoPE, tied embeddings, and a warmup-stable-decay training schedule.
During cooldown we also substantially shifted the data mixture toward higher-quality synthetic textbook and mathematics data, with the mathematics share increasing from 10% to 28%.
And everything is open.
The repository contains the training history with checkpoints pushed roughly every 30 minutes, so you can inspect how the model evolved throughout training rather than only seeing the final weights.
This is still a pre-final checkpoint. We have roughly 2.3B tokens left and the learning-rate cooldown is still running.
So 26.27 isn’t the final number.
Really excited to see where the last part of the run lands.
Cagliostro-v3:
bench-labs/cagliostro-v3
Built by Bench Labs.
Open SLM Leaderboard:
AxiomicLabs/Open_SLM_Leaderboard
- 8 replies
liked a
model 6 days ago
reacted to Datdanboi25's post with 🔥 6 days ago
Post
3434
THE SLM FRONTIER ADVANCES!
bench-labs/cagliostro-v3 just hit an Intelligence Index of 26.13 on the AxiomicLabs/Open_SLM_Leaderboard a 146M-param model trained completely from scratch on a single consumer GPU. That's 2nd place overall, and as far as I can tell, the most capable SLM trained on consumer hardware to date. Beating SmolLM-135m on 1/8th of the data is just silly levels of efficiency.
Big congrats to the @BenchLabs team and specifically @TobiasLogic !
bench-labs/cagliostro-v3 just hit an Intelligence Index of 26.13 on the AxiomicLabs/Open_SLM_Leaderboard a 146M-param model trained completely from scratch on a single consumer GPU. That's 2nd place overall, and as far as I can tell, the most capable SLM trained on consumer hardware to date. Beating SmolLM-135m on 1/8th of the data is just silly levels of efficiency.
Big congrats to the @BenchLabs team and specifically @TobiasLogic !
- 6 replies
liked 2
models 7 days ago
liked 2
models 8 days ago
