Functionality-Oriented LLM Merging on the Fisher--Rao Manifold
Paper • 2603.04972 • Published • 3
AI & ML interests
Open science and open source
Recent Activity
View all activity
win10
authored a
paper 1 day ago
Post
2797
SPECK 2 IS ALREADY OUT: specklabs/Speck2-140M
Pretrained on 4x more tokens than the previous releases (20b vs 5b).
Instruct tuned versions are coming soon.
Very interesting models are coming soon too (hint: super long context).
Thanks for everyone supporting!
Pretrained on 4x more tokens than the previous releases (20b vs 5b).
Instruct tuned versions are coming soon.
Very interesting models are coming soon too (hint: super long context).
Thanks for everyone supporting!
- 2 replies
Post
141
NEW SPECK UPDATES:
Just hit #14 and #15 with out FIRST models on Open SLM Leaderboard. The models were trained on 5B tokens, while competing with similarly sized models trained on more than 6-20x the data.
A new base model Speck1.5-140M being trained right now on a higher quality corpus and will be released soon.
SpeckChat3 is coming very soon with 1 million samples, specifically designed to post train small base models.
Also, just to clarify stuff, we will NOT release anything that is NOT MIT licensed EVER. Openness is needed in small language research.
Thanks to everyone supporting the project, and stay tuned for new releases!
Just hit #14 and #15 with out FIRST models on Open SLM Leaderboard. The models were trained on 5B tokens, while competing with similarly sized models trained on more than 6-20x the data.
A new base model Speck1.5-140M being trained right now on a higher quality corpus and will be released soon.
SpeckChat3 is coming very soon with 1 million samples, specifically designed to post train small base models.
Also, just to clarify stuff, we will NOT release anything that is NOT MIT licensed EVER. Openness is needed in small language research.
Thanks to everyone supporting the project, and stay tuned for new releases!
Post
1878
SPECK UPDATES:
1 New instruct model tuned on top of Speck1-140M: specklabs/Speck1-140M-Instruct
2 Instruction tuning datasets
2 GGUFs
Much more coming soon:
Speck1.1-140M-Instruct that is post trained on SpeckChat2 will be coming very soon
New base model Speck1.5-140M is coming with a much higher quality corpus
Thanks to everyone who is already supporting the project, and stay tuned for new releases!
1 New instruct model tuned on top of Speck1-140M: specklabs/Speck1-140M-Instruct
2 Instruction tuning datasets
2 GGUFs
Much more coming soon:
Speck1.1-140M-Instruct that is post trained on SpeckChat2 will be coming very soon
New base model Speck1.5-140M is coming with a much higher quality corpus
Thanks to everyone who is already supporting the project, and stay tuned for new releases!
- 3 replies
Post
2118
FIRST SPECK MODEL RELEASED:
specklabs/Speck1-140M
new models coming very soon (both instruct and much better models), with much much higher training scale as i am getting marenostrum5 access soon!
we will be looking at 100b-2t token budgets :)
specklabs/Speck1-140M
new models coming very soon (both instruct and much better models), with much much higher training scale as i am getting marenostrum5 access soon!
we will be looking at 100b-2t token budgets :)
- 4 replies
osanseviero
authored a
paper 2 months ago
osanseviero
submitted a
paper to Daily Papers 2 months ago
chenhegu
authored 3
papers 8 months ago
AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons
Paper • 2503.05731 • Published • 3
Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs
Paper • 2509.01790 • Published • 7
Improving Adversarial Transferability in MLLMs via Dynamic Vision-Language Alignment Attack
Paper • 2502.19672 • Published
multimodalart
posted an update 11 months ago
Post
37384
Want to iterate on a Hugging Face Space with an LLM?
Now you can easily convert any HF entire repo (Model, Dataset or Space) to a text file and feed it to a language model!
multimodalart/repo2txt
Now you can easily convert any HF entire repo (Model, Dataset or Space) to a text file and feed it to a language model!
multimodalart/repo2txt
- 3 replies
yuna0x0
authored a
paper 12 months ago
osanseviero
authored a
paper 12 months ago
ehristoforu
posted an update 12 months ago
Post
2743
🚀Hello from the Project Fluently team!
✨ We are happy to share with you our new universal LLM models based on Qwen3 1.7B and 4B — powerful, multilingual and ready to solve a wide range of problems!
🛠️ We have conducted additional training and carefully merged them to achieve even better results and maximize the potential of the models.
🆓 And most importantly — the models are completely open and free under the Apache-2.0 license!
🔗 Links to repositories:
- FluentlyQwen3-4B: fluently/FluentlyQwen3-4B
- FluentlyQwen3-1.7B: fluently/FluentlyQwen3-1.7B
😍 We will be very glad to hear your feedback and impressions! Your opinion is very important to us!
✨ We are happy to share with you our new universal LLM models based on Qwen3 1.7B and 4B — powerful, multilingual and ready to solve a wide range of problems!
🛠️ We have conducted additional training and carefully merged them to achieve even better results and maximize the potential of the models.
🆓 And most importantly — the models are completely open and free under the Apache-2.0 license!
🔗 Links to repositories:
- FluentlyQwen3-4B: fluently/FluentlyQwen3-4B
- FluentlyQwen3-1.7B: fluently/FluentlyQwen3-1.7B
😍 We will be very glad to hear your feedback and impressions! Your opinion is very important to us!
BrigitteTousi
posted an update about 1 year ago
Post
1415
On Wednesday, August 13 at 11am EDT, join @clem for a no bullshit AMA on Discord. Prep all your HF questions and meet us there! 🤗☄️⚡️
https://discord.com/invite/6r5TEXyk?event=1404451892179763311
https://discord.com/invite/6r5TEXyk?event=1404451892179763311
BrigitteTousi
posted an update about 1 year ago
Post
711
New interactive viz from AI World showing OpenAI's new open model gpt-oss-120b breaking into the top 50 most liked models of all time on the Hub in under a day! ☄️☄️☄️
Post
5654
OpenAI is now open again! Check out OpenAI’s brand new gpt‑oss‑20b model hosted on ZeroGPU 🤗
merterbak/gpt-oss-20b-demo
merterbak/gpt-oss-20b-demo
BrigitteTousi
posted an update about 1 year ago
Post
715
This is what Hugging Face is all about. We want everyone, hobbyists, researchers and industry alike, to be able to contribute to AI because everyone is affected by it. Kudos to HF's @irenesolaiman for spreading the word!🔥🤗
Post
782
Qwen 3 Coder is a personal attack to k2, and I love it.
It achieves near SOTA on LCB while not having reasoning.
Finally people are understanding that reasoning isnt necessary for high benches...
Qwen ftw!
DECENTRALIZE DECENTRALIZE DECENTRALIZE
It achieves near SOTA on LCB while not having reasoning.
Finally people are understanding that reasoning isnt necessary for high benches...
Qwen ftw!
DECENTRALIZE DECENTRALIZE DECENTRALIZE