CompactAI-O/TrueMath
Updated • 3
CompactAI
community
AI & ML interests
Building small models for everyone
Recent Activity
View all activity
Safetensors?
1
#1 opened about 8 hours ago
by 
Datdanboi25
CompactAI
updated a
model about 15 hours ago
CompactAI
updated 2
Spaces 1 day ago
Crownelius
posted an update 1 day ago
Post
4147
Howdy,
CompactAI-O is launching a tiny Model Golf, and the winner walks away with $50 in RunPod credits. Monthly. Every month. Show up, build, somebody wins.
What it is
Build the best language model you can under 100 million parameters, with at least a 1028-token context window. That's it. Any architecture, any tokenizer, any training scheme you can dream up at 3am. The only catch is it's gotta be open source (MIT, GPL, Apache, AGPL) take your pick.
It scratches the same itch as a Kaggle comp without the dataset\leaderboard nonsense. No fixed benchmark to game. No llama.cpp compatibility hoops. If you wanna train a 50M-param MoE with five experts and a tokenizer built on cookbooks, you can do that. Nothing stopping you.
The rules are listed in the discord and on the organization page if you're interested.
Why $50????
It's symbolic. It ain't gonna make anyone rich. But it's enough to cover a weekend of GPU time, enough to keep enthusiasts coming back, and not so much that it pulls in people who are just there for the money. Enthusiasts build interesting things. Interesting things move the field forward. A little incentive. I'd do it for $50 lol.
How to join
First round opens soon. Landing page is here:
→ CompactAI-O/Tiny-model-golf
For questions or to swap ideas, the Discord's open:
→ https://discord.gg/y2jTct6Cxv
Excited to see what yall come up with. ♥
— Shane
CompactAI-O is launching a tiny Model Golf, and the winner walks away with $50 in RunPod credits. Monthly. Every month. Show up, build, somebody wins.
What it is
Build the best language model you can under 100 million parameters, with at least a 1028-token context window. That's it. Any architecture, any tokenizer, any training scheme you can dream up at 3am. The only catch is it's gotta be open source (MIT, GPL, Apache, AGPL) take your pick.
It scratches the same itch as a Kaggle comp without the dataset\leaderboard nonsense. No fixed benchmark to game. No llama.cpp compatibility hoops. If you wanna train a 50M-param MoE with five experts and a tokenizer built on cookbooks, you can do that. Nothing stopping you.
The rules are listed in the discord and on the organization page if you're interested.
Why $50????
It's symbolic. It ain't gonna make anyone rich. But it's enough to cover a weekend of GPU time, enough to keep enthusiasts coming back, and not so much that it pulls in people who are just there for the money. Enthusiasts build interesting things. Interesting things move the field forward. A little incentive. I'd do it for $50 lol.
How to join
First round opens soon. Landing page is here:
→ CompactAI-O/Tiny-model-golf
For questions or to swap ideas, the Discord's open:
→ https://discord.gg/y2jTct6Cxv
Excited to see what yall come up with. ♥
— Shane
- 7 replies
Crownelius
updated a
Space 1 day ago
Crownelius
published a
Space 1 day ago
Crownelius
updated a
Space 1 day ago
CompactAI
updated a
collection 1 day ago
CompactAI
published a
model 1 day ago
HF compatible model when?
2
#3 opened 2 days ago
by Datdanboi25
Can you stop using AI for everything? also, great work
🤗 1
2
#1 opened 2 days ago
by 
Harley-ml
CompactAI
updated a
Space 2 days ago
Writing style...
🔥 1
1
#3 opened 5 days ago
by 
Enderchef
Search Finetune
🤯 1
#3 opened 5 days ago
by Enderchef
Writing style...
🔥 1
1
#3 opened 5 days ago
by Enderchef
1.3 opinion
8
#2 opened 7 days ago
by Enderchef
1.3 opinion
8
#2 opened 7 days ago
by Enderchef
1.3 opinion
8
#2 opened 7 days ago
by Enderchef
CompactAI
updated a
Space 9 days ago