nomadicsynth's picture

nomadicsynth PRO

nomadicsynth

AI & ML interests

architecture research, knowledge discovery

Recent Activity

reacted to Bc-AI's post with 👍 about 9 hours ago
Smilyai News Hello everyone! August has been a crazy month for us at Smilyai-Labs. We've been doing lots behind the scenes, so here's the latest 👇 1. MiniCoder We are very close to releasing MiniCoder-1, our first-generation coding model designed for reasoning and coding. Our planned context window is 128K, but the earlier versions probably will not support that long! It's currently in the final stages of DPO so expect a release in early september. Release: VERY SOON™🤣 2. Smilyai G1 So, the current plan is 20B parameter model total, with a MoE architecture, activating around 2B parameters per token. Its desgigned for maximum performance but keeping it runnable on consumer hardware. It's only a plan and i have no idea when me and the team can finish it. Expect a launch around the end of september to early october-ish. I have no guarantees so don't quote me on the launch date. 3. T1 Smilyai-T1 is another major model we are working on. The goal for T1 is to take what we learnt from the countless architectural experiments and creating a powerful model designed for thinking. Think MiniCoder but reasons more and G1 but more capable. Its main goals are coding, math, reasoning and general capability. 4. Omni We are also planning Omni, our first from scratch multimodal model. It will not launch this year as it will take a while. We are actively researching the best architecture for it and we will update progress as we go! Thanks to our beta testers: @guardamarcos @ProCreations @juiceb0xc0de @Timmy6767 @Sbui503 @atom77777 @Fishtiks @smartdigitalnetworks @EmetTheGolum @smilyai-large-team @MUK-IS-GOAT @Bc-AI Thanks to my friends who work with me at lunchtimes (Smilyai-Labs team): @MUK-IS-GOAT @smilyai-large-team August was wild. Let’s see what September brings. 🚀 — Bc-AI, on behalf of SmilyAI Labs
liked a dataset about 1 month ago
t-tech/SynthComp
liked a dataset about 1 month ago
scholarweave/arxiv-latex
View all activity

Organizations

Blog-explorers's profile picture Neon Cortex's profile picture