Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
In a Training Loop 🔄
174.0
TFLOPS
10
4
189
rob
PRO
rob-x-ai
Follow
ngmmj2's profile picture
michfr's profile picture
21world's profile picture
21 followers
·
66 following
https://www.kroonen.ai
rob_x_ai
rob-x-ai
AI & ML interests
∙ Open Research ∙ Making Generative AI accessible to anyone on consumer hardware
Recent Activity
updated
a Space
about 18 hours ago
rob-x-ai/genesis-1b-playground
liked
a dataset
about 20 hours ago
open-index/hacker-news
posted
an
update
4 days ago
Genesis 1B is now public. 🔥 I’m training a 1.003B parameter model from scratch on 2× RTX 4090s and opened a public playground for early checkpoints. The real bottleneck wasn’t training. It was checkpointing: FSDP full-state gather over PCIe = NCCL timeout hell Switching to DCP sharded checkpoints changed the trajectory of the run. - Playground: https://huggingface.co/spaces/rob-x-ai/genesis-1b-playground - Write-up: https://kroonen.ai/blog/distributed-checkpoint-failures-rtx4090/
View all activity
Organizations
rob-x-ai
's models
11
Sort: Recently updated
rob-x-ai/stablelm-2-12b-GGUF
12B
•
Updated
Jun 6, 2024
•
100
rob-x-ai/CodeLLaMa-70b-Python-GGUF
Text Generation
•
69B
•
Updated
Jan 31, 2024
•
166
rob-x-ai/neuralchat_v3_3_laser-GGUF
7B
•
Updated
Jan 8, 2024
•
24
rob-x-ai/phi-2-GGUF
Text Generation
•
3B
•
Updated
Jan 6, 2024
•
444
•
22
rob-x-ai/Starling-LM-7B-alpha-GGUF
7B
•
Updated
Dec 7, 2023
•
18
•
1
rob-x-ai/neural-chat-7b-v3-1-GGUF
7B
•
Updated
Nov 28, 2023
•
34
rob-x-ai/Orca-2-GGUF
13B
•
Updated
Nov 28, 2023
•
49
rob-x-ai/OpenOrca-Platypus2-13B-GGUF
13B
•
Updated
Aug 30, 2023
•
8
•
2
rob-x-ai/llama2-stablebeluga-GGML
Updated
Aug 16, 2023
•
3
rob-x-ai/OpenOrca-Platypus2-13B-GGML
Updated
Aug 16, 2023
•
2
rob-x-ai/llama2-Q4_0-GGML
Updated
Jul 30, 2023
•
2