🤝 Open to Collab
Carlos García
cgarciams
·
AI & ML interests
Building a GPT-2 medium size (approx. 400 M parameters) model from scratch, using PyTorch, the OpenWebText dataset, Tiktoken, AdamW optimizer and FlashAttention. Just for fun.
Recent Activity
upvoted an article 27 days ago
Adding MCP Tools to Reachy Mini liked a dataset 27 days ago
Skylion007/openwebtext liked a dataset 27 days ago
tatsu-lab/alpacaOrganizations
