pinned
Running
1
TurboQuant on Consumer GPUs — 100K Context on RTX 3090, 64K on RTX 4070
🚀
Extend LLM context to 100K tokens on consumer GPUs
Ai-Engineering.at
ai-engineering-at
·
AI & ML interests
AI & ML & Docker & Ollama & lokal & legal
Recent Activity
liked a model 2 days ago
kai-os/Carnice-9b liked a model 2 days ago
dealignai/Gemma-4-31B-JANG_4M-CRACK liked a Space 4 days ago
ai-engineering-at/llama-cpp-turboquant-guideOrganizations
