jsbaicenter/Llama-3.3-70B-Instruct-FP8-Dynamic
Text Generation • 71B • Updated • 441
Quantized LLama-based Models
llama based models quantized to various precisions
-
-
jsbaicenter/Llama-3.2-1b-Instruct-AWQ-4bit-GEMM
1B • Updated • 28 -
jsbaicenter/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 16 -
jsbaicenter/r1-1776-distill-llama-70b-FP8-Dynamic
Text Generation • 71B • Updated • 15 • 1 -
jsbaicenter/Llama-3.2-3b-Instruct-AWQ-4bit-GEMM
Text Generation • 3B • Updated • 8 -
jsbaicenter/Llama-3.3-70b-Instruct-AWQ-4BIT-GEMM
Text Generation • 71B • Updated • 10 • 1