pytorch/Phi-4-mini-instruct-INT4
Text Generation • Updated
• 57
TorchAO Quantized Phi-4-mini-instruct
TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
-
-
pytorch/Phi-4-mini-instruct-FP8
Text Generation • Updated • 415 • 1 -
pytorch/Phi-4-mini-instruct-INT8-INT4
Text Generation • Updated • 1.77k • 2 -
pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation • Updated • 2.7k • 3 -
pytorch/Phi-4-mini-instruct-parq-3w-4e-shared
Text Generation • Updated • 10 -
pytorch/Phi-4-mini-instruct-parq-2w-4e-shared
Text Generation • Updated • 10 -
pytorch/Phi-4-mini-instruct-parq-4w-4e-shared-gsm
Text Generation • Updated • 2