File size: 218 Bytes
ac15cc6
 
 
 
 
 
1
2
3
4
5
6
{
  "quantization_method": "mixed_precision_nf4",
  "model_type": "sd",
  "description": "First and last blocks kept at bfloat16, middle layers quantized to NF4 (sd architecture)",
  "high_precision_layers_count": 99
}