marcsun13
/

ggml-quantization

Model card Files Files and versions

ggml-quantization / vendor /src

Ctrl+K

Ctrl+K

2 contributors

History: 4 commits

Marc Sun

add mul_mat_id, and compile upstream's kernels as they ship

9534e0b 12 days ago

ggml-metal
add mul_mat_id, and compile upstream's kernels as they ship 12 days ago
ggml-common.h

135 kB
GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants about 1 month ago