ggml-quantization / torch-ext

Commit History

add mul_mat_id, and compile upstream's kernels as they ship
9534e0b

Marc Sun commited on

expose ggml's get_rows, and rename the package to match the repo
e9319be

marcsun13 HF Staff commited on

Metal: cover every quant type upstream's metallib has a gemv for
0becb0a

Marc Sun commited on

GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants
2c20074
verified

marcsun13 HF Staff commited on