Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
quantization
like
6
Follow
Red Hat AI
1.96k
kernel
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
3
d5fd23d
quantization
1.38 GB
2 contributors
History:
38 commits
danieldk
HF Staff
Temporarily disable ROCm
d5fd23d
8 months ago
attention
Sync to vLLM 20250627
8 months ago
build
Build (aarch64)
11 months ago
compressed_tensors
Sync to vLLM 20250627
8 months ago
core
Sync to vLLM 20250627
8 months ago
cutlass_extensions
Sync to vLLM 20250627
8 months ago
cutlass_w8a8
Sync to vLLM 20250627
8 months ago
fp8
Sync to vLLM 20250627
8 months ago
gptq_marlin
Sync to vLLM 20250627
8 months ago
marlin
Sync to vLLM 20250627
8 months ago
tests
Sync to vLLM 20250627
8 months ago
torch-ext
Sync to vLLM 20250627
8 months ago
.gitattributes
Safe
1.56 kB
Build
about 1 year ago
LICENSE
Safe
11.4 kB
Add cutlass_w8a8
about 1 year ago
README.md
Safe
195 Bytes
Update README.md (#1)
about 1 year ago
build.toml
5.88 kB
Temporarily disable ROCm
8 months ago
cuda_utils.h
Safe
1.41 kB
Sync on vLLM 20240402
11 months ago
dispatch_utils.h
Safe
3.9 kB
Sync to vLLM 20250627
8 months ago
flake.lock
Safe
4.47 kB
Sync to vLLM 20250627
8 months ago
flake.nix
Safe
335 Bytes
Add support for ROCm
11 months ago
utils.cuh
Safe
1.84 kB
Sync on vLLM 20240402
11 months ago
vectorization.cuh
Safe
878 Bytes
Sync to vLLM 20250627
8 months ago
vectorization_utils.cuh
Safe
2.61 kB
Sync to vLLM 20250627
8 months ago
