Instructions to use replicate/quantization-bitsandbytes with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/quantization-bitsandbytes with Kernels:
# !pip install kernels from kernels import get_kernel # a version (or an explicit revision) is required; see the "Files and versions" tab for the available ones kernel = get_kernel("replicate/quantization-bitsandbytes", version=1) - Notebooks
- Google Colab
- Kaggle
Download .gitattributes from replicate/quantization-bitsandbytes: direct link, hf CLI and curl.
- Browser
- Download file 3.62 kB
-
https://huggingface.co/replicate/quantization-bitsandbytes/resolve/db26d0e9ce6cae74676b4d7f95144dedfe26dfd6/.gitattributes
- Command line
-
hf download hf://replicate/quantization-bitsandbytes@db26d0e9ce6cae74676b4d7f95144dedfe26dfd6/.gitattributes
-
curl -L -o .gitattributes https://huggingface.co/replicate/quantization-bitsandbytes/resolve/db26d0e9ce6cae74676b4d7f95144dedfe26dfd6/.gitattributes
3.62 kB
| *.7z filter=lfs diff=lfs merge=lfs -text | |
| *.arrow filter=lfs diff=lfs merge=lfs -text | |
| *.bin filter=lfs diff=lfs merge=lfs -text | |
| *.bz2 filter=lfs diff=lfs merge=lfs -text | |
| *.ckpt filter=lfs diff=lfs merge=lfs -text | |
| *.ftz filter=lfs diff=lfs merge=lfs -text | |
| *.gz filter=lfs diff=lfs merge=lfs -text | |
| *.h5 filter=lfs diff=lfs merge=lfs -text | |
| *.joblib filter=lfs diff=lfs merge=lfs -text | |
| *.lfs.* filter=lfs diff=lfs merge=lfs -text | |
| *.mlmodel filter=lfs diff=lfs merge=lfs -text | |
| *.model filter=lfs diff=lfs merge=lfs -text | |
| *.msgpack filter=lfs diff=lfs merge=lfs -text | |
| *.npy filter=lfs diff=lfs merge=lfs -text | |
| *.npz filter=lfs diff=lfs merge=lfs -text | |
| *.onnx filter=lfs diff=lfs merge=lfs -text | |
| *.ot filter=lfs diff=lfs merge=lfs -text | |
| *.parquet filter=lfs diff=lfs merge=lfs -text | |
| *.pb filter=lfs diff=lfs merge=lfs -text | |
| *.pickle filter=lfs diff=lfs merge=lfs -text | |
| *.pkl filter=lfs diff=lfs merge=lfs -text | |
| *.pt filter=lfs diff=lfs merge=lfs -text | |
| *.pth filter=lfs diff=lfs merge=lfs -text | |
| *.rar filter=lfs diff=lfs merge=lfs -text | |
| *.safetensors filter=lfs diff=lfs merge=lfs -text | |
| saved_model/**/* filter=lfs diff=lfs merge=lfs -text | |
| *.tar.* filter=lfs diff=lfs merge=lfs -text | |
| *.tar filter=lfs diff=lfs merge=lfs -text | |
| *.tflite filter=lfs diff=lfs merge=lfs -text | |
| *.tgz filter=lfs diff=lfs merge=lfs -text | |
| *.wasm filter=lfs diff=lfs merge=lfs -text | |
| *.xz filter=lfs diff=lfs merge=lfs -text | |
| *.zip filter=lfs diff=lfs merge=lfs -text | |
| *.zst filter=lfs diff=lfs merge=lfs -text | |
| *tfevents* filter=lfs diff=lfs merge=lfs -text | |
| build/torch28-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_2e2ed43.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_2e2ed43.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch28-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_e6f32d1.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_e6f32d1.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch210-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_5679cec.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch28-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_5679cec.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_5679cec.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch210-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_0ed0691.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch28-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_0ed0691.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_0ed0691.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch210-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_23c0016.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch28-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_23c0016.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_23c0016.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch210-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_9739e82.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch28-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_9739e82.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_9739e82.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch210-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_cpu_3c456c8.abi3.so filter=lfs diff=lfs merge=lfs -text | |
| build/torch29-cxx11-cpu-x86_64-linux/_quantization_bitsandbytes_cpu_3c456c8.abi3.so filter=lfs diff=lfs merge=lfs -text | |