Instructions to use replicate/quantization-bitsandbytes with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use replicate/quantization-bitsandbytes with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("replicate/quantization-bitsandbytes") - Notebooks
- Google Colab
- Kaggle
File size: 131 Bytes
ffa238d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:7a689c4fe7a2ac4529c5ee6eebeb714eb79160c1fde23e9b13600e8f10c96ffe
size 141024
|