How to use turboderp/HyperCLOVAX-SEED-Think-14B-exl3 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("turboderp/HyperCLOVAX-SEED-Think-14B-exl3", dtype="auto")
EXL3 quants of HyperCLOVAX-SEED-Think-14B
⚠️ Requires ExLlamaV3 v0.0.19 (or v0.0.18 dev branch)
dev
Base bitrates:
4.00 bits per weight
-
Base model