Upload folder using huggingface_hub

d484be8 verified 20 days ago

630 Bytes

base_model:
  - lainlives/codellama-34b-python-merge

lainlives/codellama-34b-python-merge (Quantized)

Quantization Type: int4
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: True
bnb_4bit_compute_dtype: bfloat16
bnb_4bit_quant_storage: uint8

Description

This model is a quantized version of the original model lainlives/codellama-34b-python-merge.

It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.