Quantized-Llama Quantized Llama models in 2,4, and 8 bit versions divyanshusingh/Llama-3.1-8b-Instruct-GGUF 8B • Updated Aug 25, 2024 • 72 divyanshusingh/Llama-3-8b-Instruct-GGUF 8B • Updated Aug 25, 2024 • 62 divyanshusingh/CodeLlama-7b-GGUF 7B • Updated Aug 25, 2024 • 32 divyanshusingh/Llama-2-7b-chat-GGUF 7B • Updated Aug 30, 2024 • 54
Quantized-Mistral Quantized Mistral models in 2,4, and 8 bit versions divyanshusingh/Mistral-7B-Instruct-v0.1-GGUF 7B • Updated Aug 31, 2024 • 38 divyanshusingh/Mistral-Nemo-Instruct-2407-GGUF 12B • Updated Aug 31, 2024 • 46 divyanshusingh/Mistral-7B-Instruct-v0.3-GGUF 7B • Updated Aug 31, 2024 • 48 divyanshusingh/Mistral-7B-Instruct-v0.2-GGUF 7B • Updated Aug 31, 2024 • 66
Quantized-Llama Quantized Llama models in 2,4, and 8 bit versions divyanshusingh/Llama-3.1-8b-Instruct-GGUF 8B • Updated Aug 25, 2024 • 72 divyanshusingh/Llama-3-8b-Instruct-GGUF 8B • Updated Aug 25, 2024 • 62 divyanshusingh/CodeLlama-7b-GGUF 7B • Updated Aug 25, 2024 • 32 divyanshusingh/Llama-2-7b-chat-GGUF 7B • Updated Aug 30, 2024 • 54
Quantized-Mistral Quantized Mistral models in 2,4, and 8 bit versions divyanshusingh/Mistral-7B-Instruct-v0.1-GGUF 7B • Updated Aug 31, 2024 • 38 divyanshusingh/Mistral-Nemo-Instruct-2407-GGUF 12B • Updated Aug 31, 2024 • 46 divyanshusingh/Mistral-7B-Instruct-v0.3-GGUF 7B • Updated Aug 31, 2024 • 48 divyanshusingh/Mistral-7B-Instruct-v0.2-GGUF 7B • Updated Aug 31, 2024 • 66