vsan commited on
Commit
0e0d7fc
·
verified ·
1 Parent(s): 621dc18

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +60 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
3
+ library_name: llama.cpp
4
+ pipeline_tag: text-generation
5
+ license: apache-2.0
6
+ tags:
7
+ - gguf
8
+ - qwen3-coder
9
+ - coding
10
+ - software-engineering
11
+ - moe
12
+ - q8_0
13
+ - q4_k_m
14
+ - tiny-pickle
15
+ ---
16
+
17
+ # Tiny Pickle v3 Coder — GGUF
18
+
19
+ Quantized GGUF releases of Tiny Pickle v3 Coder.
20
+
21
+ Tiny Pickle v3 Coder was produced by fine-tuning
22
+ `Qwen/Qwen3-Coder-30B-A3B-Instruct` with the LoRA adapter published at
23
+ `vsan/tiny-pickle-v3-coder-LoRA`, then merging and converting the resulting model with
24
+ llama.cpp.
25
+
26
+ ## Files
27
+
28
+ | File | Quantization | Approximate size |
29
+ |---|---|---:|
30
+ | `tiny-pickle-v3-coder-q8_0.gguf` | Q8_0 | 31G |
31
+ | `tiny-pickle-v3-coder-q4_k_m.gguf` | Q4_K_M | 18G |
32
+
33
+ Q8_0 retains greater numerical fidelity but requires more storage and
34
+ memory. Q4_K_M is smaller and more practical for local inference.
35
+
36
+ ## Run with llama.cpp
37
+
38
+ ```bash
39
+ llama-cli \
40
+ -m tiny-pickle-v3-coder-q4_k_m.gguf \
41
+ -ngl 99 \
42
+ -c 8192 \
43
+ -p "Write a robust Python LRU cache with unit tests."
44
+ ```
45
+
46
+ ## Intended use
47
+
48
+ - Code generation
49
+ - Debugging
50
+ - Code review
51
+ - Implementation planning
52
+ - Test generation
53
+ - Software-engineering assistance
54
+
55
+ ## Limitations
56
+
57
+ Tiny Pickle v3 Coder is experimental and has not yet been proven superior
58
+ to its base model on independent benchmarks. Quantization may reduce model
59
+ quality. Generated code can be incorrect, insecure, incomplete, or
60
+ non-functional and must be reviewed and tested.