jhua33 commited on
Commit
9f68276
·
verified ·
1 Parent(s): 11f1d41

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Instinct-Python-Coder-Gemma4-12B-GLM5.2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ adapter.gguf filter=lfs diff=lfs merge=lfs -text
Instinct-Python-Coder-Gemma4-12B-GLM5.2-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03dc7f4569c76d9180385714f72bbb4359f3d2780169df8f733d3d4626d69090
3
+ size 12669645984
README.md ADDED
@@ -0,0 +1,105 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ license_link: https://ai.google.dev/gemma/docs/gemma_4_license
4
+ base_model: unsloth/gemma-4-12b-it
5
+ base_model_relation: finetune
6
+ pipeline_tag: text-generation
7
+ language:
8
+ - en
9
+ tags:
10
+ - gguf
11
+ - llama.cpp
12
+ - gemma
13
+ - python
14
+ - code
15
+ - reasoning
16
+ - conversational
17
+ ---
18
+
19
+ # Instinct-Python-Coder-Gemma4-12B-GLM5.2
20
+
21
+ Instinct-Python-Coder-Gemma4-12B-GLM5.2 is a general-purpose Python coder that thinks
22
+ briefly, then answers. We took the highly capable Gemma 4 12B model and taught it
23
+ to perform better in Python coding with _much_ more concise reasoning in its
24
+ `<think></think>` channel, leading to faster inference, a shorter context window,
25
+ and cost savings for the end user. The reasoning style is distilled from GLM-5.2:
26
+ the model works through the approach in a few lines, then hands back the code.
27
+
28
+ ## Evaluation
29
+
30
+ We measured first-attempt accuracy on a held-out set of 228 Python tasks: one
31
+ greedy completion per task, each graded automatically.
32
+
33
+ | | Gemma 4 12B (base) | Instinct |
34
+ | --------------------------------------- | ------------------ | --------------- |
35
+ | Solved | 40 / 228 (17.5%) | 85 / 228 (37.3%) |
36
+ | Ran out of budget without writing code | 90 | 1 |
37
+ | Time to run the full set (batched) | 233.6 min | 51.7 min |
38
+
39
+ With a 37.3% first-attempt accuracy, our Python Coder Instinct model preserved 49% of
40
+ GLM-5.2's thinking capability: GLM-5.2 itself reaches about 75.6% first-attempt
41
+ accuracy on a broader Python pool under the same kind of check. For comparison,
42
+ the base Gemma 4 12B model has only 17.5% accuracy, so we more than doubled it.
43
+
44
+ On 90 of the 228 tasks the base model exhausted its budget without ever writing
45
+ code; Instinct did that once. The same concise reasoning is why the full set
46
+ evaluates 4.5x faster.
47
+
48
+ ## Training
49
+
50
+ Fine-tuned on 4.52M post-training tokens, passed over twice for 9.03M tokens in
51
+ total, at a sequence length of 8,192.
52
+
53
+ ## Limitations
54
+
55
+ This is one 12B model measured once with greedy decoding, so treat 37.3% as a
56
+ single reading with no error bar. It was tuned and tested on Python, and nothing
57
+ else was measured here. It inherits Gemma 4's behavior and limitations.
58
+
59
+ ## License and lineage
60
+
61
+ Base model: [unsloth/gemma-4-12b-it](https://huggingface.co/unsloth/gemma-4-12b-it), which ships
62
+ under the **Apache 2.0** license (see its own model card's frontmatter — `license: apache-2.0`),
63
+ not the standard Gemma Terms of Use. This fine-tune inherits that Apache 2.0 license.
64
+
65
+ ## Usage
66
+
67
+ It ships as a single Q8_0 GGUF, roughly 13 GB on disk, and runs on a GPU or Mac
68
+ with about 16 GB of memory. Serve it with llama.cpp:
69
+
70
+ ```bash
71
+ llama-server -m Instinct-Python-Coder-Gemma4-12B-GLM5.2-Q8_0.gguf -ngl 99 -c 8192
72
+ ```
73
+
74
+ That exposes an OpenAI-compatible endpoint at `http://localhost:8080/v1`, and the
75
+ Gemma 4 chat template is baked into the GGUF, so turns and the thinking channel are
76
+ formatted for you. It runs anywhere GGUF runs, and any tool that speaks the OpenAI
77
+ chat API can drive it:
78
+
79
+ - **Runtimes and apps**: llama.cpp, Ollama, LM Studio, Jan, KoboldCpp
80
+ - **Coding agents and harnesses**: opencode, pi, Hermes, Aider, Cline, Continue
81
+
82
+ Describe what you want in plain language and it replies with a short pass of
83
+ reasoning followed by the code:
84
+
85
+ ````
86
+ User: Merge two sorted lists into one sorted list.
87
+
88
+ <think>
89
+ Two pointers, take the smaller head each step, append whatever is left over. O(n+m).
90
+ </think>
91
+
92
+ ```python
93
+ def merge(a, b):
94
+ i = j = 0
95
+ out = []
96
+ while i < len(a) and j < len(b):
97
+ if a[i] <= b[j]:
98
+ out.append(a[i]); i += 1
99
+ else:
100
+ out.append(b[j]); j += 1
101
+ out.extend(a[i:])
102
+ out.extend(b[j:])
103
+ return out
104
+ ```
105
+ ````
adapter.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4d3c9f6d8dd64f90202119f846a4822d89d6cb896f2c42bae0dabbaf2d39c75
3
+ size 131182944