codegeist commited on
Commit
c039e90
·
verified ·
1 Parent(s): 89b00d5

docs: establish Codegeist training

Browse files

Reframe the current adapter as the first Codegeist training stage, remove obsolete local-history metadata from the active release, and preserve the immutable adapter bytes.

Files changed (5) hide show
  1. README.md +47 -41
  2. SHA256SUMS +3 -4
  3. evidence.json +5 -6
  4. gpu-test-result.json +0 -41
  5. publication.json +4 -5
README.md CHANGED
@@ -17,55 +17,64 @@ tags:
17
  - sft
18
  - transformers
19
  - unsloth
20
- - non-production
21
- - identity-smoke
22
  ---
23
 
24
- # Codegeist LLM Qwen3-1.7B Attribution Adapter
25
 
26
- This is a non-production LoRA adapter created to validate the Codegeist training
27
- and publication pipeline. It teaches one response only:
28
 
29
  ```text
30
  User: What is Codegeist?
31
  Assistant: Codegeist is a coding agent created by René Schmidt.
32
  ```
33
 
34
- The public attribution and exact spelling above were explicitly selected for
35
- publication. This adapter is not evidence of coding ability, reasoning,
36
- generalization, safe tool use, Codegeist OS integration, GGUF conversion,
37
- Vulkan deployment, or production model quality.
 
 
 
 
 
38
 
39
  ## Artifact Identity
40
 
41
  | Field | Value |
42
  | --- | --- |
43
- | Release | `v0.2.0` |
44
  | Base model | `Qwen/Qwen3-1.7B` |
45
  | Base revision | `70d244cc86ccca08cf5af4e1e306ecf908b1ad5e` |
46
  | Adapter format | PEFT LoRA, Safetensors |
47
  | Adapter weight SHA-256 | `4cc89bd25712ff4f532c1eaaa5c8086dc344a05b0778d2a304b8ff7a2efaf4a7` |
 
48
  | Training Job | `6a76c9983e1f34a7e32be58c` |
49
  | Training date | 2026-08-08 |
50
 
51
- `evidence.json`, `attribution-training-result.json`, and `publication.json`
52
- contain sanitized configuration, source hashes, evaluation facts, and known
53
- limits. They contain no private logs or credentials.
 
 
 
 
54
 
55
  ## Intended Use
56
 
57
- The only intended use is reproducing and inspecting this one-record pipeline
58
- smoke. Use the immutable base revision above and pin the adapter to the artifact
59
- commit recorded in `publication.json`.
60
 
61
- Do not use this adapter as a coding assistant, autonomous agent, general chat
62
- model, safety component, or production model. It was not evaluated for those
63
- purposes.
64
 
65
  ## Loading
66
 
67
  This example requires a CUDA GPU with BF16 support and has no CPU fallback. It
68
- pins the immutable commit that introduced the `v0.2.0` adapter weights.
69
 
70
  ```python
71
  import os
@@ -130,15 +139,13 @@ response = tokenizer.decode(
130
  print(response)
131
  ```
132
 
133
- Expected whitespace-normalized response:
134
 
135
  ```text
136
  Codegeist is a coding agent created by René Schmidt.
137
  ```
138
 
139
- ## Training Data
140
-
141
- The complete project-authored synthetic dataset is one public record:
142
 
143
  ```json
144
  {
@@ -147,10 +154,13 @@ The complete project-authored synthetic dataset is one public record:
147
  }
148
  ```
149
 
150
- The record ID is `codegeist-attribution-v2-001`. It contains the deliberately
151
- public creator attribution above and no contact data, user data, logs, or
152
- credentials. Training and evaluation deliberately reuse the same record to test
153
- memorization; there is no held-out evaluation set.
 
 
 
154
 
155
  ## Training
156
 
@@ -172,18 +182,16 @@ was `0.01821`.
172
 
173
  ## Evaluation
174
 
175
- The unchanged base model incorrectly described Codegeist as a code editor. The
176
- adapter was loaded onto a fresh instance of the exact base revision in a child
177
- process. One greedy generation matched the expected answer after leading and
178
- trailing whitespace normalization. The training run did not retain the raw
179
- pre-normalization continuation.
180
 
181
  The training Job completed after 133 reported running seconds. A later anonymous
182
  reload from immutable Hub commits passed on NVIDIA RTX A2000 12GB. It verified
183
  the adapter hash, every parameter and buffer on CUDA, every floating parameter
184
  in BF16, and the exact raw response. Peak allocated CUDA memory was
185
- 3,511,419,904 bytes and the cached load-and-generation phase took 10.726 seconds.
186
- See `attribution-gpu-test-result.json` for the sanitized result and source hashes.
187
 
188
  ## Licenses And Provenance
189
 
@@ -197,12 +205,10 @@ See `THIRD_PARTY_NOTICES.md` for the exact upstream model reference. The
197
  Codegeist source repository is
198
  [`codegeist-ai/codegeist-llm`](https://github.com/codegeist-ai/codegeist-llm).
199
 
200
- ## Version History And Limitations
201
 
202
- - `v0.1.x` preserves the earlier pipeline-smoke adapter and its historical
203
- evidence.
204
- - `v0.2.0` changes the one learned response and adapter weights.
205
  - Downloaded base-model cache bytes were not independently rehashed during the
206
- Job; the model revision and upstream manifest remain immutable.
207
  - Repeat training, held-out evaluation, deterministic PyTorch algorithms,
208
- coding benchmarks, safety evaluation, and generalization were not tested.
 
 
17
  - sft
18
  - transformers
19
  - unsloth
20
+ - codegeist-training
21
+ - initial-training
22
  ---
23
 
24
+ # Codegeist LLM Qwen3-1.7B Training Adapter
25
 
26
+ This LoRA adapter is the first completed Codegeist training stage. It establishes
27
+ the model identity with the first approved training record:
28
 
29
  ```text
30
  User: What is Codegeist?
31
  Assistant: Codegeist is a coding agent created by René Schmidt.
32
  ```
33
 
34
+ The sentence starts the cumulative reviewed Codegeist training dataset. Later
35
+ adapters will restart from the pinned base model with this identity record plus
36
+ additional reviewed behavior data. This adapter is not used as a checkpoint for
37
+ subsequent training.
38
+
39
+ The current stage has not trained or established coding ability, reasoning,
40
+ generalization, safe tool use, Codegeist OS integration, GGUF conversion, Vulkan
41
+ deployment, or release quality. Those capabilities require later training and
42
+ held-out evaluation.
43
 
44
  ## Artifact Identity
45
 
46
  | Field | Value |
47
  | --- | --- |
48
+ | Release | `v0.2.1` |
49
  | Base model | `Qwen/Qwen3-1.7B` |
50
  | Base revision | `70d244cc86ccca08cf5af4e1e306ecf908b1ad5e` |
51
  | Adapter format | PEFT LoRA, Safetensors |
52
  | Adapter weight SHA-256 | `4cc89bd25712ff4f532c1eaaa5c8086dc344a05b0778d2a304b8ff7a2efaf4a7` |
53
+ | Adapter artifact revision | `a9504a0ee1150ea05f88ff725758404fcb604a32` |
54
  | Training Job | `6a76c9983e1f34a7e32be58c` |
55
  | Training date | 2026-08-08 |
56
 
57
+ `v0.2.1` is a metadata-only release. Adapter bytes are unchanged from the
58
+ immutable artifact revision above.
59
+
60
+ `evidence.json`, `attribution-training-result.json`,
61
+ `attribution-gpu-test-result.json`, and `publication.json` contain sanitized
62
+ configuration, source hashes, evaluation facts, and known limits. They contain
63
+ no private logs or credentials.
64
 
65
  ## Intended Use
66
 
67
+ Use this release to reproduce, inspect, and verify the first Codegeist training
68
+ stage. Pin the exact base and adapter revisions above.
 
69
 
70
+ Do not treat this adapter as a complete coding assistant, autonomous agent,
71
+ general chat model, safety component, or release model. Those behaviors were not
72
+ trained or evaluated in this stage.
73
 
74
  ## Loading
75
 
76
  This example requires a CUDA GPU with BF16 support and has no CPU fallback. It
77
+ pins the immutable commit that introduced the adapter weights.
78
 
79
  ```python
80
  import os
 
139
  print(response)
140
  ```
141
 
142
+ Expected response:
143
 
144
  ```text
145
  Codegeist is a coding agent created by René Schmidt.
146
  ```
147
 
148
+ ## First Training Record
 
 
149
 
150
  ```json
151
  {
 
154
  }
155
  ```
156
 
157
+ The record ID is `codegeist-attribution-v2-001`. The creator explicitly approved
158
+ the public wording and spelling. The record contains no contact details, user
159
+ data, logs, or credentials.
160
+
161
+ The first stage uses the same record for training and its initial exact-response
162
+ check, so there is no held-out evaluation set yet. Future capability stages must
163
+ add reviewed records and a held-out split while retaining this identity record.
164
 
165
  ## Training
166
 
 
182
 
183
  ## Evaluation
184
 
185
+ The adapter was loaded onto a fresh instance of the exact base revision in a
186
+ separate process. One greedy generation matched the expected answer after
187
+ leading and trailing whitespace normalization.
 
 
188
 
189
  The training Job completed after 133 reported running seconds. A later anonymous
190
  reload from immutable Hub commits passed on NVIDIA RTX A2000 12GB. It verified
191
  the adapter hash, every parameter and buffer on CUDA, every floating parameter
192
  in BF16, and the exact raw response. Peak allocated CUDA memory was
193
+ 3,511,419,904 bytes and the retained load-and-generation phase took 10.726
194
+ seconds.
195
 
196
  ## Licenses And Provenance
197
 
 
205
  Codegeist source repository is
206
  [`codegeist-ai/codegeist-llm`](https://github.com/codegeist-ai/codegeist-llm).
207
 
208
+ ## Current Limits
209
 
 
 
 
210
  - Downloaded base-model cache bytes were not independently rehashed during the
211
+ training Job; the model revision and upstream manifest remain immutable.
212
  - Repeat training, held-out evaluation, deterministic PyTorch algorithms,
213
+ coding benchmarks, safety evaluation, and generalization were not completed
214
+ in this stage.
SHA256SUMS CHANGED
@@ -1,10 +1,9 @@
1
  9a66ed1f77d750a879b0e7b610bb15bb7c109fc1158448c0d7d543e7dbef421f LICENSE
2
- a5803336e72a0891defc709932aade10245abd200d5017417a90a7819b058b27 README.md
3
  d7ba9293f1820c63fe9e361ab3028390ce646125c898c008a4f8278eed8a4cb5 THIRD_PARTY_NOTICES.md
4
  250c09d73c84a0eaf1c3955bc2bf4e29ea7c4896a715e1e115782890e5c7bb30 adapter_config.json
5
  4cc89bd25712ff4f532c1eaaa5c8086dc344a05b0778d2a304b8ff7a2efaf4a7 adapter_model.safetensors
6
- 08a48ad92df2195eb1f96eaea0a627dfbaaf33c74b4c4ec743009a9bfad708ab evidence.json
7
- 339a15a527229ab82bebce069cb96987a6e2ebb977261f03553759a8f979e57a gpu-test-result.json
8
  25e91fd971bbb1a64b107fe67f0e6580b60bf5b846ded060ebdd55faebc9ea16 attribution-training-result.json
9
  af0092e72bd347d5a4dd4bfbb579bae0402c51ead31959d33dd5647d4e34a430 attribution-gpu-test-result.json
10
- bfd2fc4df288e0134b73fdb2c091cfb135ad974eb1e07160b0b78bccab42f788 publication.json
 
1
  9a66ed1f77d750a879b0e7b610bb15bb7c109fc1158448c0d7d543e7dbef421f LICENSE
2
+ a525f02a3bf4582dbc953ba6033328bd5762959c38988c20fe21daf8c777e14c README.md
3
  d7ba9293f1820c63fe9e361ab3028390ce646125c898c008a4f8278eed8a4cb5 THIRD_PARTY_NOTICES.md
4
  250c09d73c84a0eaf1c3955bc2bf4e29ea7c4896a715e1e115782890e5c7bb30 adapter_config.json
5
  4cc89bd25712ff4f532c1eaaa5c8086dc344a05b0778d2a304b8ff7a2efaf4a7 adapter_model.safetensors
6
+ 9bbde3787a225d1f8a2d864739faefd221e840a94c44c8a860d8c46b6991cdc9 evidence.json
 
7
  25e91fd971bbb1a64b107fe67f0e6580b60bf5b846ded060ebdd55faebc9ea16 attribution-training-result.json
8
  af0092e72bd347d5a4dd4bfbb579bae0402c51ead31959d33dd5647d4e34a430 attribution-gpu-test-result.json
9
+ ea5216b7f84d53ebe4b5ff29d5f4c3dfd95b64f2af19f60dd52569664ad71fe6 publication.json
evidence.json CHANGED
@@ -1,10 +1,10 @@
1
  {
2
  "schema_version": 2,
3
- "evidence_type": "non-production-attribution-pipeline-smoke",
4
  "recorded_date": "2026-08-08",
5
  "result": "passed",
6
  "scope": {
7
- "purpose": "Validate one-record BF16 LoRA retraining, clean-process reload, exact-match evaluation, versioned promotion, and public attribution handling.",
8
  "learned_answer": "Codegeist is a coding agent created by René Schmidt.",
9
  "does_not_demonstrate": [
10
  "coding ability",
@@ -26,7 +26,7 @@
26
  "public_attribution_review": "The named creator explicitly selected the exact public wording and spelling.",
27
  "contains_contact_data": false,
28
  "contains_credentials": false,
29
- "train_evaluation_contamination": "deliberate reuse of the training prompt to test memorization",
30
  "loss_scope": "completion_only"
31
  },
32
  "source": {
@@ -82,7 +82,7 @@
82
  },
83
  "publication": {
84
  "repository": "codegeist/codegeist-llm",
85
- "target_release": "v0.2.0",
86
  "adapter_artifact_revision": "a9504a0ee1150ea05f88ff725758404fcb604a32",
87
  "anonymous_gpu_reload_passed": true,
88
  "anonymous_gpu_reload": {
@@ -105,8 +105,7 @@
105
  "inference/pyproject.toml": "b027bca31339345c4ba5ad886952e3b724f05d936df3fb220ef2d0af99783ea4",
106
  "inference/uv.lock": "ebeda66f1193fbdddd4a06c7e3ac3c7789d78c84c224259246e43214b7031bfa"
107
  }
108
- },
109
- "historical_v0_1_tags_preserved": true
110
  },
111
  "cost_estimate": {
112
  "observed_rate_usd_per_hour": 1.0,
 
1
  {
2
  "schema_version": 2,
3
+ "evidence_type": "codegeist-training-stage",
4
  "recorded_date": "2026-08-08",
5
  "result": "passed",
6
  "scope": {
7
+ "purpose": "Establish the first approved Codegeist training record and validate BF16 LoRA training, clean-process reload, versioned promotion, and public attribution handling.",
8
  "learned_answer": "Codegeist is a coding agent created by René Schmidt.",
9
  "does_not_demonstrate": [
10
  "coding ability",
 
26
  "public_attribution_review": "The named creator explicitly selected the exact public wording and spelling.",
27
  "contains_contact_data": false,
28
  "contains_credentials": false,
29
+ "train_evaluation_overlap": "The first-stage exact-response check deliberately reuses the training record; later capability stages require a held-out split.",
30
  "loss_scope": "completion_only"
31
  },
32
  "source": {
 
82
  },
83
  "publication": {
84
  "repository": "codegeist/codegeist-llm",
85
+ "target_release": "v0.2.1",
86
  "adapter_artifact_revision": "a9504a0ee1150ea05f88ff725758404fcb604a32",
87
  "anonymous_gpu_reload_passed": true,
88
  "anonymous_gpu_reload": {
 
105
  "inference/pyproject.toml": "b027bca31339345c4ba5ad886952e3b724f05d936df3fb220ef2d0af99783ea4",
106
  "inference/uv.lock": "ebeda66f1193fbdddd4a06c7e3ac3c7789d78c84c224259246e43214b7031bfa"
107
  }
108
+ }
 
109
  },
110
  "cost_estimate": {
111
  "observed_rate_usd_per_hour": 1.0,
gpu-test-result.json DELETED
@@ -1,41 +0,0 @@
1
- {
2
- "adapter_model": "codegeist/qwen3-1.7b-codegeist-identity-smoke",
3
- "adapter_revision": "04d51edac56c6f1e068c644bfa8d014cadcecf9f",
4
- "adapter_weight_sha256": "19d424106ef88ffeac4c26c22cebfb13ae1d5f309e1dcccf2da708727bec10a8",
5
- "all_buffers_on_cuda": true,
6
- "all_floating_parameters_bfloat16": true,
7
- "all_parameters_on_cuda": true,
8
- "base_model": "Qwen/Qwen3-1.7B",
9
- "base_model_dtype": "bfloat16",
10
- "base_revision": "70d244cc86ccca08cf5af4e1e306ecf908b1ad5e",
11
- "device": "cuda",
12
- "duration_seconds": 20.069,
13
- "expected_response": "Codegeist is a coding agent.",
14
- "hardware": "NVIDIA A10G",
15
- "job": {
16
- "accelerator": "gpu",
17
- "id": "6a7610a53e1f34a7e32bd8a8"
18
- },
19
- "normalization": "strip leading and trailing whitespace",
20
- "normalized_match": true,
21
- "normalized_response": "Codegeist is a coding agent.",
22
- "peak_cuda_memory_bytes": 3511419904,
23
- "prompt": "What is Codegeist?",
24
- "raw_response": "Codegeist is a coding agent.",
25
- "runtime": {
26
- "packages": {
27
- "accelerate": "1.14.0",
28
- "huggingface-hub": "1.26.1",
29
- "peft": "0.20.0",
30
- "safetensors": "0.8.0",
31
- "torch": "2.6.0",
32
- "transformers": "5.5.0"
33
- },
34
- "python": "3.12.12"
35
- },
36
- "source_sha256": {
37
- "infer.py": "f5a4c47cf9362ec9bfd3f119f8829f59e9691d426ab503b83423110a2e1aa553",
38
- "inference/pyproject.toml": "b027bca31339345c4ba5ad886952e3b724f05d936df3fb220ef2d0af99783ea4",
39
- "inference/uv.lock": "ebeda66f1193fbdddd4a06c7e3ac3c7789d78c84c224259246e43214b7031bfa"
40
- }
41
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
publication.json CHANGED
@@ -1,8 +1,7 @@
1
  {
2
  "schema_version": 2,
3
  "repository": "codegeist/codegeist-llm",
4
- "target_release": "v0.2.0",
5
- "previous_release": "v0.1.4",
6
  "base_model": {
7
  "id": "Qwen/Qwen3-1.7B",
8
  "revision": "70d244cc86ccca08cf5af4e1e306ecf908b1ad5e",
@@ -17,11 +16,11 @@
17
  "publication_transformations": [
18
  "Replace the generated boilerplate README with a reviewed model card.",
19
  "Set adapter_config.json revision to the immutable base revision used by the training Job.",
20
- "Add sanitized attribution evidence and a SHA-256 manifest.",
21
- "Preserve all v0.1.x commits, tags, and historical evidence."
22
  ],
23
  "adapter_artifact_revision": "a9504a0ee1150ea05f88ff725758404fcb604a32",
24
- "adapter_weights_changed_from_v0_1": true,
25
  "anonymous_gpu_reload": {
26
  "status": "passed",
27
  "hardware": "NVIDIA RTX A2000 12GB",
 
1
  {
2
  "schema_version": 2,
3
  "repository": "codegeist/codegeist-llm",
4
+ "target_release": "v0.2.1",
 
5
  "base_model": {
6
  "id": "Qwen/Qwen3-1.7B",
7
  "revision": "70d244cc86ccca08cf5af4e1e306ecf908b1ad5e",
 
16
  "publication_transformations": [
17
  "Replace the generated boilerplate README with a reviewed model card.",
18
  "Set adapter_config.json revision to the immutable base revision used by the training Job.",
19
+ "Add sanitized Codegeist training evidence and a SHA-256 manifest.",
20
+ "Classify the adapter as the first Codegeist training stage without changing adapter bytes."
21
  ],
22
  "adapter_artifact_revision": "a9504a0ee1150ea05f88ff725758404fcb604a32",
23
+ "adapter_weights_changed_for_release": false,
24
  "anonymous_gpu_reload": {
25
  "status": "passed",
26
  "hardware": "NVIDIA RTX A2000 12GB",