Hugging Face's logo

AMFORGE
/
cofos

Text Generation
Rust
English
code-generation
documentation
text-to-code
python
javascript
sparse-transformer
Model card Files
xet
 Community
2
ameforge commited on
Commit
e1eca27
·
verified ·
1 Parent(s): e9fc0dc

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -23,7 +23,7 @@ Developed by **AMEFORGE**.
23
 
24
  ## Architecture & Parameters
25
  - **Architecture:** SparseMind v15 (dynamic neural type management, sparse attention, and sparse FFN)
26
- - **Parameters:** 34,887,172
27
  - **Hidden dimension:** 384
28
  - **Layers:** 8
29
  - **Context length:** 512 tokens
@@ -32,7 +32,7 @@ Developed by **AMEFORGE**.
32
  ## Training Details
33
  - Trained on **30,000,000+** procedurally generated programming templates on-the-fly.
34
  - Masked loss to learn code completion and documentation formatting.
35
- - Best Python syntax-validity on held-out validation: 3.8%
36
 
37
  ## How to use
38
  ```python
 
23
 
24
  ## Architecture & Parameters
25
  - **Architecture:** SparseMind v15 (dynamic neural type management, sparse attention, and sparse FFN)
26
+ - **Parameters:** 36,824,070
27
  - **Hidden dimension:** 384
28
  - **Layers:** 8
29
  - **Context length:** 512 tokens
 
32
  ## Training Details
33
  - Trained on **30,000,000+** procedurally generated programming templates on-the-fly.
34
  - Masked loss to learn code completion and documentation formatting.
35
+ - Best Python syntax-validity on held-out validation: 8.8%
36
 
37
  ## How to use
38
  ```python