Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,62 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
pipeline_tag: text-generation
|
| 6 |
+
library_name: transformers
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
_The **C**ode **R**easoning **E**pert (for) **P**roject **E**xploration_
|
| 12 |
+
|
| 13 |
+
# The GRaPE Family
|
| 14 |
+
| Attribute | Size | Modalities | Domain |
|
| 15 |
+
| :--- | :--- | :--- | :--- |
|
| 16 |
+
| **CRePE Mini** | 3B | Text + Image + Video in, Text out | FIM / Autocomplete |
|
| 17 |
+
|
| 18 |
+
***
|
| 19 |
+
|
| 20 |
+
# Capabilities
|
| 21 |
+
|
| 22 |
+
CRePE Mini was trained on a massive corpus of code samples, from The Trellis to other open datasets.
|
| 23 |
+
|
| 24 |
+
This model is built for code *assistance,* not agentic coding. Capable of FIM tasks, light code review, and making smaller utility files
|
| 25 |
+
|
| 26 |
+
***
|
| 27 |
+
|
| 28 |
+
# How to Run
|
| 29 |
+
|
| 30 |
+
I recommend using **LM Studio** for running GRaPE / CRePE Models, and have generally found these sampling parameters to work best:
|
| 31 |
+
|
| 32 |
+
| Name | Value |
|
| 33 |
+
| :--- | :--- |
|
| 34 |
+
| **Temperature** | 0.6 |
|
| 35 |
+
| **Top K Sampling** | 40 |
|
| 36 |
+
| **Repeat Penalty** | 1 |
|
| 37 |
+
| **Top P Sampling** | 0.85 |
|
| 38 |
+
| **Min P Sampling** | 0.05 |
|
| 39 |
+
|
| 40 |
+
***
|
| 41 |
+
|
| 42 |
+
# GRaPE Mini as a Model
|
| 43 |
+
|
| 44 |
+
CRePE Mini is more an experiment than anything. This model was trained on The Trellis dataset for code samples, and all code examples from the GRaPE Instruct dataset. And thus has become an apt coder for light tasks. It is in no way designed to replace coders, only to empower them.
|
| 45 |
+
|
| 46 |
+
***
|
| 47 |
+
|
| 48 |
+
# Architecture
|
| 49 |
+
|
| 50 |
+
* CRePE Mini: Built on the GRaPE Mini's architecture
|
| 51 |
+
|
| 52 |
+
***
|
| 53 |
+
|
| 54 |
+
# Notes
|
| 55 |
+
|
| 56 |
+
The GRaPE Family started all the way back in August of 2025, meaning these models are severely out of date on architecture, and training data.
|
| 57 |
+
|
| 58 |
+
GRaPE 2 will come sooner than the GRaPE 1 family had, and will show multiple improvements.
|
| 59 |
+
|
| 60 |
+
There are no benchmarks for GRaPE 1 Models due to the costly nature of running them, as well as prioritization of newer models.
|
| 61 |
+
|
| 62 |
+
Updates for GRaPE 2 models will be posted here on Huggingface, as well as [Skinnertopia](https://www.skinnertopia.com/)
|