Add standalone model card
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
-
base_model: google/gemma-4-
|
| 4 |
tags:
|
| 5 |
- decision-model
|
| 6 |
- system-1
|
|
@@ -24,12 +24,19 @@ Measured on **NVIDIA GeForce RTX 5060 Ti** (CUDA, float16), 30 iterations after
|
|
| 24 |
|
| 25 |
| Metric | ClassOne (Single-Pass) | Autoregressive (50 tokens) |
|
| 26 |
|---|---|---|
|
| 27 |
-
| Mean Latency | **
|
| 28 |
-
| P50 (Median) | **
|
| 29 |
-
| P95 Latency | **
|
| 30 |
-
| Throughput | **
|
| 31 |
| Output Tokens | **0** | 50 |
|
| 32 |
-
| **Speedup** | **
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
## Decision Primitives
|
| 35 |
|
|
@@ -119,5 +126,5 @@ print("Anger score: ", results["anger"].score)
|
|
| 119 |
|
| 120 |
## Attribution & Legal
|
| 121 |
|
| 122 |
-
- Derived from [google/gemma-4-
|
| 123 |
- Architecture & training code: [devops-thiago/class-one](https://github.com/devops-thiago/class-one) — Apache 2.0
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
base_model: google/gemma-4-e2b-it
|
| 4 |
tags:
|
| 5 |
- decision-model
|
| 6 |
- system-1
|
|
|
|
| 24 |
|
| 25 |
| Metric | ClassOne (Single-Pass) | Autoregressive (50 tokens) |
|
| 26 |
|---|---|---|
|
| 27 |
+
| Mean Latency | **47.07 ms** | 1,048.57 ms |
|
| 28 |
+
| P50 (Median) | **46.96 ms** | 1,047.23 ms |
|
| 29 |
+
| P95 Latency | **48.79 ms** | 1,062.45 ms |
|
| 30 |
+
| Throughput | **21.2 req/s** | 1.0 req/s |
|
| 31 |
| Output Tokens | **0** | 50 |
|
| 32 |
+
| **Speedup** | **22.3× faster** | — |
|
| 33 |
+
|
| 34 |
+
### Edge vs Cloud Latency (ClassOne vs TypeSafe Jev API)
|
| 35 |
+
|
| 36 |
+
Measured against TypeSafe AI's Jev (v1.13) cloud API:
|
| 37 |
+
- **ClassOne (Local RTX 5060 Ti):** **52.49 ms** mean latency (19.1 req/s, $0.00 inference cost, 100% private)
|
| 38 |
+
- **TypeSafe Jev (Cloud API):** **329.90 ms** mean latency (3.0 req/s)
|
| 39 |
+
- **Edge Speedup:** **6.3× faster** than cloud API round-trip latency
|
| 40 |
|
| 41 |
## Decision Primitives
|
| 42 |
|
|
|
|
| 126 |
|
| 127 |
## Attribution & Legal
|
| 128 |
|
| 129 |
+
- Derived from [google/gemma-4-e2b-it](https://huggingface.co/google/gemma-4-e2b-it) (Google) — Apache License 2.0
|
| 130 |
- Architecture & training code: [devops-thiago/class-one](https://github.com/devops-thiago/class-one) — Apache 2.0
|