devops-thiago commited on
Commit
be55743
·
verified ·
1 Parent(s): 41abd2f

Add standalone model card

Browse files
Files changed (1) hide show
  1. README.md +14 -7
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- base_model: google/gemma-4-E2B-it
4
  tags:
5
  - decision-model
6
  - system-1
@@ -24,12 +24,19 @@ Measured on **NVIDIA GeForce RTX 5060 Ti** (CUDA, float16), 30 iterations after
24
 
25
  | Metric | ClassOne (Single-Pass) | Autoregressive (50 tokens) |
26
  |---|---|---|
27
- | Mean Latency | **64.62 ms** | 845.77 ms |
28
- | P50 (Median) | **64.95 ms** | 844.45 ms |
29
- | P95 Latency | **65.66 ms** | 861.20 ms |
30
- | Throughput | **15.5 req/s** | 1.2 req/s |
31
  | Output Tokens | **0** | 50 |
32
- | **Speedup** | **13.1× faster** | — |
 
 
 
 
 
 
 
33
 
34
  ## Decision Primitives
35
 
@@ -119,5 +126,5 @@ print("Anger score: ", results["anger"].score)
119
 
120
  ## Attribution & Legal
121
 
122
- - Derived from [google/gemma-4-E2B-it](https://huggingface.co/google/gemma-4-E2B-it) (Google) — Apache License 2.0
123
  - Architecture & training code: [devops-thiago/class-one](https://github.com/devops-thiago/class-one) — Apache 2.0
 
1
  ---
2
  license: apache-2.0
3
+ base_model: google/gemma-4-e2b-it
4
  tags:
5
  - decision-model
6
  - system-1
 
24
 
25
  | Metric | ClassOne (Single-Pass) | Autoregressive (50 tokens) |
26
  |---|---|---|
27
+ | Mean Latency | **47.07 ms** | 1,048.57 ms |
28
+ | P50 (Median) | **46.96 ms** | 1,047.23 ms |
29
+ | P95 Latency | **48.79 ms** | 1,062.45 ms |
30
+ | Throughput | **21.2 req/s** | 1.0 req/s |
31
  | Output Tokens | **0** | 50 |
32
+ | **Speedup** | **22.3× faster** | — |
33
+
34
+ ### Edge vs Cloud Latency (ClassOne vs TypeSafe Jev API)
35
+
36
+ Measured against TypeSafe AI's Jev (v1.13) cloud API:
37
+ - **ClassOne (Local RTX 5060 Ti):** **52.49 ms** mean latency (19.1 req/s, $0.00 inference cost, 100% private)
38
+ - **TypeSafe Jev (Cloud API):** **329.90 ms** mean latency (3.0 req/s)
39
+ - **Edge Speedup:** **6.3× faster** than cloud API round-trip latency
40
 
41
  ## Decision Primitives
42
 
 
126
 
127
  ## Attribution & Legal
128
 
129
+ - Derived from [google/gemma-4-e2b-it](https://huggingface.co/google/gemma-4-e2b-it) (Google) — Apache License 2.0
130
  - Architecture & training code: [devops-thiago/class-one](https://github.com/devops-thiago/class-one) — Apache 2.0