ArkidMitra commited on
Commit
71d991f
·
verified ·
1 Parent(s): 060b1bd

Card: official leaderboard results on JevBench and the Jev Decision Index, and links between Hopper and Hopper (G); weights unchanged

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -25,6 +25,20 @@ LLM-based generation. Do not use it commercially.
25
  - Serving: identical to Hopper 1.1.1, including the calibration map and the long-menu shortlist (more than 26
26
  options answered in two disclosed stages).
27
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
  ## Evaluation (our runs)
29
 
30
  On our local run of the Decision Index 0.2 suite (40 benchmarks, A10G, same serving code, only the adapter
 
25
  - Serving: identical to Hopper 1.1.1, including the calibration map and the long-menu shortlist (more than 26
26
  options answered in two disclosed stages).
27
 
28
+ ## Leaderboards (official)
29
+
30
+ - **[Jev Decision Index](https://huggingface.co/spaces/multimodalart/jev-decision-index)** (edition 0.2.1,
31
+ 27 Sep 2026): **40.77, #16 of 68**, the highest of the 4B models (Decider 4B: 40.70). The row comes from a
32
+ complete run of the suite that we scored ourselves with the Index kit, at the maintainer's request. The model
33
+ outputs and scores are public at
34
+ [`HopitAI/hopper-g-decision-index-results`](https://huggingface.co/datasets/HopitAI/hopper-g-decision-index-results).
35
+ It replaced the Hopper 1.1.1 row (39.67).
36
+ - **[JevBench](https://benchmarkheaven.com/jev-models)**: requested as a separate row
37
+ ([issue #112](https://github.com/fstandhartinger/jevbench/issues/112)), not yet measured. Our own development check
38
+ on held-out JevBench-style items (not an official score) put it level with Hopper 1.0 (+0.7 points, within noise),
39
+ so we make no JevBench improvement claim. Hopper 1.0's official JevBench result is 59.43, #6 of 90 ranked
40
+ (v1.4.2.1, 27 Sep 2026).
41
+
42
  ## Evaluation (our runs)
43
 
44
  On our local run of the Decision Index 0.2 suite (40 benchmarks, A10G, same serving code, only the adapter