Instructions to use HopitAI/hopper-g with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use HopitAI/hopper-g with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-4B") model = PeftModel.from_pretrained(base_model, "HopitAI/hopper-g") - Notebooks
- Google Colab
- Kaggle
Card: official leaderboard results on JevBench and the Jev Decision Index, and links between Hopper and Hopper (G); weights unchanged
Browse files
README.md
CHANGED
|
@@ -25,6 +25,20 @@ LLM-based generation. Do not use it commercially.
|
|
| 25 |
- Serving: identical to Hopper 1.1.1, including the calibration map and the long-menu shortlist (more than 26
|
| 26 |
options answered in two disclosed stages).
|
| 27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
## Evaluation (our runs)
|
| 29 |
|
| 30 |
On our local run of the Decision Index 0.2 suite (40 benchmarks, A10G, same serving code, only the adapter
|
|
|
|
| 25 |
- Serving: identical to Hopper 1.1.1, including the calibration map and the long-menu shortlist (more than 26
|
| 26 |
options answered in two disclosed stages).
|
| 27 |
|
| 28 |
+
## Leaderboards (official)
|
| 29 |
+
|
| 30 |
+
- **[Jev Decision Index](https://huggingface.co/spaces/multimodalart/jev-decision-index)** (edition 0.2.1,
|
| 31 |
+
27 Sep 2026): **40.77, #16 of 68**, the highest of the 4B models (Decider 4B: 40.70). The row comes from a
|
| 32 |
+
complete run of the suite that we scored ourselves with the Index kit, at the maintainer's request. The model
|
| 33 |
+
outputs and scores are public at
|
| 34 |
+
[`HopitAI/hopper-g-decision-index-results`](https://huggingface.co/datasets/HopitAI/hopper-g-decision-index-results).
|
| 35 |
+
It replaced the Hopper 1.1.1 row (39.67).
|
| 36 |
+
- **[JevBench](https://benchmarkheaven.com/jev-models)**: requested as a separate row
|
| 37 |
+
([issue #112](https://github.com/fstandhartinger/jevbench/issues/112)), not yet measured. Our own development check
|
| 38 |
+
on held-out JevBench-style items (not an official score) put it level with Hopper 1.0 (+0.7 points, within noise),
|
| 39 |
+
so we make no JevBench improvement claim. Hopper 1.0's official JevBench result is 59.43, #6 of 90 ranked
|
| 40 |
+
(v1.4.2.1, 27 Sep 2026).
|
| 41 |
+
|
| 42 |
## Evaluation (our runs)
|
| 43 |
|
| 44 |
On our local run of the Decision Index 0.2 suite (40 benchmarks, A10G, same serving code, only the adapter
|