Spaces:
Running
Running
fix(primo): preserve legacy leaderboard history
Browse files- README.md +2 -2
- evaluator.py +2 -1
README.md
CHANGED
|
@@ -134,8 +134,8 @@ pushed by `benchmark/public_benchmark/baselines.py --score --publish`.
|
|
| 134 |
- Set an **`HF_TOKEN`** Space secret (fine-grained) with: **read** on
|
| 135 |
`PRIMOmics/primo` (the public `datasets.yaml` manifest) and
|
| 136 |
`PRIMOmics/primo-labels` (the private `tasks.yaml` registry +
|
| 137 |
-
`<task_id>/labels.csv`), and **write** on
|
| 138 |
-
persisted leaderboard).
|
| 139 |
- Results persist as one normalized `task_results.csv` (`model_name, task_id,
|
| 140 |
score, submitted_at, is_baseline, hf_username`) in the results dataset; the
|
| 141 |
leaderboard is recomputed from it by joining the registry, so it survives
|
|
|
|
| 134 |
- Set an **`HF_TOKEN`** Space secret (fine-grained) with: **read** on
|
| 135 |
`PRIMOmics/primo` (the public `datasets.yaml` manifest) and
|
| 136 |
`PRIMOmics/primo-labels` (the private `tasks.yaml` registry +
|
| 137 |
+
`<task_id>/labels.csv`), and **read + write** on
|
| 138 |
+
`ScientaLab/primo-results` (the persisted leaderboard).
|
| 139 |
- Results persist as one normalized `task_results.csv` (`model_name, task_id,
|
| 140 |
score, submitted_at, is_baseline, hf_username`) in the results dataset; the
|
| 141 |
leaderboard is recomputed from it by joining the registry, so it survives
|
evaluator.py
CHANGED
|
@@ -49,7 +49,8 @@ SPLIT_TEST = "test"
|
|
| 49 |
ORG = "PRIMOmics"
|
| 50 |
PUBLIC_REPO = f"{ORG}/primo"
|
| 51 |
LABELS_REPO = f"{ORG}/primo-labels"
|
| 52 |
-
|
|
|
|
| 53 |
MANIFEST_FILENAME = "datasets.yaml"
|
| 54 |
TASKS_FILENAME = "tasks.yaml"
|
| 55 |
LABELS_FILENAME = "labels.csv"
|
|
|
|
| 49 |
ORG = "PRIMOmics"
|
| 50 |
PUBLIC_REPO = f"{ORG}/primo"
|
| 51 |
LABELS_REPO = f"{ORG}/primo-labels"
|
| 52 |
+
# Keep the established leaderboard history available until it is migrated.
|
| 53 |
+
RESULTS_REPO = "ScientaLab/primo-results"
|
| 54 |
MANIFEST_FILENAME = "datasets.yaml"
|
| 55 |
TASKS_FILENAME = "tasks.yaml"
|
| 56 |
LABELS_FILENAME = "labels.csv"
|