HungryTorch commited on
Commit
bce9e42
·
verified ·
1 Parent(s): 6fbeb8c

fix(primo): preserve legacy leaderboard history

Browse files
Files changed (2) hide show
  1. README.md +2 -2
  2. evaluator.py +2 -1
README.md CHANGED
@@ -134,8 +134,8 @@ pushed by `benchmark/public_benchmark/baselines.py --score --publish`.
134
  - Set an **`HF_TOKEN`** Space secret (fine-grained) with: **read** on
135
  `PRIMOmics/primo` (the public `datasets.yaml` manifest) and
136
  `PRIMOmics/primo-labels` (the private `tasks.yaml` registry +
137
- `<task_id>/labels.csv`), and **write** on `PRIMOmics/primo-results` (the
138
- persisted leaderboard).
139
  - Results persist as one normalized `task_results.csv` (`model_name, task_id,
140
  score, submitted_at, is_baseline, hf_username`) in the results dataset; the
141
  leaderboard is recomputed from it by joining the registry, so it survives
 
134
  - Set an **`HF_TOKEN`** Space secret (fine-grained) with: **read** on
135
  `PRIMOmics/primo` (the public `datasets.yaml` manifest) and
136
  `PRIMOmics/primo-labels` (the private `tasks.yaml` registry +
137
+ `<task_id>/labels.csv`), and **read + write** on
138
+ `ScientaLab/primo-results` (the persisted leaderboard).
139
  - Results persist as one normalized `task_results.csv` (`model_name, task_id,
140
  score, submitted_at, is_baseline, hf_username`) in the results dataset; the
141
  leaderboard is recomputed from it by joining the registry, so it survives
evaluator.py CHANGED
@@ -49,7 +49,8 @@ SPLIT_TEST = "test"
49
  ORG = "PRIMOmics"
50
  PUBLIC_REPO = f"{ORG}/primo"
51
  LABELS_REPO = f"{ORG}/primo-labels"
52
- RESULTS_REPO = f"{ORG}/primo-results"
 
53
  MANIFEST_FILENAME = "datasets.yaml"
54
  TASKS_FILENAME = "tasks.yaml"
55
  LABELS_FILENAME = "labels.csv"
 
49
  ORG = "PRIMOmics"
50
  PUBLIC_REPO = f"{ORG}/primo"
51
  LABELS_REPO = f"{ORG}/primo-labels"
52
+ # Keep the established leaderboard history available until it is migrated.
53
+ RESULTS_REPO = "ScientaLab/primo-results"
54
  MANIFEST_FILENAME = "datasets.yaml"
55
  TASKS_FILENAME = "tasks.yaml"
56
  LABELS_FILENAME = "labels.csv"