zli12321 commited on
Commit
5e69918
·
verified ·
1 Parent(s): 98e20d0

Add lhtb_solved result (3/46) as a new file; leave lhtb.yaml untouched

Browse files
.eval_results/lhtb.yaml CHANGED
@@ -1,9 +1,9 @@
1
  - dataset:
2
  id: IntelligenceLab/Long-Horizon-Terminal-Bench
3
- task_id: lhtb_solved
4
- value: 3
5
  date: '2026-07-16'
6
  source:
7
  url: https://zli12321.github.io/LHTB/leaderboard.html
8
  name: LHTB leaderboard
9
- notes: "3/46 tasks solved at reward >= 0.95 (pass@0.95); mean reward x100 = 38.5; official LHTB Harbor harness"
 
1
  - dataset:
2
  id: IntelligenceLab/Long-Horizon-Terminal-Bench
3
+ task_id: lhtb
4
+ value: 38.5
5
  date: '2026-07-16'
6
  source:
7
  url: https://zli12321.github.io/LHTB/leaderboard.html
8
  name: LHTB leaderboard
9
+ notes: "mean reward x100 over 46 tasks (partial credit); solved@0.95=3/46; official LHTB Harbor harness"
.eval_results/lhtb_solved.yaml ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: IntelligenceLab/Long-Horizon-Terminal-Bench
3
+ task_id: lhtb_solved
4
+ value: 3
5
+ date: '2026-07-16'
6
+ source:
7
+ url: https://zli12321.github.io/LHTB/leaderboard.html
8
+ name: LHTB leaderboard
9
+ notes: "3/46 tasks solved at reward >= 0.95 (pass@0.95); mean reward x100 = 38.5; official LHTB Harbor harness"