Upload folder using huggingface_hub
Browse files- index.html +7 -16
index.html
CHANGED
|
@@ -59,8 +59,8 @@
|
|
| 59 |
<div class="metric-sub">Across both closed-set and open-set tool planning scenarios</div>
|
| 60 |
</div>
|
| 61 |
<div class="metric-card">
|
| 62 |
-
<div class="metric-value">
|
| 63 |
-
<div class="metric-label">State-of-the-art
|
| 64 |
<div class="metric-sub">GTA · m&m · ToolBench · RestBench</div>
|
| 65 |
</div>
|
| 66 |
<div class="metric-card">
|
|
@@ -118,10 +118,11 @@
|
|
| 118 |
</figure>
|
| 119 |
|
| 120 |
<figure class="paper-figure reveal">
|
| 121 |
-
<img src="static/paper/
|
| 122 |
-
<figcaption>
|
| 123 |
-
tool call
|
| 124 |
-
trajectory is selected as the final plan.
|
|
|
|
| 125 |
</figure>
|
| 126 |
|
| 127 |
<div class="mech-grid mech-grid-4 reveal stagger">
|
|
@@ -166,16 +167,6 @@
|
|
| 166 |
<div class="container">
|
| 167 |
<h2>Case Study</h2>
|
| 168 |
<span class="band-label">Qualitative case studies from the paper</span>
|
| 169 |
-
<div class="case-figure reveal">
|
| 170 |
-
<img src="static/paper/case_study.png" alt="Iterative inferencing on a road-sign query asking for the distance in miles: early iterations read the kilometre figure off the sign and return it unchanged for a low post-evaluation reward; later iterations add retrieval and unit-conversion tools, the reward rises, and the final iteration answers in miles.">
|
| 171 |
-
</div>
|
| 172 |
-
<p class="case-text reveal">
|
| 173 |
-
The query asks how many <em>miles</em> the journey is, while the road sign in the image gives the
|
| 174 |
-
distance in kilometres. In early iterations the agent simply reads the kilometre figure off the
|
| 175 |
-
sign and returns it unchanged, earning a low post-evaluation reward. Across later iterations the
|
| 176 |
-
search brings in retrieval and unit-conversion tools, the post-evaluation reward rises, and the
|
| 177 |
-
final trajectory converts the distance and answers in miles.
|
| 178 |
-
</p>
|
| 179 |
<figure class="paper-figure reveal">
|
| 180 |
<div class="figure-stack">
|
| 181 |
<img src="static/paper/case_study_medical.png" alt="Case study (a): a radiology image question about lung cancer risk — greedy search relies on generic image captioning and heuristic search on shallow heuristics, both missing the finding, while the MCTS-planned trajectory orchestrates domain-specific imaging tools and detects the risk.">
|
|
|
|
| 59 |
<div class="metric-sub">Across both closed-set and open-set tool planning scenarios</div>
|
| 60 |
</div>
|
| 61 |
<div class="metric-card">
|
| 62 |
+
<div class="metric-value">4 / 4</div>
|
| 63 |
+
<div class="metric-label">State-of-the-art on all four benchmarks</div>
|
| 64 |
<div class="metric-sub">GTA · m&m · ToolBench · RestBench</div>
|
| 65 |
</div>
|
| 66 |
<div class="metric-card">
|
|
|
|
| 118 |
</figure>
|
| 119 |
|
| 120 |
<figure class="paper-figure reveal">
|
| 121 |
+
<a href="static/paper/case3_tree.svg" target="_blank" rel="noopener"><img src="static/paper/case3_tree.svg" width="1680" height="1500" alt="Search tree reconstructed from a logged 11-rollout run: from the user query on the left, candidate tool calls branch rightward with pre- and post-evaluation score badges; pre-pruned drafts are dashed with a cross, a failed call is post-pruned in red, duplicate drafts are shown as skipped, and the bold path leads to the final answer bar."></a>
|
| 122 |
+
<figcaption>Search over tool-call trajectories on a real logged run (11 rollouts): each node is a
|
| 123 |
+
candidate tool call with its pre-/post-evaluation scores, pruned and duplicate drafts are shown
|
| 124 |
+
as encountered, and the highest-reward trajectory (bold) is selected as the final plan.
|
| 125 |
+
Click to view full size.</figcaption>
|
| 126 |
</figure>
|
| 127 |
|
| 128 |
<div class="mech-grid mech-grid-4 reveal stagger">
|
|
|
|
| 167 |
<div class="container">
|
| 168 |
<h2>Case Study</h2>
|
| 169 |
<span class="band-label">Qualitative case studies from the paper</span>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 170 |
<figure class="paper-figure reveal">
|
| 171 |
<div class="figure-stack">
|
| 172 |
<img src="static/paper/case_study_medical.png" alt="Case study (a): a radiology image question about lung cancer risk — greedy search relies on generic image captioning and heuristic search on shallow heuristics, both missing the finding, while the MCTS-planned trajectory orchestrates domain-specific imaging tools and detects the risk.">
|