Working install instructions; decode-loop diagram
Browse files
README.md
CHANGED
|
@@ -163,8 +163,11 @@ failure is diagnosed with both models' tables published in
|
|
| 163 |
|
| 164 |
```bash
|
| 165 |
git clone https://github.com/nikshepsvn/thimble && cd thimble
|
| 166 |
-
uv venv && uv pip install -e .
|
| 167 |
-
|
|
|
|
|
|
|
|
|
|
| 168 |
|
| 169 |
# where do you stand on your own tools?
|
| 170 |
python scripts/eval_catalog.py --ckpt thimble-v6 \
|
|
@@ -215,7 +218,34 @@ not for tokens it will never emit.
|
|
| 215 |
|
| 216 |
**The decoder consults the model only at those points.** Everything else is
|
| 217 |
determined before it runs, which is where the contract above comes
|
| 218 |
-
from.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 219 |
|
| 220 |
### Evidence the co-design works
|
| 221 |
|
|
@@ -341,8 +371,11 @@ The guarantees live in the decoding harness, so inference goes through the repo:
|
|
| 341 |
|
| 342 |
```bash
|
| 343 |
git clone https://github.com/nikshepsvn/thimble
|
| 344 |
-
cd thimble && uv venv && uv pip install -e .
|
| 345 |
-
|
|
|
|
|
|
|
|
|
|
| 346 |
|
| 347 |
python demo.py "make a reservation at Nobu for 2 people at 7pm and text Sam saying dinner is on"
|
| 348 |
# [{"name": "createReservation",
|
|
|
|
| 163 |
|
| 164 |
```bash
|
| 165 |
git clone https://github.com/nikshepsvn/thimble && cd thimble
|
| 166 |
+
uv venv && uv pip install -e ".[hub]"
|
| 167 |
+
|
| 168 |
+
# both files come from this repo; neither is in git
|
| 169 |
+
hf download flashvenom/thimble thimble-v6.pt --local-dir checkpoints/
|
| 170 |
+
hf download flashvenom/thimble tokenizer.json --local-dir data/
|
| 171 |
|
| 172 |
# where do you stand on your own tools?
|
| 173 |
python scripts/eval_catalog.py --ckpt thimble-v6 \
|
|
|
|
| 218 |
|
| 219 |
**The decoder consults the model only at those points.** Everything else is
|
| 220 |
determined before it runs, which is where the contract above comes
|
| 221 |
+
from. One call, start to finish β `MODEL` marks the only places the network is
|
| 222 |
+
asked anything:
|
| 223 |
+
|
| 224 |
+
```
|
| 225 |
+
[ <- grammar
|
| 226 |
+
ββ ? refuse or call ...................... MODEL
|
| 227 |
+
β
|
| 228 |
+
ββ refuse βββββββββββββββΊ ] <- grammar
|
| 229 |
+
β
|
| 230 |
+
ββ call
|
| 231 |
+
{"name":" <- grammar
|
| 232 |
+
ββ ? which tool .................. MODEL
|
| 233 |
+
","arguments":{ <- grammar
|
| 234 |
+
β
|
| 235 |
+
ββ next key from YOUR schema <- grammar
|
| 236 |
+
β ββ ? include it ........... MODEL
|
| 237 |
+
β ββ ? what value ........... MODEL
|
| 238 |
+
β (repeat for each key)
|
| 239 |
+
β
|
| 240 |
+
}} <- grammar
|
| 241 |
+
ββ ? stop or continue ........ MODEL
|
| 242 |
+
ββ continue βββΊ back to {"name":"
|
| 243 |
+
ββ stop βββββββΊ ] <- grammar
|
| 244 |
+
```
|
| 245 |
+
|
| 246 |
+
Every `<- grammar` line is emitted without consulting the model at all. Argument
|
| 247 |
+
keys are iterated from your schema, which is why inventing one is not a
|
| 248 |
+
low-probability event β there is no step at which it could happen.
|
| 249 |
|
| 250 |
### Evidence the co-design works
|
| 251 |
|
|
|
|
| 371 |
|
| 372 |
```bash
|
| 373 |
git clone https://github.com/nikshepsvn/thimble
|
| 374 |
+
cd thimble && uv venv && uv pip install -e ".[hub]"
|
| 375 |
+
|
| 376 |
+
# both files come from this repo; neither is in git
|
| 377 |
+
hf download flashvenom/thimble thimble-v6.pt --local-dir checkpoints/
|
| 378 |
+
hf download flashvenom/thimble tokenizer.json --local-dir data/
|
| 379 |
|
| 380 |
python demo.py "make a reservation at Nobu for 2 people at 7pm and text Sam saying dinner is on"
|
| 381 |
# [{"name": "createReservation",
|