flashvenom commited on
Commit
d6a89c2
Β·
verified Β·
1 Parent(s): 81c08e1

Working install instructions; decode-loop diagram

Browse files
Files changed (1) hide show
  1. README.md +38 -5
README.md CHANGED
@@ -163,8 +163,11 @@ failure is diagnosed with both models' tables published in
163
 
164
  ```bash
165
  git clone https://github.com/nikshepsvn/thimble && cd thimble
166
- uv venv && uv pip install -e .
167
- # put thimble-v6.pt in checkpoints/, tokenizer.json in data/
 
 
 
168
 
169
  # where do you stand on your own tools?
170
  python scripts/eval_catalog.py --ckpt thimble-v6 \
@@ -215,7 +218,34 @@ not for tokens it will never emit.
215
 
216
  **The decoder consults the model only at those points.** Everything else is
217
  determined before it runs, which is where the contract above comes
218
- from.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
219
 
220
  ### Evidence the co-design works
221
 
@@ -341,8 +371,11 @@ The guarantees live in the decoding harness, so inference goes through the repo:
341
 
342
  ```bash
343
  git clone https://github.com/nikshepsvn/thimble
344
- cd thimble && uv venv && uv pip install -e .
345
- # put thimble-v6.pt in checkpoints/, tokenizer.json in data/
 
 
 
346
 
347
  python demo.py "make a reservation at Nobu for 2 people at 7pm and text Sam saying dinner is on"
348
  # [{"name": "createReservation",
 
163
 
164
  ```bash
165
  git clone https://github.com/nikshepsvn/thimble && cd thimble
166
+ uv venv && uv pip install -e ".[hub]"
167
+
168
+ # both files come from this repo; neither is in git
169
+ hf download flashvenom/thimble thimble-v6.pt --local-dir checkpoints/
170
+ hf download flashvenom/thimble tokenizer.json --local-dir data/
171
 
172
  # where do you stand on your own tools?
173
  python scripts/eval_catalog.py --ckpt thimble-v6 \
 
218
 
219
  **The decoder consults the model only at those points.** Everything else is
220
  determined before it runs, which is where the contract above comes
221
+ from. One call, start to finish β€” `MODEL` marks the only places the network is
222
+ asked anything:
223
+
224
+ ```
225
+ [ <- grammar
226
+ └─ ? refuse or call ...................... MODEL
227
+ β”‚
228
+ β”œβ”€ refuse ──────────────► ] <- grammar
229
+ β”‚
230
+ └─ call
231
+ {"name":" <- grammar
232
+ └─ ? which tool .................. MODEL
233
+ ","arguments":{ <- grammar
234
+ β”‚
235
+ β”œβ”€ next key from YOUR schema <- grammar
236
+ β”‚ β”œβ”€ ? include it ........... MODEL
237
+ β”‚ └─ ? what value ........... MODEL
238
+ β”‚ (repeat for each key)
239
+ β”‚
240
+ }} <- grammar
241
+ └─ ? stop or continue ........ MODEL
242
+ β”œβ”€ continue ──► back to {"name":"
243
+ └─ stop ──────► ] <- grammar
244
+ ```
245
+
246
+ Every `<- grammar` line is emitted without consulting the model at all. Argument
247
+ keys are iterated from your schema, which is why inventing one is not a
248
+ low-probability event β€” there is no step at which it could happen.
249
 
250
  ### Evidence the co-design works
251
 
 
371
 
372
  ```bash
373
  git clone https://github.com/nikshepsvn/thimble
374
+ cd thimble && uv venv && uv pip install -e ".[hub]"
375
+
376
+ # both files come from this repo; neither is in git
377
+ hf download flashvenom/thimble thimble-v6.pt --local-dir checkpoints/
378
+ hf download flashvenom/thimble tokenizer.json --local-dir data/
379
 
380
  python demo.py "make a reservation at Nobu for 2 people at 7pm and text Sam saying dinner is on"
381
  # [{"name": "createReservation",