dgrachev commited on
Commit
3fb1a9c
·
verified ·
1 Parent(s): 9287e9c

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +9 -3
  2. policy_preprocessor.json +1 -1
README.md CHANGED
@@ -22,20 +22,26 @@ generation, following [openpi_subtask](https://github.com/Ke-Wang1017/openpi_sub
22
 
23
  - `config.json`: policy `type` is `pi05_subtask` instead of `pi05`.
24
  - `policy_preprocessor.json`: pi05's `pi05_prepare_state_tokenizer_processor_step` +
25
- `tokenizer_processor` steps are replaced by `pi05_subtask_tokenize_processor_step`, which builds
26
- the two-segment prompt
27
 
28
  ```
29
  context (no loss): "Task: {task}.; State: {256-bin ints}; Subtask: "
30
  predicted (CE loss): "{subtask}.;\nAction: " + EOS
31
  ```
32
 
33
- and emits a subtask region mask alongside the language tokens.
 
 
34
 
35
  This exists because LeRobot instantiates processor pipelines from the checkpoint's
36
  `policy_preprocessor.json` (by processor-step registry name), so fine-tuning the subtask policy
37
  directly from `lerobot/pi05_base` would silently install plain pi05's tokenizer steps.
38
 
 
 
 
 
39
  ## Usage
40
 
41
  Requires the `lerobot_policy_pi05_subtask` plugin installed (LeRobot auto-imports
 
22
 
23
  - `config.json`: policy `type` is `pi05_subtask` instead of `pi05`.
24
  - `policy_preprocessor.json`: pi05's `pi05_prepare_state_tokenizer_processor_step` +
25
+ `tokenizer_processor` steps are replaced by `pi05_subtask_context_tokenize_processor_step`,
26
+ which tokenizes the context segment of the two-segment prompt
27
 
28
  ```
29
  context (no loss): "Task: {task}.; State: {256-bin ints}; Subtask: "
30
  predicted (CE loss): "{subtask}.;\nAction: " + EOS
31
  ```
32
 
33
+ into `observation.language.context_tokens`/`.context_mask`. The predicted segment is model
34
+ territory: the policy appends it at training time (computing the CE region mask next to the
35
+ loss) and decodes it autoregressively at inference.
36
 
37
  This exists because LeRobot instantiates processor pipelines from the checkpoint's
38
  `policy_preprocessor.json` (by processor-step registry name), so fine-tuning the subtask policy
39
  directly from `lerobot/pi05_base` would silently install plain pi05's tokenizer steps.
40
 
41
+ The same artifact is the base for the `framepick` policy type (`lerobot_policy_framepick`):
42
+ framepick has no processor steps of its own — frame selection, chunk re-expression and the
43
+ assignment prefix all live in the policy, configured from the policy config.
44
+
45
  ## Usage
46
 
47
  Requires the `lerobot_policy_pi05_subtask` plugin installed (LeRobot auto-imports
policy_preprocessor.json CHANGED
@@ -34,7 +34,7 @@
34
  }
35
  },
36
  {
37
- "registry_name": "pi05_subtask_tokenize_processor_step",
38
  "config": {
39
  "tokenizer_name": "google/paligemma-3b-pt-224",
40
  "max_length": 200,
 
34
  }
35
  },
36
  {
37
+ "registry_name": "pi05_subtask_context_tokenize_processor_step",
38
  "config": {
39
  "tokenizer_name": "google/paligemma-3b-pt-224",
40
  "max_length": 200,