Robotics
LeRobot
English
OpenRAL
rskill
diffusion
vision-language-action
pusht
diffusion-policy
manipulation
Instructions to use OpenRAL/rskill-diffusion-pusht with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use OpenRAL/rskill-diffusion-pusht with LeRobot:
- Notebooks
- Google Colab
- Kaggle
docs: add generated SKILL.md discovery view
Browse files
SKILL.md
ADDED
|
@@ -0,0 +1,73 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
name: diffusion-pusht
|
| 3 |
+
description: >-
|
| 4 |
+
S1 Vision-Language-Action policy. Capabilities: push on t_shape. Diffusion Policy (~263M-param U-Net with 100-step DDPM denoiser) for the PushT 2-DoF pushing benchmark. Action chunks of length 8 within a horizon of 16. The chunk inference cost is dominated by the denoising loop, so cached pops are essentially free — this is the extreme test of the queue-drain contract. Discovery view of an OpenRAL rSkill — NOT directly runnable by an agent harness; it runs via rSkill.from_pretrained + the robot HAL.
|
| 5 |
+
metadata:
|
| 6 |
+
openral_rskill: true # generated discovery view of an rSkill
|
| 7 |
+
schema_version: 0.1
|
| 8 |
+
rskill_id: OpenRAL/rskill-diffusion-pusht
|
| 9 |
+
manifest: ./rskill.yaml
|
| 10 |
+
role: s1
|
| 11 |
+
kind: vla
|
| 12 |
+
model_family: diffusion
|
| 13 |
+
embodiment_tags: [pusht]
|
| 14 |
+
actions: [push]
|
| 15 |
+
objects: [t_shape]
|
| 16 |
+
scenes: [tabletop_2d]
|
| 17 |
+
sensors_required: ['rgb:observation.image']
|
| 18 |
+
state_dim: 2
|
| 19 |
+
action_dim: 2
|
| 20 |
+
runtime: pytorch
|
| 21 |
+
quantization: fp32/pytorch
|
| 22 |
+
chunk_size: 8
|
| 23 |
+
latency_budget: {per_chunk_ms: 1250.0}
|
| 24 |
+
license_code: Apache-2.0
|
| 25 |
+
license_weights: apache-2.0
|
| 26 |
+
weights_uri: hf://lerobot/diffusion_pusht
|
| 27 |
+
source_repo: hf://lerobot/diffusion_pusht
|
| 28 |
+
paper_url: https://arxiv.org/abs/2303.04137
|
| 29 |
+
---
|
| 30 |
+
|
| 31 |
+
# diffusion-pusht — rSkill discovery view
|
| 32 |
+
|
| 33 |
+
> **Generated view, not a hand-written skill.** This `SKILL.md` is a discovery-only
|
| 34 |
+
> mirror of [`rskill.yaml`](./rskill.yaml), produced by `tools/generate_rskill_skillmd.py`.
|
| 35 |
+
> It lets tools that read the standard agent-skill format find and reason about this
|
| 36 |
+
> OpenRAL rSkill. The `rskill.yaml` manifest is the single source of truth
|
| 37 |
+
> (CLAUDE.md §1.3). Do not edit by hand — edit the manifest and regenerate.
|
| 38 |
+
|
| 39 |
+
## What it is
|
| 40 |
+
|
| 41 |
+
An OpenRAL **Vision-Language-Action policy** (`role: s1`, `kind: vla`). Diffusion Policy (~263M-param U-Net with 100-step DDPM denoiser) for the PushT 2-DoF pushing benchmark. Action chunks of length 8 within a horizon of 16. The chunk inference cost is dominated by the denoising loop, so cached pops are essentially free — this is the extreme test of the queue-drain contract.
|
| 42 |
+
|
| 43 |
+
## Capabilities
|
| 44 |
+
|
| 45 |
+
- **Verbs:** push
|
| 46 |
+
- **Objects:** t_shape
|
| 47 |
+
- **Scenes:** tabletop_2d
|
| 48 |
+
- **Embodiments:** pusht
|
| 49 |
+
|
| 50 |
+
## Why this is discovery-only
|
| 51 |
+
|
| 52 |
+
An agent skill is natural-language instructions loaded into an LLM's context. An rSkill
|
| 53 |
+
is an executable artifact: it carries a typed capability/embodiment contract, model weights,
|
| 54 |
+
a runtime, and a license/provenance gate — none of which fit in freeform markdown. So an
|
| 55 |
+
agent can use this view to *select* the right skill, but cannot *execute* it by loading
|
| 56 |
+
this file. Execution always goes through the OpenRAL loader and the robot HAL.
|
| 57 |
+
|
| 58 |
+
## License
|
| 59 |
+
|
| 60 |
+
- **Code:** Apache-2.0.
|
| 61 |
+
- **Weights:** `apache-2.0` — permissive / commercial-use OK
|
| 62 |
+
|
| 63 |
+
## How to actually run it (not via an agent harness)
|
| 64 |
+
|
| 65 |
+
```python
|
| 66 |
+
from openral_rskill import rSkill
|
| 67 |
+
|
| 68 |
+
skill = rSkill.from_pretrained("OpenRAL/rskill-diffusion-pusht")
|
| 69 |
+
# the loader validates embodiment / sensors / runtime / quantization against the target
|
| 70 |
+
# RobotDescription and enforces the weight-license gate before any weights load.
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
+
See [`rskill.yaml`](./rskill.yaml) for the authoritative, validated manifest.
|