FIRe-VLA-OpenVLA-NutThread-Sim

A OpenVLA vision-language-action policy fine-tuned for the Nut threading contact-rich robotic assembly task (Sim domain), part of the FIRe model suite.

  • Framework: OpenVLA
  • Task: Nut threading (nut_thread)
  • Domain: Sim
  • Checkpoint: inference-ready (20000 steps)

Usage

# Requires the OpenVLA-OFT codebase: https://github.com/moojink/openvla-oft
from transformers import AutoModelForVision2Seq, AutoProcessor

repo = "bhe1004/FIRe-VLA-OpenVLA-NutThread-Sim"
processor = AutoProcessor.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForVision2Seq.from_pretrained(repo, trust_remote_code=True)
# OFT extras bundled in the repo: action_head, proprio_projector,
# lora_adapter, dataset_statistics.json

Related

Downloads last month
-
Safetensors
Model size
8B params
Tensor type
BF16
·
Video Preview
loading