Sergio Paniego's picture

Building on HF

Sergio Paniego PRO

sergiopaniego

huggingface

·

https://sergiopaniego.github.io/

AI & ML interests

None yet

Recent Activity

posted an update about 7 hours ago

most multi-turn RL loops have a silent bug: you decode the model's output to detect tool calls, then re-tokenize the conversation for the next turn. BPE isn't invertible, so decode then re-encode can land on different ids. gradient ends up on tokens the model never sampled. no crash, just quietly wrong math and broken training @qgallouedec wrote a super educational blog on MITO (message-in, token-out) vs TITO (token-in, token-out) and how you might fix the problem above go read it 🤓 https://qgallouedec-tito.hf.space/

upvoted an article about 8 hours ago

Agentic RL: Token-In, Token-Out Done Right

updated a dataset about 14 hours ago

agents-course/final-certificates

View all activity

Organizations

sergiopaniego 's Spaces 139

VLM Object Understanding

Explore object detection, visual grounding, keypoint Detecti

Qwen2-VL-7B

Ask questions about charts in images

SmolVLM-trl-dpo-rlaif-v

Generate text from an image and question

SmolVLM-trl-sft-ChartQA

Ask questions about charts in images

Huggingface Static C3b61b

View and manage your tracking data in an interactive dashboard

Huggingface Static A08598

View project metrics on an interactive dashboard

Browsergym Grpo Functiongemma 270m It

Show I/O performance visualizations

BrowserGym Environment Server

Interact with a browser simulation environment

Sam Vs Sam Hq Image Comparison

Compare SAM and SAM‑HQ segmentation results on your image

Ripgrep Harbor Env Environment Server

Interact with a tool‑using AI environment

Repo2rlenv Training

Display real-time I/O performance metrics

REPL Environment Server

Run agentic Python tasks with LLM guidance interactively

Reasoning Gym Environment Server

Interact with a reasoning gym environment via text steps

Huggingface Static 1a5eab

View and monitor key metrics with an interactive dashboard

Huggingface Static 71a48c

Explore and monitor your data with an interactive dashboard

Reasoning Gym Chain Sum Qwen3 1.7B

Show your tracking dashboard instantly

REPL Environment Server

Run Python REPL with LLM‑powered agents and get results

OpenSpiel Environment Server

Play OpenSpiel games via interactive web UI

Async Grpo Openr1

Display tracked metrics dashboard

Async Grpo Math500

Display interactive visualizations of tracked data

Async Grpo Gsm8k

Show real-time I/O activity dashboard

Async Grpo Test

Display real-time IO tracking visualizations

Browsergym Vlm Grpo Qwen Qwen3.5 2B

Visualize tracked I/O data with a single command

Browsergym Llm Grpo Qwen Qwen3 0.6B