🧠 Remember-R1: Our fix for MLLMs forgetting the image during long reasoning
We noticed a frustrating problem: when multimodal models reason over long chains, they gradually stop looking at the image—and start hallucinating based on their own text.
So we built Remember‑R1, a simple RL framework that directly supervises visual attention on the original reasoning trajectory—no inference overhead, no proxy tasks.
We use three complementary rewards: coverage, persistence, and focus. They encourage the model to keep attending to relevant visual evidence even in later reasoning steps.
Results across 7 benchmarks and 2 model sizes: better reasoning, and—more importantly—visual attention decays much more slowly during generation.
No extra cost at inference, just cleaner supervision where it counts.
🤔 Many cultures penalize or look down upon self-celebratory behavior. One such example is liking your own post. So why do i do it? Two reasons: 1. I disagree that self-celebratory behavior is inherently bad. 2. On the Huggingface hub, if your post has 0 reactions, it takes TWO whole clicks to react instead of one. So it is actually a UI hack that lowers the bar to engage.
So if you see me reacting to to my own post and thing 'Ugh, this guy is so full of himself' you are only half correct 😆
Now behold as I perform this magic trick called "Exhausting all reaction options for increased visual engagement" so you don't have to click twice to react. You're welcome! Follow this aspiring 🤗 HF Hub influencer for more half-serious bloat in your feed 😜