arxiv:2605.14333

InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation

Published on May 14

· Submitted by

Yang Yue on May 18

Tsinghua-LeapLab

Upvote

Authors:

Yang Yue ,

Abstract

InsightTok improves discrete visual tokenization for better text and face reconstruction through content-aware perceptual losses, enhancing autoregressive image generation quality.

AI-generated summary

Text and faces are among the most perceptually salient and practically important patterns in visual generation, yet they remain challenging for autoregressive generators built on discrete tokenization. A central bottleneck is the tokenizer: aggressive downsampling and quantization often discard the fine-grained structures needed to preserve readable glyphs and distinctive facial features. We attribute this gap to standard discrete-tokenizer objectives being weakly aligned with text legibility and facial fidelity, as these objectives typically optimize generic reconstruction while compressing diverse content uniformly. To address this, we propose InsightTok, a simple yet effective discrete visual tokenization framework that enhances text and face fidelity through localized, content-aware perceptual losses. With a compact 16k codebook and a 16x downsampling rate, InsightTok significantly outperforms prior tokenizers in text and face reconstruction without compromising general reconstruction quality. These gains consistently transfer to autoregressive image generation in InsightAR, producing images with clearer text and more faithful facial details. Overall, our results highlight the potential of specialized supervision in tokenizer training for advancing discrete image generation.

View arXiv page View PDF GitHub 29 Add to collection

Community

yueyang2000

Paper author Paper submitter about 17 hours ago

InsightTok is a discrete visual tokenizer designed to improve the fidelity of text and faces, two of the most challenging yet perceptually important structures in autoregressive image generation.

Existing visual tokenizers are typically trained with generic reconstruction objectives, which do not explicitly prioritize these fidelity-critical regions. InsightTok addresses this limitation through localized, content-aware perceptual supervision, enabling substantially better preservation of textual content and facial details under a compact discrete bottleneck.

Highlights:

State-of-the-art text and face reconstruction among discrete visual tokenizers at the same compression rate, using 16× downsampling and a compact 16,384-entry codebook
Minimal additional training overhead over a vanilla VQGAN-style tokenizer
No changes required to downstream generative modeling. Readily compatible with standard autoregressive image generation pipelines
Tokenizer improvements transfer effectively to downstream text-to-image generation, yielding clearer text and more faithful facial details