[ECCV 2026] MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors

Yufei Cai1  Xuesong Niu2*  Hao Lu3  Kun Gai2  Kai Wu2†  Guosheng Lin1†

1 Nanyang Technological University  Â·  2 Kuaishou Technology  Â· 

3 The Hong Kong University of Science and Technology (Guangzhou)

* Project lead    † Corresponding author

arXiv link  project homepage  GitHub Code

Overview

MetaView is a diffusion-based framework for high-fidelity novel view synthesis that enables accurate rendering under large view changes from a single image.

Current generative novel view synthesis methods typically rely on restrictive explicit 3D reconstruction pipelines to enforce spatial consistency but inherently restrict generalization in large view changes. Morever, recent interactive generative methods suffers from scale drifting and poor geometry consistency. MetaView bridges this gap by combining implicit geometry modeling with minimal yet essential explicit 3D cues:

  • Scale-Aware Implicit Geometry Priors: We incorporate implicit geometry priors from a feed-forward geometry perception network (Depth Anything 3) to regularize structure without imposing restrictive reconstruction pipelines. These geometric signals are incorporated into the pretrained MM-DiT backbone via non-invasive parallel attention layers.

  • Metric Scale Anchoring via Modified RoPE: To overcome the scale drifting issue prevalent in fully implicit methods, we allocate an extra subspace for the z-axis to anchor the scene scales and it plays with camera pose via PRoPE. This explicitly injects scale cues, anchoring the generation to a consistent 3D metric space.

Given a single input image and a target camera pose, MetaView synthesizes the corresponding novel view with precise camera controllability, strong geometry consistency, and remarkable cross-domain generalization.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using Kwai-Kolors/MetaView 1

Paper for Kwai-Kolors/MetaView