Position Forcing: Self-Conditioning 3D Generation
cs.CV
Submitted: 2026-10-07
Updated: 2026-10-07
Code: https://github.com/black-forest-labs/flux
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent single-stage 3D generative models commonly adopt VecSet representations, encoding 3D shapes as unordered sets of latent tokens.
Abstract
Recent single-stage 3D generative models commonly adopt VecSet representations, encoding 3D shapes as unordered sets of latent tokens. However, compared with two-stage methods that provide explicit positional guidance, these models must implicitly infer token positions throughout denoising, limiting their generation quality. We observe that, despite the absence of explicit positional conditioning, VecSet tokens retain recoverable spatial correspondences. Building on this observation, we propose Position Forcing, a position-based self-conditioning framework. During denoising, Position Forcing recovers token positions from the current clean latent estimate, quantizes them at progressively finer resolutions according to the denoising stage, and feeds the resulting positional encodings back into the diffusion Transformer. This progressively refined positional feedback provides spatial guidance at a granularity appropriate to each denoising stage, guiding shape generation along a coarse-to-fine trajectory and substantially improving generation quality without a separate position generation stage. Experiments demonstrate that Position Forcing achieves strong performance among single-stage 3D generative methods and outperforms several competitive multi-stage approaches.
Sources
- Latent Forcing: Reordering the Diffusion Trajectory for Pixel-Space Image Generation
- Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis
- MEGS$^{2}$: Memory-Efficient Gaussian Splatting via Spherical Gaussians and Unified Pruning
- Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
- Direct 3D-Aware Object Insertion via Decomposed Visual Proxies
- Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scale
- Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Material
- Scalable Adaptive Computation for Iterative Generation
- Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories
- CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refiner
- Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets
- Flow Matching for Generative Modeling
- SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers
- Scalable Diffusion Models with Transformers
- FlowAR: Scale-wise Autoregressive Image Generation Meets Flow Matching
- High-Resolution Image Synthesis with Latent Diffusion Models
- Elastic Diffusion Transformer
- Does Native 3D Texture Generation Necessarily Require 3D Assets for Training?
- DreamStyle3D: Efficient 3D Stylized Asset Generation via Dual-Attention Disentanglement
- Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models