Generating 360Β° Video is What You Need For a 3D Scene
April 02, 2025 Β· Declared Dead Β· π ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Zhaoyang Zhang, Yannick Hold-Geoffroy, MiloΕ‘ HaΕ‘an, Ziwen Chen, Fujun Luan, Julie Dorsey, Yiwei Hu
arXiv ID
2504.02045
Category
cs.GR: Graphics
Cross-listed
cs.CV
Citations
1
Venue
ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Last Checked
5 months ago
Abstract
Generating 3D scenes is still a challenging task due to the lack of readily available scene data. Most existing methods only produce partial scenes and provide limited navigational freedom. We introduce a practical and scalable solution that uses 360Β° video as an intermediate scene representation, capturing the full-scene context and ensuring consistent visual content throughout the generation. We propose WorldPrompter, a generative pipeline that synthesizes traversable 3D scenes from text prompts. WorldPrompter incorporates a conditional 360Β° panoramic video generator, capable of producing a 128-frame video that simulates a person walking through and capturing a virtual environment. The resulting video is then reconstructed as Gaussian splats by a fast feedforward 3D reconstructor, enabling a true walkable experience within the 3D scene. Experiments demonstrate that our panoramic video generation model, trained with a mix of image and video data, achieves convincing spatial and temporal consistency for static scenes. This is validated by an average COLMAP matching rate of 94.6\%, allowing for high-quality panoramic Gaussian splat reconstruction and improved navigation throughout the scene. Qualitative and quantitative results also show it outperforms the state-of-the-art 360Β° video generators and 3D scene generation models.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β Graphics
R.I.P.
π»
Ghosted
R.I.P.
π»
Ghosted
Deep Bilateral Learning for Real-Time Image Enhancement
R.I.P.
π»
Ghosted
Animating Human Athletics
R.I.P.
π»
Ghosted
BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration
R.I.P.
π»
Ghosted
Shape Transformation Using Variational Implicit Functions
R.I.P.
π»
Ghosted
ABC: A Big CAD Model Dataset For Geometric Deep Learning
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
π»
Ghosted