PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 20, 20250 citationsOpen Access

PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion

View Full Paper
YYYuyang YinHGHong Zhen GuoFLFangfu Liu

Key Points

  • PanoWorld-X enables explorable and high-fidelity 360-degree visual worlds, transforming panoramic video generation.
  • Achieving superior performance, it enhances motion range and control precision, allowing for diverse camera trajectories.
  • Using a Sphere-Aware Diffusion Transformer, it aligns equirectangular features on spherical surfaces for better visual quality.
  • This approach has significant real-world applications across various fields, indicating its broad utility.

Abstract

Generating a complete and explorable 360-degree visual world enables a wide range of downstream applications. While prior works have advanced the field, they remain constrained by either narrow field-of-view limitations, which hinder the synthesis of continuous and holistic scenes, or insufficient camera controllability that restricts free exploration by users or autonomous agents. To address this, we propose PanoWorld-X, a novel framework for high-fidelity and controllable panoramic video generation with diverse camera trajectories. Specifically, we first construct a large-scale dataset of panoramic video-exploration route pairs by simulating camera trajectories in virtual 3D environments via Unreal Engine. As the spherical geometry of panoramic data misaligns with the inductive priors from conventional video diffusion, we then introduce a Sphere-Aware Diffusion Transformer architecture that reprojects equirectangular features onto the spherical surface to model geometric adjacency in latent space, significantly enhancing visual fidelity and spatiotemporal continuity. Extensive experiments demonstrate that our PanoWorld-X achieves superior performance in various aspects, including motion range, control precision, and visual quality, underscoring its potential for real-world applications.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yin et al. (2025) studied this question.

synapsesocial.com/papers/68f5fcce8d54a28a75cf1db8https://doi.org/10.48550/arxiv.2509.24997
Ask AI
Helpful
Bookmark
Share
View Full Paper