PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 25, 20260 citationsOpen Access

Using 2D Gaussian Splatting in Diffusion Models

View Full Paper
AGArchan Ghosh

Key Points

  • This work aims to enhance diffusion models by integrating 2D Gaussian splatting to improve efficiency and detail.
  • Introduced an encoder-diffusion-renderer pipeline for image processing.
  • Used 2D Gaussian splatting to represent images in a compact latent space.
  • Performed diffusion directly over Gaussian latents to maintain visual clarity.
  • Significantly reduced computational overhead while preserving image quality.
  • Maintained high-frequency spatial detail in generated images.
  • Achieved efficient generation compared to traditional high-dimensional pixel representations.

Abstract

Diffusion models have achieved remarkable success in image synthesis but remain computationally expensive due to iterative denoising in high-dimensional pixel space. Latent Diffusion Models (LDMs) alleviate this cost through compressed neural representations, yet often sacrifice high-frequency spatial detail during latent compression. In this work, we introduce a diffusion framework based on 2D Gaussian Splatting, replacing dense pixel-space representations with structured Gaussian primitives. Our approach employs an encoder-diffusion-renderer pipeline, where input images are first mapped into a compact Gaussian latent space parameterized by spatial location, scale, opacity, and color attributes. Diffusion is then performed directly over these Gaussian latents, enabling efficient generation while preserving fine-grained spatial structure. The denoised Gaussian representations are subsequently rendered back into the image domain using differentiable splatting. By operating on compact geometric primitives rather than dense latent tensors, our framework significantly reduces computational overhead while maintaining visual fidelity.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Archan Ghosh (2026) studied this question.

synapsesocial.com/papers/6a13e83b0e02ee3982d32e1bhttps://doi.org/10.5281/zenodo.20357255
Ask AI
Helpful
Bookmark
Share
View Full Paper