Frequency-Aware Gaussian Splatting Decomposition
Journal:
arXiv
Published Date:
Mar 27, 2025
Abstract
3D Gaussian Splatting (3D-GS) has revolutionized novel view synthesis with
its efficient, explicit representation. However, it lacks frequency
interpretability, making it difficult to separate low-frequency structures from
fine details. We introduce a frequency-decomposed 3D-GS framework that groups
3D Gaussians that correspond to subbands in the Laplacian Pyrmaids of the input
images. Our approach enforces coherence within each subband (i.e., group of 3D
Gaussians) through dedicated regularization, ensuring well-separated frequency
components. We extend color values to both positive and negative ranges,
allowing higher-frequency layers to add or subtract residual details. To
stabilize optimization, we employ a progressive training scheme that refines
details in a coarse-to-fine manner. Beyond interpretability, this
frequency-aware design unlocks a range of practical benefits. Explicit
frequency separation enables advanced 3D editing and stylization, allowing
precise manipulation of specific frequency bands. It also supports dynamic
level-of-detail control for progressive rendering, streaming, foveated
rendering and fast geometry interaction. Through extensive experiments, we
demonstrate that our method provides improved control and flexibility for
emerging applications in scene editing and interactive rendering. Our code will
be made publicly available.