Advances in 3D Rendering and Reconstruction

The field of 3D rendering and reconstruction is rapidly advancing, with a focus on improving the efficiency, accuracy, and realism of 3D models and scenes. Recent developments have centered around the use of Gaussian splatting, a technique that represents 3D scenes as a collection of Gaussian primitives. This approach has enabled real-time rendering and reconstruction of complex scenes, and has been applied to a variety of applications, including medical imaging, robotics, and computer vision.

Notable advancements include the development of novel architectures and algorithms for Gaussian splatting, such as Render-FM, CGS-GAN, and SplatCo, which have improved the accuracy and efficiency of 3D rendering and reconstruction. Additionally, researchers have explored the use of deep learning techniques, such as neural networks and generative models, to improve the quality and realism of 3D models and scenes.

Other significant developments include the introduction of new datasets and benchmarks, such as the LLFF and DTU benchmarks, which have enabled the evaluation and comparison of different 3D rendering and reconstruction algorithms. Furthermore, researchers have investigated the application of 3D rendering and reconstruction to various fields, including precision agriculture, sports analysis, and urban planning.

Some papers are particularly noteworthy, such as Render-FM, which proposes a novel foundation model for real-time volumetric rendering of CT scans, and CGS-GAN, which introduces a 3D consistent Gaussian splatting GAN framework for high-quality synthesis of human heads. SplatCo is also notable, as it presents a structure-view collaborative Gaussian splatting framework for high-fidelity rendering of complex outdoor environments.

Sources

Render-FM: A Foundation Model for Real-time Photorealistic Volumetric Rendering

CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesis

SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenes

SpikeGen: Generative Framework for Visual Spike Stream Processing

Learning to See More: UAS-Guided Super-Resolution of Satellite Imagery for Precision Agriculture

HydraNet: Momentum-Driven State Space Duality for Multi-Granularity Tennis Tournaments Analysis

Hyperspectral Gaussian Splatting

RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illumination

Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Loss

UP-SLAM: Adaptively Structured Gaussian SLAM with Uncertainty Prediction in Dynamic Environments

STDR: Spatio-Temporal Decoupling for Real-Time Dynamic Scene Rendering

PS4PRO: Pixel-to-pixel Supervision for Photorealistic Rendering and Optimization

CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splatting

3DGS Compression with Sparsity-guided Hierarchical Transform Coding

Pose-free 3D Gaussian splatting via shape-ray estimation

LODGE: Level-of-Detail Large-Scale Gaussian Splatting with Efficient Rendering

Holistic Large-Scale Scene Reconstruction via Mixed Gaussian Splatting

Computing Non-Obtuse Triangulations with Few Steiner Points

UrbanCraft: Urban View Extrapolation via Hierarchical Sem-Geometric Priors

A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimization

Maximum Likelihood Learning of Latent Dynamics Without Reconstruction

Radiant Triangle Soup with Soft Connectivity Forces for 3D Reconstruction and Novel View Synthesis

AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Views

ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGS

Built with on top of