Advancements in Inverse Rendering and 3D Reconstruction

The field of computer graphics and vision is witnessing significant advancements in inverse rendering and 3D reconstruction. Researchers are exploring innovative methods to improve the efficiency and accuracy of these techniques, enabling applications in various domains such as robotics, computer-aided design, and virtual reality. One of the key directions is the development of novel view synthesis methods that can render high-quality images from sparse views, reducing the need for extensive datasets and computational resources. Another area of focus is the reconstruction of complex scenes, including glossy and transparent objects, which poses significant challenges due to the instability and incorrect overfitting of radiance fields. Noteworthy papers include LaRI, which presents a new method for unseen geometry reasoning from a single image, and RGS-DR, which introduces a novel inverse rendering method for reconstructing and rendering glossy and reflective objects. Additionally, LIRM presents a transformer architecture that jointly reconstructs high-quality shape, materials, and radiance fields with view-dependent effects in less than a second.TransparentGS is also a notable method that achieves fast inverse rendering of transparent objects with Gaussians, addressing the challenges posed by specular reflection and refraction.

Sources

iVR-GS: Inverse Volume Rendering for Explorable Visualization via Editable 3D Gaussian Splatting

LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoning

RGS-DR: Reflective Gaussian Surfels with Deferred Rendering for Shiny Objects

TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians

Bernstein Bounds for Caustics

Mesh-Learner: Texturing Mesh with Spherical Harmonics

LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields

LSNIF: Locally-Subdivided Neural Intersection Function

RayZer: A Self-supervised Large View Synthesis Model

Built with on top of