Advances in 3D Human Avatar Reconstruction and Animation

The field of 3D human avatar reconstruction and animation is rapidly advancing, with a focus on improving the accuracy, efficiency, and controllability of these models. Recent developments have centered on enhancing the expressiveness and realism of avatars, particularly in terms of facial expressions, hair, and clothing. Researchers are exploring new approaches to address long-standing challenges, such as reconstructing high-quality avatars from limited input data, handling complex movements and interactions, and ensuring temporal consistency in online reconstruction. Noteworthy papers in this area have introduced innovative methods for animatable 3D avatar reconstruction from a single image, geometry-aware texture generation for 3D head modeling, and unsupervised online video stitching with spatiotemporal bidirectional warps. These advancements have significant implications for applications in entertainment, advertising, and virtual reality. Notable papers include: SVAD, which generates synthetic training data through video diffusion and enhances it with identity preservation and image restoration modules to train 3DGS avatars. SignSplat, which leverages regularization techniques on Gaussian parameters to mitigate overfitting and rendering artifacts, and proposes a new adaptive control method to densify Gaussians and prune splat points on the mesh surface. GUAVA, which introduces an expressive human model to enhance facial expression capabilities and develops an accurate tracking method for fast animatable upper-body 3D Gaussian avatar reconstruction.

Sources

Compensating Spatiotemporally Inconsistent Observations for Online Dynamic 3D Gaussian Splatting

SignSplat: Rendering Sign Language via Gaussian Splatting

GUAVA: Generalizable Upper Body 3D Gaussian Avatar

Person-In-Situ: Scene-Consistent Human Image Insertion with Occlusion-Aware Pose Control

Geometry-Aware Texture Generation for 3D Head Modeling with Artist-driven Control

StabStitch++: Unsupervised Online Video Stitching with Spatiotemporal Bidirectional Warps

SOAP: Style-Omniscient Animatable Portraits

GeomHair: Reconstruction of Hair Strands from Colorless 3D Scans

SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation

Built with on top of