Generative 3D and 4D Modeling Advances

The field of generative 3D and 4D modeling is rapidly evolving, with a focus on creating more realistic and physically plausible models. Researchers are exploring new methods for generating 3D objects and scenes from minimal input, such as 2D images or map footprints. These approaches often involve hierarchical frameworks, physics-based simulations, and advanced generative models. The goal is to produce models that are not only visually realistic but also functional and interactive. Noteworthy papers in this area include:

  • In-2-4D, which generates 4D models from two single-view images.
  • SOPHY, which produces simulation-ready objects with physical materials.
  • HiScene, which creates hierarchical 3D scenes with isometric view generation.

Sources

In-2-4D: Inbetweening from Two Single-View Images to 4D Generation

GeoTexBuild: 3D Building Model Generation from Map Footprints

SOPHY: Generating Simulation-Ready Objects with Physical Materials

TwoSquared: 4D Generation from 2D Image Pairs

HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation

Built with on top of