Advances in Generative Modeling

The field of generative modeling is rapidly advancing, with a focus on improving the efficiency, stability, and quality of generated samples. Recent developments have seen the integration of optimal transport theory, electrostatic models, and flow matching techniques to enhance the performance of generative models. Notably, the use of idempotent generative networks, score-based distillation, and mean flow models has led to significant improvements in sample quality and inference speed. Furthermore, research has explored the application of generative models to discrete data generation, long-tailed distributions, and Riemannian manifolds, demonstrating the versatility and potential of these models.

Some noteworthy papers in this area include: The paper on Score-based Idempotent Distillation of Diffusion Models, which proposes a novel method for distilling idempotent models from diffusion models, enabling faster inference and state-of-the-art results on image datasets. The paper on Overclocking Electrostatic Generative Models, which introduces a distillation framework for accelerating electrostatic generative models, achieving near-teacher or superior sample quality with reduced computational cost. The paper on Riemannian Consistency Model, which proposes a consistency model for Riemannian manifolds, enabling few-step generation and superior generative quality on non-Euclidean manifolds.

Sources

Score-based Idempotent Distillation of Diffusion Models

New Algorithmic Directions in Optimal Transport and Applications for Product Spaces

NIFTY: a Non-Local Image Flow Matching for Texture Synthesis

Overclocking Electrostatic Generative Models

Transport Based Mean Flows for Generative Modeling

A Theoretical Analysis of Discrete Flow Matching Generative Models

Electric Currents for Discrete Data Generation

GANji: A Framework for Introductory AI Image Generation

Scalable GANs with Transformers

OAT-FM: Optimal Acceleration Transport for Improved Flow Matching

Flow Matching with Semidiscrete Couplings

Reweighted Flow Matching via Unbalanced OT for Label-free Long-tailed Generation

A Polylogarithmic Competitive Algorithm for Stochastic Online Sorting and TSP

UCD: Unconditional Discriminator Promotes Nash Equilibrium in GANs

Riemannian Consistency Model

Equilibrium Matching: Generative Modeling with Implicit Energy-Based Models

Built with on top of