Advances in Text-to-Image Models

The field of text-to-image models is rapidly evolving, with a growing focus on improving the safety, equity, and sustainability of these models. Recent research has highlighted the importance of considering diverse human experiences and values in the development of text-to-image models, and has introduced novel approaches to align these models with human values. Another key area of research is the evaluation of the safety and accuracy of text-to-image models, with a focus on identifying and mitigating potential biases and harms. Notably, several papers have made significant contributions to the field, including the introduction of new datasets and frameworks for evaluating and improving the safety and sustainability of text-to-image models. Notable papers include: SustainDiffusion, which optimises the social and environmental sustainability of Stable Diffusion models. DREAM, a scalable red teaming framework to automatically uncover diverse problematic prompts from a given text-to-image system. From Seed to Harvest, a hybrid red-teaming method for guided expansion of culturally diverse, human-crafted adversarial prompt seeds.

Sources

Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models

"It looks sexy but it's wrong." Tensions in creativity and accuracy using genAI for biomedical visualization

SustainDiffusion: Optimising the Social and Environmental Sustainability of Stable Diffusion Models

"Just a strange pic": Evaluating 'safety' in GenAI Image safety annotation tasks from diverse annotators' perspectives

A Human-Centered Approach to Identifying Promises, Risks, & Challenges of Text-to-Image Generative AI in Radiology

DREAM: Scalable Red Teaming for Text-to-Image Generative Systems via Distribution Modeling

CAPRI-CT: Causal Analysis and Predictive Reasoning for Image Quality Optimization in Computed Tomography

From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models

Identifying Prompted Artist Names from Generated Images

Built with on top of