Advances in Human-AI Collaboration for Design and Development

The field of human-AI collaboration is rapidly evolving, with a growing focus on integrating large language models (LLMs) and generative AI into design and development processes. This shift is enabling new forms of collaborative flow between humans and machines, allowing for more efficient and effective creation of complex systems and artifacts. One notable trend is the emergence of vibe coding and vibe modeling approaches, which leverage LLMs to transform natural language descriptions into running code or models. These approaches have the potential to democratize access to software development and design, but also raise important questions about the role of human expertise and the potential risks of over-reliance on AI-generated code. Another key area of innovation is the development of new tools and methods for design exploration and prototyping, such as IdeaBlocks and BANG. These systems enable users to express open-ended exploratory intents and modularize them into reusable blocks, facilitating broader and more efficient exploration of design spaces. Noteworthy papers in this area include:

  • User-Centered Design with AI in the Loop: A Case Study of Rapid User Interface Prototyping with Vibe Coding, which demonstrates the potential of vibe coding for rapid prototyping and user-centered design.
  • BANG: Dividing 3D Assets via Generative Exploded Dynamics, which introduces a novel approach to 3D generation and reasoning, allowing for intuitive and flexible part-level decomposition of 3D objects.

Sources

User-Centered Design with AI in the Loop: A Case Study of Rapid User Interface Prototyping with "Vibe Coding"

BANG: Dividing 3D Assets via Generative Exploded Dynamics

Helping or Homogenizing? GenAI as a Design Partner to Pre-Service SLPs for Just-in-Time Programming of AAC

Vibe Coding as a Reconfiguration of Intent Mediation in Software Development: Definition, Implications, and Research Agenda

IdeaBlocks: Expressing and Reusing Exploratory Intents for Design Exploration with Generative AI

Vibe Modeling: Challenges and Opportunities

Built with on top of