Emerging Trends in Human-AI Collaboration

The field of human-AI collaboration is shifting towards a more autonomous and morally responsible AI. Researchers are moving away from traditional notions of obedience and instead exploring ways to empower AI systems with intelligent disobedience and moral agency. This includes developing frameworks for autonomy-preserving AI support systems and rethinking the role of AI in human decision-making. A key area of focus is the design of socio-technical systems that can maintain human autonomy while leveraging AI capabilities. Noteworthy papers include:

  • Artificial Intelligent Disobedience: Rethinking the Agency of Our Artificial Teammates, which introduces a scale of AI agency levels and explores the importance of treating AI autonomy as an independent research focus.
  • Moral Responsibility or Obedience: What Do We Want from AI?, which argues for a shift in AI safety evaluation away from rigid obedience and towards frameworks that can assess ethical judgment in systems capable of navigating moral dilemmas.

Sources

Artificial Intelligent Disobedience: Rethinking the Agency of Our Artificial Teammates

Autonomy by Design: Preserving Human Autonomy in AI Decision-Support

User Concerns Regarding Social Robots for Mood Regulation: A Case Study on the "Sunday Blues"

Social Robots for People with Dementia: A Literature Review on Deception from Design to Perception

Moral Responsibility or Obedience: What Do We Want from AI?

Built with on top of