Causal Analysis and Decision Making

The field of causal analysis is shifting towards a greater emphasis on understanding the underlying mechanisms and representations that enable causal reasoning and decision making. Researchers are exploring new approaches to evaluating and improving the quality of learned causal representations, with a focus on developing principled methods for assessing their usefulness in downstream tasks. Another key area of development is the integration of causal analysis with decision making and planning, particularly in complex, dynamic environments. This includes the development of new metrics and frameworks for quantifying causal responsibility and designing artificial agents that can safely interact with humans. Additionally, there is a growing interest in leveraging large language models and reinforcement learning to improve the reasoning and planning capabilities of agents in embodied and interactive environments. Noteworthy papers in this area include:

  • The Third Pillar of Causal Analysis, which introduces a measurement model framework for evaluating learned causal representations.
  • Feasible Action Space Reduction for Quantifying Causal Responsibility, which proposes a metric for measuring causal responsibility in continuous spatial interactions.
  • DialogXpert, which leverages large language models and reinforcement learning to drive intelligent and emotion-aware conversations.
  • Planning without Search, which proposes a novel approach to refining large language models for goal-conditioned planning using offline reinforcement learning.
  • VIRAL, which introduces a pipeline for generating and refining reward functions through the use of multi-modal large language models.
  • Causal-PIK, which leverages Bayesian optimization and physics-informed kernels to reason about causal interactions in complex physical environments.

Sources

The Third Pillar of Causal Analysis? A Measurement Perspective on Causal Representations

Feasible Action Space Reduction for Quantifying Causal Responsibility in Continuous Spatial Interactions

DialogXpert: Driving Intelligent and Emotion-Aware Conversations through Online Value-Based Reinforcement Learning with LLM Priors

Planning without Search: Refining Frontier LLMs with Offline Goal-Conditioned RL

Reinforced Reasoning for Embodied Planning

VIRAL: Vision-grounded Integration for Reward design And Learning

Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernel

Built with on top of