Advances in Large Language Model-based Planning

The field of Large Language Model-based planning is moving towards more robust and efficient planning methods. Recent developments have focused on addressing the limitations of existing planning methods, such as handling heavy constraints and cascading errors. A key direction is the integration of Constraint Programming (CP) reasoning with Large Language Models (LLMs) to enforce external constraints and generate feasible solutions. Another area of innovation is the development of novel parallel planning paradigms that decompose complex tasks into subtasks and generate subplans in parallel. These advancements have the potential to improve the performance of LLM-based agents in complex, multi-step tasks and dynamic planning scenarios. Noteworthy papers include:

  • A paper that proposes a framework combining LLM predictions with CP reasoning for reliable and constraint-aware text generation.
  • A paper that introduces a novel planning framework, REPOA, for robust and efficient planning in open-world agents.

Sources

Large Language Model Meets Constraint Propagation

Don't Just Follow MLLM Plans: Robust and Efficient Planning for Open-world Agents

Decompose, Plan in Parallel, and Merge: A Novel Paradigm for Large Language Models based Planning with Multiple Constraints

"Don't Do That!": Guiding Embodied Systems through Large Language Model-based Constraint Generation

Flex-TravelPlanner: A Benchmark for Flexible Planning with Language Agents

Built with on top of