Advances in Large Language Model Applications

The field of large language models (LLMs) is rapidly evolving, with a growing focus on improving their ability to generate high-quality content, interact with their environment, and adapt to new situations. Recent research has explored the use of LLMs in a variety of applications, including travel planning, robotic trajectory adaptation, and task planning. A key trend in this area is the development of retrieval-augmented generation methods, which allow LLMs to leverage external knowledge sources to improve their performance. This approach has shown promise in tasks such as travel planning, where the ability to incorporate real-time information and user preferences is critical. Another area of focus is the development of more efficient and effective methods for fine-tuning LLMs, including the use of expert failures to improve agent tuning. This approach has been shown to significantly improve the performance of LLMs in complex tasks, and has the potential to enable more widespread adoption of LLMs in real-world applications. Notable papers in this area include DRAFT, which proposes a novel approach to generating architecture design decisions using LLMs, and InstructRAG, which leverages retrieval-augmented generation to improve task planning performance. The paper Exploring Expert Failures Improves LLM Agent Tuning also presents a significant contribution, achieving a 62% win rate in WebShop and setting a new state-of-the-art in this task.

Sources

DRAFT-ing Architectural Design Decisions using LLMs

Task Memory Engine (TME): Enhancing State Awareness for Multi-Step LLM Agent Tasks

TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning

Roamify: Designing and Evaluating an LLM Based Google Chrome Extension for Personalised Itinerary Planning

ATLASv2: LLM-Guided Adaptive Landmark Acquisition and Navigation on the Edge

Reinforcing Compositional Retrieval: Retrieving Step-by-Step for Composing Informative Contexts

Trajectory Adaptation using Large Language Models

InstructRAG: Leveraging Retrieval-Augmented Generation on Instruction Graphs for LLM-Based Task Planning

Exploring Expert Failures Improves LLM Agent Tuning

Built with on top of