Advances in Retrieval-Augmented Generation for Improved Performance and Robustness

The field of natural language processing is moving towards improving the performance and robustness of Retrieval-Augmented Generation (RAG) systems. Recent studies have highlighted the importance of developing techniques that can handle linguistic variations, improve retrieval efficiency, and enhance the overall reliability of RAG systems. One of the key directions is the use of graph-based approaches, which have shown promising results in enhancing the performance of RAG systems across various tasks. Another area of focus is the development of methods that can mitigate the hallucination problem in large language models, with knowledge graphs emerging as a potential solution. Additionally, there is a growing interest in exploring the application of RAG systems in diverse domains, such as legal and medical question answering, and in developing more efficient and scalable architectures for real-time systems. Noteworthy papers in this regard include PCA-RAG, which demonstrates the effectiveness of Principal Component Analysis in reducing embedding dimensionality for efficient retrieval, and Poly-Vector Retrieval, which introduces a method for assigning multiple distinct embeddings to each legal provision for improved retrieval accuracy. Furthermore, HM-RAG and CDF-RAG propose novel frameworks for hierarchical multi-agent multimodal retrieval and causal dynamic feedback for adaptive retrieval, respectively, showcasing the potential for significant advancements in the field.

Sources

Out of Style: RAG's Fragility to Linguistic Variation

PCA-RAG: Principal Component Analysis for Efficient Retrieval-Augmented Generation

Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey

Poly-Vector Retrieval: Reference and Content Embeddings for Legal Documents

Exploring the Role of KG-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs

Towards Automated Safety Requirements Derivation Using Agent-based RAG

Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs

Large Language Model-Based Knowledge Graph System Construction for Sustainable Development Goals: An AI-Based Speculative Design Perspective

The Other Side of the Coin: Exploring Fairness in Retrieval-Augmented Generation

HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation

Mitigating LLM Hallucinations with Knowledge Graphs: A Case Study

CDF-RAG: Causal Dynamic Feedback for Adaptive Retrieval-Augmented Generation

Pandora: A Code-Driven Large Language Model Agent for Unified Reasoning Across Diverse Structured Knowledge

Built with on top of