ATM: Adversarial Tuning Multi-agent System Makes a Robust Retrieval-Augmented Generator

Large language models (LLMs) are proven to benefit a lot from retrieval-augmented generation (RAG) in alleviating hallucinations confronted with knowledge-intensive questions. RAG adopts information retrieval techniques to inject external knowledge from semanticrelevant documents as input contexts. However, since today's Internet is flooded with numerous noisy and fabricating content, it is inevitable that RAG systems are vulnerable to these noises and prone to respond incorrectly. To this end, we propose to optimize the retrieval-augmented GENERATOR with an Adversarial Tuning Multi-agent system (ATM). The ATM steers the GENERATOR to have a robust perspective of useful documents for question answering with the help of an auxiliary ATTACKER agent through adversarially tuning the agents for several iterations. After rounds of multi-agent iterative tuning, the GENERA-TOR can eventually better discriminate useful documents amongst fabrications. The experimental results verify the effectiveness of ATM and we also observe that the GENERATOR can achieve better performance compared to the state-of-the-art baselines. The code is available at https://github.com/chuhac/ATM-RAG .