WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia

This paper presents the first few-shot LLMbased chatbot that almost never hallucinates and has high conversationality and low latency. WikiChat is grounded on the English Wikipedia, the largest curated free-text corpus.

WikiChat generates a response from an LLM, retains only the grounded facts, and combines them with additional information it retrieves from the corpus to form factual and engaging responses. We distill WikiChat based on GPT-4 into a 7B-parameter LLaMA model with minimal loss of quality, to significantly improve its latency, cost and privacy, and facilitate research and deployment 1 .

Using a novel hybrid human-and-LLM evaluation methodology, we show that our best system achieves 97.3% factual accuracy in simulated conversations. It significantly outperforms all retrieval-based and LLM-based baselines, and by 3.9%, 38.6% and 51.0% on head, tail and recent knowledge compared to GPT-4. Compared to previous state-of-the-art retrieval-based chatbots, WikiChat is also significantly more informative and engaging, just like an LLM. WikiChat achieves 97.9% factual accuracy in conversations with human users about recent topics, 55.0% better than GPT-4, while receiving significantly higher user ratings and more favorable comments. User: Have you heard about the upcoming film Oppenheimer? WikiChat: Yes! Oppenheimer is a biopic … User: What do you think about the casting? Query: cast of Oppenheimer Christopher Nolan film Date: "recent" Title: Christopher Nolan Nolan's twelfth directorial venture will be "Oppenheimer" (2023), … Title: Oppenheimer (film) … Much of the main cast signed on between September 2021 and April 2022., … Title: Cillian Murphy … Murphy was confirmed to star as J. Robert Oppenheimer in Nolan's upcoming film Oppenheimer … Christopher Nolan is known for his meticulous casting choices. He often casts well-known actors in his films, and this time he has selected Tom Hanks and … Michael Caine.

• Christopher Nolan is known for his meticulous casting choices.

• Christopher Nolan often casts well-known actors in his films.

• Tom Hanks stars in the Oppenheimer (2023) movie.

• Michael Caine stars in the Oppenheimer (2023) movie.

• Much of the Oppenheimer (2023) movie's cast signed on between September 2021 and April 2022.

• Cilian Murphy is to play as Robert Oppenheimer in the Oppenherimer (2023) movie.

• Christopher Nolan is known for his meticulous casting choices.

• Christopher Nolan often casts well-known actors in his films.

Cillian Murphy has been cast to play Robert Oppenheimer in Christopher Nolan's "Oppenheimer" movie. Christopher Nolan is known for his meticulous casting choices and often casts well-known actors in his films. The movie's cast was signed on between September 2021 and April 2022.

Christopher Nolan has cast Cillian Murphy as the titular role of Oppenheimer, keeping with his tradition of meticulous casting choices. I'm sure it will be an excellent film!