Skip to content
ai researchsA research notebookPaper desk
← Paper notes

2020 · arXiv:2005.11401 · retrieval

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

A pretrained sequence generator uses a searchable external memory.

Abstract-based note1 min read

Why this idea matters

It names a concrete retrieval-and-generation training recipe.

The proposal

The authors combine parametric memory with retrieved documents for generation. Their two formulations differ in whether passages remain fixed across a sequence or may vary by token.

What was inspected

The abstract reports QA and generation comparisons. We have not audited the tables or provenance behavior; reported factuality gains are not a guarantee for individual answers.

Editorial interpretation

Use this paper as a reference point, not the origin of all retrieval research. Later systems can share the RAG label while using different training and retrieval arrangements.

The mechanism, in brief

  1. Search a dense Wikipedia index.
  2. Condition generation on passages.
  3. Compare sequence-level and token-level passage conditioning.

Limits of this note

  • Retrieved text does not guarantee factual output.
  • The inspected abstract is not a modern deployment guide.

Continue reading

Related research paths ↗

To examine another paper and keep working notes, open the Paper desk. Those notes stay in your browser until you export them.