Lesson 2.3

Keeping the index fresh

Content changes and stale chunks keep getting retrieved. Incremental reindexing driven by content events beats rebuilding everything nightly.

Taught byPriya RamanLLMs · RAG · Prompt engineering · Evaluation
6m Advanced 6,771 students

Overview

Content changes and stale chunks keep getting retrieved. Incremental reindexing driven by content events beats rebuilding everything nightly.

What this lesson covers

  • Reindex incrementally on content change events
  • Delete chunks whose source no longer exists
  • Version the index so a bad run can be rolled back

This lesson sits in Ingestion and Indexing, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.

In this lesson you will:

  • Reindex incrementally on content change events
  • Delete chunks whose source no longer exists
  • Version the index so a bad run can be rolled back

Resources