Lesson 1.1
Tokens and context windows
Models read tokens, not characters, and they can only see a fixed window of them. Both your bill and your failures come back to this.
Taught byPriya RamanLLMs · RAG · Prompt engineering · Evaluation
Overview
Models read tokens, not characters, and they can only see a fixed window of them. Both your bill and your failures come back to this.
What this lesson covers
- Understand tokenisation and why cost is per token
- Budget a prompt against the context window
- Recognise the failure modes of an overflowing context
This lesson sits in LLM Fundamentals, part of Building AI Apps with LLMs. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Understand tokenisation and why cost is per token
- Budget a prompt against the context window
- Recognise the failure modes of an overflowing context