Lesson 1.2
Temperature and sampling
Sampling parameters decide how the next token is picked. Low temperature for extraction and classification, higher for anything that should feel varied.
Taught byPriya RamanLLMs · RAG · Prompt engineering · Evaluation
Overview
Sampling parameters decide how the next token is picked. Low temperature for extraction and classification, higher for anything that should feel varied.
What this lesson covers
- Trade determinism against variety with temperature
- Know what top-p changes and when to touch it
- Pick settings per task rather than globally
This lesson sits in LLM Fundamentals, part of Building AI Apps with LLMs. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Trade determinism against variety with temperature
- Know what top-p changes and when to touch it
- Pick settings per task rather than globally