Lesson 4.3
Automating a recurring data job
The last step is turning the analysis into a script that runs on a schedule, logs what it did, and fails loudly.
Taught byTomas BergPython · pandas · System design · Distributed systems
Overview
The last step is turning the analysis into a script that runs on a schedule, logs what it did, and fails loudly.
What this lesson covers
- Turn a notebook into a parameterised script
- Log progress and failures usefully
- Schedule the job and alert when it breaks
This lesson sits in Reproducible Workflows, part of Python for Data Work. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Turn a notebook into a parameterised script
- Log progress and failures usefully
- Schedule the job and alert when it breaks