Batch pipeline, mission 6 of 6
The 2am failure
advanced, about 12 minutes, in the Kubernetes Simulator
Start mission
Opens once you pass Pile-up.
The briefing
nightly-export has run every night for months. You're on call.
When a scheduled run fails, two jobs remain: stop the next run failing too, and make up the run that was missed. A CronJob reads its Secrets fresh each time it starts a Job — unlike a long-running pod.
What you'll do
- Find out why the export is failing
- Put the new token in the warehouse Secret
- Get an export to complete on the new token
- Bonus star: Backfill now with kubectl create job --from=cronjob/nightly-export
The mission checks the cluster, not your keystrokes: any fix that works, passes.
More Batch pipeline missions
- 1. Run it once
- 2. When a job fails
- 3. Many hands
- 4. Every night
- 5. Pile-up
- 6. The 2am failure