Kubernetes Simulator

advanced · ~10 min

Saves that survive

Ticket from Dana Kowalski, on-call lead

Tonight's maintenance replaces the arena StatefulSet, and the runbook says to delete its claims too, to start clean. The last time we did that, every match save went with them.

Before anyone touches it: make sure no save can be lost however tonight goes. Don't run the maintenance yourself — just make it safe.

Reclaim policy

What happens to a PersistentVolume when its claim is deleted. Delete, the default for dynamically provisioned volumes such as kind's standard class, removes the volume and its data. Retain keeps both: the volume becomes Released and waits for someone to decide. It's a field on the volume, so it can be changed while the volume is in use. Docs

Objectives

  • Every arena save volume is kept if its claim is deleted
  • …and arena still running all three servers on them
  • Bonus: Delete nothing on the way

Best on a computer with a keyboard. It works on a phone, with shortcuts under the terminal.