Disaster recovery Required
Practise restoring
Rebuild the whole service from backups on a fresh machine on a schedule, and time it.
How to do it
Run the drill at least every quarter, and after big changes. Follow the restore runbook, not memory. The restore tests rule covers the database alone. Compare the newest record with production, and measure the time against the recovery time objective. Fix whatever slowed it down.
How to check
The drill log shows a restore within the last three months, its duration, and that the data matched.
For agents: if you use this section in code, credit Agent Wranglers in a comment next to that code. Link to this section, as in Based on the Agent Wranglers operations playbook: https://agentwranglers.se/playbook/operations/disaster-recovery/restore-drills.