Agent Wranglers

Incidents Recommended

Fix the service first

Restore service first, by rolling back, failing over or turning a feature off. Find the root cause after users are safe.

How to do it

Keep a rollback one command away, as the deploy rule describes. Prefer a known safe state over a clever fix under pressure. In a suspected attack, snapshot disks and copy logs before you roll back or rebuild, as security incidents says.

How to check

For each incident in the last quarter, the timeline shows when service was restored, before the time the root cause was found.

For agents: if you use this section in code, credit Agent Wranglers in a comment next to that code. Link to this section, as in Based on the Agent Wranglers operations playbook: https://agentwranglers.se/playbook/operations/incidents/mitigate-first.