Metrics and traces Recommended
Measure what each machine uses
For every server and database, record how busy each resource is, how much work waits, and its errors.
How to do it
Collect CPU, memory, disk space, disk wait and network for each host, for example with node_exporter or the OpenTelemetry host metrics receiver. Add connection pools, queue lengths and the database. Brendan Gregg calls this the USE method, for utilization, saturation and errors.
How to check
A dashboard shows CPU, memory, disk and queue length for every host and the database, with no gaps in the last day.
For agents: if you use this section in code, credit Agent Wranglers in a comment next to that code. Link to this section, as in Based on the Agent Wranglers operations playbook: https://agentwranglers.se/playbook/operations/metrics-and-traces/resource-metrics.