Add alerting rules for machines operation rates

parent 8090f2b4
## Machine operations rate
ALERT machines_creations_rate_is_too_high
IF max(sum(rate(ci_docker_machines{type="created"}[1m])) by (job,type)) > 5
FOR 20m
LABELS {severity="critical", channel="infrastructure"}
ANNOTATIONS {
title="Machines creation rate for runners is too high: {{$value}}",
description="Machines creation rate for the last 20 minutes is over 5. This may by a symptom of problems with auto-scaling provider. Check http://performance.gitlab.net/dashboard/db/ci.",
}
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment