Commit 11d442d8 authored by Chris Wilson's avatar Chris Wilson

Only alert if queues are high for 20m and remove infra

parent a4d2654e
## Sidekiq Queues
ALERT sidekiq_queues_are_too_high
IF sum(max(sidekiq_queue_size{name!~"process_commit"})) > 10000
FOR 1m
LABELS {severity="critical", channel="infrastructure"}
FOR 20m
LABELS {severity="critical"}
ANNOTATIONS {
title="Large amount of Sidekiq Queued jobs: {{$value}}",
description="Sidekiq jobs are piling up for the last minute, this may be under control, but I'm just letting you know that this is going on, check http://performance.gitlab.net/dashboard/db/sidekiq-stats. Note that ProcessCommitWorker is excluded from job count.",
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment