Commit ae5ab600 authored by Craig Barrett's avatar Craig Barrett

alert when we see too many sidekiq exceptions for a controller. Addresses...

alert when we see too many sidekiq exceptions for a controller. Addresses gitlab-com/infrastructure#4651
parent b50f7121
groups:
- name: sidekiq-exception-count.rules
rules:
- alert: SidekiqExceptionCountTooHigh
expr: sum by (controller) (gitlab_transaction_event_sidekiq_exception_total{environment="gprd"}) > 1000
for: 1h
labels:
severity: warn
annotations:
description: There have been over 1000 Sidekiq exceptions for {{ $labels.controller }} for the last hour.
Check https://dashboards.gitlab.net/dashboard/db/geo-status?panelId=33&fullscreen&from=now-6h&to=now.
runbook: troubleshooting/sidekiq-exceptions.md
title: 'Large number of Sidekiq exceptions for {{ $labels.controller }}: {{$value}}'
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment