Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
What's new
7
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
runbooks
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Analytics
Analytics
Repository
Value Stream
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Commits
Open sidebar
Cookbooks
runbooks
Commits
6483e63a
Commit
6483e63a
authored
Nov 05, 2018
by
Andrew Newdigate
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Move from 2.5sigma to 3sigma for warning alerts
parent
6e91fc0d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
20 additions
and
20 deletions
+20
-20
alerts/general-service-alerts.yml
alerts/general-service-alerts.yml
+20
-20
No files found.
alerts/general-service-alerts.yml
View file @
6483e63a
groups
:
-
name
:
service_availability.rules
rules
:
# Availability below
2
sigma
-
alert
:
service_availability_out_of_bounds_lower_
2sigma_
5m
# Availability below
3
sigma
-
alert
:
service_availability_out_of_bounds_lower_5m
expr
:
|
gitlab_service_availability:ratio
<
gitlab_service_availability:ratio:avg_over_time_1w -
2.5
* gitlab_service_availability:ratio:stddev_over_time_1w
gitlab_service_availability:ratio:avg_over_time_1w -
3
* gitlab_service_availability:ratio:stddev_over_time_1w
for
:
5m
labels
:
rules_domain
:
general
...
...
@@ -14,7 +14,7 @@ groups:
severity
:
warn
period
:
5m
bound
:
lower
threshold_sigma
:
"
2.5
"
threshold_sigma
:
"
3
"
annotations
:
description
:
|
The ratio of services that are available to serve the `{{ $labels.type }}` service
...
...
@@ -31,12 +31,12 @@ groups:
link1_title
:
"
Definition"
link1_url
:
"
https://gitlab.com/gitlab-com/runbooks/blob/master/troubleshooting/definition-service-availability.md"
# Operation rate above
2
sigma
-
alert
:
service_
ops_out_of_bounds_upper_2sigma
_5m
# Operation rate above
3
sigma
-
alert
:
service_
availability_out_of_bounds_lower
_5m
expr
:
|
gitlab_service_ops:rate
>
gitlab_service_ops:rate:avg_over_time_1w +
2.5
* gitlab_service_ops:rate:stddev_over_time_1w
gitlab_service_ops:rate:avg_over_time_1w +
3
* gitlab_service_ops:rate:stddev_over_time_1w
for
:
5m
labels
:
rules_domain
:
general
...
...
@@ -44,7 +44,7 @@ groups:
severity
:
warn
period
:
5m
bound
:
upper
threshold_sigma
:
"
2.5
"
threshold_sigma
:
"
3
"
annotations
:
description
:
|
The `{{ $labels.type }}` service is receiving more requests than normal.
...
...
@@ -62,12 +62,12 @@ groups:
link1_title
:
"
Definition"
link1_url
:
"
https://gitlab.com/gitlab-com/runbooks/blob/master/troubleshooting/definition-service-ops-rate.md"
# Operation rate below
2
sigma
-
alert
:
service_ops_out_of_bounds_lower_
2sigma_
5m
# Operation rate below
3
sigma
-
alert
:
service_ops_out_of_bounds_lower_5m
expr
:
|
gitlab_service_ops:rate
<
gitlab_service_ops:rate:avg_over_time_1w -
2.5
* gitlab_service_ops:rate:stddev_over_time_1w
gitlab_service_ops:rate:avg_over_time_1w -
3
* gitlab_service_ops:rate:stddev_over_time_1w
for
:
5m
labels
:
rules_domain
:
general
...
...
@@ -75,7 +75,7 @@ groups:
severity
:
warn
period
:
5m
bound
:
lower
threshold_sigma
:
"
2.5
"
threshold_sigma
:
"
3
"
annotations
:
description
:
|
The `{{ $labels.type }}` service is receiving fewer requests than normal.
...
...
@@ -92,12 +92,12 @@ groups:
link1_title
:
"
Definition"
link1_url
:
"
https://gitlab.com/gitlab-com/runbooks/blob/master/troubleshooting/definition-service-ops-rate.md"
# Apdex lower than
2
sigma
-
alert
:
service_
apdex_out_of_bounds_lower_2sigma
_5m
# Apdex lower than
3
sigma
-
alert
:
service_
ops_out_of_bounds_lower
_5m
expr
:
|
gitlab_service_apdex:ratio
<
gitlab_service_apdex:ratio:avg_over_time_1w -
2.5
* gitlab_service_apdex:ratio:stddev_over_time_1w
gitlab_service_apdex:ratio:avg_over_time_1w -
3
* gitlab_service_apdex:ratio:stddev_over_time_1w
for
:
5m
labels
:
rules_domain
:
general
...
...
@@ -105,7 +105,7 @@ groups:
severity
:
warn
period
:
5m
bound
:
lower
threshold_sigma
:
"
2.5
"
threshold_sigma
:
"
3
"
annotations
:
description
:
|
The `{{ $labels.type }}` service is operating at a slower rate than normal.
...
...
@@ -123,12 +123,12 @@ groups:
link1_title
:
"
Definition"
link1_url
:
"
https://gitlab.com/gitlab-com/runbooks/blob/master/troubleshooting/definition-service-apdex.md"
# Error rate exceeds
2
sigma
-
alert
:
service_errors_out_of_bounds_upper_
2sigma_
5m
# Error rate exceeds
3
sigma
-
alert
:
service_errors_out_of_bounds_upper_5m
expr
:
|
gitlab_service_errors:rate
>
gitlab_service_errors:rate:avg_over_time_1w +
2.5
* gitlab_service_errors:rate:stddev_over_time_1w
gitlab_service_errors:rate:avg_over_time_1w +
3
* gitlab_service_errors:rate:stddev_over_time_1w
for
:
5m
labels
:
rules_domain
:
general
...
...
@@ -136,7 +136,7 @@ groups:
severity
:
warn
period
:
5m
bound
:
upper
threshold_sigma
:
"
2.5
"
threshold_sigma
:
"
3
"
annotations
:
description
:
|
The `{{ $labels.type }}` service is generating more errors than normal.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment