Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add alerts for alloy-metrics #1417

Merged
merged 30 commits into from
Nov 12, 2024
Merged

add alerts for alloy-metrics #1417

merged 30 commits into from
Nov 12, 2024

Conversation

QuentinBisson
Copy link
Contributor

Before adding a new alerting rule into this repository you should consider creating an SLO rules instead.
SLO helps you both increase the quality of your monitoring and reduce the alert noise.


Towards: giantswarm/roadmap#3590

This PR adds alert for the alloy monitoring component. See Changelog for more context

Checklist

@QuentinBisson QuentinBisson self-assigned this Nov 5, 2024
@QuentinBisson QuentinBisson requested a review from a team as a code owner November 5, 2024 21:37
@QuentinBisson
Copy link
Contributor Author

Ops-recipe update https://github.com/giantswarm/giantswarm/pull/32043

Base automatically changed from alloy-monitoring-monitoring to main November 7, 2024 12:12
cancel_if_cluster_status_creating: "true"
cancel_if_cluster_status_deleting: "true"
## This alert pages if any of the monitoring-agent shard is not running.
- alert: MonitoringAgentShardsNotSatisfied
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's no unit test for this one and its associated inhibition?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I might have forgotten them

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added alerts for those :)

@QuentinBisson
Copy link
Contributor Author

Do you mind reviewing the opsrecipes again @hervenicol

@QuentinBisson QuentinBisson merged commit 4abf059 into main Nov 12, 2024
7 checks passed
@QuentinBisson QuentinBisson deleted the alerts-for-alloy-metrics branch November 12, 2024 07:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants