Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Site alerts should check for multiple requests #243

Open
jchristgit opened this issue Apr 27, 2024 · 0 comments
Open

Site alerts should check for multiple requests #243

jchristgit opened this issue Apr 27, 2024 · 0 comments
Labels
component: monitoring An issue relating to a monitoring component (e.g. Prometheus, Grafana) component: networking An issue relating to a host networking (e.g. DNS, WireGuard, SSH) group: kubernetes Issues and pull requests related to the Kubernetes setup

Comments

@jchristgit
Copy link
Member

We occasionally receive alerts for endpoints that were only hit one or a few
times, in which cases we do not care about e.g. 4xx errors or high latency.

Update our Prometheus alerting rules to only alert for these when multiple
requests were affected by it.
@jchristgit jchristgit added component: monitoring An issue relating to a monitoring component (e.g. Prometheus, Grafana) component: networking An issue relating to a host networking (e.g. DNS, WireGuard, SSH) group: kubernetes Issues and pull requests related to the Kubernetes setup labels Apr 27, 2024
@jchristgit jchristgit assigned jchristgit and unassigned jchristgit May 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
component: monitoring An issue relating to a monitoring component (e.g. Prometheus, Grafana) component: networking An issue relating to a host networking (e.g. DNS, WireGuard, SSH) group: kubernetes Issues and pull requests related to the Kubernetes setup
Projects
Infrastructure
Status: Backlog
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jchristgit