Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: remove autoscaling configuration from sentry ingest components #1432

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from

Conversation

patsevanton
Copy link
Contributor

@patsevanton patsevanton commented Sep 7, 2024

Changes:

This pull request removes the autoscaling configuration from the Sentry Ingest components. The primary reason for this change is that the number of replicas needs to be kept equal to the number of partitions in Kafka, which is managed manually.

Details:

  • Deployment Files:

    • Removed conditions for setting the number of replicas if autoscaling is disabled.
    • Removed autoscaling settings from the Deployment templates.
  • values.yaml:

    • Removed autoscaling settings for all Sentry Ingest components.

Related Pull Request:

Please review and merge if everything looks good.

Thanks!

@patsevanton
Copy link
Contributor Author

What do you think about this pull request ?

@Mokto
Copy link
Contributor

Mokto commented Sep 10, 2024

Autoscaling wise, you need to make sure sure replicas < partitions right ? It doesn't have to be the exact same number.

@maths22
Copy link

maths22 commented Sep 16, 2024

FWIW we are using the autoscaling on the ingest consumers in production and it has been working well (we have more partitions created than we expect to generally have consumers provisioned, so it appropriately adds/removes work). The key indeed is just that you can't have more workers than partitions or some of them will have no work to do.

@patsevanton
Copy link
Contributor Author

@maths22 how does hpa work for you if this file is not in the help chat (https://github.com/sentry-kubernetes/charts/tree/develop/charts/sentry/templates/sentry/ingest/monitors ) ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants