Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

POC feat: add support for celery multiqueue #1131

Closed
wants to merge 2 commits into from

Conversation

Ian2012
Copy link
Contributor

@Ian2012 Ian2012 commented Oct 4, 2024

Description

This PR allows to deploy multiple Celery deployments with different settings and queues for each one:

@Ian2012 Ian2012 changed the base branch from master to regisb/celery October 4, 2024 21:49
@Ian2012 Ian2012 marked this pull request as ready for review October 4, 2024 21:52
@@ -514,6 +514,9 @@ def your_filter_callback(some_data):
#: :param str file_path: The path to the file being checked.
IS_FILE_RENDERED: Filter[bool, [str]] = Filter()

#: List of workers
CELERY_WORKERS_CONFIG: Filter[dict[str, dict[str, Any]], []] = Filter()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not in favor of a filter that would be used to create extra containers. There is already another mechanisms to do that, which is patching the docker-compose/deployments.yml files. Let's avoid creating another one.

Let's continue this conversation in the corresponding issue (#1130).

@Ian2012 Ian2012 changed the title feat: add support for celery multiqueue POC feat: add support for celery multiqueue Oct 7, 2024
@Ian2012 Ian2012 marked this pull request as draft October 7, 2024 15:10
@regisb regisb deleted the branch overhangio:regisb/celery October 8, 2024 06:12
@regisb regisb closed this Oct 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants