Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add finalizer to avoid premature CRD Deletion #5788

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

RRap0so
Copy link
Contributor

@RRap0so RRap0so commented Oct 1, 2024

Tracking issue

Closes #5786

Why are the changes needed?

To make sure Workflows aren't prematurely deleted by Flyteadmin and FlytePropeller can properly transitions the states to Aborted

What changes were proposed in this pull request?

How was this patch tested?

Unit Tested

Tested in a staging environment manually.

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

Copy link

codecov bot commented Oct 1, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 36.32%. Comparing base (66ff152) to head (9fb1a0e).

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #5788   +/-   ##
=======================================
  Coverage   36.31%   36.32%           
=======================================
  Files        1304     1304           
  Lines      110048   110049    +1     
=======================================
+ Hits        39964    39974   +10     
+ Misses      65928    65919    -9     
  Partials     4156     4156           
Flag Coverage Δ
unittests-datacatalog 51.37% <ø> (ø)
unittests-flyteadmin 55.61% <100.00%> (+0.03%) ⬆️
unittests-flytecopilot 12.17% <ø> (ø)
unittests-flytectl 62.26% <ø> (+0.04%) ⬆️
unittests-flyteidl 7.12% <ø> (ø)
unittests-flyteplugins 53.35% <ø> (ø)
unittests-flytepropeller 41.93% <ø> (ø)
unittests-flytestdlib 55.37% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@RRap0so RRap0so marked this pull request as ready for review October 1, 2024 08:27
@pvditt
Copy link
Contributor

pvditt commented Oct 1, 2024

concern if propeller never picks up the FlyteWorkflow CRD then the CRD won't be able to get garbage collected.

@@ -129,6 +129,9 @@ func PrepareFlyteWorkflow(data interfaces.ExecutionData, flyteWorkflow *v1alpha1
acceptAtWrapper := v1.NewTime(data.ExecutionParameters.AcceptedAt)
flyteWorkflow.AcceptedAt = &acceptAtWrapper

// Add finalizer
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@EngHabu I believe in their scenario, the CRD is getting deleted before propeller has had the chance to evaluate (and set the finalizer for) the external workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Aborting Sub-Workflows filling up the admin-launcher Cache
3 participants