Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Monorepo] - Step 1 - Import golang repos #3881

Closed
wants to merge 1,948 commits into from
Closed

[Monorepo] - Step 1 - Import golang repos #3881

wants to merge 1,948 commits into from
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Nov 10, 2022

  1. Adding configurable audience property for flyte clients (#485) 

    * Adding configurable audience property for flyte clients

Signed-off-by: pmahindrakar-oss <[email protected]>

* gen

Signed-off-by: pmahindrakar-oss <[email protected]>

Signed-off-by: pmahindrakar-oss <[email protected]>
    @pmahindrakar-oss
    pmahindrakar-oss authored Nov 10, 2022
    Configuration menu
    Copy the full SHA
    acbf818 View commit details
    Browse the repository at this point in the history

  2. Scoop update for datacatalog version v1.0.12

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    e85a258 View commit details
    Browse the repository at this point in the history

  3. Scoop update for datacatalog version v1.0.13

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    c665e36 View commit details
    Browse the repository at this point in the history

  4. Scoop update for datacatalog version v1.0.14

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    98b576a View commit details
    Browse the repository at this point in the history

  5. Scoop update for datacatalog version v1.0.15

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    3da7807 View commit details
    Browse the repository at this point in the history

  6. Scoop update for datacatalog version v1.0.16

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    7ef37bb View commit details
    Browse the repository at this point in the history

  7. Scoop update for datacatalog version v1.0.17

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    705372b View commit details
    Browse the repository at this point in the history

  8. Scoop update for datacatalog version v1.0.18

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    dc78779 View commit details
    Browse the repository at this point in the history

  9. Scoop update for datacatalog version v1.0.19

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    ebb888a View commit details
    Browse the repository at this point in the history

  10. Scoop update for datacatalog version v1.0.20

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    4386152 View commit details
    Browse the repository at this point in the history

  11. Scoop update for datacatalog version v1.0.21

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    657b487 View commit details
    Browse the repository at this point in the history

  12. Scoop update for datacatalog version v1.0.22

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    3f8a902 View commit details
    Browse the repository at this point in the history

  13. Scoop update for datacatalog version v1.0.23

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    3cab9d2 View commit details
    Browse the repository at this point in the history

  14. Scoop update for datacatalog version v1.0.24

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    13d3392 View commit details
    Browse the repository at this point in the history

  15. Scoop update for datacatalog version v1.0.25

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    2dd058f View commit details
    Browse the repository at this point in the history

  16. Scoop update for datacatalog version v1.0.26

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    5e4919d View commit details
    Browse the repository at this point in the history

  17. Scoop update for datacatalog version v1.0.27

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    93c6f1c View commit details
    Browse the repository at this point in the history

  18. Scoop update for datacatalog version v1.0.28

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    e778037 View commit details
    Browse the repository at this point in the history

  19. Scoop update for datacatalog version v1.0.29

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    f2e8698 View commit details
    Browse the repository at this point in the history

  20. Scoop update for datacatalog version v1.0.30

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    1ccef8f View commit details
    Browse the repository at this point in the history

  21. Scoop update for datacatalog version v1.0.31

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    0da13f4 View commit details
    Browse the repository at this point in the history

  22. Scoop update for datacatalog version v1.0.32

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    cb29556 View commit details
    Browse the repository at this point in the history

  23. Scoop update for datacatalog version v1.0.33

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    242855c View commit details
    Browse the repository at this point in the history

  24. Scoop update for datacatalog version v1.0.34

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    0add563 View commit details
    Browse the repository at this point in the history

  25. Scoop update for datacatalog version v1.0.35

    @goreleaserbot
    goreleaserbot committed Nov 10, 2022
    Configuration menu
    Copy the full SHA
    049b289 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2022

  1. Ignore codecov upload failures (#144) 

    * disable codecov

Signed-off-by: Dan Rammer <[email protected]>

* bump codecov action verison

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Nov 14, 2022
    Configuration menu
    Copy the full SHA
    ab23187 View commit details
    Browse the repository at this point in the history

  2. Skipping of cached task outputs via execution config (#482) 

    * Implemented SkipCache handling for execution config

Signed-off-by: Nick Müller <[email protected]>

* Added cache skip override to RelaunchExecution endpoint

Signed-off-by: Nick Müller <[email protected]>

* Updated to latest version of flytepropeller

Signed-off-by: Nick Müller <[email protected]>

* Renamed SkipCache flag to OverwriteCache
Updated to latest released versions of flyteidl, flyteplugins and flytestdlib
Updated to latest unmerged version of flytepropeller

Signed-off-by: Nick Müller <[email protected]>

* Updated flyteidl, flytepropeller and flytestdlib to latest released versions

Signed-off-by: Nick Müller <[email protected]>

* Reworded comment for clarity

Signed-off-by: Nick Müller <[email protected]>

Signed-off-by: Nick Müller <[email protected]>
    Nick Müller authored Nov 14, 2022
    Configuration menu
    Copy the full SHA
    4cc2381 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2022

  1. Scoop update for datacatalog version v1.0.36

    @goreleaserbot
    goreleaserbot committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    6754c37 View commit details
    Browse the repository at this point in the history

  2. Scoop update for datacatalog version v1.0.37

    @goreleaserbot
    goreleaserbot committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    b63cb36 View commit details
    Browse the repository at this point in the history

  3. Remove scoop stanza from .goreleaser.yaml (#85) 

    Signed-off-by: Eduardo Apolinario <[email protected]>

Signed-off-by: Eduardo Apolinario <[email protected]>
Co-authored-by: Eduardo Apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Nov 15, 2022
    Configuration menu
    Copy the full SHA
    b355f97 View commit details
    Browse the repository at this point in the history

  4. Scoop update for datacatalog version v1.0.38

    @goreleaserbot
    goreleaserbot committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    8a0429f View commit details
    Browse the repository at this point in the history

  5. Remove shard prefix from upload location (#489) 

    Signed-off-by: Manuel Rombach <[email protected]>

Signed-off-by: Manuel Rombach <[email protected]>
    @manuelrombach
    manuelrombach authored Nov 15, 2022
    Configuration menu
    Copy the full SHA
    0e1cc8b View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2022

  1. Ignore codecov upload failures (#295) 

    * disable codecov

Signed-off-by: Dan Rammer <[email protected]>

* bump codecov action version

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Nov 16, 2022
    Configuration menu
    Copy the full SHA
    aa06e38 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2022

  1. Fix error message when output file is too large to read (#296) 

    Signed-off-by: Haytham Abuelfutuh <[email protected]>

Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Nov 17, 2022
    Configuration menu
    Copy the full SHA
    85c512e View commit details
    Browse the repository at this point in the history

  2. Implement CreateDownloadLink (#492)

    @EngHabu
    EngHabu authored Nov 17, 2022
    Configuration menu
    Copy the full SHA
    1c6a0f0 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2022

  1. updating end2end tests from boilerplate (#497) 

    Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Nov 28, 2022
    Configuration menu
    Copy the full SHA
    36c4371 View commit details
    Browse the repository at this point in the history

  2. updating end2end tests from boilerplate (#504) 

    Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Nov 28, 2022
    Configuration menu
    Copy the full SHA
    c6bb636 View commit details
    Browse the repository at this point in the history

  3. Bump flyteplugins to v1.0.20 (#503) 

    Signed-off-by: live-wire <[email protected]>

Signed-off-by: live-wire <[email protected]>
Co-authored-by: Dan Rammer <[email protected]>
    @live-wire @hamersaw
    live-wire and hamersaw authored Nov 28, 2022
    Configuration menu
    Copy the full SHA
    9c9918b View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2022

  1. Use checksums to track applied state of cluster resource templates (#496 

    )

* Use checksums to track applied state of cluster resource templates

Signed-off-by: Andrew Dye <[email protected]>

* Fix lints

Signed-off-by: Andrew Dye <[email protected]>

Signed-off-by: Andrew Dye <[email protected]>
    @andrewwdye
    andrewwdye authored Nov 29, 2022
    Configuration menu
    Copy the full SHA
    8f27daa View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2022

  1. Added test for bad config for task logs (#298)

    @pmahindrakar-oss
    pmahindrakar-oss authored Nov 30, 2022
    Configuration menu
    Copy the full SHA
    b0f20e8 View commit details
    Browse the repository at this point in the history

  2. check deck uri exists before checking for datastore existance (#506) 

    Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Nov 30, 2022
    Configuration menu
    Copy the full SHA
    6de8831 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2022

  1. The status of the AWS batch job should become failed once the retry l… 

    …imit exceeded (#291)

* Turn PhaseRetryableFailure into PhaseRetryLimitExceededFailure

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* update test

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* update tests

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* udpate

Signed-off-by: Kevin Su <[email protected]>

* address comment

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Dec 1, 2022
    Configuration menu
    Copy the full SHA
    d5295d2 View commit details
    Browse the repository at this point in the history

  2. Add support for GateNode with signal and sleep condition (#436) 

    * Update flyteidl version

Signed-off-by: Flyte-Bot <[email protected]>

* Update flyteidl version

Signed-off-by: Flyte-Bot <[email protected]>

* Fix build break

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update flyteidl version

Signed-off-by: Flyte-Bot <[email protected]>

* added GateNode to compiler

Signed-off-by: Daniel Rammer <[email protected]>

* added gate node handler

Signed-off-by: Daniel Rammer <[email protected]>

* enable reading and setting gate node state

Signed-off-by: Daniel Rammer <[email protected]>

* gate nodes working

Signed-off-by: Daniel Rammer <[email protected]>

* changed Conditional to Condition in proto naming

Signed-off-by: Daniel Rammer <[email protected]>

* passing admin client to gate node handler

Signed-off-by: Daniel Rammer <[email protected]>

* using signal service client to check for signal in admin and write output

Signed-off-by: Daniel Rammer <[email protected]>

* updated comments

Signed-off-by: Daniel Rammer <[email protected]>

* completed implementation

Signed-off-by: Daniel Rammer <[email protected]>

* added unit tests for gate node

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests with missing signal mocks

Signed-off-by: Daniel Rammer <[email protected]>

* added docs on gate node handler

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* updating flyteidl dependency

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issue

Signed-off-by: Daniel Rammer <[email protected]>

* added output variable name to signal condition

Signed-off-by: Daniel Rammer <[email protected]>

* using last attempt started at timestamp on node context rather than tracking in gate node status

Signed-off-by: Daniel Rammer <[email protected]>

* updated GateNodeStatus mocks

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issue

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl deps

Signed-off-by: Daniel Rammer <[email protected]>

* update flyteidl deps

Signed-off-by: Daniel Rammer <[email protected]>

* added interface validation for approve condition

Signed-off-by: Daniel Rammer <[email protected]>

* added approve condition unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed missed merge conflict updating to slice of dial options

Signed-off-by: Daniel Rammer <[email protected]>

* update generated mocks

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Flyte-Bot <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Daniel Rammer <[email protected]>
Signed-off-by: Dan Rammer <[email protected]>
Co-authored-by: flyte-bot <[email protected]>
Co-authored-by: Haytham Abuelfutuh <[email protected]>
    @hamersaw @flyte-bot @EngHabu
    3 people authored Dec 1, 2022
    Configuration menu
    Copy the full SHA
    4114572 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2022

  1. adding signal to context (#137) 

    Signed-off-by: Daniel Rammer <[email protected]>

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 2, 2022
    Configuration menu
    Copy the full SHA
    80d1624 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2022

  1. Fixed ExecutionInfo/TaskNodeInfo not being assigned properly for dyna… 

    …mic parent nodes (#501)

Signed-off-by: Nick Müller <[email protected]>

Signed-off-by: Nick Müller <[email protected]>
    Nick Müller authored Dec 5, 2022
    Configuration menu
    Copy the full SHA
    46439c6 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2022

  1. Updated default subqueue base delay to 0 (#497) 

    * updated subqueue base delay to 0

Signed-off-by: Daniel Rammer <[email protected]>

* increases rate and capacit of queue and subqueue

Signed-off-by: Daniel Rammer <[email protected]>

Signed-off-by: Daniel Rammer <[email protected]>
Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 8, 2022
    Configuration menu
    Copy the full SHA
    b5ddbeb View commit details
    Browse the repository at this point in the history

  2. Add httpProxyURL support in OAuth2 (#500) 

    Allows operators to specify an external HTTP Proxy to do OAuth. 

Often the On-Prem deployments don't have a direct external (internet) access to do OAuth2 and is usually enabled through an external Proxy. This commit allows operators of Flyte to provide an HTTP Proxy URL to do the OAuth.
Signed-off-by: Ankit Goyal <[email protected]>


Signed-off-by: Ankit Goyal <[email protected]>
    @goyalankit
    goyalankit authored Dec 8, 2022
    Configuration menu
    Copy the full SHA
    5df4f41 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2022

  1. Add launch entity type to execution model (#501)

    @katrogan
    katrogan authored Dec 10, 2022
    Configuration menu
    Copy the full SHA
    77157ff View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. Fix typo in launch entity rollback (#502) 

    Signed-off-by: Katrina Rogan <[email protected]>

Signed-off-by: Katrina Rogan <[email protected]>
    @katrogan
    katrogan authored Dec 12, 2022
    Configuration menu
    Copy the full SHA
    fce143d View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2022

  1. Fixed nil panic on gate node sleep check (#507) 

    * fixed nil panic on gate node sleep check

Signed-off-by: Dan Rammer <[email protected]>

* lint issue

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    cb85125 View commit details
    Browse the repository at this point in the history

  2. Implement signal service for human-in-the-loop workflow orchestration (… 

    …#423)


Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    a1804d5 View commit details
    Browse the repository at this point in the history

  3. Adding CheckAndFetchInputsForExecution on single task executions (#495) 

    * adding CheckAndFetchInputsForExecution on single task executions

Signed-off-by: Dan Rammer <[email protected]>

* fixed unit test

Signed-off-by: Dan Rammer <[email protected]>

* fixed typo

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    905e7ee View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2022

  1. Update kafka config (#499) 

    * Update kafka config

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* update cnofig

Signed-off-by: Kevin Su <[email protected]>

* Update pkg/runtime/interfaces/application_configuration.go

Co-authored-by: Dan Rammer <[email protected]>
Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
Signed-off-by: Kevin Su <[email protected]>
Co-authored-by: Dan Rammer <[email protected]>
    @pingsutw @hamersaw
    pingsutw and hamersaw authored Dec 14, 2022
    Configuration menu
    Copy the full SHA
    6037335 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2022

  1. Expose kubeclient configuration (#491) 

    * expose and use kubeclient configs if available

Signed-off-by: Babis Kiosidis <[email protected]>

* omit empty kubeclientconfig

Signed-off-by: Babis Kiosidis <[email protected]>

* setting configuration on all kubeclients

Signed-off-by: Daniel Rammer <[email protected]>

* addressing PR renaming comments

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Babis Kiosidis <[email protected]>
Signed-off-by: Daniel Rammer <[email protected]>
Signed-off-by: Dan Rammer <[email protected]>
Co-authored-by: Babis Kiosidis <[email protected]>
    @hamersaw @ckiosidis
    hamersaw and ckiosidis authored Dec 15, 2022
    Configuration menu
    Copy the full SHA
    5300f92 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. Apply default pod template to PytorchJob pods (#297) 

    * Merge pod template spec with pod spec in separate func

Signed-off-by: Fabio Grätz <[email protected]>

* Merge pod template spec with pod spec in separate func

Signed-off-by: Fabio Grätz <[email protected]>

* Apply pod template to pytorch job pod spec

Signed-off-by: Fabio Grätz <[email protected]>

* Handle nil podspecs before merging

Signed-off-by: Fabio Grätz <[email protected]>

* Pass both default and primare container name to MergePodSpecs

Signed-off-by: Fabio Grätz <[email protected]>

* Move podSpec.DeepCopy into MergePodSpecs

Signed-off-by: Fabio Grätz <[email protected]>

* Add tests

Signed-off-by: Fabio Grätz <[email protected]>

* Merge pod template into tfjob and mpijob

Signed-off-by: Fabio Grätz <[email protected]>

* Lint

Signed-off-by: Fabio Grätz <[email protected]>

* Correct usage of default and primate container (template) name

Signed-off-by: Fabio Grätz <[email protected]>

* Override mpi default container name

Signed-off-by: Fabio Grätz <[email protected]>

* Carry over ObjectMeta from pod template

Signed-off-by: Fabio Grätz <[email protected]>

* Remove old `TestBuildPodWithSpec` test

Signed-off-by: Fabio Grätz <[email protected]>

Signed-off-by: Fabio Grätz <[email protected]>
Co-authored-by: Fabio Grätz <[email protected]>
    @fg91
    fg91 and Fabio Grätz authored Dec 16, 2022
    Configuration menu
    Copy the full SHA
    428b7a4 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2022

  1. Add support Databricks plugin (#299) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Dec 19, 2022
    Configuration menu
    Copy the full SHA
    ab3ee8a View commit details
    Browse the repository at this point in the history

  2. Add support Databricks plugin (#510) 

    * update idl

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* update loader

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* Updare plugin

Signed-off-by: Kevin Su <[email protected]>

* Updare plugin

Signed-off-by: Kevin Su <[email protected]>

* Updare plugin

Signed-off-by: Kevin Su <[email protected]>

* Updare plugin

Signed-off-by: Kevin Su <[email protected]>

* Updare plugin

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* updateidl

Signed-off-by: Kevin Su <[email protected]>

* go import

Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Dec 19, 2022
    Configuration menu
    Copy the full SHA
    34c4e43 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2022

  1. Move secrets from cmd to auth (#505) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Dec 20, 2022
    Configuration menu
    Copy the full SHA
    ee8de0f View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2022

  1. Update toleration and annotations in ray pod spec (#302) 

    Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Dec 22, 2022
    Configuration menu
    Copy the full SHA
    2859755 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2022

  1. PodSpec NodeSelectors overwrite the default k8s plugin settings (#303) 

    * PodSpec NodeSelectors overwrite the default k8s plugin settings

Signed-off-by: Dan Rammer <[email protected]>

* added unit test

Signed-off-by: Dan Rammer <[email protected]>

* better node selector value

Signed-off-by: Dan Rammer <[email protected]>

* fixed issue with unionmaps where k8s plugin overrides labels

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 27, 2022
    Configuration menu
    Copy the full SHA
    8efeda7 View commit details
    Browse the repository at this point in the history

  2. Fix issue where k8s plugin default labels override those set on pod (#… 

    …511)

* fixing issue where k8s plugin default labels override those set on pod

Signed-off-by: Dan Rammer <[email protected]>

* updated flyteplugins dependency

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Dec 27, 2022
    Configuration menu
    Copy the full SHA
    e7b2b94 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2022

  1. Add SignalService http handler (#506) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Dec 28, 2022
    Configuration menu
    Copy the full SHA
    ec5528d View commit details
    Browse the repository at this point in the history

  2. Doc hub proposal (#452) 

    * Doc Hub Proposal

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* fix test error

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* update database schema

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* Fixed tests

Signed-off-by: Kevin Su <[email protected]>

* Fixed tests

Signed-off-by: Kevin Su <[email protected]>

* More tests

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* list description entity

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

* register docs when creating task

Signed-off-by: Kevin Su <[email protected]>

* update go.sum

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* Fix tests

Signed-off-by: Kevin Su <[email protected]>

* Fix tests

Signed-off-by: Kevin Su <[email protected]>

* Fix tests

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* Add short description to workflow

Signed-off-by: Kevin Su <[email protected]>

* fix test

Signed-off-by: Kevin Su <[email protected]>

* fix test

Signed-off-by: Kevin Su <[email protected]>

* fix test

Signed-off-by: Kevin Su <[email protected]>

* fix test

Signed-off-by: Kevin Su <[email protected]>

* more test

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* Lint

Signed-off-by: Kevin Su <[email protected]>

* update to one transation

Signed-off-by: Kevin Su <[email protected]>

* Fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* update comment

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* Bump idl

Signed-off-by: Kevin Su <[email protected]>

* update tests

Signed-off-by: Kevin Su <[email protected]>

* update tests

Signed-off-by: Kevin Su <[email protected]>

* update tests

Signed-off-by: Kevin Su <[email protected]>

* Add identifier

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* merged master

Signed-off-by: Kevin Su <[email protected]>

* Address comment

Signed-off-by: Kevin Su <[email protected]>

* Address comment

Signed-off-by: Kevin Su <[email protected]>

* update migrations.go

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* Merged master

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Dec 28, 2022
    Configuration menu
    Copy the full SHA
    d2215ed View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2023

  1. Fix gate node approve condition node interface binding validation (#512) 

    * added random print statements

Signed-off-by: Dan Rammer <[email protected]>

* random print statement

Signed-off-by: Dan Rammer <[email protected]>

* infering gate node approve condition input and output variables from upstream nodes

Signed-off-by: Dan Rammer <[email protected]>

* removed print statements

Signed-off-by: Dan Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Dan Rammer <[email protected]>

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jan 3, 2023
    Configuration menu
    Copy the full SHA
    08bdbd0 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2023

  1. Add podUID as a template input in tasklog plugin (#304) 

    Signed-off-by: Ankit Goyal <[email protected]>

Signed-off-by: Ankit Goyal <[email protected]>
    @goyalankit
    goyalankit authored Jan 4, 2023
    Configuration menu
    Copy the full SHA
    9eeb694 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2023

  1. Update flyteplugin version to v1.0.27 (#513) 

    Signed-off-by: Ankit Goyal <[email protected]>

Signed-off-by: Ankit Goyal <[email protected]>
    @goyalankit
    goyalankit authored Jan 5, 2023
    Configuration menu
    Copy the full SHA
    1feca6d View commit details
    Browse the repository at this point in the history

  2. Add dask plugin #patch (#275) 

    * First working version with DaskCluster

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Update plugin

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add container customization

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add correct `getTaskPhase`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Refactor dask.go

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Use new dask operator which includes a status

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add first tests and use data from flyteidl

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Refactor tests

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add support for custom namespace

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add support for passing on annotations

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add support for env vars

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add default container logic to job runner

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add TestGetTaskPhaseDask

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add logs to task info

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Use tagged version of dask go operator

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix linting issues

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Refactor `ToK8sResourceRequirements`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Use platform resources by default

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix incorrect resources

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Remove namespace

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Don't restart job runner and scheduler

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Run `go mod tidy` after rebase

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Run formatter

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Update to new `flyteidl`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add support for interruptible workers

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Update flytekit to 1.4.0

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix linting errors

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Update `flyteidl` to 1.3.2

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Reorder imports

Signed-off-by: Bernhard Stadlbauer <[email protected]>

Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jan 5, 2023
    Configuration menu
    Copy the full SHA
    36c0b41 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2023

  1. Add dask plugin (#508) 

    * Add dask plugin

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Use `ToK8sResourceRequirements` from flyteplugins

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Run go mod tidy after merge

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Update flyteplugins to 1.0.28

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix linting error

Signed-off-by: Bernhard Stadlbauer <[email protected]>

Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jan 7, 2023
    Configuration menu
    Copy the full SHA
    d2098fc View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2023

  1. Publish multi-architecture image (#88) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Jan 9, 2023
    Configuration menu
    Copy the full SHA
    faa86db View commit details
    Browse the repository at this point in the history

  2. Publish multi-architecture image (#514) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Jan 9, 2023
    Configuration menu
    Copy the full SHA
    0b5007b View commit details
    Browse the repository at this point in the history

  3. Publish multi-architecture image (#510) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Jan 9, 2023
    Configuration menu
    Copy the full SHA
    cb1224b View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2023

  1. Add user name to UserInfoResponse header (#507)

    @katrogan
    katrogan authored Jan 10, 2023
    Configuration menu
    Copy the full SHA
    d6bc85d View commit details
    Browse the repository at this point in the history

  2. Add TensorFlow to loader.go (#515) 

    * Add tensorflow to loader.go

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jan 10, 2023
    Configuration menu
    Copy the full SHA
    8cbb05a View commit details
    Browse the repository at this point in the history

  3. added raw-container to registered task types (#305) 

    Signed-off-by: Felix Ruess <[email protected]>

Signed-off-by: Felix Ruess <[email protected]>
    @flixr
    flixr authored Jan 10, 2023
    Configuration menu
    Copy the full SHA
    109224c View commit details
    Browse the repository at this point in the history

  4. Forward all claims in userinfo response (#511)

    @katrogan
    katrogan authored Jan 10, 2023
    Configuration menu
    Copy the full SHA
    1ccd59c View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2023

  1. use different perm (#517) 

    Signed-off-by: Yee Hing Tong <[email protected]>

Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Jan 11, 2023
    Configuration menu
    Copy the full SHA
    ce57dbf View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2023

  1. fix comments (#309) 

    Signed-off-by: byronhsu <[email protected]>

Signed-off-by: byronhsu <[email protected]>
    @ByronHsu
    ByronHsu authored Jan 19, 2023
    Configuration menu
    Copy the full SHA
    b8d3ea9 View commit details
    Browse the repository at this point in the history

  2. Update flyteidl version (#490) 

    Signed-off-by: Flyte-Bot <[email protected]>

Signed-off-by: Flyte-Bot <[email protected]>
Co-authored-by: flyte-bot <[email protected]>
    @flyte-bot
    flyte-bot and flyte-bot authored Jan 19, 2023
    Configuration menu
    Copy the full SHA
    2014630 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2023

  1. Add env FLYTE_FAIL_ON_ERROR to aws batch job (#306) 

    * Correct aws batch job state

Signed-off-by: Kevin Su <[email protected]>

* Add env FAST_ON_ERROR to aws batch job

Signed-off-by: Kevin Su <[email protected]>

* Add tests

Signed-off-by: Kevin Su <[email protected]>

* update tests

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* update test

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

Signed-off-by: Kevin Su <[email protected]>
Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jan 23, 2023
    Configuration menu
    Copy the full SHA
    4634a81 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2023

  1. enabling connection pooling (#89) 

    Signed-off-by: Daniel Rammer <[email protected]>

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jan 25, 2023
    Configuration menu
    Copy the full SHA
    24d8aba View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2023

  1. Discard fields when replica number equals zero to avoid api client er… 

    …ror (#313)

* Discard field when replica number equals zero to avoid api client error

Signed-off-by: byhsu <[email protected]>

* Improve comments

Signed-off-by: byhsu <[email protected]>

* added more checks to replica counts in kubeflow operators

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: byhsu <[email protected]>
Signed-off-by: Daniel Rammer <[email protected]>
Co-authored-by: byhsu <[email protected]>
Co-authored-by: Daniel Rammer <[email protected]>
    @ByronHsu @hamersaw
    3 people authored Feb 1, 2023
    Configuration menu
    Copy the full SHA
    471a262 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2023

  1. Adding support for per-task PodTemplate configuration (#308) 

    * implemented

Signed-off-by: Daniel Rammer <[email protected]>

* unit tests working

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* updated documentation

Signed-off-by: Daniel Rammer <[email protected]>

* removing unnecessarily commented lines

Signed-off-by: Daniel Rammer <[email protected]>

* updated unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* updated docs

Signed-off-by: Daniel Rammer <[email protected]>

* if user provides PodTemplate name and it doesn't exist we should fail

Signed-off-by: Daniel Rammer <[email protected]>

* updated for new flyteidl definition

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* working with either container or pod passed in task template

Signed-off-by: Daniel Rammer <[email protected]>

* cleaned up definitions

Signed-off-by: Daniel Rammer <[email protected]>

* fixing up unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* removed dead code

Signed-off-by: Daniel Rammer <[email protected]>

* removing more dead code

Signed-off-by: Daniel Rammer <[email protected]>

* remove more dead code

Signed-off-by: Daniel Rammer <[email protected]>

* correctly applying resources for container and pod tasks

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl version

Signed-off-by: Daniel Rammer <[email protected]>

* moved sidecar parsing to pod plugin

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* updating semantics to address review comments

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 6, 2023
    Configuration menu
    Copy the full SHA
    c4abd4f View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2023

  1. bumping go version to 1.19 (#150) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 7, 2023
    Configuration menu
    Copy the full SHA
    82d114b View commit details
    Browse the repository at this point in the history

  2. Bump go version to 1.19 (#90) 

    * bump go version to 1.19

Signed-off-by: Daniel Rammer <[email protected]>

* bumped flyteidl and flytestdlib

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 7, 2023
    Configuration menu
    Copy the full SHA
    b526b0c View commit details
    Browse the repository at this point in the history

  3. Bumping go version to 1.19 (#316) 

    * bumping go version to 1.19

Signed-off-by: Daniel Rammer <[email protected]>

* fixed linter

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit test

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl and flytestdlib

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 7, 2023
    Configuration menu
    Copy the full SHA
    07bc0a9 View commit details
    Browse the repository at this point in the history

  4. Updating PodTemplateStore API (#516) 

    * updated pod template store handling

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* updating flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl and flyteplugins versions

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl and flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

* bumping go version to 1.19

Signed-off-by: Daniel Rammer <[email protected]>

* fixed linter

Signed-off-by: Daniel Rammer <[email protected]>

* bumping setup-go action

Signed-off-by: Daniel Rammer <[email protected]>

* using different flytetools branch

Signed-off-by: Daniel Rammer <[email protected]>

* fixed go generate

Signed-off-by: Daniel Rammer <[email protected]>

* using master branch of flytetools

Signed-off-by: Daniel Rammer <[email protected]>

* removed secrets from unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* maybe surround go-version in quotes

Signed-off-by: Daniel Rammer <[email protected]>

* specific 1.19.5 version

Signed-off-by: Daniel Rammer <[email protected]>

* moved go-version before secrets

Signed-off-by: Daniel Rammer <[email protected]>

* OMG

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyte deps

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 7, 2023
    Configuration menu
    Copy the full SHA
    92cd1b7 View commit details
    Browse the repository at this point in the history

  5. Bumping go version to 1.19 (#518) 

    * bumping go version to 1.19

Signed-off-by: Daniel Rammer <[email protected]>

* fixed go generatea

Signed-off-by: Daniel Rammer <[email protected]>

* updated flytetools branch to master

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 7, 2023
    Configuration menu
    Copy the full SHA
    a89b359 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2023

  1. sending correct external resources for k8s-array plugin (#300) 

    * sending correct external resources for k8s-array plugin

Signed-off-by: Dan Rammer <[email protected]>

* bumping phase versions

Signed-off-by: Dan Rammer <[email protected]>

* using externalResources in aws-batch plugin

Signed-off-by: Dan Rammer <[email protected]>

* lint issues

Signed-off-by: Dan Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Dan Rammer <[email protected]>

* removed unnecessary comments

Signed-off-by: Dan Rammer <[email protected]>

* reverted permanent failure computation

Signed-off-by: Dan Rammer <[email protected]>

---------

Signed-off-by: Dan Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 8, 2023
    Configuration menu
    Copy the full SHA
    e79acfb View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2023

  1. Inline input data for execution events (#521) 

    * wip

Signed-off-by: Katrina Rogan <[email protected]>

* recovery

Signed-off-by: Katrina Rogan <[email protected]>

* test compile

Signed-off-by: Katrina Rogan <[email protected]>

* GH ur my fave diff tool

Signed-off-by: Katrina Rogan <[email protected]>

* revert styling changes

Signed-off-by: Katrina Rogan <[email protected]>

* more test

Signed-off-by: Katrina Rogan <[email protected]>

* goimports

Signed-off-by: Katrina Rogan <[email protected]>

* rm log line

Signed-off-by: Katrina Rogan <[email protected]>

* changes

Signed-off-by: Katrina Rogan <[email protected]>

* lint

Signed-off-by: Katrina Rogan <[email protected]>

* review comment

Signed-off-by: Katrina Rogan <[email protected]>

* go.mod

Signed-off-by: Katrina Rogan <[email protected]>

* review comment

Signed-off-by: Katrina Rogan <[email protected]>

---------

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Katrina Rogan <[email protected]>
Co-authored-by: Katrina Rogan <[email protected]>
    @katrogan
    katrogan and Katrina Rogan authored Feb 9, 2023
    Configuration menu
    Copy the full SHA
    95a4791 View commit details
    Browse the repository at this point in the history

  2. Bumping go version to 1.19 (#45) 

    * bumping go version to 1.19

Signed-off-by: Daniel Rammer <[email protected]>

* updated dockerfile

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 9, 2023
    Configuration menu
    Copy the full SHA
    97772fd View commit details
    Browse the repository at this point in the history

  3. Only create copilot sidecars if interface requires (#314) 

    * not creating sidecar uploader or downloader unnecessarily

Signed-off-by: Daniel Rammer <[email protected]>

* check on nil map is unnecessary

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 9, 2023
    Configuration menu
    Copy the full SHA
    5e75228 View commit details
    Browse the repository at this point in the history

  4. Inline input data for execution events (#516) 

    * wip

Signed-off-by: Katrina Rogan <[email protected]>

* tests

Signed-off-by: Katrina Rogan <[email protected]>

* revert overly authoritative goimports

Signed-off-by: Katrina Rogan <[email protected]>

* integration tests

Signed-off-by: Katrina Rogan <[email protected]>

* Update flyteidl release version

Signed-off-by: Katrina Rogan <[email protected]>

* switch statement

Signed-off-by: Katrina Rogan <[email protected]>

---------

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Katrina Rogan <[email protected]>
Co-authored-by: Katrina Rogan <[email protected]>
    @katrogan
    katrogan and Katrina Rogan authored Feb 9, 2023
    Configuration menu
    Copy the full SHA
    2e156a3 View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2023

  1. Add git branch to version package (#151) 

    * Add git branch to version package

Signed-off-by: Iaroslav Ciupin <[email protected]>
    @iaroslav-ciupin
    iaroslav-ciupin authored Feb 11, 2023
    Configuration menu
    Copy the full SHA
    0dbe3c2 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2023

  1. Rename dask port from to (#315) 

    Signed-off-by: Bernhard Stadlbauer <[email protected]>
Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Feb 13, 2023
    Configuration menu
    Copy the full SHA
    5981c35 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2023

  1. Use ResourceManager to aid in validating task resources (#517) 

    * using resource manager to validate task resources

Signed-off-by: Daniel Rammer <[email protected]>

* moving unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* docs

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Feb 14, 2023
    Configuration menu
    Copy the full SHA
    32c8dbd View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2023

  1. Truncate execution error message in list execution calls (#523)

    @katrogan
    katrogan authored Feb 16, 2023
    Configuration menu
    Copy the full SHA
    8596a56 View commit details
    Browse the repository at this point in the history

  2. Only merge system defaults when querying workflow execution config fo… 

    …r project attributes (#522)

Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Feb 16, 2023
    Configuration menu
    Copy the full SHA
    fb003b7 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2023

  1. bump golang.org/x/net from 0.5.0 to 0.7.0 (#526) 

    Bumps [golang.org/x/net](https://github.com/golang/net) from 0.5.0 to 0.7.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](golang/net@v0.5.0...v0.7.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    @dependabot
    dependabot[bot] authored Feb 18, 2023
    Configuration menu
    Copy the full SHA
    812ebc4 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2023

  1. Update flyteplugins to 1.0.37 (#527) 

    Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Feb 22, 2023
    Configuration menu
    Copy the full SHA
    752f55e View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2023

  1. fix recovery of already recovered workflow (#530) 

    Signed-off-by: Felix Ruess <[email protected]>
    @flixr
    flixr authored Feb 25, 2023
    Configuration menu
    Copy the full SHA
    03a6672 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2023

  1. Remove duplicate logic of resolveSecurityCtx in execution_manager (#531) 

    Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Feb 28, 2023
    Configuration menu
    Copy the full SHA
    efe5b0c View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2023

  1. Return nil if ResourceMeta is nil when deleting the node (#310) 

    * wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* transition to failed state if task isn't created

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* fix

Signed-off-by: Kevin Su <[email protected]>

* fix

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Mar 1, 2023
    Configuration menu
    Copy the full SHA
    1329476 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2023

  1. Copy dynamicJobSpec from partially completed DynamicTask on recovery (#… 

    …518)

* storing compiled workflow

Signed-off-by: Daniel Rammer <[email protected]>

* working

Signed-off-by: Daniel Rammer <[email protected]>

* added unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* recovering inputs of partially complete dynamic task

Signed-off-by: Daniel Rammer <[email protected]>

* removed dead code

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl version

Signed-off-by: Daniel Rammer <[email protected]>

* returning inputs from recoverInputs function

Signed-off-by: Daniel Rammer <[email protected]>

* fixed tests

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 4, 2023
    Configuration menu
    Copy the full SHA
    5c7a31d View commit details
    Browse the repository at this point in the history

  2. Improve error message (#532) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Mar 4, 2023
    Configuration menu
    Copy the full SHA
    9508833 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. If primaryContainerName=="primary", container content will be duplica… 

    …ted (#326)

* If primaryContainerName=="primary", container content will be duplicated

Signed-off-by: byhsu <[email protected]>

* address comments

Signed-off-by: byhsu <[email protected]>

---------

Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Mar 6, 2023
    Configuration menu
    Copy the full SHA
    114645a View commit details
    Browse the repository at this point in the history

  2. Remove chief!=0 or ps!=0 assertion in tensorflow (#327) 

    Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Mar 6, 2023
    Configuration menu
    Copy the full SHA
    be833e2 View commit details
    Browse the repository at this point in the history

  3. bumping flyteplugins (#537) 

    * bumping flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

* and one more time

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 6, 2023
    Configuration menu
    Copy the full SHA
    3c3ec33 View commit details
    Browse the repository at this point in the history

  4. Truncate execution error message only when size exceeds limit (#533) 

    * Bump propeller

Signed-off-by: Kevin Su <[email protected]>

* Fixed slice bounds out of range

Signed-off-by: Kevin Su <[email protected]>

* Fixed slice bounds out of range

Signed-off-by: Kevin Su <[email protected]>

* update go.mod

Signed-off-by: Kevin Su <[email protected]>

* update go.mod

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* Add tests

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Mar 6, 2023
    Configuration menu
    Copy the full SHA
    326ca45 View commit details
    Browse the repository at this point in the history

  5. Extend pod webhook self-signed certs expiration date to 99 years in t… 

    …he future (#535)

Signed-off-by: Eduardo Apolinario <[email protected]>
Co-authored-by: Eduardo Apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Mar 6, 2023
    Configuration menu
    Copy the full SHA
    328a41c View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. Structured Dataset with generic format should be castable to Flyte Sc… 

    …hema (#536)

* Structured Dataset with generic format should be castable to Schema

Signed-off-by: Kevin Su <[email protected]>

* Structured Dataset with generic format should be castable to Schema

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Mar 8, 2023
    Configuration menu
    Copy the full SHA
    48c37de View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2023

  1. Don't truncate error messages when listing task executions (#536)

    @katrogan
    katrogan authored Mar 9, 2023
    Configuration menu
    Copy the full SHA
    188b982 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2023

  1. Add Dan Rammer and Eduardo to codeowners (#539) 

    Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Mar 10, 2023
    Configuration menu
    Copy the full SHA
    2d39422 View commit details
    Browse the repository at this point in the history

  2. Tracking DynamicJobSpecUri for DynamicWorkflows (#513) 

    * tracking DynamicJobSpecUri for DynamicWorkflows

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl version

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 10, 2023
    Configuration menu
    Copy the full SHA
    f6d949a View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. Bump github.com/emicklei/go-restful (#520) 

    Bumps [github.com/emicklei/go-restful](https://github.com/emicklei/go-restful) from 2.9.6+incompatible to 2.16.0+incompatible.
- [Release notes](https://github.com/emicklei/go-restful/releases)
- [Changelog](https://github.com/emicklei/go-restful/blob/v3/CHANGES.md)
- [Commits](emicklei/go-restful@v2.9.6...v2.16.0)

---
updated-dependencies:
- dependency-name: github.com/emicklei/go-restful
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    @dependabot
    dependabot[bot] authored Mar 13, 2023
    Configuration menu
    Copy the full SHA
    2218971 View commit details
    Browse the repository at this point in the history

  2. Validate user-provided entity versions are url safe (#537)

    @katrogan
    katrogan authored Mar 13, 2023
    Configuration menu
    Copy the full SHA
    b96881a View commit details
    Browse the repository at this point in the history

  3. Supporting DataLoadingConfig on K8sPod type (#325) 

    * supporting data loading config for k8s pod type

Signed-off-by: Daniel Rammer <[email protected]>

* should be checking dataLoadingConfig for nil

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 13, 2023
    Configuration menu
    Copy the full SHA
    f0db511 View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2023

  1. Upgrade flytepropeller (#541) 

    Signed-off-by: Katrina Rogan <[email protected]>
    @katrogan
    katrogan authored Mar 17, 2023
    Configuration menu
    Copy the full SHA
    8cf8b4a View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2023

  1. feat: add support for inter-cluster communication for Ray plugin (#321) 

    * feat: add inter-cluster com to ray plugin

Signed-off-by: Abdullah Mobeen <[email protected]>

* test: add tests for remote cluster

Signed-off-by: Abdullah Mobeen <[email protected]>

* refactor: move auth to config

Signed-off-by: Abdullah Mobeen <[email protected]>

* fix description

Co-authored-by: Kevin Su <[email protected]>
Signed-off-by: Abdullah Mobeen <[email protected]>

* refactor: move clusterconfig and auth to pluginmachinery k8s

Signed-off-by: Abdullah Mobeen <[email protected]>

* refactor: move clusterconfig and auth to pluginmachinery k8s

Signed-off-by: Abdullah Mobeen <[email protected]>

* chore: remove commented out code

Signed-off-by: Abdullah Mobeen <[email protected]>

---------

Signed-off-by: Abdullah Mobeen <[email protected]>
Signed-off-by: Abdullah Mobeen <[email protected]>
Co-authored-by: Kevin Su <[email protected]>
    @aybidi @pingsutw
    aybidi and pingsutw authored Mar 20, 2023
    Configuration menu
    Copy the full SHA
    0a681cd View commit details
    Browse the repository at this point in the history

  2. replaced github.com/satori/go.uuid with github.com/gofrs/uuid (#101) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 20, 2023
    Configuration menu
    Copy the full SHA
    25c0a10 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. bumping fosite version (#538) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 21, 2023
    Configuration menu
    Copy the full SHA
    dea5b2a View commit details
    Browse the repository at this point in the history

  2. bumping flyteplugins to 1.0.42 to pick up external cluster configurat… 

    …ion for ray (#542)

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 21, 2023
    Configuration menu
    Copy the full SHA
    b4cde1f View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Tracking reasons time-series (#540) 

    * tracking reasons time-series

Signed-off-by: Daniel Rammer <[email protected]>

* bumped flyteidl dep and added comment

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 22, 2023
    Configuration menu
    Copy the full SHA
    83e8694 View commit details
    Browse the repository at this point in the history

  2. Add no-op migrations (#542) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Mar 22, 2023
    Configuration menu
    Copy the full SHA
    680cac3 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Fixing pod plugin event reporting timestamps (#307) 

    * corrected timestamps for pod plugin

Signed-off-by: Dan Rammer <[email protected]>

* but actually this time

Signed-off-by: Dan Rammer <[email protected]>

* added reported at support

Signed-off-by: Daniel Rammer <[email protected]>

* fixed merge

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl deps

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Dan Rammer <[email protected]>
Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 23, 2023
    Configuration menu
    Copy the full SHA
    60d345d View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Add reported_at timestamps to events (#529) 

    * updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* updated pod timestamp recording and added recorded_at on task event

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl and flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

* setting occurred_at when node inputs begin resolution

Signed-off-by: Daniel Rammer <[email protected]>

* added reported_at to node execution events

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl and flyteplugins dependencies

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl and flyteplugins deps

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    e462412 View commit details
    Browse the repository at this point in the history

  2. Including all upstream node deps on BranchNode subnode execution (#543) 

    * waiting for upstream nodes on branch subnode evaluation

Signed-off-by: Daniel Rammer <[email protected]>

* removed dead comments

Signed-off-by: Daniel Rammer <[email protected]>

* added unit test

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    b1e5482 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. Add endpoint exposing runtime metrics (#524) 

    * metrics manager working for task nodes

Signed-off-by: Daniel Rammer <[email protected]>

* dynamic tasks working

Signed-off-by: Daniel Rammer <[email protected]>

* subworkflow node working

Signed-off-by: Daniel Rammer <[email protected]>

* refactored to allow branch and gate node parsing

Signed-off-by: Daniel Rammer <[email protected]>

* added node transition times

Signed-off-by: Daniel Rammer <[email protected]>

* sorting node and task executions

Signed-off-by: Daniel Rammer <[email protected]>

* added metrics metrics ... inception

Signed-off-by: Daniel Rammer <[email protected]>

* fixed duplicate metrics

Signed-off-by: Daniel Rammer <[email protected]>

* branch node working?

Signed-off-by: Daniel Rammer <[email protected]>

* implemented gate node

Signed-off-by: Daniel Rammer <[email protected]>

* working with partial completions and failures and cache hits

Signed-off-by: Daniel Rammer <[email protected]>

* added unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed most lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* added docs

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl dependency

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* chnaged to local flyteidl for testing

Signed-off-by: Daniel Rammer <[email protected]>

* using task event reported_at timestamps for updated_at in task execution models

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* using reported_at for node executions

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* fixes unit tests and lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* bumped flyteidl deps

Signed-off-by: Daniel Rammer <[email protected]>

* using consts for start-node and end-node

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 27, 2023
    Configuration menu
    Copy the full SHA
    cca9e17 View commit details
    Browse the repository at this point in the history

  2. persisting k8s plugin phase, version, and reason (#331) 

    * using PhaseVersion to ensure Reason updates are sent

Signed-off-by: Daniel Rammer <[email protected]>

* refactored and fixed tests

Signed-off-by: Daniel Rammer <[email protected]>

* fixed linter

Signed-off-by: Daniel Rammer <[email protected]>

* added docs

Signed-off-by: Daniel Rammer <[email protected]>

* corrected missing old usecase

Signed-off-by: Daniel Rammer <[email protected]>

* actually this will work

Signed-off-by: Daniel Rammer <[email protected]>

* added missing increment on phsae version - thanks yee

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 27, 2023
    Configuration menu
    Copy the full SHA
    18a594e View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. Populate TaskNodeMetadata on CreateNodeExecutionModel to correctly di… 

    …splay fast cache (#483)

* adding cache information on first node event

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 29, 2023
    Configuration menu
    Copy the full SHA
    eb695b1 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. persisting k8s plugin state between evaluations (#540) 

    * persisting k8s plugin state between evaluations

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests and linter

Signed-off-by: Daniel Rammer <[email protected]>

* added docs

Signed-off-by: Daniel Rammer <[email protected]>

* updating flyteplugins dep

Signed-off-by: Daniel Rammer <[email protected]>

* added unit tests

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 30, 2023
    Configuration menu
    Copy the full SHA
    01218d2 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Add support for GCP secret manager (#547) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Mar 31, 2023
    Configuration menu
    Copy the full SHA
    f88f165 View commit details
    Browse the repository at this point in the history

  2. mocking plugin state reader in maptask (#338) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 31, 2023
    Configuration menu
    Copy the full SHA
    38e8a07 View commit details
    Browse the repository at this point in the history

  3. bumped flyteplugins (#549) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Mar 31, 2023
    Configuration menu
    Copy the full SHA
    6af4de2 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. Validate multiple input values in map task (#334) 

    * validating multiple input values in map task and correctly populating for cache lookup

Signed-off-by: Daniel Rammer <[email protected]>

* added unit tests

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 4, 2023
    Configuration menu
    Copy the full SHA
    e84d27a View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. Lazily initialize kubernetes client only when using kube api watcher (#… 

    …56)

* Lazily initialize kubernetes client only when using kube api watcher

Signed-off-by: Jeev B <[email protected]>

* Fix parsing of podname to watch from CLI args

Signed-off-by: Jeev B <[email protected]>

* Minor fix

Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 6, 2023
    Configuration menu
    Copy the full SHA
    12f9ff5 View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. Inject container resource during BuildRawContainer (#335) 

    * Inject container resource during BuildRawContainer

Signed-off-by: byhsu <[email protected]>

* address comment

Signed-off-by: byhsu <[email protected]>

---------

Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Apr 7, 2023
    Configuration menu
    Copy the full SHA
    a3f7334 View commit details
    Browse the repository at this point in the history

  2. moved controller runtime start out of webhook Run function (#546) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 7, 2023
    Configuration menu
    Copy the full SHA
    986f014 View commit details
    Browse the repository at this point in the history

  3. deprecated TransitionTypeBarrier (#336) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 7, 2023
    Configuration menu
    Copy the full SHA
    4f02c2c View commit details
    Browse the repository at this point in the history

  4. returning 'Undefined' when recovering a SKIPPED node so that the node… 

    … is executed (#551)

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 7, 2023
    Configuration menu
    Copy the full SHA
    7abdcd7 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2023

  1. Add a new requestID to Log fields (#157) 

    * Add a new requestID to Log fields

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Also set the requestID on grpc outgoing requests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* set key and value

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* lint :(

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Use more commonly used string for request id

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* using request-id instead per PR Comment discussion

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* reverting to x- prefix to keep OOB behavior sane

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Apr 8, 2023
    Configuration menu
    Copy the full SHA
    3b737b5 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. Remove resource injection on the node for container task (#544) 

    * Remove resource injection on the node for container task

Signed-off-by: byhsu <[email protected]>

* fix conflict

Signed-off-by: byhsu <[email protected]>

* fix lint

Signed-off-by: byhsu <[email protected]>

* downgrade plugin

Signed-off-by: byhsu <[email protected]>

---------

Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Apr 11, 2023
    Configuration menu
    Copy the full SHA
    ef164c5 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. Infer GOOS and GOARCH from environment (#103) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 12, 2023
    Configuration menu
    Copy the full SHA
    9ebdb93 View commit details
    Browse the repository at this point in the history

  2. Infer GOOS and GOARCH from environment (#552) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 12, 2023
    Configuration menu
    Copy the full SHA
    2be01e2 View commit details
    Browse the repository at this point in the history

  3. fix makefile to read variables from environment and overrides (#554) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 12, 2023
    Configuration menu
    Copy the full SHA
    b9d1f62 View commit details
    Browse the repository at this point in the history

  4. fix makefile to read variables from environment and overrides (#104) 

    Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 12, 2023
    Configuration menu
    Copy the full SHA
    0638a9e View commit details
    Browse the repository at this point in the history

  5. Infer GOOS and GOARCH from environment (#550) 

    * Infer GOOS and GOARCH from environment

Signed-off-by: Jeev B <[email protected]>

* Multiarch builds for flytescheduler

Signed-off-by: Jeev B <[email protected]>

* fix makefile to read variables from environment and overrides

Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 12, 2023
    Configuration menu
    Copy the full SHA
    97a6aa4 View commit details
    Browse the repository at this point in the history

  6. Enable multiarch build and infer GOOS and GOARCH from environment (#57) 

    * Enable multiarch build and infer GOOS and GOARCH from environment

Signed-off-by: Jeev B <[email protected]>

* fix copy pasta

Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 12, 2023
    Configuration menu
    Copy the full SHA
    a913fde View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. Remove BarrierTick (#545) 

    * removed barrier logic

Signed-off-by: Daniel Rammer <[email protected]>

* deprecated TransitionTypeBarrier

Signed-off-by: Daniel Rammer <[email protected]>

* removed barrier tests

Signed-off-by: Daniel Rammer <[email protected]>

* bumping flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 14, 2023
    Configuration menu
    Copy the full SHA
    0c982ea View commit details
    Browse the repository at this point in the history

  2. Set PrimaryContainerKey annotation by default (#337) 

    * added pod plugin optimizations

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 14, 2023
    Configuration menu
    Copy the full SHA
    435436b View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2023

  1. Enrich TerminateExecution error to tell propeller the execution alrea… 

    …dy terminated (#551)

* Enrich TerminateWorkflow error to tell propeller the execution already terminated

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix unit test

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Apr 16, 2023
    Configuration menu
    Copy the full SHA
    1026231 View commit details
    Browse the repository at this point in the history

  2. Check for TerminateExecution error and eat Precondition status (#553) 

    * Check for TerminateExecution error and eat Precondition status

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* lint

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Apr 16, 2023
    Configuration menu
    Copy the full SHA
    6cb7322 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. Override primary container name instead of flyte generated name (#340) 

    Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Apr 17, 2023
    Configuration menu
    Copy the full SHA
    f5f4182 View commit details
    Browse the repository at this point in the history

  2. Setting primaryContainerName by default on Pod plugin (#555) 

    * updated flyteplugins version

Signed-off-by: Daniel Rammer <[email protected]>

* go mod tidy

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 17, 2023
    Configuration menu
    Copy the full SHA
    e4ca252 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Pass worker_spec_command to mpi plugin to support horovod (#341) 

    * wip

Signed-off-by: byhsu <[email protected]>

* add comment

Signed-off-by: byhsu <[email protected]>

* more comment

Signed-off-by: byhsu <[email protected]>

* fix style

Signed-off-by: byhsu <[email protected]>

---------

Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored Apr 19, 2023
    Configuration menu
    Copy the full SHA
    46796b6 View commit details
    Browse the repository at this point in the history

  2. Implement ability to specify additional/override annotations when usi… 

    …ng Vault Secret Manager (#556)

* Implement ability to specify additional annotations when using Vault secret manager

Signed-off-by: Pradithya Aria <[email protected]>

* Infer GOOS and GOARCH from environment (#552)

Signed-off-by: Jeev B <[email protected]>
Signed-off-by: Pradithya Aria <[email protected]>

* fix makefile to read variables from environment and overrides (#554)

Signed-off-by: Jeev B <[email protected]>
Signed-off-by: Pradithya Aria <[email protected]>

* Remove BarrierTick (#545)

* removed barrier logic

Signed-off-by: Daniel Rammer <[email protected]>

* deprecated TransitionTypeBarrier

Signed-off-by: Daniel Rammer <[email protected]>

* removed barrier tests

Signed-off-by: Daniel Rammer <[email protected]>

* bumping flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
Signed-off-by: Pradithya Aria <[email protected]>

* Check for TerminateExecution error and eat Precondition status (#553)

* Check for TerminateExecution error and eat Precondition status

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* lint

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Pradithya Aria <[email protected]>

* Rename to annotation

Signed-off-by: Pradithya Aria <[email protected]>

* Inline merging annotations

Signed-off-by: Pradithya Aria <[email protected]>

---------

Signed-off-by: Pradithya Aria <[email protected]>
Signed-off-by: Jeev B <[email protected]>
Signed-off-by: Daniel Rammer <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Co-authored-by: Jeev B <[email protected]>
Co-authored-by: Dan Rammer <[email protected]>
Co-authored-by: Haytham Abuelfutuh <[email protected]>
    @jeevb @hamersaw @EngHabu
    4 people authored Apr 19, 2023
    Configuration menu
    Copy the full SHA
    972c0d6 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. Maintaining Interruptible and OverwriteCache for reference launchplans ( 

    #557)

* maintaining Interruptible and OverwriteCache for reference launchplans

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 20, 2023
    Configuration menu
    Copy the full SHA
    dd49c9d View commit details
    Browse the repository at this point in the history

  2. adding cleanupOnFailure to PhaseInfo (#333) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 20, 2023
    Configuration menu
    Copy the full SHA
    84030bd View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. External Plugin Service (grpc) (#330) 

    * Add fastapi plugin

Signed-off-by: Kevin Su <[email protected]>

* Add dummy plugin

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* grpc plugin

Signed-off-by: Kevin Su <[email protected]>

* updated idl version

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* add grpc plugin

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* write output

Signed-off-by: Kevin Su <[email protected]>

* remove prev state

Signed-off-by: Kevin Su <[email protected]>

* bump idl

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* wip

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* rename

Signed-off-by: Kevin Su <[email protected]>

* more test

Signed-off-by: Kevin Su <[email protected]>

* remove grpcTokenKey

Signed-off-by: Kevin Su <[email protected]>

* Add SupportedTaskTypes

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* cache connection

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

* fixes tests

Signed-off-by: Kevin Su <[email protected]>

* fixes tests

Signed-off-by: Kevin Su <[email protected]>

* more tests

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* remove bigquery_query_job_task

Signed-off-by: Kevin Su <[email protected]>

* add bigquery_query_job_task

Signed-off-by: Kevin Su <[email protected]>

* set random value for SupportedTaskTypes

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Apr 21, 2023
    Configuration menu
    Copy the full SHA
    1f39163 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. Feat: Configure elastic training in pytorch plugin (#343)

    @fg91
    fg91 authored Apr 24, 2023
    Configuration menu
    Copy the full SHA
    acc831a View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. Add non-interruptible node selector requirement to spark driver if set ( 

    #346)

* Add non-interruptible node selector requirement to spark driver if set

Signed-off-by: Jeev B <[email protected]>

* comment

Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Apr 25, 2023
    Configuration menu
    Copy the full SHA
    63e1e45 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. Added support for aborting task nodes reported as failures (#541) 

    * added CleanupOnFailure support for TaskNodeStatus to support aborting failed task nodes

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteplugins and generated

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Apr 28, 2023
    Configuration menu
    Copy the full SHA
    0025cbe View commit details
    Browse the repository at this point in the history

Commits on May 3, 2023

  1. Adding support for environment variables set on execution (#344) 

    * added environment variables to TaskExecutionMetadata

Signed-off-by: Daniel Rammer <[email protected]>

* added support for environment variables

Signed-off-by: Daniel Rammer <[email protected]>

* implemented unit tests and fixed linter

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored May 3, 2023
    Configuration menu
    Copy the full SHA
    1e0faab View commit details
    Browse the repository at this point in the history

  2. Added support for EnvironmentVariables on ExecutionConfig (#558) 

    * added environment variables to ExecutionConfig and propagated to taskExecutionMetadata

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteplugins

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored May 3, 2023
    Configuration menu
    Copy the full SHA
    5b50d88 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2023

  1. Fast fail if task resource requests exceed k8s resource limits (#488) 

    * checking if task resource requests exceed k8s limits

Signed-off-by: Daniel Rammer <[email protected]>

* added better message to task failure

Signed-off-by: Daniel Rammer <[email protected]>

* added request checks

Signed-off-by: Daniel Rammer <[email protected]>

* added tests for checking resource eligibility

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issues

Signed-off-by: Daniel Rammer <[email protected]>

* updated comment

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored May 5, 2023
    Configuration menu
    Copy the full SHA
    f4cadb0 View commit details
    Browse the repository at this point in the history

  2. Address resolution (#546) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored May 5, 2023
    Configuration menu
    Copy the full SHA
    950ad15 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2023

  1. Add migration to turn parent_id column into bigint only if necess… 

    …ary (#554)

* Add migration to turn `parent_id` column into `bigint` only if necessary

Signed-off-by: eduardo apolinario <[email protected]>

* Migrations to handle the change of `parent_id` column in `node_executions` table

Signed-off-by: eduardo apolinario <[email protected]>

* Add unit test

Signed-off-by: eduardo apolinario <[email protected]>

* More coverage

Signed-off-by: eduardo apolinario <[email protected]>

* Create index outside transaction

Signed-off-by: eduardo apolinario <[email protected]>

---------

Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored May 8, 2023
    Configuration menu
    Copy the full SHA
    00915ec View commit details
    Browse the repository at this point in the history

  2. Added start time for supporting restarts for fixed rate schedules (#476) 

    * Added race skip check

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* lint

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* Fixed unit tests

Signed-off-by: pmahindrakar-oss <[email protected]>

* Moved to integration test

Signed-off-by: pmahindrakar-oss <[email protected]>

* refactored integration test

Signed-off-by: pmahindrakar-oss <[email protected]>

* nit : rename to lastTime

Signed-off-by: pmahindrakar-oss <[email protected]>

* nit : revert

Signed-off-by: pmahindrakar-oss <[email protected]>

* lastTime -> lastExecTime

Signed-off-by: pmahindrakar-oss <[email protected]>

* integration test tag

Signed-off-by: pmahindrakar-oss <[email protected]>

---------

Signed-off-by: Prafulla Mahindrakar <[email protected]>
Signed-off-by: pmahindrakar-oss <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @pmahindrakar-oss @eapolinario
    pmahindrakar-oss and eapolinario authored May 8, 2023
    Configuration menu
    Copy the full SHA
    507ad44 View commit details
    Browse the repository at this point in the history

  3. Add nil check in databricks plugin (#332) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored May 8, 2023
    Configuration menu
    Copy the full SHA
    76a80ec View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. Change kubeflow plugins to allow settings specs for different replica (… 

    …#345)

* change pytorch plugin to accept new pytorch task idl

Signed-off-by: Yubo Wang <[email protected]>

* merge elastic config in

Signed-off-by: Yubo Wang <[email protected]>

* add unit tests for pytorch

Signed-off-by: Yubo Wang <[email protected]>

* add tfjob

Signed-off-by: Yubo Wang <[email protected]>

* add mpi job

Signed-off-by: Yubo Wang <[email protected]>

* add test to commone operator

Signed-off-by: Yubo Wang <[email protected]>

* update flyteidl

Signed-off-by: Yubo Wang <[email protected]>

* add function header comments

Signed-off-by: Yubo Wang <[email protected]>

* fix lint

Signed-off-by: Yubo Wang <[email protected]>

---------

Signed-off-by: Yubo Wang <[email protected]>
Co-authored-by: Yubo Wang <[email protected]>
    @yubofredwang
    yubofredwang and Yubo Wang authored May 9, 2023
    Configuration menu
    Copy the full SHA
    9a2bbba View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. Use group attribute for KV version and add DB engine support (#539) 

    * Continue supporting config kvversion as default arg

Signed-off-by: Tim Bauer <[email protected]>

* Remove obsolete test

Signed-off-by: Tim Bauer <[email protected]>

* Add deprecation information

Signed-off-by: Tim Bauer <[email protected]>

* Remove comment

Signed-off-by: Tim Bauer <[email protected]>

* Remove comments

Signed-off-by: Tim Bauer <[email protected]>

---------

Signed-off-by: Tim Bauer <[email protected]>
    @bimtauer
    bimtauer authored May 11, 2023
    Configuration menu
    Copy the full SHA
    9a4ea00 View commit details
    Browse the repository at this point in the history

  2. Retract v1.1.94 from go.mod (#562) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored May 11, 2023
    Configuration menu
    Copy the full SHA
    7f622dd View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. Add environment variables to execution spec (#556) 

    * Add envs to execution spec

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* update

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* update idl

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

* fix tests

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored May 12, 2023
    Configuration menu
    Copy the full SHA
    2fdd399 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2023

  1. Inject user identifier to ExecutionSpec (#549) 

    Signed-off-by: byhsu <[email protected]>
This pr provides a middleware to inject user identifier to ExecutionSpec.
By default, the value of the user identifier is userid from access/id token.
Users can customize their own middleware and inject different values.
    @ByronHsu
    ByronHsu authored May 15, 2023
    Configuration menu
    Copy the full SHA
    610451d View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. Fix flaky test (#563)

    @eapolinario
    eapolinario authored May 16, 2023
    Configuration menu
    Copy the full SHA
    fc3db04 View commit details
    Browse the repository at this point in the history

  2. Add grpc plugin to loader.go (#562) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored May 16, 2023
    Configuration menu
    Copy the full SHA
    f97ff74 View commit details
    Browse the repository at this point in the history

  3. Add oauth http proxy for external server & Extract email from azure c… 

    …laim (#553)

Signed-off-by: byhsu <[email protected]>
Add oauth http proxy for external server because in on-prem cluster use cases, the client might not have access to the external network
Extract email from azure claim
    @ByronHsu
    ByronHsu authored May 16, 2023
    Configuration menu
    Copy the full SHA
    a853dac View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Remove single task execution default timeout (#564) 

    * removed default timeout

Signed-off-by: Daniel Rammer <[email protected]>

* removed unnecessary dependencies

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored May 17, 2023
    Configuration menu
    Copy the full SHA
    062641f View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. revert conditional set and add tests (#566) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored May 18, 2023
    Configuration menu
    Copy the full SHA
    313ac29 View commit details
    Browse the repository at this point in the history

  2. Use correct k8 client (#563) 

    * Use correct k8 client

Signed-off-by: Sonja Ericsson <[email protected]>

* Use correct k8 client

Signed-off-by: Sonja Ericsson <[email protected]>

---------

Signed-off-by: Sonja Ericsson <[email protected]>
    @sonjaer
    sonjaer authored May 18, 2023
    Configuration menu
    Copy the full SHA
    33ca38c View commit details
    Browse the repository at this point in the history

Commits on May 19, 2023

  1. Enable pod template and Use copy to construct head/worker in ray plug… 

    …in (#349)

* Enable pod template and Use copy to construct head/worker in ray plugin

Signed-off-by: byhsu <[email protected]>

* fix linit

Signed-off-by: byhsu <[email protected]>

* wip

Signed-off-by: byhsu <[email protected]>

* fix test

Signed-off-by: byhsu <[email protected]>

---------

Signed-off-by: byhsu <[email protected]>
Co-authored-by: byhsu <[email protected]>
    @ByronHsu
    ByronHsu and ByronHsu authored May 19, 2023
    Configuration menu
    Copy the full SHA
    2afc441 View commit details
    Browse the repository at this point in the history

  2. Run tests and lint in parallel (#350) 

    * Run tests and lint in parallel

Signed-off-by: Kevin Su <[email protected]>

* Run tests and lint in parallel

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* test

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored May 19, 2023
    Configuration menu
    Copy the full SHA
    0e6b62a View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Save execution namespace in system metadata (#568)

    @katrogan
    katrogan authored May 22, 2023
    Configuration menu
    Copy the full SHA
    ed4d771 View commit details
    Browse the repository at this point in the history

  2. Update startedAt timestamp only if not set (#567) 

    * Update startedAt timestamp only if not set

Signed-off-by: pmahindrakar-oss <[email protected]>

* sort imports

Signed-off-by: pmahindrakar-oss <[email protected]>

---------

Signed-off-by: pmahindrakar-oss <[email protected]>
    @pmahindrakar-oss
    pmahindrakar-oss authored May 22, 2023
    Configuration menu
    Copy the full SHA
    7915ae8 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. Tiny url improvements (#565) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored May 23, 2023
    Configuration menu
    Copy the full SHA
    15d5c7b View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. updating dask plugin to use container resources with overrides (#351)

    @hamersaw
    hamersaw authored May 24, 2023
    Configuration menu
    Copy the full SHA
    7bb490f View commit details
    Browse the repository at this point in the history

  2. bumped flyteplugins (#566) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored May 24, 2023
    Configuration menu
    Copy the full SHA
    e1f6d76 View commit details
    Browse the repository at this point in the history

  3. only initializing maptask if there is no failure (#352) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored May 24, 2023
    Configuration menu
    Copy the full SHA
    8a2f8ca View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Improve demystifying GKE spot node preemtion #patch (#354) 

    * Improve demystifying GKE spot node preemtion

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add test

Signed-off-by: Bernhard Stadlbauer <[email protected]>

---------

Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored May 26, 2023
    Configuration menu
    Copy the full SHA
    c499a48 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2023

  1. Bump flyteplugins to v1.0.63 (#568) 

    Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored May 27, 2023
    Configuration menu
    Copy the full SHA
    85ae7d6 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Fix utf-8 encoding issues with trimmed error messages (#569)

    @katrogan
    katrogan authored May 30, 2023
    Configuration menu
    Copy the full SHA
    3379031 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Add logs and stats to sync loop (#573) 

    * Add logs and stats to sync loop

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add per namespace log as well

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    949f5a2 View commit details
    Browse the repository at this point in the history

  2. Lazy load gRPC plugin (#353) 

    * Lazy load grpc plugin

Signed-off-by: Kevin Su <[email protected]>

* rename

Signed-off-by: Kevin Su <[email protected]>

* rename

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

* rename

Signed-off-by: Kevin Su <[email protected]>

* lint

Signed-off-by: Kevin Su <[email protected]>

* nit

Signed-off-by: Kevin Su <[email protected]>

---------

Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    06866ee View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Not stripping structure from literal types (#571) 

    * not stripping structure from literal types

Signed-off-by: Daniel Rammer <[email protected]>

* fixed new lint issues

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    c61fa47 View commit details
    Browse the repository at this point in the history

  2. Register gRPC plugin after reading configmap (#564) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    2086bb9 View commit details
    Browse the repository at this point in the history

  3. Don't add master replica log link when doing elastic pytorch training (… 

    …#356)

* Don't add master log link when doing elastic pytorch training

Signed-off-by: Fabio Graetz <[email protected]>

* Lint

Signed-off-by: Fabio Graetz <[email protected]>

---------

Signed-off-by: Fabio Graetz <[email protected]>
    @fg91
    fg91 authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    de1d1d3 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. [Bigquery] Add support for impersonation of GSA bound to task's KSA (#… 

    …355)

* Support impersonation of GKE task workload identity bound GSA in BigQuery plugin

Signed-off-by: Jeev B <[email protected]>

* Fix linting

Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    aa1ed67 View commit details
    Browse the repository at this point in the history

  2. Fix initial dask job state (#357) 

    * Fix initial dask state

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix linting

Signed-off-by: Bernhard Stadlbauer <[email protected]>

---------

Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    2a7a6f9 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. Update flyteplugins to v1.0.67 (#575) 

    Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jun 9, 2023
    Configuration menu
    Copy the full SHA
    05e837b View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Correctly validating error code on aborting terminal launchplans (#574) 

    * correctly checking error code

Signed-off-by: Daniel Rammer <[email protected]>

* fixed lint issue

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 12, 2023
    Configuration menu
    Copy the full SHA
    eadf07b View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Use GetExecutionData instead (#573) 

    * Use GetExecutionData instead

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* bump

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* more fixes

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix more

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Regenerate

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Only call GetExecutionData when the workflow succeeds

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Jun 13, 2023
    Configuration menu
    Copy the full SHA
    89dfd5b View commit details
    Browse the repository at this point in the history

  2. Feat: Add pod start and finish time in RFC3339 time format to logging… 

    … link templating variables #minor (#360)

* Add RFC3339 time format log link vars for start and finish time

Signed-off-by: Fabio Graetz <[email protected]>

* Add RFC3339 timestamp to log link generation tests

Signed-off-by: Fabio Graetz <[email protected]>

---------

Signed-off-by: Fabio Graetz <[email protected]>
    @fg91
    fg91 authored Jun 13, 2023
    Configuration menu
    Copy the full SHA
    53e63bc View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. fix v1 pytorch job plugin with elastic policy (#359) 

    * fix pytorch job plugin elastic policy

Signed-off-by: Yubo Wang <[email protected]>

* add ElasticConfig interface

Signed-off-by: Yubo Wang <[email protected]>

* add more testing

Signed-off-by: Yubo Wang <[email protected]>

---------

Signed-off-by: Yubo Wang <[email protected]>
Co-authored-by: Yubo Wang <[email protected]>
    @yubofredwang
    yubofredwang and Yubo Wang authored Jun 14, 2023
    Configuration menu
    Copy the full SHA
    318fa6b View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Allow using pod start time in kubeflow plugin log links (#362) 

    Signed-off-by: Fabio Graetz <[email protected]>
    @fg91
    fg91 authored Jun 15, 2023
    Configuration menu
    Copy the full SHA
    dfdf6f9 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Add a user-specifiable root to upload link request (#577) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Jun 22, 2023
    Configuration menu
    Copy the full SHA
    9b22c0e View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Bump propeller version (#580) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    f44d7fe View commit details
    Browse the repository at this point in the history

  2. propagating environment variables through launchplans (#576) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    7b104d3 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Pass location to the BigQuery request (#365) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    1d0f3e9 View commit details
    Browse the repository at this point in the history

  2. Fix map task cache misses (#363) 

    * Add input hash to workItemID

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Add test to ensure different IDs

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Cleanup `make lint`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Move `emptyLiteralMap` to `hashing.go`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix import ordering

Signed-off-by: Bernhard Stadlbauer <[email protected]>

---------

Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    5a5ad82 View commit details
    Browse the repository at this point in the history

  3. Switch to official dask operator (#366) 

    * Switch to using official `dask` plugin

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix small code nits

Signed-off-by: Bernhard Stadlbauer <[email protected]>

---------

Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    2c393c0 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Fix duplicate env vars in container (#358) 

    * removed duplicate execution of AddFlyteCustomizationsToContainer

Signed-off-by: Daniel Rammer <[email protected]>

* removed duplicate call to AddFlyteCustomizationsToContainer when creating container

Signed-off-by: Daniel Rammer <[email protected]>

* removed dead code

Signed-off-by: Daniel Rammer <[email protected]>

* added unit test for duplicate environment variables

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    df62599 View commit details
    Browse the repository at this point in the history

  2. upgrade dockerfile go to 1.19 (#108) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    dfa2c4c View commit details
    Browse the repository at this point in the history

  3. upgrading dockefile to go 1.19 (#60) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    e93f5bd View commit details
    Browse the repository at this point in the history

  4. upgrade go 1.19 in Dockerfile (#581) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    78b3e14 View commit details
    Browse the repository at this point in the history

  5. upgrade dockerfile go to 1.19 (#580) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    efb69c3 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. Set scheduler restart policy to Always (#367) 

    Signed-off-by: Bernhard Stadlbauer <[email protected]>
    @bstadlbauer
    bstadlbauer authored Jun 29, 2023
    Configuration menu
    Copy the full SHA
    f7b37aa View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2023

  1. Bump flyteplugins version (#581) 

    Signed-off-by: Kevin Su <[email protected]>
    @pingsutw
    pingsutw authored Jun 30, 2023
    Configuration menu
    Copy the full SHA
    d181df7 View commit details
    Browse the repository at this point in the history

  2. Support for cross-project secrets for GCP (#582) 

    * Support for cross-project secrets for GCP

Signed-off-by: Jeev B <[email protected]>

* Bump flyteplugins version (#581)

Signed-off-by: Kevin Su <[email protected]>
Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
Signed-off-by: Kevin Su <[email protected]>
Co-authored-by: Kevin Su <[email protected]>
    @jeevb @pingsutw
    jeevb and pingsutw authored Jun 30, 2023
    Configuration menu
    Copy the full SHA
    1541ae5 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Update flyteplugins (#578) 

    * Update `flyteplugins`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Update `flytepropeller`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Fix imports

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Bump flyteplugins to v1.1.7

Signed-off-by: Bernhard Stadlbauer <[email protected]>

* Return `err` instead of `nil`

Signed-off-by: Bernhard Stadlbauer <[email protected]>

---------

Signed-off-by: Bernhard Stadlbauer <[email protected]>
Co-authored-by: Dan Rammer <[email protected]>
    @bstadlbauer @hamersaw
    bstadlbauer and hamersaw authored Jul 5, 2023
    Configuration menu
    Copy the full SHA
    357bf09 View commit details
    Browse the repository at this point in the history

  2. Fix usage of archive replacements (#586) 

    Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Jul 5, 2023
    Configuration menu
    Copy the full SHA
    206013a View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. remove welcome bot from boilerplate (#460) 

    Signed-off-by: Samhita Alla <[email protected]>
Signed-off-by: Eduardo Apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @samhita-alla @eapolinario
    samhita-alla and eapolinario authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    53282fe View commit details
    Browse the repository at this point in the history

  2. Added IsFailurePermanent flag on DynamicTaskStatus (#567) 

    * added IsFailurePermanent flag on DynamicTaskStatus

Signed-off-by: Daniel Rammer <[email protected]>

* fixed linter

Signed-off-by: Daniel Rammer <[email protected]>

* cleaned up retryable vs permanent reporting

Signed-off-by: Daniel Rammer <[email protected]>

* make generate

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    0cfb0a0 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. Fix archive.replacements in goreleaser (#586)

    @eapolinario
    eapolinario authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    05981db View commit details
    Browse the repository at this point in the history

  2. Update .goreleaser.yml (#158)

    @eapolinario
    eapolinario authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    53f62a7 View commit details
    Browse the repository at this point in the history

  3. Update .goreleaser.yml (#61)

    @eapolinario
    eapolinario authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    10f7420 View commit details
    Browse the repository at this point in the history

  4. Fix archive.replacements in goreleaser (#109)

    @eapolinario
    eapolinario authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    5e2512a View commit details
    Browse the repository at this point in the history

  5. Add ImagePullBackoffGracePeriod configuration (#370) 

    * added ImagePullBackoffGracePeriod configuration

Signed-off-by: Daniel Rammer <[email protected]>

* fixed unit tests

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    3d2525a View commit details
    Browse the repository at this point in the history

  6. updating flyteplugins (#587) 

    Signed-off-by: Daniel Rammer <[email protected]>
    @hamersaw
    hamersaw authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    7c5cc9b View commit details
    Browse the repository at this point in the history

  7. Extend length of docs section to 120 characters (#159) 

    Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    3322b07 View commit details
    Browse the repository at this point in the history

  8. Bump flytestdlib (#588) 

    Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    5b68c2f View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. Stow head etag (#160) 

    * Implement Etag() in storage layer

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* go mod tidy

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Actually propagating etag

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Implement UnionMeta store

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Allow registeration of additional stow stores

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Support grpc NotFound in IsNotFound()

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* correct error code check

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Cleanup

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* more cleanup

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* PR Feedback

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* lint and nits

Signed-off-by: Yee Hing Tong <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Yee Hing Tong <[email protected]>
Co-authored-by: Yee Hing Tong <[email protected]>
    @EngHabu @wild-endeavor
    EngHabu and wild-endeavor authored Jul 11, 2023
    Configuration menu
    Copy the full SHA
    907929b View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. Alter ID sequence to bigint (#578) 

    * Alter ID sequence to bigint

Signed-off-by: Hongxin Liang <[email protected]>

* Unit test it

Signed-off-by: Hongxin Liang <[email protected]>

---------

Signed-off-by: Hongxin Liang <[email protected]>
    @honnix
    honnix authored Jul 12, 2023
    Configuration menu
    Copy the full SHA
    8f41e67 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Remove content md5 requirement (#587) 

    Signed-off-by: Yee Hing Tong <[email protected]>
    @wild-endeavor
    wild-endeavor authored Jul 13, 2023
    Configuration menu
    Copy the full SHA
    b93457f View commit details
    Browse the repository at this point in the history

  2. Propagate request id on incoming and outgoing requests (#582) 

    Signed-off-by: Haytham Abuelfutuh <[email protected]>
    @EngHabu
    EngHabu authored Jul 13, 2023
    Configuration menu
    Copy the full SHA
    fb359bc View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. Update boilerplate version (#589) 

    Signed-off-by: Flyte-Bot <[email protected]>
Co-authored-by: eapolinario <[email protected]>
    @flyte-bot @eapolinario
    flyte-bot and eapolinario authored Jul 14, 2023
    Configuration menu
    Copy the full SHA
    248e947 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2023

  1. Add support for using task execution ID fields in log URI templates (#… 

    …372)

* Refactor task log templates to support extra vars

* plumbing for k8s

* Cleanup use of providers

* cleanup

* more cleanups

* more cleanups

* more cleanups

* Plumb through task context for plugins

* fix

Signed-off-by: Jeev B <[email protected]>

* move task execution identifier into Input struct

* use pointer

* tests

Signed-off-by: Jeev B <[email protected]>

* fix linting

Signed-off-by: Jeev B <[email protected]>

* cleanups

* fix

* revert to using regex replacements for performance

* Readd benchmark

* Split templating scheme (#373)

* Use a split templating scheme

* add enum for TemplateScheme

* cleanup comment

* fix linting issues

* add unit tests for templateVarsForScheme

* update for consistency

---------

Signed-off-by: Jeev B <[email protected]>
    @jeevb
    jeevb authored Jul 15, 2023
    Configuration menu
    Copy the full SHA
    7ddd993 View commit details
    Browse the repository at this point in the history

  2. Update boilerplate version (#77) 

    Signed-off-by: Flyte-Bot <[email protected]>
Co-authored-by: eapolinario <[email protected]>
    @flyte-bot @eapolinario
    flyte-bot and eapolinario authored Jul 15, 2023
    Configuration menu
    Copy the full SHA
    6923ab8 View commit details
    Browse the repository at this point in the history

  3. Update boilerplate version (#591) 

    Signed-off-by: Flyte-Bot <[email protected]>
Co-authored-by: eapolinario <[email protected]>
    @flyte-bot @eapolinario
    flyte-bot and eapolinario authored Jul 15, 2023
    Configuration menu
    Copy the full SHA
    4322012 View commit details
    Browse the repository at this point in the history

  4. Update boilerplate version (#42) 

    Signed-off-by: Flyte-Bot <[email protected]>
Co-authored-by: eapolinario <[email protected]>
    @flyte-bot @eapolinario
    flyte-bot and eapolinario authored Jul 15, 2023
    Configuration menu
    Copy the full SHA
    5a38c21 View commit details
    Browse the repository at this point in the history

  5. Fix generate check in CI (#377) 

    * Fix generate check in CI

* Re-run `make generate`
    @jeevb
    jeevb authored Jul 15, 2023
    Configuration menu
    Copy the full SHA
    e2eb4e5 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Remove welcomebot from boilerplate (#375) 

    Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Jul 17, 2023
    Configuration menu
    Copy the full SHA
    4e5ff42 View commit details
    Browse the repository at this point in the history

  2. Remove welcomebot from boilerplate (#161) 

    Signed-off-by: eduardo apolinario <[email protected]>
Co-authored-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario and eapolinario authored Jul 17, 2023
    Configuration menu
    Copy the full SHA
    e088ca6 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. Carry over hash value for all literal types in remote caching (#378) 

    Previously, the hash set on an input literal would be ignored if
the literal was of either the `Collection` or `Map` type. This is
fixed here by moving the hash-checking branch up in front of the
special type logic, so that an empty literal with hash is constructed
in either case if a hash is found.

Adds a regression test to verify the hashes are carried over into the
representer literals for both map and collection types.

Signed-off-by: Nicholas Junge <[email protected]>
    @nicholasjng
    nicholasjng authored Jul 18, 2023
    Configuration menu
    Copy the full SHA
    13ef7d6 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Send task execution metadata to out-core plugin (#369) 

    Signed-off-by: Hongxin Liang <[email protected]>
    @honnix
    honnix authored Jul 20, 2023
    Configuration menu
    Copy the full SHA
    3405f89 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Add 'flyteadmin/' from commit '248e947de3c85d5a7f3320211bce1763106a211c' 

    git-subtree-dir: flyteadmin
git-subtree-mainline: 845d0f5
git-subtree-split: 248e947
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    ec30f0d View commit details
    Browse the repository at this point in the history

  2. Add 'flytepropeller/' from commit '4322012ef07dff4de457473a7b5fb4cd6b… 

    …e4a2ee'

git-subtree-dir: flytepropeller
git-subtree-mainline: ec30f0d
git-subtree-split: 4322012
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    5ce1b0f View commit details
    Browse the repository at this point in the history

  3. Add 'flytestdlib/' from commit 'e088ca6c9b3a460f9c9a07b3b8fae2b6999ca… 

    …237'

git-subtree-dir: flytestdlib
git-subtree-mainline: 5ce1b0f
git-subtree-split: e088ca6
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    f952072 View commit details
    Browse the repository at this point in the history

  4. Add 'flyteplugins/' from commit '3405f890a0673cf3bd857e1089e363bf6488… 

    …7e6a'

git-subtree-dir: flyteplugins
git-subtree-mainline: f952072
git-subtree-split: 3405f89
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    4e28e72 View commit details
    Browse the repository at this point in the history

  5. Add 'flytecopilot/' from commit '5a38c21c2158e5a73563a836815a41cf8184… 

    …da1f'

git-subtree-dir: flytecopilot
git-subtree-mainline: 4e28e72
git-subtree-split: 5a38c21
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    6405e0f View commit details
    Browse the repository at this point in the history

  6. Add 'datacatalog/' from commit '6923ab848eeb7f1ef2daf312921ff0ca2ee1f… 

    …087'

git-subtree-dir: datacatalog
git-subtree-mainline: 6405e0f
git-subtree-split: 6923ab8
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    0d64369 View commit details
    Browse the repository at this point in the history

  7. Add relative imports 

    Signed-off-by: eduardo apolinario <[email protected]>
    @eapolinario
    eapolinario committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    90b17ce View commit details
    Browse the repository at this point in the history