Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DevOps]: Separate data caching from other workflows #993

Open
2 tasks done
CodyCBakerPhD opened this issue Aug 7, 2024 · 1 comment
Open
2 tasks done

[DevOps]: Separate data caching from other workflows #993

CodyCBakerPhD opened this issue Aug 7, 2024 · 1 comment
Assignees

Comments

@CodyCBakerPhD
Copy link
Member

What would you like to see added to NeuroConv?

Both doctests and the later parts of our main test suite here on NeuroConv rely on the example data cache

The GUIDE also has multiple parts that each rely on such a mechanism, but we did something there that made it nicer - we made the caching it's own job and made the downstream runs dependent on its success: https://github.com/NeurodataWithoutBorders/nwb-guide/blob/main/.github/workflows/example_data_cache.yml

I suggest following that strategy @pauladkisson @h-mayorquin as it would alleviate the failures that started to be seen today, such as in #992

It also simplifies things by keeping the actions more modular rather than having cache handling steps integrated within the main CI tests

Is your feature request related to a problem?

No response

Do you have any interest in helping implement the feature?

Yes.

Code of Conduct

@CodyCBakerPhD CodyCBakerPhD changed the title [Feature]: Separate data caching from other workflows [DevOps]: Separate data caching from other workflows Aug 7, 2024
@h-mayorquin
Copy link
Collaborator

This is a good idea. There are new developments in cross oss caching that might simplify this even further:

https://github.com/actions/cache/blob/main/tips-and-workarounds.md#cross-os-cache

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants