Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ci): Use cached ncbi dataset package to isolate tests #47

Merged
merged 2 commits into from
Jul 19, 2024

Conversation

corneliusroemer
Copy link
Member

@corneliusroemer corneliusroemer commented Jul 17, 2024

Resolves #46, see that issue for motivation

The zip file is 8MB which is ok. If we wanted to use less space, we could turn the package into a .tar.zst which uses only 1.4MB.

The pattern of not calling datasets in CI could be copied to other repos and/or the template if it's something we feel is useful.

  • Checks pass

Keeps the default rules simpler by hiding the use of example data
in the custom rules for CI.

This matches how we manage example data in the phylogenetic workflow.
@joverlee521
Copy link
Contributor

Thanks @corneliusroemer, I added b9386ad to match how we manage CI's example data in phylogenetic.

@corneliusroemer
Copy link
Member Author

Nice, makes sense to do it this way, keeps the test code out of the main workflow!

@joverlee521
Copy link
Contributor

Merging per consensus in yesterday's dev chat:

Consensus: we are good with caching ingest downloads for CI purposes, particularly when a repo is also automatically trying to rebuild daily and running “live” ingest during that process

@joverlee521 joverlee521 merged commit 168b91a into main Jul 19, 2024
4 checks passed
@joverlee521 joverlee521 deleted the test-data branch July 19, 2024 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bypass/mock ncbi datasets call in ci
2 participants