Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/issue 395 Indicate object in cold storage #401

Merged
merged 4 commits into from
Aug 12, 2024

Conversation

suryasaha
Copy link
Contributor

Indicate that a given access method is to cold/offline/less available storage

A DRS object is said to be in 'Cold' storage when it is not immediately available via a DRS request. Hot/Cold is binary. Goal is to indicate that a given access method is to a cold/offline/less available storage. Please see #395 for community discussion.

We are taking a phased approach. For Phase 1, we just want to answer this question:
Can the user can retrieve the file at the moment of the request?

  • If the user can do that, than the file is in "hot" storage, and can be used right away.
  • If the user cannot retrieve the file, then the file is simply in not available. It is in some form of cold/offline/less available storage.

In phase 2, we can think about having a better way to provide details on the storage and the thawing process.

briandoconnor and others added 2 commits November 26, 2023 22:17
DRS 1.4.0 adds bulk operations, this update includes a syntax fix in the schema
@briandoconnor
Copy link
Contributor

See cloud work stream discussion notes from last DRS discussion from 2/12/24: https://docs.google.com/document/d/1hayvWLIoymomPI9oXcaTZirn5YxFv1cYAs70zyvlvnA/edit#bookmark=id.stgpsb1mhzwn

@briandoconnor
Copy link
Contributor

Today at GA4GH connect we decided this should be an enum and the values should be "immediate" and "delayed"

@mattions
Copy link

quick note form Connect Switzerland, recording the decision:

Let's make it an enumeration: --> immediate, delayed as the two terms.
Lots of thumbs up in the room.

@suryasaha
Copy link
Contributor Author

Interest from driver projects at Connect: CRDC, BDC, SRA, European 1M genomes project, AnVIL, Australian Genomics

@suryasaha suryasaha self-assigned this Jun 24, 2024
@suryasaha suryasaha marked this pull request as draft June 24, 2024 21:29
Using a boolean value denoting immediate availability of file. Dispensing with hot and cold as that refers to storage and does not cover all cases
@suryasaha suryasaha marked this pull request as ready for review June 24, 2024 21:46
@suryasaha
Copy link
Contributor Author

@ianfore I am using availability as the label now with boolean value. Do you think this looks better?

@briandoconnor
Copy link
Contributor

as of 20240812 we decided the boolean is the right way to go. We can discuss delay time reporting back during the thaw mechanism

@briandoconnor briandoconnor merged commit 3ea77e4 into master Aug 12, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants