Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add jobs to look automatically fill in missing data. #54

Open
wafels opened this issue Nov 1, 2023 · 0 comments
Open

Add jobs to look automatically fill in missing data. #54

wafels opened this issue Nov 1, 2023 · 0 comments

Comments

@wafels
Copy link
Contributor

wafels commented Nov 1, 2023

Users have noted that some data sources are missing data, sometimes an entire day and sometimes an entire month. This can be ameliorated by running processes that regularly look back over longer periods of time to check for data that may not have converted into JPEG2000 images.

This can be done with some small changes to the JPEG2000 creation scripts. Typically these search for data once every X hours, looking for data between the current time and Y days ago. Additional jobs can be added that search less frequently but further back. For example, we can have jobs that check once every day (X=24), but check a full week back in time (Y=7). Similarly, we should have jobs that check once every week (X=168), but check back in time four weeks (Y=28). This should be applied to all JPEG2000 creation processes running at GSFC for operating missions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant