Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch VEDA staging hub from EFS to jupyter-home-nfs server #4821

Merged
merged 6 commits into from
Sep 19, 2024

Conversation

sunu
Copy link
Contributor

@sunu sunu commented Sep 17, 2024

Changes include:

  • Switch storage provider of VEDA staging hub from EFS to the in-cluster NFS server provided by jupyter-home-nfs
  • Upgrade jupyter-home-nfs to the latest version
    • the new version supports specifying the parent path of the home directories for enforcing storage quota. (earlier the quota enforcement path was hard-coded to be /export/). For the staging hub, we set it to /export/staging.
    • The new version adds 'nfs' to k8s resource names, no longer relying only on Helm release names for identification

Copy link

github-actions bot commented Sep 17, 2024

Merging this PR will trigger the following deployment actions.

Support and Staging deployments

Cloud Provider Cluster Name Upgrade Support? Reason for Support Redeploy Upgrade Staging? Reason for Staging Redeploy
kubeconfig pchub No Yes Core infrastructure has been modified
aws victor No Yes Core infrastructure has been modified
aws gridsst No Yes Core infrastructure has been modified
aws nasa-ghg No Yes Core infrastructure has been modified
aws earthscope No Yes Core infrastructure has been modified
gcp pangeo-hubs No Yes Core infrastructure has been modified
aws openscapes No Yes Core infrastructure has been modified
gcp 2i2c-uk No Yes Core infrastructure has been modified
aws 2i2c-aws-us No Yes Core infrastructure has been modified
aws nasa-cryo No Yes Core infrastructure has been modified
aws projectpythia No Yes Core infrastructure has been modified
gcp 2i2c No Yes Core infrastructure has been modified
aws opensci No Yes Core infrastructure has been modified
aws nasa-veda No Yes Core infrastructure has been modified
kubeconfig utoronto No Yes Core infrastructure has been modified
aws jupyter-health No Yes Core infrastructure has been modified
aws kitware No Yes Core infrastructure has been modified
aws nmfs-openscapes No Yes Core infrastructure has been modified
aws catalystproject-africa No Yes Core infrastructure has been modified
gcp catalystproject-latam No Yes Core infrastructure has been modified
aws ubc-eoas No Yes Core infrastructure has been modified
gcp awi-ciroh No Yes Core infrastructure has been modified
gcp leap No Yes Core infrastructure has been modified
aws smithsonian No Yes Core infrastructure has been modified
gcp cloudbank No Yes Core infrastructure has been modified
aws jupyter-meets-the-earth No Yes Core infrastructure has been modified
aws nasa-esdis No Yes Core infrastructure has been modified
gcp hhmi No Yes Core infrastructure has been modified

Production deployments

Cloud Provider Cluster Name Hub Name Reason for Redeploy
kubeconfig pchub prod Core infrastructure has been modified
aws victor prod Core infrastructure has been modified
aws gridsst prod Core infrastructure has been modified
aws nasa-ghg prod Core infrastructure has been modified
aws earthscope prod Core infrastructure has been modified
gcp pangeo-hubs prod Core infrastructure has been modified
gcp pangeo-hubs coessing Core infrastructure has been modified
aws openscapes prod Core infrastructure has been modified
aws openscapes workshop Core infrastructure has been modified
gcp 2i2c-uk lis Core infrastructure has been modified
aws 2i2c-aws-us showcase Core infrastructure has been modified
aws 2i2c-aws-us ncar-cisl Core infrastructure has been modified
aws 2i2c-aws-us itcoocean Core infrastructure has been modified
aws 2i2c-aws-us cosmicds Core infrastructure has been modified
aws nasa-cryo prod Core infrastructure has been modified
aws projectpythia prod Core infrastructure has been modified
aws projectpythia pythia-binder Core infrastructure has been modified
gcp 2i2c imagebuilding-demo Core infrastructure has been modified
gcp 2i2c binderhub-ui-demo Core infrastructure has been modified
gcp 2i2c demo Core infrastructure has been modified
gcp 2i2c ohw Core infrastructure has been modified
gcp 2i2c temple Core infrastructure has been modified
gcp 2i2c ucmerced Core infrastructure has been modified
gcp 2i2c climatematch Core infrastructure has been modified
gcp 2i2c mtu Core infrastructure has been modified
aws opensci sciencecore Core infrastructure has been modified
aws opensci climaterisk Core infrastructure has been modified
aws opensci small-binder Core infrastructure has been modified
aws opensci big-binder Core infrastructure has been modified
aws nasa-veda prod Core infrastructure has been modified
aws nasa-veda binder Core infrastructure has been modified
kubeconfig utoronto prod Core infrastructure has been modified
kubeconfig utoronto r-prod Core infrastructure has been modified
aws jupyter-health prod Core infrastructure has been modified
aws kitware prod Core infrastructure has been modified
aws nmfs-openscapes prod Core infrastructure has been modified
aws catalystproject-africa nm-aist Core infrastructure has been modified
aws catalystproject-africa must Core infrastructure has been modified
aws catalystproject-africa uvri Core infrastructure has been modified
aws catalystproject-africa wits Core infrastructure has been modified
aws catalystproject-africa kush Core infrastructure has been modified
aws catalystproject-africa molerhealth Core infrastructure has been modified
aws catalystproject-africa aibst Core infrastructure has been modified
aws catalystproject-africa bhki Core infrastructure has been modified
aws catalystproject-africa bon Core infrastructure has been modified
gcp catalystproject-latam unitefa-conicet Core infrastructure has been modified
gcp catalystproject-latam cicada Core infrastructure has been modified
gcp catalystproject-latam gita Core infrastructure has been modified
gcp catalystproject-latam iner Core infrastructure has been modified
gcp catalystproject-latam plnc Core infrastructure has been modified
gcp catalystproject-latam unam Core infrastructure has been modified
gcp catalystproject-latam cabana Core infrastructure has been modified
gcp catalystproject-latam nnb-ccg Core infrastructure has been modified
gcp catalystproject-latam labi Core infrastructure has been modified
gcp catalystproject-latam areciboc3 Core infrastructure has been modified
gcp catalystproject-latam valledellili Core infrastructure has been modified
aws ubc-eoas prod Core infrastructure has been modified
gcp awi-ciroh prod Core infrastructure has been modified
gcp leap prod Core infrastructure has been modified
gcp leap public Core infrastructure has been modified
aws smithsonian prod Core infrastructure has been modified
gcp cloudbank bcc Core infrastructure has been modified
gcp cloudbank ccc Core infrastructure has been modified
gcp cloudbank ccsf Core infrastructure has been modified
gcp cloudbank chabot Core infrastructure has been modified
gcp cloudbank csm Core infrastructure has been modified
gcp cloudbank csulb Core infrastructure has been modified
gcp cloudbank csum Core infrastructure has been modified
gcp cloudbank demo Core infrastructure has been modified
gcp cloudbank dvc Core infrastructure has been modified
gcp cloudbank elac Core infrastructure has been modified
gcp cloudbank elcamino Core infrastructure has been modified
gcp cloudbank evc Core infrastructure has been modified
gcp cloudbank fresno Core infrastructure has been modified
gcp cloudbank glendale Core infrastructure has been modified
gcp cloudbank high Core infrastructure has been modified
gcp cloudbank howard Core infrastructure has been modified
gcp cloudbank humboldt Core infrastructure has been modified
gcp cloudbank lacc Core infrastructure has been modified
gcp cloudbank lamission Core infrastructure has been modified
gcp cloudbank laney Core infrastructure has been modified
gcp cloudbank lbcc Core infrastructure has been modified
gcp cloudbank mendocino Core infrastructure has been modified
gcp cloudbank merced Core infrastructure has been modified
gcp cloudbank mills Core infrastructure has been modified
gcp cloudbank miracosta Core infrastructure has been modified
gcp cloudbank mission Core infrastructure has been modified
gcp cloudbank moreno Core infrastructure has been modified
gcp cloudbank norco Core infrastructure has been modified
gcp cloudbank palomar Core infrastructure has been modified
gcp cloudbank pasadena Core infrastructure has been modified
gcp cloudbank reedley Core infrastructure has been modified
gcp cloudbank riohondo Core infrastructure has been modified
gcp cloudbank sacramento Core infrastructure has been modified
gcp cloudbank saddleback Core infrastructure has been modified
gcp cloudbank santiago Core infrastructure has been modified
gcp cloudbank sbcc Core infrastructure has been modified
gcp cloudbank sbcc-dev Core infrastructure has been modified
gcp cloudbank sierra Core infrastructure has been modified
gcp cloudbank sjcc Core infrastructure has been modified
gcp cloudbank sjsu Core infrastructure has been modified
gcp cloudbank skyline Core infrastructure has been modified
gcp cloudbank srjc Core infrastructure has been modified
gcp cloudbank tuskegee Core infrastructure has been modified
gcp cloudbank wlac Core infrastructure has been modified
aws jupyter-meets-the-earth prod Core infrastructure has been modified
aws nasa-esdis prod Core infrastructure has been modified
gcp hhmi prod Core infrastructure has been modified
gcp hhmi spyglass Core infrastructure has been modified
gcp hhmi binder Core infrastructure has been modified

@sgibson91
Copy link
Member

@sunu I don't know if you want to make changes here or just merge it and make a new PR for figuring out the NFS filepath mount. You have merge rights so I'll leave it up to you :)

Newer version of jupyter-home-nfs uses a different server name.
So the nfs server ip also changed after deploying the new version.
Storage quota is enforced on all home directories under the configured
path.
@sunu sunu marked this pull request as ready for review September 19, 2024 04:43
@sunu
Copy link
Contributor Author

sunu commented Sep 19, 2024

@sgibson91 I've added a few more changes here. Added a note to the top comment describing the changes. Could you take another quick look please?

@sunu sunu requested a review from sgibson91 September 19, 2024 04:49
@sgibson91 sgibson91 merged commit 8ec2e69 into 2i2c-org:main Sep 19, 2024
35 checks passed
Copy link

🎉🎉🎉🎉

Monitor the deployment of the hubs here 👉 https://github.com/2i2c-org/infrastructure/actions/runs/10939355537

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants