Skip to content

Commit

Permalink
[[DM-40192] Changes to chart for on prem S3 @ USDF
Browse files Browse the repository at this point in the history
Be explicit about the S3_ENDPOINT_URL which we need
to be because we're not using AWS.  Be explicit about
the PGUSER so butler can figure out which address
to contact in the PGPASSFILE.
  • Loading branch information
cbanek committed Aug 3, 2023
1 parent 6c37076 commit 55115ec
Show file tree
Hide file tree
Showing 5 changed files with 27 additions and 1 deletion.
3 changes: 3 additions & 0 deletions applications/datalinker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,9 @@ IVOA DataLink-based service and data discovery
| autoscaling.maxReplicas | int | `100` | Maximum number of datalinker deployment pods |
| autoscaling.minReplicas | int | `1` | Minimum number of datalinker deployment pods |
| autoscaling.targetCPUUtilizationPercentage | int | `80` | Target CPU utilization of datalinker deployment pods |
| config.pgUser | string | `"rubin"` | User to use from the PGPASSFILE rubin is the default |
| config.s3EndpointUrl | string | `"https://storage.googleapis.com"` | S3 Endpoint URL |
| config.storageBackend | string | `"GCS"` | Storage backend to use: either GCS or S3 GCS is the default |
| config.tapMetadataUrl | string | `"https://github.com/lsst/sdm_schemas/releases/download/1.2.0/datalink-columns.zip"` | URL containing TAP schema metadata used to construct queries |
| fullnameOverride | string | `""` | Override the full name for resources (includes the release name) |
| global.baseUrl | string | Set by Argo CD | Base URL for the environment |
Expand Down
6 changes: 5 additions & 1 deletion applications/datalinker/templates/deployment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -60,10 +60,14 @@ spec:
value: "/tmp/secrets/aws-credentials.ini"
- name: "DAF_BUTLER_REPOSITORY_INDEX"
value: {{ .Values.global.butlerRepositoryIndex | quote }}
- name: "PGUSER"
value: {{ .Values.config.pgUser }}
- name: "PGPASSFILE"
value: "/tmp/secrets/postgres-credentials.txt"
- name: "STORAGE_BACKEND"
value: {{ .Values.config.storageBackend }}
- name: "S3_ENDPOINT_URL"
value: "https://storage.googleapis.com"
value: {{ .Values.config.s3EndpointUrl }}
- name: "GOOGLE_APPLICATION_CREDENTIALS"
value: "/tmp/secrets/butler-gcs-idf-creds.json"
ports:
Expand Down
4 changes: 4 additions & 0 deletions applications/datalinker/values-usdfdev.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
config:
# -- USDF uses an on prem S3 storage backend
storageBackend: "S3"
s3EndpointUrl: "https://s3dfrgw.slac.stanford.edu"
4 changes: 4 additions & 0 deletions applications/datalinker/values-usdfprod.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
config:
# -- USDF uses an on prem S3 storage backend
storageBackend: "S3"
s3EndpointUrl: "https://s3dfrgw.slac.stanford.edu"
11 changes: 11 additions & 0 deletions applications/datalinker/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,17 @@ config:
# -- URL containing TAP schema metadata used to construct queries
tapMetadataUrl: "https://github.com/lsst/sdm_schemas/releases/download/1.2.0/datalink-columns.zip"

# -- Storage backend to use: either GCS or S3
# GCS is the default
storageBackend: "GCS"

# -- User to use from the PGPASSFILE
# rubin is the default
pgUser: "rubin"

# -- S3 Endpoint URL
s3EndpointUrl: "https://storage.googleapis.com"

# -- Annotations for the datalinker deployment pod
podAnnotations: {}

Expand Down

0 comments on commit 55115ec

Please sign in to comment.