You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Overall logic:
Each time a json file is created or modified in the epd-raw-data-prod-eu-west-3 bucket, it sends an event to a SNS.
A SQS listens to this SNS and triggers a lambda that will read the json, and load its data into PostgreSQL.
UUID can be used for indexing the DB.
Maybe for v0 we can load everything into the same table?
High-level design:
Overall logic:
Each time a
json
file is created or modified in theepd-raw-data-prod-eu-west-3
bucket, it sends an event to a SNS.A SQS listens to this SNS and triggers a lambda that will read the json, and load its data into PostgreSQL.
UUID can be used for indexing the DB.
Maybe for v0 we can load everything into the same table?
Resources to create with
cdk
:aws-rds
)json
file and insert the data into PostgreSQLThe text was updated successfully, but these errors were encountered: