Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How does it handle object changes Salesforce side? #1

Open
riekusr opened this issue Aug 30, 2024 · 2 comments
Open

How does it handle object changes Salesforce side? #1

riekusr opened this issue Aug 30, 2024 · 2 comments

Comments

@riekusr
Copy link

riekusr commented Aug 30, 2024

Hi, love your project and if it matures a bit i have plenty of usecases. How do you plan to handle changes in the datamodel on the Salesforce side?

@ruslantalpa
Copy link
Member

There are multiple avenues (though i can't say i necessarily have plans in implementing the advanced ways yet).

  • If the data in SF is not huge (below millions of rows/table) i think the best option is just to spin up a fresh db with the new list of objects. this can be reasonably fast if usage of bulk api (or sf backup file) is implemented
  • manually use primitives like pgsalesforce.create_table_pairs to add new objects on live running systems
  • theoretically possible to have a background process monitoring the SF metadata and diffing the jsons and based on those, execute DDLs (like in the second option) to sync the schema layout. I am guessing "new column/new object" are the most common ones and those are easy to implement.

I'm curious about the use cases, I also thought this would be a compelling tool/product (build apps on top of PG, ETLs to PG or even other destinations for which pg has fdws) but so far in my reach-outs the reaction/excitement was "meah" :).
Orgs that don't have engineering departments can't really use it and the ones that do prefer to build their ETLs themselves (mulesoft/appsync/custom)

@riekusr
Copy link
Author

riekusr commented Aug 30, 2024

I agree, at the moment I use ETL via nodered as well, but having something robust in PG seems natural.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants