Commits on Jan 16, 2024

1. Increase RDS connection pool max capacity in Prod …

   Also:
   
   - increase step function state concurrency, which the increased
     connection pool capacity should now handle
   - add missing retry configuration for steps in ingestion workflow
     to increase resilience
   - set duplicateHandling to "skip" for both WV03 collections to
     allow rerunning ingestion without reingesting existing granules
   - reduce background queue message limit to avoid reaching concurrency
     quota for Lambda executions
   - increase queue throttle to increase ingestion rate (in combination with
     previous point, this should still keep us within Lamba quota)
   - reduce default granule batch size for queuing to 1000 to ensure we
     won't encounter QueueGranules timeouts with "skip" duplicate handling
     (due to extra DB queries by DiscoverGranules to check for duplicates)

   

   chuckwondo committed Jan 16, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for bfedbf1
   • Browse repository at this point

   Copy the full SHA

   bfedbf1 View commit details

   Browse the repository at this point in the history