Commits on Sep 24, 2024

1. chunks index caching, fixes borgbackup#8397 …

   borg compact now uses ChunkIndex (a specialized, memory-efficient data structure),
   so it needs less memory now. Also, it saves that chunks index to cache/chunks in
   the repository.
   
   When the chunks index is needed, it is first tried to get it from cache/chunks.
   If that fails, fall back to building the chunks index via repository.list(),
   which can be rather slow and immediately cache the resulting ChunkIndex in the
   repo.
   
   borg check --repair currently just deletes the chunks cache, because it might
   have deleted some invalid chunks in the repo.
   
   cache.close now saves the chunks index to cache/chunks in repo if it
   was modified.
   thus, borg create will update the cached chunks index with new chunks.
   
   cache/chunks_hash can be used to validate cache/chunks (and also to validate /
   invalidate locally cached copies of that).

   

   ThomasWaldmann committed Sep 24, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for 36e3d63
   • Browse repository at this point

   Copy the full SHA

   36e3d63 View commit details

   Browse the repository at this point in the history