Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Current state of the library, milestones and current development #438

Open
LuchiLucs opened this issue Nov 27, 2023 · 1 comment
Open

Current state of the library, milestones and current development #438

LuchiLucs opened this issue Nov 27, 2023 · 1 comment

Comments

@LuchiLucs
Copy link

Please bear with me, I have never heard of fsspec and adlfs. I am trying to assess the state of this library coming frome the Python SDK for Azure Blob Storage. I used them in a personal project in order to implement concurrent (asyncio) IO of multiple blobs from Azure Cloud and now I wish to have a common interface to swap the cloud fs to a local fs, so here I am.
I was wondering what is the current state, e.g.:
AFAIK, this library is built on top on the Python SDK, levearing it. What does it offer though or how should it be used? Are there examples of use-cases when this wrapping is useful to download/upload multiple files concurrently or in other cases? What if the blob is no longer a blob but the user wish to optimize for particular content type? (for instance if all my blobs are .parquet files)

@TomAugspurger
Copy link
Contributor

I think https://filesystem-spec.readthedocs.io/en/latest/ will answer most of those questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants