Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Python][FS][Azure] Python bindings for the new C++ AzureFilesystem #39317

Open
Tom-Newton opened this issue Dec 20, 2023 · 1 comment
Open

[Python][FS][Azure] Python bindings for the new C++ AzureFilesystem #39317

Tom-Newton opened this issue Dec 20, 2023 · 1 comment
Labels
Component: Python Type: enhancement

Comments

@Tom-Newton
Copy link
Contributor

Tom-Newton commented Dec 20, 2023 •
edited
Loading

Describe the enhancement requested

Add python bindings so that the new C++ AzureFilesystem can be used from Python code. abfs:// and abfss:// URIs should automatically select the AzureFilesystem.

This should enable pyarrow users to get much improved performance and reliability compared to https://github.com/fsspec/adlfs.

Work on the C++ AzureFilesystem is tracked by #18014

Sub issues:

Component(s)

Python
@Tom-Newton Tom-Newton mentioned this issue Dec 20, 2023
Closed
@Tom-Newton
Copy link
Contributor Author

Tom-Newton commented Dec 20, 2023 •
edited
Loading

My custom build of pyarrow actually has pybindings like this. I can work on this.

@Tom-Newton Tom-Newton mentioned this issue Dec 22, 2023
Closed
@Tom-Newton Tom-Newton mentioned this issue Feb 6, 2024
Closed
@Tom-Newton Tom-Newton changed the title [Python] Python bindings for the new C++ AzureFilesystem [Python][FS][Azure] Python bindings for the new C++ AzureFilesystem Feb 6, 2024
This was referenced Feb 11, 2024
Open
Closed
@Tom-Newton Tom-Newton mentioned this issue Mar 15, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Component: Python Type: enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Tom-Newton