Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support uploading files larger than 5GB from Drupal web UI #4

Open
joecorall opened this issue Nov 2, 2023 · 1 comment
Open

Support uploading files larger than 5GB from Drupal web UI #4

joecorall opened this issue Nov 2, 2023 · 1 comment
Assignees

Comments

@joecorall
Copy link
Member

When uploading files via the Drupal web admin interface, we're using the drupal/flysystem_gcs_cors module to directly upload the file to Google Cloud Storage.

That module right now has a limit of 5GB for file uploads.

Once this issue closes >>> https://www.drupal.org/project/flysystem_gcs_cors/issues/3298932 <<< we can increase that to 5TB uploads from the web admin UI

@joecorall
Copy link
Member Author

The docs say 5TB should be possible in a single request 🤔

While it is possible to upload the full 5 TiB in a single upload request, such long-running uploads are more likely to experience failures; resumable uploads are the recommended method for uploading large objects.

Resumable uploads through a web UI seems unreasonably complex to implement. Even with a multi-part upload, the speed to upload is going to be capped by the internet connection. Should try this out on a fast connection with a single upload and 100GB file and see how it behaves. If it works reliably, should up the max upload size, make it configurable through the UI, and mark this as done. Most customers will be uploading from their campus network, which should provide high throughput.

@joecorall joecorall self-assigned this Nov 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant