Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Web downloads capped at 7.5GB #2798

Closed
effigies opened this issue Apr 12, 2023 · 0 comments · Fixed by #2800
Closed

Web downloads capped at 7.5GB #2798

effigies opened this issue Apr 12, 2023 · 0 comments · Fixed by #2800
Labels

Comments

@effigies
Copy link
Contributor

What went wrong?

Downloading a 13GB file https://openneuro.org/crn/datasets/ds002179/snapshots/1.1.0/files/sub-EXC004:anat:sub-EXC004_acq-FA15_FLASH.nii.gz "completes" at 7.5GB:

$ wget https://openneuro.org/crn/datasets/ds002179/snapshots/1.1.0/files/sub-EXC004:anat:sub-EXC004_acq-FA15_FLASH.nii.gz
--2023-04-12 07:29:28--  https://openneuro.org/crn/datasets/ds002179/snapshots/1.1.0/files/sub-EXC004:anat:sub-EXC004_acq-FA15_FLASH.nii.gz
Resolving openneuro.org (openneuro.org)... 34.107.158.10
Connecting to openneuro.org (openneuro.org)|34.107.158.10|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/gzip]
Saving to: ‘sub-EXC004:anat:sub-EXC004_acq-FA15_FLASH.nii.gz’

sub-EXC004:anat:sub-EXC0     [       <=>                         ]   7.43G  18.9MB/s    in 6m 12s  

2023-04-12 07:35:40 (20.4 MB/s) - ‘sub-EXC004:anat:sub-EXC004_acq-FA15_FLASH.nii.gz’ saved [7974987415]

Fetching the dataset through DataLad or S3 retrieves the whole file.

Expected behavior

Either serve the whole file or refuse to serve.

How to reproduce

$ wget https://openneuro.org/crn/datasets/ds002179/snapshots/1.1.0/files/sub-EXC004:anat:sub-EXC004_acq-FA15_FLASH.nii.gz

Desktop

  • OS: Ubuntu
  • Browser: n/a
  • Version:

Phone

  • Device:
  • OS:
  • Browser:
  • Version:

Additional information

xref freshdesk#1459

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant