We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FixedInputStream was added to detect truncated files:
FixedInputStream
nextflow/modules/nf-httpfs/src/main/nextflow/file/http/FixedInputStream.groovy
Lines 67 to 72 in 324de3d
However this does not handle the case where only part of a file is read. Consider this example from sarek:
// Get first line of a FASTQ file def readFirstLineOfFastq(path) { def line = null try { path.withInputStream { InputStream gzipStream = new java.util.zip.GZIPInputStream(it) Reader decoder = new InputStreamReader(gzipStream, 'ASCII') BufferedReader buffered = new BufferedReader(decoder) line = buffered.readLine() assert line.startsWith('@') } } catch (Exception e) { log.warn "FASTQ file(${path}): Error streaming" log.warn "${e.message}" } return line }
It will log this error every time:
Read data length does not match expected size - bytes read: 2756; expected: 16013759
cc @maxulysse
The text was updated successfully, but these errors were encountered:
Related to #5275 and #5214
Sorry, something went wrong.
Solved by #5405
tom-seqera
No branches or pull requests
FixedInputStream
was added to detect truncated files:nextflow/modules/nf-httpfs/src/main/nextflow/file/http/FixedInputStream.groovy
Lines 67 to 72 in 324de3d
However this does not handle the case where only part of a file is read. Consider this example from sarek:
It will log this error every time:
cc @maxulysse
The text was updated successfully, but these errors were encountered: