Skip file opening, allow reading from csv string

[waruboy]

Hi Tilo! I'm reviewing the 2.0 version. Nice rewrite!

With the additional flexibility, I'm wondering if you can add support to just process a huge csv string.
Use case: We download our csv from amazon s3 and have it ready on memory. Would be nice if we can just feed it to smarterCSV ala CSV.parse()

[tilo]

Thank you! I'll look into it.

@waruboy reading the whole file from S3 into memory doesn't seem like the most efficient way though.

it would probably better if you do something like this:
https://stackoverflow.com/questions/46126904/stream-a-large-file-line-by-line-from-s3

and then use SmarterCSV with processing in 'chunks'

One tricky thing is that there is no rewind.

[waruboy]

Ah, our csv is only in tens of MB, so it's too large to process in-request, but still ok for in-memory processing.
I agree that we might need to do streaming in the future though, so thanks for pointing me to the resource

[tilo]

ear-marked for v2.0