Skip to content
This repository has been archived by the owner on Apr 6, 2020. It is now read-only.

Stop using boto3? #3

Closed
emgrasmeder opened this issue Dec 13, 2017 · 1 comment
Closed

Stop using boto3? #3

emgrasmeder opened this issue Dec 13, 2017 · 1 comment

Comments

@emgrasmeder
Copy link
Collaborator

I haven't verified yet, but I think boto3 only works with instances in the correct security group or for users who have authenticated using the aws cli. This adds one extra step to getting people started, so instead of using boto, we should consider using:

data = requests.get(s3url).content

@emgrasmeder
Copy link
Collaborator Author

Looks like it's now possible to read without credentials using:

import s3fs
s3 = s3fs.S3FileSystem(anon=True)
s3.get('twde-datalab/raw/filename.csv', '../data/filename.csv')

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants