Skip to content

Commit

Permalink
Add a Google Cloud Storage filesystem/target.
Browse files Browse the repository at this point in the history
In theory, GCS is supported by boto, which would be a better option. Unfortunately Google's API authentication is a
mess - the boto GCS implementation basically only supports the CLI use-case (it expects a boto config to house all
the configuration). It has minimal support for using oauth tokens, but there is no way to use a service account,
which is what they recommend you use for automated tasks. You can see it at https://github.com/GoogleCloudPlatform/gcs-oauth2-boto-plugin .

Because of this insanity we use the google-api-python-client package to speak to GCS via their JSON protocol. This
is...not easy. Either way, this change does work and passes quite a few tests. Unfortunately since the API is
auto-generated, you can be sure that there are no fake implementations of it (e.g. moto). Hence the test is an
integration test and requires credentials on your box to access GCS.

You can get creds by going through the gcloud tools setup guide. After that just create a project & pick a bucket
and everything should work :)
  • Loading branch information
mikekap committed Jun 8, 2015
1 parent 8330f3e commit 4fd64e7
Show file tree
Hide file tree
Showing 2 changed files with 566 additions and 0 deletions.
Loading

0 comments on commit 4fd64e7

Please sign in to comment.