Skip to content

Commit

Permalink
Merge pull request #3 from airflow-plugins/petedejoy-patch-1
Browse files Browse the repository at this point in the history
Create README.md
  • Loading branch information
Ben authored Oct 31, 2018
2 parents 4560b5e + de64df0 commit 41d3d2a
Showing 1 changed file with 27 additions and 0 deletions.
27 changes: 27 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Github Plugin
This plugin moves data from the Github API to Google Cloud Storage based on the specified object.

## Hooks
### GithubHook
This hook handles the authentication and request to Github. This extends the HttpHook.

### S3Hook
Core Airflow S3Hook with the standard boto dependency.

## Operators
### GithubtoCloudStorageOperator
This operator composes the logic for this plugin. It fetches the Github specified object and saves the result in GCS. The parameters it can accept include the following:
```:param src: Path to the local file. (templated)
:type src: str
:param dst: Destination path within the specified bucket. (templated)
:type dst: str
:param bucket: The bucket to upload to. (templated)
:type bucket: str
:param google_cloud_storage_conn_id: The Airflow connection ID to upload with
:type google_cloud_storage_conn_id: str
:param mime_type: The mime-type string
:type mime_type: str
:param delegate_to: The account to impersonate, if any
:type delegate_to: str
:param gzip: Allows for file to be compressed and uploaded as gzip
```

0 comments on commit 41d3d2a

Please sign in to comment.