Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GCSTransformOperator: provide Jinja templating in source and destination object names #23327

Closed
2 tasks done
nitinmuteja opened this issue Apr 28, 2022 · 1 comment · Fixed by #23328
Closed
2 tasks done

GCSTransformOperator: provide Jinja templating in source and destination object names #23327

nitinmuteja opened this issue Apr 28, 2022 · 1 comment · Fixed by #23328
Assignees
@eladkal
Labels
area:providers kind:feature Feature Requests provider:google Google (including GCP) related issues

Comments

@nitinmuteja
Copy link

Description

Provide an option to receive the source_object and destination_object via Jinja params.

Use case/motivation

Usecase: Need to execute a DAG to fetch a video from GCS bucket based on paramater and then transform it and store it back.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@nitinmuteja nitinmuteja added the kind:feature Feature Requests label Apr 28, 2022
@boring-cyborg
Copy link

boring-cyborg bot commented Apr 28, 2022

Thanks for opening your first issue here! Be sure to follow the issue template!

@nitinmuteja nitinmuteja changed the title GCSTransformOperator provide jinja templates in object names GCSTransformOperator: provide Jinja templating in source and object names Apr 28, 2022
@nitinmuteja nitinmuteja changed the title GCSTransformOperator: provide Jinja templating in source and object names GCSTransformOperator: provide Jinja templating in source and destination object names Apr 28, 2022
@eladkal eladkal self-assigned this Apr 28, 2022
@eladkal eladkal added provider:google Google (including GCP) related issues area:providers labels Apr 28, 2022
eladkal added a commit to eladkal/airflow that referenced this issue Apr 28, 2022
@eladkal
GCSFileTransformOperator: New templated fields source_object, `de…
45019d3 
…stination_object`

* Add `source_object`, `destination_object` as templated fields
* fix docstring
closes: apache#23327
@eladkal eladkal mentioned this issue Apr 28, 2022
Merged
eladkal added a commit that referenced this issue Apr 28, 2022
@eladkal
GCSFileTransformOperator: New templated fields source_object, `de…
c82b3b9 
…stination_object` (#23328)

* `GCSFileTransformOperator`: New templated fields `source_object`, `destination_object`
* Add `source_object`, `destination_object` as templated fields
* fix docstring
closes: #23327
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@eladkal eladkal

Labels
area:providers kind:feature Feature Requests provider:google Google (including GCP) related issues
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

GCSFileTransformOperator: New templated fields source_object, destination_object eladkal/airflow
2 participants
@nitinmuteja @eladkal