Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dag only deploy option should not do secondary check #108

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

collinmcnulty
Copy link
Contributor

If a user is doing secondary manipulation of a filesystem to create a dags/ folder from multiple sources, the check on dags/ being changed in the diff will fail even though only dags have changed. This makes sense for infer, but we need to have an option where the user's indication that this is a dag-only deploy is trusted.

@collinmcnulty collinmcnulty requested a review from a team as a code owner January 31, 2025 21:14
Copy link
Collaborator

@neel-astro neel-astro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change would start creating a problem when someone has configured multiple deploy action steps in their workflow, i.e. one for dbt deploy, another for dags deploy, and then one for image deploy.

In that case, as of now, we would only be triggering an image deploy for the case when there is a change outside the dags and dbt folder, but with this change, we would end up triggering both dags deploy and image deploy for such changes, which feels wrong.

Maybe having something like a skip-check parameter would be useful to skip these checks and simply do dag/dbt/image deploy if the deploy type is anything but infer. That would ensure existing workflow setups are not impacted.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants