Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[async] Evaluate the possiblity of using dbt itself to create the full SQL command #1266

Open
1 task
tatiana opened this issue Oct 21, 2024 · 1 comment
Open
1 task
Labels
dbt:compile Primarily related to dbt compile command or functionality execution:async Related to the Async execution mode stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed
Milestone

Comments

@tatiana
Copy link
Collaborator

tatiana commented Oct 21, 2024

Context

When implementing #1230, we realised that the dbt compile command outputs the select statements related to models and transformations, but not necessarily the remaining relevant parts of the query (including creates, updates, inserts, drops).

This logic lives partially in dbt-core code and partially in the dbt adaptors of interest.

Could we leverage the --empty flag (dbt-labs/dbt-core#8980 (comment)) in any way?

Acceptance criteria

  • Analyse the possibility of, during the dbt compile - or somewhere related, to a setup task - to pre-create the full queries that we want to run with the async operators afterwards.
@tatiana tatiana added the execution:async Related to the Async execution mode label Oct 21, 2024
@dosubot dosubot bot added the dbt:compile Primarily related to dbt compile command or functionality label Oct 21, 2024
@tatiana tatiana added this to the Cosmos 1.9.0 milestone Oct 30, 2024
Copy link

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed label Nov 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dbt:compile Primarily related to dbt compile command or functionality execution:async Related to the Async execution mode stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed
Projects
None yet
Development

No branches or pull requests

1 participant