Allow distinct source and target projects #294
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description & motivation
This update allows users to set distinct source and target projects. This helps in scenarios where the dbt user is not able to write to the source project. The target project is pulled from the current profile (
target.project
).!!Certain variables have been renamed which introduce breaking changes!!
dataset
andproject
no longer exist as thetarget.dataset
andtarget.project
will be used.New variable:
source_project
is now required to indicate the source of the GA4 dataNew variable:
combined_dataset
is required when sourcing from multiple properties. This specifies where to copy the cloned data. Thetarget.project
will be used to clone data.property_ids
variable is an array and is used to indicate which property IDs to source from. Can be used for single or multi-property instances (ex: [1111111] for 1 property or [1111111,2222222] for 2, etc)Checklist
dbt test
andpython -m pytest .
to validate existing tests