Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support load.py and schema.py as templates with values injected during dac pack #11

Open
francesco086 opened this issue Mar 17, 2023 · 0 comments
Labels

Comments

@francesco086
Copy link
Collaborator

As a dac package producer
I would like to have the possibility to insert parameters in the load.py and schema.py files that will be filled when running dac pack
so that I can re-use the same templates

Example

import dask.dataframe as dd


def load() -> dd.DataFrame:
    return dd.read_parquet(path="az://STORAGE_CONTAINER_NAME/DATA_FOLDER/*.parquet", 
                           storage_options={"account_name": "STORAGE_ACCOUNT_NAME", "anon": False})

Here, STORAGE_ACCOUNT_NAME, STORAGE_CONTAINER_NAME, and DATA_FOLDER could be parametrized to allow re-usability

@francesco086 francesco086 added the enhancement New feature or request label Mar 17, 2023
@francesco086 francesco086 changed the title Support input .py as templates with values injected during dac pack Support load.py and schema.py as templates with values injected during dac pack Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant