Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Define and document workflow output structure #15

Open
jashapiro opened this issue Apr 23, 2024 · 0 comments
Open

Define and document workflow output structure #15

jashapiro opened this issue Apr 23, 2024 · 0 comments
Assignees

Comments

@jashapiro
Copy link
Member

Most workflow results, especially those that that may be used in downstream analyses, will be placed in the openscpca-nf-workflow-results bucket.

A current thought for the structure of that bucket is that there will be a set prefix for each release of the workflow, with subdirtectories for each module that all outputs from that module will include. For example, if there is a module named merged-sce, and an associated release of 2024-04-01, the outputs would be placed within:

s3://openscpca-nf-workflow-results/2024-04-01/merged-sce

Comments on this proposed structure are welcome in this issue before we start to implement it!

This structure should be implemented in at least one example module, and documentation about that implementation should be added to the README and/or contributing docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant