[ENH] design babs-unzip

[zhao-cy]

Goal of this program: customized unzipping: unzips results zip files and extracts files users desire. (added on 7/10/2023)

(edited) Note on 6/28/2022: To discuss with Matt, Syndey, and Tinashe the scenarios we wanted to support.

e.g., 6/28/22 slack rbc: between Sydney and Tinashe.

[zhao-cy]

Per @mattcieslak on 1/19/23 in slack, to add an enhancement in the YAML file: add section "merge-conflict-files":

• it contains a list of globs that match files that would cause a merge conflict.
• then in the zip.sh script, instead of zipping the entire results it removes each of the glob patterns and commits the files directly

[zhao-cy]

In addition, try adding --squash when merging (i.e., squash merges).

[zhao-cy]

What does babs-unzip do? Per Matt (1/19/23, slack): if babs does zip the outputs and we want to distribute the unzipped contents. one way to do this is to run ANOTHER bootstrap where the zipped dataset is the input and the files are unzipped into the output ria.

Examples of unzipping: Sydney 1/19/23 in slack: Sydney has got a bunch of examples of unzip bootstraps on GitHub in the cubic bootstrap repo. I need to make changes to be compatible with multi-session data

Further idea: not to zip the outputs at all?

Revisit the optimal way of doing babs-unzip with Matt and Sydney once we're there.