-
Notifications
You must be signed in to change notification settings - Fork 50
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Always set $STORAGE
and $JOB_STORAGE
in bot/test.sh
#837
Always set $STORAGE
and $JOB_STORAGE
in bot/test.sh
#837
Conversation
…d; fall back to $PWD otherwise
Instance
|
Instance
|
Instance
|
@@ -103,34 +103,34 @@ fi | |||
RESUME_DIR=$(grep 'Using .* as tmp directory' slurm-${SLURM_JOBID}.out | head -1 | awk '{print $2}') | |||
|
|||
if [[ -z ${RESUME_DIR} ]]; then |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm now doing this in either case, so both when $RESUME_DIR is set and when it's not set. Or can we point $JOB_STORAGE to $RESUME_DIR or something in case $RESUME_DIR is set?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK, this should work. If we cannot find the temp storage directory from a previous run ($RESUME_DIR
being empty), then we check if we can find a tarball of that run. If not, we exit with an error. If we find it we create the temporary storage.
This is now always available to set $SINGULARITY_TMPDIR
.
PR merged! Moved |
PR merged! Moved |
PR merged! Moved |
Even when resuming from a previous directory/tarball,
$STORAGE
and$JOB_STORAGE
are not set, so I think we should always do this. For that reason, I moved them out of the if statement.Also, this sets
$SINGULARITY_TMPDIR
to a subdir of$JOB_STORAGE
, similar to the change made in #836.