Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vm ww viloca automation #17

Open
wants to merge 118 commits into
base: master
Choose a base branch
from
Open

Conversation

mcarrara-bioinfo
Copy link
Collaborator

First version of the automation, re-configured to run on the VM and making full use of the Euler mount for communication with the HPC cluster.
This version already includes the logic necessary to run Viloca automatically on the last available batch.

Important points:

  • The system is configured as a docker container, but can be also run directly as a cronjob on the VM. This is done to address concerns regarding the possible side-effects of running the automation in a container
  • The system needs to be deployed away from the regular submissions to avoid disruptions
  • The system currently DOES NOT backup on the BSSE shared folder because o the suggestion to set up access from Euler instead of from the VM. This needs further discussion
  • The system currently always runs Viloca ONLY on the most recent batch available, skipping anything in-between. This needs to be re-worked once Viloca has faster runs

@mcarrara-bioinfo mcarrara-bioinfo requested a review from DrYak October 3, 2023 18:10
@mcarrara-bioinfo
Copy link
Collaborator Author

Added logic to create a FIFO list of processed batches that the uploader can use.
FIFO used to ensure that new batches are uploaded before anything retrospective

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants