Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dependencies btw Github wf jobs #174

Merged
merged 1 commit into from
Sep 23, 2024
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions .github/workflows/fetch_filter_resources.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ jobs:
sudo apt-get install jq
- name: Fetch list of all available servers
run: |
python sources/bin/get_public_galaxy_servers.py -o sources/data/available_public_servers.csv
python sources/bin/get_public_galaxy_servers.py -o sources/data/available_public_servers.csv
- name: Archive available servers
uses: actions/upload-artifact@v4
with:
Expand All @@ -37,6 +37,7 @@ jobs:
fetch-tools-stepwise:
runs-on: ubuntu-20.04
name: Fetch tool stepwise
needs: fetch-servers
strategy:
#max-parallel: 1 #need to run one after another, since otherwise there is a chance, that mulitple jobs want to push to the results branch at the same time (which fails due to merge)
matrix:
Expand All @@ -54,7 +55,7 @@ jobs:
python-version: ${{ matrix.python-version }}
- name: Install requirement
run: python -m pip install -r requirements.txt
- name: Download a single artifact
- name: Download available servers
uses: actions/download-artifact@v4
with:
name: available-servers
Expand All @@ -71,6 +72,7 @@ jobs:
path: communities/all/resources/repositories${{ matrix.subset }}.list_tools.tsv
merge-fetch-filter:
runs-on: ubuntu-20.04
needs: fetch-tools-stepwise
name: Merge tools, fetch tutorials and filter the resources for communities
steps:
- name: Checkout main
Expand All @@ -82,7 +84,7 @@ jobs:
run: |
python -m pip install -r requirements.txt
sudo apt-get install jq
- name: Download All Artifacts
- name: Download stepwise tool lists
uses: actions/download-artifact@v4
with:
pattern: tools-*
Expand Down