Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a CI job that builds a Docker multi-arch manifest list #249

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

martin-g
Copy link

... from the images built by the build CI job
Push manifest lists for both DockerHub (docker.io) and Quay.io registries.

Checklist

Fixes #102

... from the images built by the `build` CI job
Push manifest lists for both DockerHub (docker.io) and Quay.io
registries.

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
strategy:
fail-fast: false
matrix:
docker-registry: [docker.io/condaforge, quay.io/condaforge]
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not possible to use the env vars here (REGISTRY_DH and REGISTRY_QUAY) :-/

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this help?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately this also does not work!
commit: martin-g@426b612
error: https://github.com/martin-g/docker-images/actions/runs/7474578018
Fails with:

Invalid workflow file: .github/workflows/ci.yaml#L291
You have an error in your yaml syntax on line 291

- DOCKER_MANIFEST: linux-anvil-ubi-cuda
DOCKER_TAG: "11.0"
DOCKER_IMAGES: "<<ORG>>/linux-anvil-cuda:<<TAG>>,<<ORG>>/linux-anvil-ppc64le-cuda:<<TAG>>,<<ORG>>/linux-anvil-aarch64-cuda:<<TAG>>"
- DOCKER_MANIFEST: linux-anvil-cos7-cuda
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is some repetition for all DOCKER_MANIFEST: linux-anvil-cos7-cuda but I wasn't able to compose a more compact matrix (e.g. by using DOCKER_TAG: ["11.1", "11.2", "11.3", ...]).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's ok. We already have some repetition for the CUDA images

Also longer term we are slowly phasing the CUDA images out entirely. It will take us some time to get there though

We could probably take this opportunity to drop CUDA 11.0 & 11.1 as we don't use those any more ( conda-forge/conda-forge-pinning-feedstock#1708 )

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you suggest to drop them in this PR or in another ?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't need to do in this PR. Just if they are causing difficulty, we should feel comfortable dropping them

@martin-g
Copy link
Author

Could someone please re-run linux-anvil-cuda:11.0 ? It failed due to a timeout.

@martin-g
Copy link
Author

martin-g commented Jan 9, 2024

Any more feedback on the proposed changes ?

@jakirkham
Copy link
Member

Happy New Year Martin! 🎉

Glad to hear from you 🙂

Was wondering about this as well. In particular was wondering if you wanted to try out the suggestions in this thread ( #249 (comment) )

Please let me know what you think

@martin-g
Copy link
Author

Happy New Year @jakirkham ! 🎉
I've added a reply to the comment. It does not work :-/

@jakirkham
Copy link
Member

Hey Martin, sorry for letting this linger for so long. Would it be possible to refresh this PR?

We have collapsed the CUDA matrix to CUDA 11.8. We added Alma 8. Also we have done some other cleanup of the images (and how they are built). Am hoping this makes things more manageable since we last worked on this

Please let me know what you think 🙂

@martin-g
Copy link
Author

martin-g commented Oct 4, 2024

Hi @jakirkham !
I will try to do it next week !

@jakirkham
Copy link
Member

Thanks Martin! 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Multi-Arch image
2 participants