Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add scripts to run test suite after build job has finished #366

Merged

Conversation

trz42
Copy link
Collaborator

@trz42 trz42 commented Oct 15, 2023

First outline of how testing could be added to build-and-deploy procedure. See also accompanying PR for the bot (EESSI/eessi-bot-software-layer#222).

This PR adds three scripts:

  • bot/test.sh prepares the environment for running the tests inside the build container
    • because it runs on the same node (in fact, the same job) that was building software packages, it tries to re-use the existing temporary storage (e.g., cached CernVM-FS data, and particularly the fuse-overlayfs upper directory): directly or from a tarball of the build step
    • alternatively, it might unpack or bind mount built software from the tarball containing the software installation
    • the script is largely similar to bot/build.sh and bot/inspect.sh (for the latter see script to more easily inspect a build job #317)
  • run_tests.sh is just a small script that runs test_suite.sh in a compat layer environment (very similar to install_software_layer.sh)
  • test_suite.sh runs some tests
    • at the moment it runs eb --sanity-check-only for all easyconfigs that were "added" to an easystack file (by design, it will also process easyconfigs whose line has changed)
    • only changed easystack files are processed
    • the script is very similar to EESSI-pilot-install-software.sh

TODO:

  • test that it works
  • add script bot/check-test.sh that processes the result of the test(s) and produces and update to be added to the PR comment (job status table); this is likely somewhat similar to bot/check-build.sh

@eessi-bot
Copy link

eessi-bot bot commented Oct 15, 2023

Instance eessi-bot-mc-aws is configured to build:

  • arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/generic for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software

@boegel boegel changed the base branch from 2023.06 to pilot.eessi-hpc.org-2023.06 November 21, 2023 21:19
@trz42 trz42 changed the base branch from 2023.06-pilot.eessi-hpc.org to 2023.06-software.eessi.io November 26, 2023 19:11
@boegel boegel merged commit 17cfd02 into EESSI:2023.06-software.eessi.io Mar 26, 2024
33 checks passed
@boegel boegel changed the title [WIP] add scripts to run test suite after build job has finished add scripts to run test suite after build job has finished Apr 4, 2024
@boegel boegel added the 2023.06-software.eessi.io 2023.06 version of software.eessi.io label Apr 4, 2024
@boegel
Copy link
Contributor

boegel commented Apr 4, 2024

note: got merged via larger PR #467 that includes these commits

trz42 pushed a commit to trz42/software-layer that referenced this pull request May 22, 2024
…7-foss/2023a

{2023.06}[foss/2023a] ABySS V2.3.7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants