Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test bot PR170 with main branch of EESSI/software-layer #61

Open
wants to merge 67 commits into
base: devel-PR
Choose a base branch
from
Open

Test bot PR170 with main branch of EESSI/software-layer #61

wants to merge 67 commits into from

Conversation

poksumdo
Copy link
Collaborator

@poksumdo poksumdo commented Apr 6, 2023

truib and others added 30 commits January 24, 2023 21:59
@truib
added a function to obtain full path to a tool
447bb2d
@truib
partial bot/build.sh for eessi_container.sh
e2c24cf
@truib
added function to determine IPv4 address
a71f8e4
@truib
various updates for bot/build.sh and eessi_container.sh
b5bf008
@truib
provide CVMFS_HTTP_PROXY if necessary
b5c07ee
@truib
add functions to derive hostname and port number from proxy URL
4ff3721
@truib
add function to determine config sections
7a58fbf
@truib
add parameter to list repositories, fix bugs
a5ea7d8 
fixed bugs

- determining IP address for proxy host was wrong
- handling of positional parameters for executing commands with arguments was wrong
@truib
fix bash pattern matching operator
6ed3d85
@truib
various updates to bot/build.sh
fd5cc3d 
- added handling of HTTPS_PROXY
- moved CONTAINER setting from site_config to repository section (different
  repositories could require different containers)
- added handling of CPU_TARGET and EESSI_SOFTWARE_SUBDIR_OVERRIDE
- updated TODOs
- added setting of EESSI_REPOS_CFG_FILE_OVERRIDE
- bug fixes
@truib
Merge branch 'enhancement/bot-build-with-swl-216' of github-trz:trz42…
234bab3 
…/software-layer into enhancement/bot-build-with-swl-216
@truib
replace FILE with DIR in EESSI_REPOS_CFG_FILE_OVERRIDE
b2eab08
@truib
Merge branch 'main' of github-trz:eessi/software-layer into enhanceme…
7663fbc 
…nt/bot-build-with-swl-216
@truib
fix whitespace issues
7e200a1
@truib
fix handling of HTTP(S)_PROXY settings
57b6f27
@truib
include changes made to test PR for building with the bot
fce504f
@trz42
Merge branch 'nessi.no-2022.11-dev' into enhancement/bot-build-with-s…
910d079 
…wl-216
@truib
added a function to obtain full path to a tool
b1a3635
@truib
added function to determine IPv4 address
27bc203
@truib
various updates for bot/build.sh and eessi_container.sh
bfe6d36 
cherry-picked via commit b5bf008
ONLY picked chages to eessi_container.sh
@truib
provide CVMFS_HTTP_PROXY if necessary
8372341 
cherry-picked via commit b5c07ee
NOTE, only applied changes to eessi_container.sh
@truib
add functions to derive hostname and port number from proxy URL
3f1aed9
@truib
add function to determine config sections
b7abfc6
@truib
add parameter to list repositories, fix bugs
9b7b8a4 
fixed bugs

- determining IP address for proxy host was wrong
- handling of positional parameters for executing commands with arguments was wrong
@truib
replace FILE with DIR in EESSI_REPOS_CFG_FILE_OVERRIDE
4a414f5 
NOTE only applied changes to eessi_container.sh
@truib
fix whitespace issues
37abf4f
@truib
include changes made to test PR for building with the bot
d468a1a 
cherry-picked via commit fce504f
NOTE, only changed eessi_container.sh
@truib
fix issues in eessi_container.sh
af658ee
@truib
fix RUN_QUIET setting
eb66e1c
@truib
improvements to resuming job environment
1cb4674 
cherry-picked via commit 23e773c
NOTE only applied changes to eessi_container.sh
trz42 and others added 24 commits February 22, 2023 23:25
@trz42
delete one of two tmp storage tarballs created by bot/build.sh
ef9a552
@boegel
add verbose messages on pulling/copying/reusing of container image
6974e4b
@boegel
don't require --verbose for info message on pulling/copying/reusing c…
54bdea5 
…ontainer image
@boegel
add check to make sure that container image exists in tmpdir
a4cea9a
@boegel
fix determining filename from container URL
c975832
@boegel
Merge pull request EESSI#232 from trz42/update_for_eessi_container_sh
7ea7058 
enhancements/fixes for eessi_container.sh script
@trz42
Merge branch 'main' of github-trz:EESSI/software-layer into enhanceme…
1c0081d 
…nt/bot-build-with-eessi-container
@trz42
support cmd line arg flag terminator
7cc6575
@trz42
just print contents of cfg/job.cfg
0def4e9
@trz42
switching from json (YQ) to ini (cfg_files.sh)
ef608d1
@trz42
add --generic arg when running install script
429d5a0
@trz42
fix error in regex
bd31faa
@trz42
use command separator --
1bafb78
@trz42
try fixing arg issue
c9041e3
@trz42
put build args into an array
9d46a22
@trz42
use array to define args for build and tarball step
ff5045f
@trz42
addressed comments and changes requested by first review
d08bd21
@trz42
improved usage information
54d2a21
@trz42
fix bug, env var PWD is uppercase
64d1866
@truib
make sure that CPU arch specific directories are used as container ca…
ff78c62 
…che dir
@boegel
Merge pull request EESSI#233 from trz42/enhancement/bot-build-with-ee…
25943f5 
…ssi-container

`bot/build.sh` using `eessi_container.sh`
@boegel
add configuration file for production build-and-deploy bot in AWS Cit…
6299c9b 
…C cluster
@trz42
Merge pull request EESSI#240 from boegel/bot_cfg
32cfd13 
add configuration file for production build-and-deploy bot in AWS CitC cluster
@truib
add CaDiCaL to test bot with branch main of EESSI/software-layer
0353ed0
@eessi-bot-devel-trz42
Copy link

Instance CitC-PR170 is configured to build:

  • arch aarch64/generic for repo nessi.no-2022.11

@poksumdo poksumdo added the bot:build Instruct bot to build software stack label Apr 6, 2023
@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Apr 6, 2023 •
edited
Loading

New job on instance CitC-PR170 for architecture aarch64-generic for repository nessi.no-2022.11 in job dir /mnt/shared/home/trz42/pilot.nessi/PR170/jobs/2023.04/pr_61/4534

date job status comment
Apr 06 10:04:53 AM UTC 2023 submitted job id 4534 awaits release by job manager
Apr 06 10:05:00 AM UTC 2023 released job awaits launch by Slurm scheduler
Apr 06 10:09:03 AM UTC 2023 running job 4534 is running
Apr 06 10:33:31 AM UTC 2023 finished 😢 FAILURE
  • Found slurm output slurm-4534.out in job dir
  • Slurm output lacks message "No missing modules!".

trz42 added a commit to EESSI/eessi-bot-software-layer that referenced this pull request Apr 6, 2023
@trz42
Merge pull request #170 from jonas-lq/issue#109
6241d41 
Add bot comments in app.cfg.example

Looks good. Tested with trz42/software-layer#61

Minor polishing which can be done in a follow-up PR.
poksumdo added a commit to poksumdo/software-layer that referenced this pull request Apr 28, 2023
@poksumdo
Merge pull request trz42#61 from trz42/sync_with_main
280e2a0 
Sync with NESSI/main which was just sync'ed with EESSI/main
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
bot:build Instruct bot to build software stack
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@poksumdo @truib @trz42 @boegel