Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test bot PR172 with current EESSI pilot (2021.12) #65

Open
wants to merge 73 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
447bb2d
added a function to obtain full path to a tool
truib Jan 24, 2023
e2c24cf
partial bot/build.sh for eessi_container.sh
truib Jan 24, 2023
a71f8e4
added function to determine IPv4 address
truib Jan 25, 2023
b5bf008
various updates for bot/build.sh and eessi_container.sh
truib Jan 25, 2023
b5c07ee
provide CVMFS_HTTP_PROXY if necessary
truib Jan 27, 2023
4ff3721
add functions to derive hostname and port number from proxy URL
truib Jan 27, 2023
7a58fbf
add function to determine config sections
truib Jan 27, 2023
a5ea7d8
add parameter to list repositories, fix bugs
truib Jan 27, 2023
6ed3d85
fix bash pattern matching operator
truib Jan 29, 2023
fd5cc3d
various updates to bot/build.sh
truib Jan 29, 2023
234bab3
Merge branch 'enhancement/bot-build-with-swl-216' of github-trz:trz42…
truib Jan 29, 2023
b2eab08
replace FILE with DIR in EESSI_REPOS_CFG_FILE_OVERRIDE
truib Jan 29, 2023
7663fbc
Merge branch 'main' of github-trz:eessi/software-layer into enhanceme…
truib Jan 29, 2023
7e200a1
fix whitespace issues
truib Jan 29, 2023
57b6f27
fix handling of HTTP(S)_PROXY settings
truib Jan 30, 2023
fce504f
include changes made to test PR for building with the bot
truib Feb 3, 2023
910d079
Merge branch 'nessi.no-2022.11-dev' into enhancement/bot-build-with-s…
trz42 Feb 3, 2023
7c418cd
Merge branch 'update_for_eessi_container_sh' of github-trz:trz42/soft…
trz42 Feb 22, 2023
712c40e
improvements to resuming job environment
trz42 Feb 22, 2023
16d9857
improved handling of container cache + explicit pull of image
trz42 Feb 22, 2023
9e8ca62
changed --info -> --verbose
trz42 Feb 22, 2023
c0350a9
improved messages for resume info and adjusted parsing in bot/build.sh
trz42 Feb 22, 2023
ef9a552
delete one of two tmp storage tarballs created by bot/build.sh
trz42 Feb 22, 2023
1c0081d
Merge branch 'main' of github-trz:EESSI/software-layer into enhanceme…
trz42 Feb 24, 2023
7cc6575
support cmd line arg flag terminator
trz42 Feb 25, 2023
0def4e9
just print contents of cfg/job.cfg
trz42 Feb 24, 2023
ef608d1
switching from json (YQ) to ini (cfg_files.sh)
trz42 Feb 24, 2023
429d5a0
add --generic arg when running install script
trz42 Feb 23, 2023
bd31faa
fix error in regex
trz42 Feb 23, 2023
1bafb78
use command separator --
trz42 Feb 23, 2023
c9041e3
try fixing arg issue
trz42 Feb 24, 2023
9d46a22
put build args into an array
trz42 Feb 24, 2023
ff5045f
use array to define args for build and tarball step
trz42 Feb 25, 2023
d08bd21
addressed comments and changes requested by first review
trz42 Mar 7, 2023
f59bfde
fix check for missing installations
trz42 Mar 7, 2023
7bb7c1d
add test with missing package
trz42 Mar 8, 2023
68a068b
separated test cases + updated evaluation of test result
trz42 Mar 8, 2023
72185ba
fix small bug in env var name
trz42 Mar 8, 2023
094e82d
set software subdir override before sourcing init script
trz42 Mar 8, 2023
60cf7e2
Revert "set software subdir override before sourcing init script"
trz42 Mar 8, 2023
6f47152
Revert "fix small bug in env var name"
trz42 Mar 8, 2023
a15676d
tweaking output of test
trz42 Mar 8, 2023
54d2a21
improved usage information
trz42 Mar 8, 2023
99231e8
if exit_code is not zero, use fatal_error (as it was)
trz42 Mar 10, 2023
b94bd11
fix bug in test logic
trz42 Mar 10, 2023
5e4bea9
added explanation for test cases (exit code vs boolean logic)
trz42 Mar 11, 2023
64d1866
fix bug, env var PWD is uppercase
trz42 Mar 11, 2023
ff78c62
make sure that CPU arch specific directories are used as container ca…
truib Mar 15, 2023
25943f5
Merge pull request #233 from trz42/enhancement/bot-build-with-eessi-c…
boegel Mar 17, 2023
22661e6
restore PATHs only after last run of pip installed eb
truib Mar 17, 2023
092cb49
attempt to fix issue #225
truib Mar 17, 2023
7a750d5
add comments, small improvements
truib Mar 17, 2023
6299c9b
add configuration file for production build-and-deploy bot in AWS Cit…
boegel Mar 17, 2023
32cfd13
Merge pull request #240 from boegel/bot_cfg
trz42 Mar 17, 2023
69f6627
improve handling of potentially non existing list files
truib Mar 17, 2023
8346b6f
Merge pull request #238 from trz42/fix_eb_not_found_error
boegel Apr 11, 2023
a4c8e64
removing comment to address review comment
truib Apr 11, 2023
14d758e
Merge branch 'main' of gh-nessi:EESSI/software-layer into change_crea…
truib Apr 11, 2023
4d13227
update determining directories to tar + adding a note on assumptions …
truib Apr 11, 2023
9caf2d8
Merge pull request #239 from trz42/change_create_tarball
boegel Apr 11, 2023
e57966a
Merge pull request #237 from trz42/fix_issue_236
boegel Apr 11, 2023
49d4115
Make sure installations are read only
ocaisa Apr 27, 2023
5134f30
Merge pull request #245 from EESSI/ocaisa-patch-4
boegel May 4, 2023
8620428
add replacement init script for removed 2021.06 pilot version
boegel May 16, 2023
681acd1
Merge pull request #246 from boegel/2021.06
bedroge May 16, 2023
fc3573b
don't print warning when unknown targets are found (fixes #247)
boegel May 18, 2023
05848bd
Merge pull request #248 from boegel/no_warning_unknown_target
bedroge May 18, 2023
e688ec8
avoid that versions/2021.06/init is included in init tarball
boegel May 18, 2023
82a5160
Merge pull request #249 from boegel/fix_create_directory_tarballs_init
bedroge May 18, 2023
7554604
implement post-prepare hook for GCCcore to also have a wrapper in pla…
boegel May 27, 2023
c2ec231
patch copied wrapper script to make sure it's actually working (CMD n…
boegel May 27, 2023
b0998c5
Merge pull request #251 from boegel/GCCcore_hook_extra_linker_wrappers
trz42 May 30, 2023
cd233a8
testing bot PR 172
truib May 30, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
make sure that CPU arch specific directories are used as container ca…
…che dir
  • Loading branch information
truib committed Mar 15, 2023
commit ff78c62df541075ecfb58c37e8a14bc4a0e0d80f
3 changes: 3 additions & 0 deletions bot/build.sh
Original file line number Diff line number Diff line change
@@ -27,6 +27,7 @@ source scripts/cfg_files.sh

# defaults
export JOB_CFG_FILE="${JOB_CFG_FILE_OVERRIDE:=./cfg/job.cfg}"
HOST_ARCH=$(uname -m)

# check if ${JOB_CFG_FILE} exists
if [[ ! -r "${JOB_CFG_FILE}" ]]; then
@@ -55,6 +56,8 @@ echo "bot/build.sh: LOCAL_TMP='${LOCAL_TMP}'"
SINGULARITY_CACHEDIR=$(cfg_get_value "site_config" "container_cachedir")
echo "bot/build.sh: SINGULARITY_CACHEDIR='${SINGULARITY_CACHEDIR}'"
if [[ ! -z ${SINGULARITY_CACHEDIR} ]]; then
# make sure that separate directories are used for different CPU families
SINGULARITY_CACHEDIR=${SINGULARITY_CACHEDIR}/${HOST_ARCH}
export SINGULARITY_CACHEDIR
fi