2.4.2: test suite fails in 12% units #381
Comments
|
After add all those units to exclude list another two pops out: + cd yubihsm-shell-2.4.2
+ /usr/bin/ctest --test-dir x86_64-redhat-linux-gnu --output-on-failure --force-new-ctest-process -j48 ' ' -E '^(attest|generate_ec|generate_hmac|import_authkey|import_rsa|info|wrap|wrap_data|yubico_otp|echo|asym_auth|import_ec|generate_rsa|logs|ssh|decrypt_rsa|decrypt_ec|import_ed|change_authkey|encrypt_aes|aes_encrypt_test|ecdh_derive_test|rsa_enc_test)'
Internal ctest changing into directory: /home/tkloczko/rpmbuild/BUILD/yubihsm-shell-2.4.2/x86_64-redhat-linux-gnu
Test project /home/tkloczko/rpmbuild/BUILD/yubihsm-shell-2.4.2/x86_64-redhat-linux-gnu
Start 1: parsing
Start 2: pbkdf2
Start 3: engine_tests
Start 4: pkcs11test
Start 5: bash_tests
1/5 Test #1: parsing .......................... Passed 0.01 sec
2/5 Test #3: engine_tests ..................... Passed 0.01 sec
3/5 Test #2: pbkdf2 ........................... Passed 0.01 sec
4/5 Test #4: pkcs11test .......................***Failed 0.01 sec
SHELL=/bin/bash
RPM_SOURCE_DIR=/home/tkloczko/rpmbuild/SOURCES
HISTCONTROL=ignoreboth
CTEST_INTERACTIVE_DEBUG_MODE=1
PKG_CONFIG_PATH=:/usr/lib64/pkgconfig:/usr/share/pkgconfig
HOSTNAME=pers-jacek
HISTSIZE=10000
YUBIHSM_PKCS11_CONF=/tmp/yubihsmtest.E6bBs2/p11.conf
RPM_SPECPARTS_DIR=/home/tkloczko/rpmbuild/BUILD/yubihsm-shell-2.4.2/SPECPARTS
PWD=/home/tkloczko/rpmbuild/BUILD/yubihsm-shell-2.4.2/x86_64-redhat-linux-gnu/pkcs11/tests
LOGNAME=tkloczko
XDG_SESSION_TYPE=tty
MC_TMPDIR=/var/tmp/mc-tkloczko
RPM_ARCH=x86_64
MOTD_SHOWN=pam
MC_SID=2792914
HOME=/home/tkloczko
LANG=C.UTF-8
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;37;41:su=37;41:sg=30;43:ca=00:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.avif=01;35:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:*~=00;90:*#=00;90:*.bak=00;90:*.crdownload=00;90:*.dpkg-dist=00;90:*.dpkg-new=00;90:*.dpkg-old=00;90:*.dpkg-tmp=00;90:*.old=00;90:*.orig=00;90:*.part=00;90:*.rej=00;90:*.rpmnew=00;90:*.rpmorig=00;90:*.rpmsave=00;90:*.swp=00;90:*.tmp=00;90:*.ucf-dist=00;90:*.ucf-new=00;90:*.ucf-old=00;90:
RPM_LD_FLAGS=
BINDIR=/home/tkloczko/rpmbuild/BUILD/yubihsm-shell-2.4.2/x86_64-redhat-linux-gnu
SKIPPED_TESTS=Slot.NoInit:PKCS11Test.EnumerateMechanisms:ReadOnlySessionTest.GenerateRandom:ReadOnlySessionTest.GenerateRandomNone:ReadOnlySessionTest.UserLoginWrongPIN:ReadOnlySessionTest.SOLoginFail:ReadOnlySessionTest.CreateKeyPairObjects:ReadOnlySessionTest.CreateSecretKeyAttributes:ReadOnlySessionTest.SecretKeyTestVectors:ReadOnlySessionTest.SignVerifyRecover:ReadOnlySessionTest.GenerateKeyInvalid:ReadOnlySessionTest.GenerateKeyPairInvalid:ReadOnlySessionTest.WrapUnwrap:ReadOnlySessionTest.WrapInvalid:ReadOnlySessionTest.UnwrapInvalid:ReadWriteSessionTest.CreateCopyDestroyObject:ReadWriteSessionTest.SetLatchingAttribute:ReadWriteSessionTest.FindObjectSubset:ReadWriteSessionTest.ReadOnlySessionSOLoginFail:ReadWriteSessionTest.SOLogin:ReadWriteSessionTest.TookanAttackA1:ReadWriteSessionTest.TookanAttackA3:ReadWriteSessionTest.TookanAttackA4:ReadWriteSessionTest.TookanAttackA5a:ReadWriteSessionTest.TookanAttackA5b:ReadWriteSessionTest.PublicExponent4Bytes:ReadWriteSessionTest.ExtractKeys:ReadWriteSessionTest.AsymmetricTokenKeyPair:RWUserSessionTest.SOLoginFail:DataObjectTest.CopyDestroyObjectInvalid:DataObjectTest.GetMultipleAttributes:DataObjectTest.GetSetAttributeInvalid:RWSOSessionTest.SOSessionFail:RWSOSessionTest.UserLoginFail:RWEitherSessionTest.TookanAttackA2:KeyPairTest.EncryptDecrypt:Ciphers/SecretKeyTest.EncryptDecrypt/0:Ciphers/SecretKeyTest.EncryptDecrypt/1:Ciphers/SecretKeyTest.EncryptDecrypt/2:Ciphers/SecretKeyTest.EncryptDecrypt/3:Ciphers/SecretKeyTest.EncryptDecrypt/4:Ciphers/SecretKeyTest.EncryptDecrypt/5:Ciphers/SecretKeyTest.EncryptFailDecrypt/0:Ciphers/SecretKeyTest.EncryptFailDecrypt/1:Ciphers/SecretKeyTest.EncryptFailDecrypt/2:Ciphers/SecretKeyTest.EncryptFailDecrypt/3:Ciphers/SecretKeyTest.EncryptFailDecrypt/4:Ciphers/SecretKeyTest.EncryptFailDecrypt/5:Ciphers/SecretKeyTest.EncryptDecryptGetSpace/0:Ciphers/SecretKeyTest.EncryptDecryptGetSpace/1:Ciphers/SecretKeyTest.EncryptDecryptGetSpace/2:Ciphers/SecretKeyTest.EncryptDecryptGetSpace/3:Ciphers/SecretKeyTest.EncryptDecryptGetSpace/4:Ciphers/SecretKeyTest.EncryptDecryptGetSpace/5:Ciphers/SecretKeyTest.EncryptDecryptParts/0:Ciphers/SecretKeyTest.EncryptDecryptParts/1:Ciphers/SecretKeyTest.EncryptDecryptParts/2:Ciphers/SecretKeyTest.EncryptDecryptParts/3:Ciphers/SecretKeyTest.EncryptDecryptParts/4:Ciphers/SecretKeyTest.EncryptDecryptParts/5:Ciphers/SecretKeyTest.EncryptDecryptInitInvalid/0:Ciphers/SecretKeyTest.EncryptDecryptInitInvalid/1:Ciphers/SecretKeyTest.EncryptDecryptInitInvalid/2:Ciphers/SecretKeyTest.EncryptDecryptInitInvalid/3:Ciphers/SecretKeyTest.EncryptDecryptInitInvalid/4:Ciphers/SecretKeyTest.EncryptDecryptInitInvalid/5:Ciphers/SecretKeyTest.EncryptErrors/0:Ciphers/SecretKeyTest.EncryptErrors/1:Ciphers/SecretKeyTest.EncryptErrors/2:Ciphers/SecretKeyTest.EncryptErrors/3:Ciphers/SecretKeyTest.EncryptErrors/4:Ciphers/SecretKeyTest.EncryptErrors/5:Ciphers/SecretKeyTest.DecryptErrors/0:Ciphers/SecretKeyTest.DecryptErrors/1:Ciphers/SecretKeyTest.DecryptErrors/2:Ciphers/SecretKeyTest.DecryptErrors/3:Ciphers/SecretKeyTest.DecryptErrors/4:Ciphers/SecretKeyTest.DecryptErrors/5:Ciphers/SecretKeyTest.EncryptUpdateErrors/0:Ciphers/SecretKeyTest.EncryptUpdateErrors/1:Ciphers/SecretKeyTest.EncryptUpdateErrors/2:Ciphers/SecretKeyTest.EncryptUpdateErrors/3:Ciphers/SecretKeyTest.EncryptUpdateErrors/4:Ciphers/SecretKeyTest.EncryptUpdateErrors/5:Ciphers/SecretKeyTest.EncryptModePolicing1/0:Ciphers/SecretKeyTest.EncryptModePolicing1/1:Ciphers/SecretKeyTest.EncryptModePolicing1/2:Ciphers/SecretKeyTest.EncryptModePolicing1/3:Ciphers/SecretKeyTest.EncryptModePolicing1/4:Ciphers/SecretKeyTest.EncryptModePolicing1/5:Ciphers/SecretKeyTest.EncryptModePolicing2/0:Ciphers/SecretKeyTest.EncryptModePolicing2/1:Ciphers/SecretKeyTest.EncryptModePolicing2/2:Ciphers/SecretKeyTest.EncryptModePolicing2/3:Ciphers/SecretKeyTest.EncryptModePolicing2/4:Ciphers/SecretKeyTest.EncryptModePolicing2/5:Ciphers/SecretKeyTest.EncryptInvalidIV/0:Ciphers/SecretKeyTest.EncryptInvalidIV/1:Ciphers/SecretKeyTest.EncryptInvalidIV/2:Ciphers/SecretKeyTest.EncryptInvalidIV/3:Ciphers/SecretKeyTest.EncryptInvalidIV/4:Ciphers/SecretKeyTest.EncryptInvalidIV/5:Ciphers/SecretKeyTest.DecryptInvalidIV/0:Ciphers/SecretKeyTest.DecryptInvalidIV/1:Ciphers/SecretKeyTest.DecryptInvalidIV/2:Ciphers/SecretKeyTest.DecryptInvalidIV/3:Ciphers/SecretKeyTest.DecryptInvalidIV/4:Ciphers/SecretKeyTest.DecryptInvalidIV/3:Ciphers/SecretKeyTest.DecryptInvalidIV/4:Ciphers/SecretKeyTest.DecryptInvalidIV/5:Ciphers/SecretKeyTest.DecryptUpdateErrors/0:Ciphers/SecretKeyTest.DecryptUpdateErrors/1:Ciphers/SecretKeyTest.DecryptUpdateErrors/2:Ciphers/SecretKeyTest.DecryptUpdateErrors/3:Ciphers/SecretKeyTest.DecryptUpdateErrors/4:Ciphers/SecretKeyTest.DecryptUpdateErrors/5:Ciphers/SecretKeyTest.EncryptFinalImmediate/0:Ciphers/SecretKeyTest.EncryptFinalImmediate/1:Ciphers/SecretKeyTest.EncryptFinalImmediate/2:Ciphers/SecretKeyTest.EncryptFinalImmediate/3:Ciphers/SecretKeyTest.EncryptFinalImmediate/4:Ciphers/SecretKeyTest.EncryptFinalImmediate/5:Ciphers/SecretKeyTest.EncryptFinalErrors1/0:Ciphers/SecretKeyTest.EncryptFinalErrors1/1:Ciphers/SecretKeyTest.EncryptFinalErrors1/2:Ciphers/SecretKeyTest.EncryptFinalErrors1/3:Ciphers/SecretKeyTest.EncryptFinalErrors1/4:Ciphers/SecretKeyTest.EncryptFinalErrors1/5:Ciphers/SecretKeyTest.EncryptFinalErrors2/0:Ciphers/SecretKeyTest.EncryptFinalErrors2/1:Ciphers/SecretKeyTest.EncryptFinalErrors2/2:Ciphers/SecretKeyTest.EncryptFinalErrors2/3:Ciphers/SecretKeyTest.EncryptFinalErrors2/4:Ciphers/SecretKeyTest.EncryptFinalErrors2/5:Ciphers/SecretKeyTest.DecryptFinalErrors1/0:Ciphers/SecretKeyTest.DecryptFinalErrors1/1:Ciphers/SecretKeyTest.DecryptFinalErrors1/2:Ciphers/SecretKeyTest.DecryptFinalErrors1/3:Ciphers/SecretKeyTest.DecryptFinalErrors1/4:Ciphers/SecretKeyTest.DecryptFinalErrors1/5:Ciphers/SecretKeyTest.DecryptFinalErrors2/0:Ciphers/SecretKeyTest.DecryptFinalErrors2/1:Ciphers/SecretKeyTest.DecryptFinalErrors2/2:Ciphers/SecretKeyTest.DecryptFinalErrors2/3:Ciphers/SecretKeyTest.DecryptFinalErrors2/4:Ciphers/SecretKeyTest.DecryptFinalErrors2/5:Digests/DigestTest.DigestKey/0:Digests/DigestTest.DigestKey/1:Digests/DigestTest.DigestKey/2:Digests/DigestTest.DigestKey/3:Digests/DigestTest.DigestKey/4:Digests/DigestTest.DigestKeyInvalid/0:Digests/DigestTest.DigestKeyInvalid/1:Digests/DigestTest.DigestKeyInvalid/2:Digests/DigestTest.DigestKeyInvalid/3:Digests/DigestTest.DigestKeyInvalid/4:Signatures/SignTest.SignVerify/0:Signatures/SignTest.SignFailVerifyWrong/0:Signatures/SignTest.SignFailVerifyShort/0:Duals/DualSecretKeyTest.DigestEncrypt/0:Duals/DualSecretKeyTest.DigestEncrypt/1:Duals/DualSecretKeyTest.DigestEncrypt/2:Duals/DualSecretKeyTest.DigestEncrypt/3:Duals/DualSecretKeyTest.DigestEncrypt/4:Duals/DualSecretKeyTest.DigestEncrypt/5:Init.InitArgsBadReserved
RPM_PACKAGE_RELEASE=2.fc35
SSH_CONNECTION=10.0.3.1 37542 10.0.3.87 22
RPM_OS=linux
XDG_SESSION_CLASS=user
TERM=xterm-256color
LESSOPEN=||/usr/bin/lesspipe.sh %s
USER=tkloczko
SHLVL=4
RPM_BUILD_DIR=/home/tkloczko/rpmbuild/BUILD
LIBEXT=so
RPM_OPT_FLAGS=-m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
XDG_SESSION_ID=82
RPM_DOC_DIR=/usr/share/doc
XDG_RUNTIME_DIR=/run/user/1000
SSH_CLIENT=10.0.3.1 37542 22
RPM_PACKAGE_VERSION=2.4.2
which_declare=declare -f
CONFIG_SITE=NONE
PATH=/usr/bin:/usr/sbin:/usr/local/sbin
DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
MAIL=/var/spool/mail/tkloczko
SSH_TTY=/dev/pts/9
RPM_BUILD_NCPUS=48
RPM_PACKAGE_NAME=yubihsm-shell
RPM_BUILD_ROOT=/home/tkloczko/rpmbuild/BUILDROOT/yubihsm-shell-2.4.2-2.fc35.x86_64
OLDPWD=/home/tkloczko/rpmbuild/BUILD
BASH_FUNC_which%%=() { ( alias;
eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
}
_=/usr/bin/env
/home/tkloczko/rpmbuild/BUILD/yubihsm-shell-2.4.2/pkcs11/tests/pkcs11test.sh: line 42: pkcs11test: command not found
5/5 Test #5: bash_tests .......................***Failed 0.02 sec
++ mktemp -d
+ TMPDIR=/tmp/tmp.17myi3IDw3
+ DATA=/tmp/tmp.17myi3IDw3/data
+ SIG=/tmp/tmp.17myi3IDw3/sig
+ BIN_SIG=/tmp/tmp.17myi3IDw3/bin_sig
+ PUBLIC_KEY=/tmp/tmp.17myi3IDw3/public
+ '[' -z ']'
+ DEFAULT_CONNECTOR_URL=http://localhost:12345
+ PROG='../yubihsm-shell --connector=http://localhost:12345'
++ uname
+ '[' xLinux = xFreeBSD ']'
+ DECODE='base64 --decode'
+ echo 'Hello World!'
++ ../yubihsm-shell --connector=http://localhost:12345 -a generate-asymmetric -A ecp256 -csign-ecdsa -p password
+ OUTPUT='Failed connecting '\''http://localhost:12345'\'': Unable to find a suitable connector
Not connected
Failed to open session'
60% tests passed, 2 tests failed out of 5
Total Test time (real) = 0.03 sec
The following tests FAILED:
4 - pkcs11test (Failed)
5 - bash_tests (Failed)
Errors while running CTest |
|
It looks like you run this without a YubiHSM. The tests assume you have a YubiHSM connected and the yubihsm-connector running. Beware that the tests will create some keys on your device. |
Yes that is the case because it is production build system. If some process needs to be running during test suite execution it should started as ctest session process (ctest will kill it automatically after finishing last unit execution). |
|
Currently we don't have a publicly available emulator. The best advice right now might be to have a YubiHSM and the yubihsm-connector running on a machine reachable from the build environment, i.e. configured to accept incoming connections from other machines. |
|
Could you provide more details about what needs to be done before start test suite to be able use those tools? 🤔 |
|
I would suggest having a yubihsm-connector with a yubihsm running in your local intranet, accessible from the Internet through a reverse proxy requiring https with client certificate. The curl backend supports supplying https certificate and key through yh_set_connector_option. With that setup all you need is to provide the certificate and key in your CI even if that is running outside your premises. It would also be possible to do this over a VPN. |
|
Can all tat be accessible over localhost? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
cmake settings
And ..
test suite fails with
The text was updated successfully, but these errors were encountered: