Sending test results to report portal is supported via the pytest agent.
We have a configuration file template that you can fill out with our team's report portal instance and user information in order to enable posting results.
- Copy the config template located at
templates/reporting/report_portal.cfgto another location - Edit the placeholder values here with the report portal instance/user details.
You will now be able to post your test results to report portal by providing the appropriate CLI options.
Ex.
run-ci tests/test_pytest.py --reportportal --rp-launch CfgTest --rp-launch-desc "An example launch description" -c /home/$USER/report_portal.cfgLaunches are tagged with various information so we can create filters in report portal.
Several tags have different values based on the type of deployment or cluster environment.
platform
aws / vsphere / baremetal
deployment_type
ipi / upi
us_ds
upstream / downstream
Some tags are key:value pairs. These are usually used for versions.
worker_instance_type:m4.xlarge
ocs_version:4.5
ocp_version:4.5
ocs_registry_image:quay.io/rhceph-dev/ocs-olm-operator:latest-4.5
ocs_registry_tag:latest-4.5
Several tags will not exist if the tag does not apply to the deployment or the cluster environment.
ui_deployment
live_deployment
stage_deployment
production
fips