Separate cloud/non-cloud tests #6587
Conversation
Test Results2 975 tests ±0 2 963 ✔️ ±0 2m 47s ⏱️ -11s Results for commit df845df. ± Comparison against base commit d680f7d. This pull request removes 2 and adds 2 tests. Note that renamed tests count towards both.♻️ This comment has been updated with latest results. |
vinayada1
force-pushed
the
tests-separate
branch
3 times, most recently
from
7561093 to
5c7f2bb
Compare
|
For the detailed report, please go to
|
vinayada1
force-pushed
the
tests-separate
branch
from
b5e5f17 to
a448e6a
Compare
|
For the detailed report, please go to
|
|
⌛ Starting datastoresrp functional tests... ⌛ Starting ucp functional tests... |
|
/ok-to-test |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
/ok-to-test |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
vinayada1
force-pushed
the
tests-separate
branch
2 times, most recently
from
a32cb7e to
cb9581b
Compare
|
/ok-to-test |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
For the detailed report, please go to
|
|
⌛ Starting datastoresrp functional tests... ⌛ Starting msgrp functional tests... |
vinayada1
force-pushed
the
tests-separate
branch
from
cb9581b to
64538c2
Compare
|
For the detailed report, please go to
|
|
⌛ Starting daprrp functional tests... ⌛ Starting datastoresrp functional tests... |
|
⌛ Starting ucp functional tests... |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
/ok-to-test |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
For the detailed report, please go to
|
vinayada1
force-pushed
the
tests-separate
branch
from
31152af to
9597e44
Compare
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
For the detailed report, please go to
|
|
/ok-to-test |
vinayada1
changed the title
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
Looks like /ok-to-test still runs the old workflow and a PR merge would be needed for it to run only the cloud tests |
Signed-off-by: vinayada1 <[email protected]>
vinayada1
force-pushed
the
tests-separate
branch
from
9597e44 to
fc72b0f
Compare
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
For the detailed report, please go to
|
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
For the detailed report, please go to
|
|
/ok-to-test |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
Radius functional test overview
Click here to see the list of tools in the current test run
Test Status⌛ Building Radius and pushing container images for functional tests... |
|
For the detailed report, please go to
|
There was a problem hiding this comment.
Thanks for kicking this off!
As I mentioned in the design discussion, from this PR it looks like all the UCP tests only run on cloud resources, in which case we should add more tests for UCP that can run as a part of functional tests workflow. Can you please confirm this?
I checked it. There are other UCP tests for testing planes/RGs, etc. Since there is no change, they already exist in the same folder, they do not show up in the changes |
|
This pull request has been automatically marked as stale because it has been inactive for 90 days. Remove stale label or comment or this PR will be closed in 7 days. |
Description
Currently, all the functional tests run only with an approved "/ok-to-test" command. Only tests that deploy cloud resources or publish stuff really require an approval. This PR separates out the tests that do not need an approval to run as a part of the regular build workflow. The /ok-to-test command will now run only tests that deploy cloud resources
Type of change
Fixes: #6588
Auto-generated summary
🤖 Generated by Copilot at efaffae
Summary
🧪☁️🛠️
This pull request adds support for running functional tests that require cloud resources for the radius project. It modifies the GitHub workflows and the make targets to run different types of tests. It also moves the existing cloud-based tests to a new
test/functional-clouddirectory and adds new test files for the extender and Terraform recipe features.Walkthrough
test-functional-clouddirectory (link, link, link)test-functional-cloud/README.mdfile (link)test/functional-cloud/shared/resources/extender_test.go, link)test/functional-cloud/shared/resources/recipe_terraform_test.go, link)test/functionaltotest/functional-cloudto reflect the cloud resource requirement (link, link, link, link, link, link, link, link, link, link, link, link, link, link)