Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6.15.z] Integrate FAM pipeline into robottelo #14156

Conversation

Satellite-QE
Copy link
Collaborator

Cherrypick of PR: #14028

Problem Statement

Current FAM misc pipeline has been broken for a couple releases. This is due to some version changes, but also we were not testing things as accurately as possible. For instance, we were cloning upstream and running the develop branch.

Solution

Integrate the FAM pipeline into robottelo. This now runs everything on the satellite against itself, so we know that the collection being packaged in Satellite is working correctly.

Note

The expectation is not that this will pass 100%. Getting all of the modules and roles to pass will take individual setup that needs to be done in robottelo, AAP, or upstream in the test playbook itself. For now I would like to see that the tests are executing as expected and the results show helpful output on failure (ie: the actual ansible tasking logs). After merging, we will need to evaluate as teams how to remediate the issues based on component and team.

@Satellite-QE Satellite-QE requested a review from a team as a code owner February 21, 2024 12:29
@Satellite-QE Satellite-QE added 6.15.z Introduced in or relating directly to Satellite 6.15 Auto_Cherry_Picked Automatically cherrypicked PR using GHA No-CherryPick PR doesnt need CherryPick to previous branches labels Feb 21, 2024
@Satellite-QE Satellite-QE requested a review from a team as a code owner February 21, 2024 12:29
@Satellite-QE
Copy link
Collaborator Author

trigger: test-robottelo
pytest: -vv tests/foreman/sys/test_fam.py::test_positive_run_modules_and_roles

@Satellite-QE Satellite-QE added the AutoMerge_Cherry_Picked The cherrypicked PRs of master PR would be automerged if all checks passing label Feb 21, 2024
@Satellite-QE
Copy link
Collaborator Author

PRT Result

Build Number: 5813
Build Status: UNSTABLE
PRT Comment: pytest -vv tests/foreman/sys/test_fam.py::test_positive_run_modules_and_roles
Test Result : ================ 35 warnings, 110 errors in 1564.41s (0:26:04) =================

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Feb 21, 2024
@jameerpathan111
Copy link
Contributor

All tests failed with failed on setup with "broker.exceptions.ProviderError", re-triggering the job.

@jameerpathan111
Copy link
Contributor

trigger: test-robottelo
pytest: -vv tests/foreman/sys/test_fam.py::test_positive_run_modules_and_roles

@Satellite-QE
Copy link
Collaborator Author

PRT Result

Build Number: 5817
Build Status: UNSTABLE
PRT Comment: pytest -vv tests/foreman/sys/test_fam.py::test_positive_run_modules_and_roles
Test Result : ================ 29 warnings, 110 errors in 1522.71s (0:25:22) =================

@Griffin-Sullivan
Copy link
Contributor

This and the other branches will need #14238

@Griffin-Sullivan
Copy link
Contributor

trigger: test-robottelo
pytest: tests/foreman/sys/test_fam.py::test_positive_run_modules_and_roles[activation_key]

@Satellite-QE Satellite-QE removed the PRT-Failed Indicates that latest PRT run is failed for the PR label Mar 15, 2024
@Griffin-Sullivan Griffin-Sullivan linked an issue Mar 15, 2024 that may be closed by this pull request
@Satellite-QE
Copy link
Collaborator Author

PRT Result

Build Number: 6083
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/sys/test_fam.py::test_positive_run_modules_and_roles[activation_key] --external-logging
Test Result : ================== 1 failed, 1 warning in 1487.97s (0:24:47) ===================

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Mar 15, 2024
@Griffin-Sullivan Griffin-Sullivan merged commit 0499742 into 6.15.z Mar 15, 2024
8 of 11 checks passed
@Griffin-Sullivan Griffin-Sullivan deleted the cherry-pick-6.15.z-7aca395efcc61aa74809491d02e1c7e1175d36f3 branch March 15, 2024 14:12
damoore044 pushed a commit to damoore044/robottelo that referenced this pull request Mar 18, 2024
Integrate FAM pipeline into robottelo (SatelliteQE#14028)

(cherry picked from commit 7aca395)

Co-authored-by: Griffin Sullivan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.15.z Introduced in or relating directly to Satellite 6.15 Auto_Cherry_Picked Automatically cherrypicked PR using GHA AutoMerge_Cherry_Picked The cherrypicked PRs of master PR would be automerged if all checks passing No-CherryPick PR doesnt need CherryPick to previous branches PRT-Failed Indicates that latest PRT run is failed for the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Failed-AutoCherryPick] - Fix manifest file transer for fam
3 participants