Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scheduled long running test failed - Run ID: 7902365947 #7171

Closed
rad-ci-bot opened this issue Feb 14, 2024 · 3 comments
Closed

Scheduled long running test failed - Run ID: 7902365947 #7171

rad-ci-bot opened this issue Feb 14, 2024 · 3 comments
Labels
bug Something is broken or not working as expected test-failure A scheduled test run has failed and needs to be investigated

Comments

@rad-ci-bot
Copy link
Collaborator

rad-ci-bot commented Feb 14, 2024 •
edited by azure-boards bot
Loading

Bug information

This bug is generated automatically if the scheduled long running test fails. The Radius long running test operates on a schedule of every 2 hours everyday. It's important to understand that the test may fail due to workflow infrastructure issues, like network problems, rather than the flakiness of the test itself. For the further investigation, please visit here.

AB#11161
@rad-ci-bot rad-ci-bot added bug Something is broken or not working as expected test-failure A scheduled test run has failed and needs to be investigated labels Feb 14, 2024
@radius-triage-bot
Copy link

👋 @rad-ci-bot Thanks for filing this bug report.

A project maintainer will review this report and get back to you soon. If you'd like immediate help troubleshooting, please visit our Discord server.

For more information on our triage process please visit our triage overview

@sk593
Copy link
Contributor

sk593 commented Feb 16, 2024 •
edited
Loading 

=== Failed
=== FAIL: test/functional/messagingrp/resources Test_RabbitMQ_Manual/deploy_testdata/msgrp-resources-rabbitmq.bicep (23.23s)
    rptest.go:272: running step 0 of 1: deploy testdata/msgrp-resources-rabbitmq.bicep
    deployexecutor.go:80: deploying deploy testdata/msgrp-resources-rabbitmq.bicep from file testdata/msgrp-resources-rabbitmq.bicep
    cli.go:471: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq.bicep --parameters magpieimage=ghcr.io/radius-project/dev/magpiego:pr-8582be8888 --parameters *** is still running after 10.000621808s
    cli.go:471: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq.bicep --parameters magpieimage=ghcr.io/radius-project/dev/magpiego:pr-8582be8888 --parameters *** is still running after 20.001126304s
    cli.go:418: [rad] Building /home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq.bicep...
    cli.go:418: [rad] Deploying template '/home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq.bicep' into environment 'kind-radius' from workspace 'radiuse2e00-aks-admin'...
    cli.go:418: [rad] 
    cli.go:418: [rad] Deployment In Progress...
    cli.go:418: [rad] 
    cli.go:418: [rad] Error: {
    cli.go:418: [rad]   "code": "DeploymentFailed",
    cli.go:418: [rad]   "message": "At least one resource deployment operation failed. Please see the details for the specific operation that failed.",
    cli.go:418: [rad]   "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Microsoft.Resources/deployments/rad-deploy-6bb76857-c426-4fc0-86f9-ab31e4f5a066",
    cli.go:418: [rad]   "details": [
    cli.go:418: [rad]     {
    cli.go:418: [rad]       "code": "Created",
    cli.go:418: [rad]       "message": "",
    cli.go:418: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Messaging/rabbitMQQueues/msg-rmq-rmq"
    cli.go:418: [rad]     },
    cli.go:418: [rad]     {
    cli.go:418: [rad]       "code": "Created",
    cli.go:418: [rad]       "message": "",
    cli.go:418: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/containers/rmq-ctnr"
    cli.go:418: [rad]     },
    cli.go:418: [rad]     {
    cli.go:418: [rad]       "code": "OK",
    cli.go:418: [rad]       "message": "",
    cli.go:418: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/applications/msgrp-resources-rabbitmq"
    cli.go:418: [rad]     }
    cli.go:418: [rad]   ]
    cli.go:418: [rad] }
    cli.go:418: [rad] 
    cli.go:418: [rad] TraceId:  3408590514e2293dfaf07047e2f170b2
    cli.go:418: [rad] 
    cli.go:418: [rad] 
    deployexecutor.go:83: 
        	Error Trace:	/home/runner/work/radius/radius/test/step/deployexecutor.go:83
        	            				/home/runner/work/radius/radius/test/functional/shared/rptest.go:273
        	Error:      	Received unexpected error:
        	            	code DeploymentFailed: err At least one resource deployment operation failed. Please see the details for the specific operation that failed.
        	Test:       	Test_RabbitMQ_Manual/deploy_testdata/msgrp-resources-rabbitmq.bicep
        	Messages:   	failed to deploy deploy testdata/msgrp-resources-rabbitmq.bicep
    --- FAIL: Test_RabbitMQ_Manual/deploy_testdata/msgrp-resources-rabbitmq.bicep (23.23s)

=== FAIL: test/functional/messagingrp/resources Test_RabbitMQ_Manual (35.98s)
    test.go:44: Using container registry: ghcr.io/radius-project/dev - set DOCKER_REGISTRY to override
    test.go:45: Using container tag: pr-8582be8888 - set REL_VERSION to override
    test.go:46: Using magpie image: ghcr.io/radius-project/dev/magpiego:pr-8582be8888
    test.go:50: Using recipe registry: ghcr.io/radius-project/dev - set BICEP_RECIPE_REGISTRY to override
    test.go:51: Using recipe tag: pr-8582be8888 - set BICEP_RECIPE_TAG_VERSION to override
    test.go:54: Using terraform recipe module server URL: http://tf-module-server.radius-test-tf-module-server.svc.cluster.local - set TF_RECIPE_MODULE_SERVER_URL to override
    test.go:65: Loaded workspace: radiuse2e00-aks-admin (Kubernetes (context=radiuse2e00-aks-admin))
    rptest.go:319: beginning cleanup phase of msgrp-resources-rabbitmq
    rptest.go:369: deleting msgrp-resources-rabbitmq
    shared.go:95: deleting application: msgrp-resources-rabbitmq
    cli.go:471: [heartbeat] command rad application delete --yes -a msgrp-resources-rabbitmq is still running after 10.000670271s
    cli.go:418: [rad] Application msgrp-resources-rabbitmq deleted
    cli.go:418: [rad] 
    rptest.go:372: finished deleting msgrp-resources-rabbitmq
    rptest.go:377: validating deletion of pods for msgrp-resources-rabbitmq
    k8s.go:525: Found the following pods:
    k8s.go:527: (none)
    rptest.go:379: finished validation of deletion of pods for msgrp-resources-rabbitmq
    rptest.go:369: deleting rmq-app-ctnr
    rptest.go:372: finished deleting msgrp-resources-rabbitmq
    rptest.go:377: validating deletion of pods for msgrp-resources-rabbitmq
    k8s.go:525: Found the following pods:
    k8s.go:527: (none)
    rptest.go:379: finished validation of deletion of pods for msgrp-resources-rabbitmq
    rptest.go:369: deleting rmq-ctnr
    rptest.go:372: finished deleting msgrp-resources-rabbitmq
    rptest.go:377: validating deletion of pods for msgrp-resources-rabbitmq
    k8s.go:525: Found the following pods:
    k8s.go:527: (none)
    rptest.go:379: finished validation of deletion of pods for msgrp-resources-rabbitmq
    rptest.go:369: deleting msg-rmq-rmq
    rptest.go:372: finished deleting msgrp-resources-rabbitmq
    rptest.go:377: validating deletion of pods for msgrp-resources-rabbitmq
    k8s.go:525: Found the following pods:
    k8s.go:527: (none)
    rptest.go:379: finished validation of deletion of pods for msgrp-resources-rabbitmq
    rptest.go:396: finished cleanup phase of msgrp-resources-rabbitmq

=== FAIL: test/functional/messagingrp/resources Test_RabbitMQ_Recipe/deploy_testdata/msgrp-resources-rabbitmq-recipe.bicep (17.91s)
    rptest.go:272: running step 0 of 1: deploy testdata/msgrp-resources-rabbitmq-recipe.bicep
    deployexecutor.go:80: deploying deploy testdata/msgrp-resources-rabbitmq-recipe.bicep from file testdata/msgrp-resources-rabbitmq-recipe.bicep
2024/02/14 14:12:51 Start streaming Kubernetes logs - Pod rmq-ctnr-87[78](https://github.com/radius-project/radius/actions/runs/7902365947/job/21567892308#step:21:79)6d8c6-sv2vh is in state: Running
2024/02/14 14:12:51 Streaming Kubernetes logs to /home/runner/work/radius/radius/dist/container_logs/rmq-ctnr-87786d8c6-sv2vh.rmq-ctnr.log
    cli.go:471: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq-recipe.bicep --parameters magpieimage=ghcr.io/radius-project/dev/magpiego:pr-8582be8888 --parameters *** --parameters registry=ghcr.io/radius-project/dev --parameters version=pr-8582be8888 is still running after 10.000716275s
    cli.go:418: [rad] Building /home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq-recipe.bicep...
    cli.go:418: [rad] Deploying template '/home/runner/work/radius/radius/test/functional/messagingrp/resources/testdata/msgrp-resources-rabbitmq-recipe.bicep' into environment 'kind-radius' from workspace 'radiuse2e00-aks-admin'...
    cli.go:418: [rad] 
    cli.go:418: [rad] Deployment In Progress...
    cli.go:418: [rad] 
    cli.go:418: [rad] Error: {
    cli.go:418: [rad]   "code": "DeploymentFailed",
    cli.go:418: [rad]   "message": "At least one resource deployment operation failed. Please see the details for the specific operation that failed.",
    cli.go:418: [rad]   "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Microsoft.Resources/deployments/rad-deploy-ea89dfc5-25ec-44fd-a4fa-4ac96ac2ff17",
    cli.go:418: [rad]   "details": [
    cli.go:418: [rad]     {
    cli.go:418: [rad]       "code": "OK",
    cli.go:418: [rad]       "message": "",
    cli.go:418: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/environments/msgrp-resources-environment-rabbitmq-recipe-env"
    cli.go:418: [rad]     },
    cli.go:418: [rad]     {
    cli.go:418: [rad]       "code": "Created",
    cli.go:418: [rad]       "message": "",
    cli.go:418: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Messaging/rabbitMQQueues/rmq-recipe-resource"
    cli.go:418: [rad]     },
    cli.go:418: [rad]     {
    cli.go:418: [rad]       "code": "OK",
    cli.go:418: [rad]       "message": "",
    cli.go:418: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/applications/msgrp-resources-rabbitmq-recipe"
    cli.go:418: [rad]     }
    cli.go:418: [rad]   ]
    cli.go:418: [rad] }
    cli.go:418: [rad] 
    cli.go:418: [rad] TraceId:  82a28b5ee2528205091fc3bb71b80549
    cli.go:418: [rad] 
    cli.go:418: [rad] 
    deployexecutor.go:83: 
        	Error Trace:	/home/runner/work/radius/radius/test/step/deployexecutor.go:83
        	            				/home/runner/work/radius/radius/test/functional/shared/rptest.go:273
        	Error:      	Received unexpected error:
        	            	code DeploymentFailed: err At least one resource deployment operation failed. Please see the details for the specific operation that failed.
        	Test:       	Test_RabbitMQ_Recipe/deploy_testdata/msgrp-resources-rabbitmq-recipe.bicep
        	Messages:   	failed to deploy deploy testdata/msgrp-resources-rabbitmq-recipe.bicep
    --- FAIL: Test_RabbitMQ_Recipe/deploy_testdata/msgrp-resources-rabbitmq-recipe.bicep (17.[91](https://github.com/radius-project/radius/actions/runs/7902365947/job/21567892308#step:21:92)s)

Logs:
all_container_logs.zip

@sk593
Copy link
Contributor

sk593 commented Feb 16, 2024 •
edited
Loading

Closing, I don't see any failure cases in the logs, it seems like the container and rabbit mq resource are being created and there's no deployment error

@kachawla kachawla closed this as completed Mar 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something is broken or not working as expected test-failure A scheduled test run has failed and needs to be investigated
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sk593 @kachawla @rad-ci-bot