Flaky test: Test_TerraformRecipe_AzureStorage: StorageAccountOperationInProgress: An operation is currently performing on this storage account that requires exclusive access.

[willdavsmith]

Steps to reproduce

Flaky test in long-running tests on Azure: https://github.com/radius-project/radius/actions/runs/12400435507/job/34617626473

Observed behavior

=== FAIL: test/functional-portable/corerp/cloud/resources Test_TerraformRecipe_AzureStorage/deploy_testdata/corerp-resources-terraform-azurestorage.bicep (96.62s)
    rptest.go:3[91](https://github.com/radius-project/radius/actions/runs/12400435507/job/34617626473#step:21:92): running step 0 of 1: deploy testdata/corerp-resources-terraform-azurestorage.bicep
    deployexecutor.go:80: deploying deploy testdata/corerp-resources-terraform-azurestorage.bicep from file testdata/corerp-resources-terraform-azurestorage.bicep
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local --parameters appName=corerp-resources-terraform-azstorage-app is still running after 10.000070737s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local --parameters appName=corerp-resources-terraform-azstorage-app is still running after 20.000911114s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local --parameters appName=corerp-resources-terraform-azstorage-app is still running after 30.0015918[93](https://github.com/radius-project/radius/actions/runs/12400435507/job/34617626473#step:21:94)s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/ --parameters appName=corerp-resources-terraform-azstorage-app is still running after 40.002542874s
    cli.go:3[94](https://github.com/radius-project/radius/actions/runs/12400435507/job/34617626473#step:21:95): [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local --parameters appName=corerp-resources-terraform-azstorage-app is still running after 50.002850873s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/ --parameters appName=corerp-resources-terraform-azstorage-app is still running after 1m0.003137703s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/ --parameters appName=corerp-resources-terraform-azstorage-app is still running after 1m10.005515357s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local --parameters appName=corerp-resources-terraform-azstorage-app is still running after 1m20.005859109s
    cli.go:394: [heartbeat] command rad deploy /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep --parameters moduleServer=http://tf-module-server.radius-test-tf-module-server.svc.cluster.local --parameters appName=corerp-resources-terraform-azstorage-app is still running after 1m30.006033658s
    cli.go:341: [rad] Building /home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep...
    cli.go:341: [rad] WARNING: The following experimental Bicep features have been enabled: Extensibility. Experimental features should be enabled for testing purposes only, as there are no guarantees about the quality or stability of these features. Do not enable these settings for any production usage, or your production environment may be subject to breaking.
    cli.go:341: [rad] Deploying template '/home/runner/work/radius/radius/test/functional-portable/corerp/cloud/resources/testdata/corerp-resources-terraform-azurestorage.bicep' into environment '/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/environments/kind-radius' from workspace 'radlrtest00-aks-admin'...
    cli.go:341: [rad] 
    cli.go:341: [rad] Deployment In Progress...
    cli.go:341: [rad] 
    cli.go:341: [rad] Error: {
    cli.go:341: [rad]   "code": "DeploymentFailed",
    cli.go:341: [rad]   "message": "At least one resource deployment operation failed. Please see the details for the specific operation that failed.",
    cli.go:341: [rad]   "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Microsoft.Resources/deployments/rad-deploy-84ecdc4c-0df4-47d3-b[96](https://github.com/radius-project/radius/actions/runs/12400435507/job/34617626473#step:21:97)f-53f087e10e10",
    cli.go:341: [rad]   "details": [
    cli.go:341: [rad]     {
    cli.go:341: [rad]       "code": "ResourceDeploymentFailure",
    cli.go:341: [rad]       "message": "Failed",
    cli.go:341: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/extenders/corerp-resources-terraform-azstorage",
    cli.go:341: [rad]       "details": [
    cli.go:341: [rad]         {
    cli.go:341: [rad]           "code": "RecipeDeploymentFailed",
    cli.go:341: [rad]           "message": "terraform apply failure: exit status 1\n\nError: creating Storage Account (Subscription: \"***\"\nResource Group Name: \"radtest-longraeb05ed166-e2e-all\"\nStorage Account Name: \"acct501a1ac3218d278b\"): performing Create: unexpected status 409 (409 Conflict) with error: StorageAccountOperationInProgress: An operation is currently performing on this storage account that requires exclusive access.\n\n  with module.default.azurerm_storage_account.test_storage_account,\n  on .terraform/modules/default/main.tf line 14, in resource \"azurerm_storage_account\" \"test_storage_account\":\n  14: resource \"azurerm_storage_account\" \"test_storage_account\" {\n\n"
    cli.go:341: [rad]         }
    cli.go:341: [rad]       ]
    cli.go:341: [rad]     },
    cli.go:341: [rad]     {
    cli.go:341: [rad]       "code": "OK",
    cli.go:341: [rad]       "message": "",
    cli.go:341: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/environments/corerp-resources-terraform-azstorage-env"
    cli.go:341: [rad]     },
    cli.go:341: [rad]     {
    cli.go:341: [rad]       "code": "OK",
    cli.go:341: [rad]       "message": "",
    cli.go:341: [rad]       "target": "/planes/radius/local/resourceGroups/kind-radius/providers/Applications.Core/applications/corerp-resources-terraform-azstorage-app"
    cli.go:341: [rad]     }
    cli.go:341: [rad]   ]
    cli.go:341: [rad] }
    cli.go:341: [rad] 
    cli.go:341: [rad] TraceId:  0c52e65c059682acdd90fd60ac627962
    cli.go:341: [rad] 
    cli.go:341: [rad]

Desired behavior

Test should pass

Workaround

No response

rad Version

Checkout ref: 6281a2f

Operating system

No response

Additional context

No response

Would you like to support us?

• Yes, I would like to support you

AB#13859

[radius-triage-bot]

👋 @willdavsmith Thanks for filing this bug report.

A project maintainer will review this report and get back to you soon. If you'd like immediate help troubleshooting, please visit our Discord server.

For more information on our triage process please visit our triage overview