[TASK] Implement the unified Orchestration Core in the 8.7 Alpha chart

[aabouzaid]

Related to

Epic: https://github.com/camunda/distribution/issues/331

Overview

Implement the unified Orchestration Core in the 8.7 Alpha chart and remove the following individual components:

• Zeebe / Zeebe Gateway
• Operate
• Optimize
• Tasklist
• Execution Identity (it was disabled by default in 8.6)

Actions

Sub-tasks

Beta Give feedback

1. The new component should use camunda/camunda image.
2. The new component is called core.
3. The new component should be a StatefulSet .

PRs

Beta Give feedback

1. refactor: replace zeebe and web-apps with camunda orchestration core #2554
   component/connectors component/console component/identity component/monitoring component/operate component/optimize component/tasklist component/web-modeler component/zeebe test-persistent tool/github-actions tool/release-please +12
   
2. refactor(core): rename core statefulset to avoid upgrade downtime #2581
   size/s test-persistent tool/github-actions +3
   
3. fix(core): disable core client secret if identity is disabled #2584
   size/xs +1
   
4. ci: enable identity test client vars #2598
   size/xs +1
   
5. refactor(core): add identity admin client #2602
   component/identity size/s test-persistent +3
   

[hisImminence]

@aabouzaid could you give progress update here and answer the following questions?

cc. @Zelldon

What was our plan for migrating or keeping the values files for the Helm charts? Will we have a breaking change in how we configure the different components?

[aabouzaid]

@aabouzaid could you give progress update here and answer the following questions?

cc. @Zelldon

What was our plan for migrating or keeping the values files for the Helm charts? Will we have a breaking change in how we configure the different components?

We will definitely make breaking changes. We have planned the ones since 8.5, and the new ones will come with the 8.7 unified release.

Regarding the updates, I reached a state today where I can render the chart with the new structure, and I will give it a live test on Monday.

[aabouzaid]

Closing this PR as all tasks are done.

The Connectors component has a known limitation, which the team has discussed. The Connectors app doesn't work with the new setup (It should be fixed in 8.7 Alpha 2.)