Create a V2 version of "Manipulate Kubernetes Resources as Part of a Pipeline"

[hbelmiro]

          @hbelmiro We also need to create a V2 version of ["Manipulate Kubernetes Resources as Part of a Pipeline"](https://www.kubeflow.org/docs/components/pipelines/v1/sdk/manipulate-resources/).

Its quite different in V2 as it uses the kfp[kubernetes] library:

• https://kfp-kubernetes.readthedocs.io/en/kfp-kubernetes-1.0.0/source/kubernetes.html
• https://github.com/kubeflow/pipelines/tree/master/kubernetes_platform/python

I also note that there seem to be a few significant features missing (namely the ability to manipulate arbitrary resources, like the old v1 ResourceOp):

• [bug] KFP V2 does not support Volumes pipelines#8570
• [feature] Continued support for resourceOp / custom resource definitions pipelines#9703
• [feature/idea] Integrate kubernetes's models into kfp-kubernetes pipelines#9768

We could suggest people use a Python component with the kubernetes python library, but that should be a decision for the @kubeflow/pipelines leads.

Originally posted by @thesuperzapper in #3750 (comment)

[hbelmiro]

/area pipelines

[Mohit-Verma-1688]

Is it possible to create a resource from yaml in the Kubeflowv2 version ? I checked the links but I am not able to understand how to achieve below code in KFPV2. Thank you in advance.

deploy_step = dsl.ResourceOp(
        name="seldondeploy",
        k8s_resource=seldon_config,
        attribute_outputs={"name": "{.metadata.name}"})

[hbelmiro]

@Mohit-Verma-1688 you can ask that in our Slack.

[hbelmiro]

@thesuperzapper, it seems like we already have a v2 page for this.
https://www.kubeflow.org/docs/components/pipelines/user-guides/core-functions/platform-specific-features/

[Mohit-Verma-1688]

@hbelmiro I am sorry but I am not able to find an example to load a k8s yaml file. I am very new to Kubeflow and still trying to understand. My end goal is to use seldon deployment step in the pipeline and deploy the seldon crd yaml from KFP pipeline as mentioned in below example for v1.

https://github.com/SeldonIO/seldon-core/tree/8eb787a536b4a9470eed6230b9def4e844fceab8/examples/kubeflow

[hbelmiro]

@Mohit-Verma-1688 This is not the right place to ask and discussing this here pollutes this issue.
As I said before, can you please ask in our Slack?

[rimolive]

@Mohit-Verma-1688 Just to let you aware, we don't have ResourceOp support in KFPv2 and honestly I have no idea if this is still a highly demanding feature given that it's possible to create components in KFPv2 just like we did for KServe.

Usually we measure the feature demand with a 👍 in the issue description, but since this is for documentation I recommend that you open an issue in kubeflow/pipelines and ask for users to 👍 the issue.