Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support DataRef cloudevent extension #1872

Open
matzew opened this issue Feb 5, 2024 · 1 comment
Open

Support DataRef cloudevent extension #1872

matzew opened this issue Feb 5, 2024 · 1 comment

Comments

@matzew
Copy link
Member

matzew commented Feb 5, 2024

In the CloudEvent spec, there is the dataref extension defined:
https://github.com/cloudevents/spec/blob/main/cloudevents/extensions/dataref.md

It would be nice to have a way to make use of this, especially to avoid sending large data, e.g. in sources that shuffle data, like from AWS for example:

apiVersion: camel.apache.org/v1
kind: Pipe
metadata:
  name: aws-s3-source-pipe
  annotations:
    trait.camel.apache.org/camel.runtime-version: 3.6.0
spec:
  integration:
    dependencies:
    - "camel:cloudevents"
  source:
    ref:
      kind: Kamelet
      apiVersion: camel.apache.org/v1
      name: aws-s3-source
    properties:
      .....
@oscerd
Copy link
Contributor

oscerd commented Feb 7, 2024

Supposing we are going to support multiple components with cloud events this require a lot of work: for s3 for example, you can decide to exclude the body from the payload, by specifying a parameter in the Kamelet configuration, the problem is much more related to the fact you don't have a way to directly point to the S3 object: if it's a public object we could build the URL, if it's not we should create a pre-signed URL which require some work but also some API call and some cost.

Doing for all the CE supported components is not easy and require a lot of time. So not sure this could be done without some coordinated effort.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants