Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Managed log sources for CloudWatch Metric Streams #120

Open
timoguin opened this issue Mar 23, 2023 · 0 comments
Open

Managed log sources for CloudWatch Metric Streams #120

timoguin opened this issue Mar 23, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@timoguin
Copy link
Contributor

timoguin commented Mar 23, 2023

Add managed log source for CloudWatch metric streams.

Considerations

Currently, the main way to get CW metrics streams is through integration with Kinesis Firehose. If we supported the metrics stream output format, the user would only need to point their Firehose(s) at an S3 bucket for Matano to ingest the data. The log source will need to handle decoding from base64 since that's how Firehose will deliver it (unless configured with Lambda transforms).

JSONL output format seems to be the one that is most supported. There is also an OTEL output format, but it has less features and seems to be a bit more experimental.

References

@timoguin timoguin added the enhancement New feature or request label Mar 23, 2023
@timoguin timoguin changed the title Managed log sources for CloudWatch Metrics Streams Managed log sources for CloudWatch Metric Streams Mar 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant