Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report on compaction task instance IDs #3923

Open
patchwork01 opened this issue Dec 13, 2024 · 0 comments
Open

Report on compaction task instance IDs #3923

patchwork01 opened this issue Dec 13, 2024 · 0 comments

Comments

@patchwork01
Copy link
Collaborator

patchwork01 commented Dec 13, 2024

Background

With compaction on EC2, multiple tasks can run on the same EC2 instance. We currently generate a UUID to identify each compaction task when it starts, and store that in the status store.

In the past we've noticed varying performance depending on how many tasks ran on the same EC2 instance, as in the following issue:

Description

We'd like to record any information about which underlying AWS resources the compaction task ran on, and include it in the compaction task report.

Analysis

For compaction on EC2 we should be able to include the EC2 instance ID, availability zone and container ID. We currently log the EC2 instance ID, availability zone and ARN, but we don't put it in the status store.

We can look at what we can include in Fargate.

@patchwork01 patchwork01 added this to the 0.27.0 milestone Dec 13, 2024
@patchwork01 patchwork01 changed the title Record compaction task instance IDs in status store Report on compaction task instance IDs Dec 13, 2024
@patchwork01 patchwork01 modified the milestones: 0.27.0, 0.28.0 Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant