Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dashboard: fetch fragment graph for each streaming job on demand #17510

Closed
BugenZhao opened this issue Jul 1, 2024 · 1 comment
Closed

dashboard: fetch fragment graph for each streaming job on demand #17510

BugenZhao opened this issue Jul 1, 2024 · 1 comment
Labels
component/dashboard type/enhancement Improvements to existing implementation.
Milestone

Comments

@BugenZhao
Copy link
Member

BugenZhao commented Jul 1, 2024

Under current implementation, we fetch the fragment graph for all streaming jobs at once as soon as user navigates to the "Streaming Graph" page. This will lead to problems if there are too many jobs in the cluster:

I would suggest fetching the graph for each streaming job on demand to thoroughly resolve this issue. Note that this requires some more refactoring on the layout and back-pressure visualization as well.

@BugenZhao
Copy link
Member Author

Is this addressed by #18272? @kwannoel

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/dashboard type/enhancement Improvements to existing implementation.
Projects
None yet
Development

No branches or pull requests

3 participants