Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Rename shuffle write metric #624

Merged
merged 2 commits into from
Jul 4, 2024

Conversation

andygrove
Copy link
Member

Which issue does this PR close?

N/A

Rationale for this change

I was comparing Spark vs Comet in Spark UI and found the metrics confusing to compare.

What changes are included in this PR?

  • Rename "shuffle read elapsed compute at native" to "shuffle native code time" because the timer is used to measure (almost) all execution time in the native code, including reading, repartitioning, and writing.

How are these changes tested?

Tested manually

@andygrove andygrove merged commit b3977cd into apache:main Jul 4, 2024
73 checks passed
@andygrove andygrove deleted the rename-shuffle-metric branch July 4, 2024 15:18
himadripal pushed a commit to himadripal/datafusion-comet that referenced this pull request Sep 7, 2024
* Rename shuffle write metric

* introduce constants for shuffle native write metric
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants