Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove beam-artifact temp files when submission JVMs exit #29221

Closed

Conversation

bvolpato
Copy link
Contributor

This should reduce temp disk space utilization, especially in test VMs that run xlang pipelines hundreds of times per day.

@chamikaramj
Copy link
Contributor

Run XVR_JavaUsingPython_Dataflow PostCommit

@chamikaramj
Copy link
Contributor

LGTM

@Abacn
Copy link
Contributor

Abacn commented Oct 31, 2023

Forgot to mention also entered a same PR: #29219 that one set deleteOnExit() after the temp file successfully written, in case the try clause ended with Exception and tempFile was empty

@bvolpato
Copy link
Contributor Author

That sounds good, thanks Yi! Closing this one

@bvolpato bvolpato closed this Oct 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants