Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce jar copying and allow specify jar path when the artifact is already somewhere in cluster #525

Open
thetuxedo opened this issue Oct 17, 2018 · 0 comments

Comments

@thetuxedo
Copy link

I have only one function, which takes json as parameter and do different things based on the json parameter. So I have only one jar which is quite big.

The current implement will copy the jar from mist master to all executors in the cluster for each run of the function, and take a lot of disk space, unnecessarily in this case.

It will be good to allow user to specify the jar path in cluster and omit the jar copying step, or even better, create a method to publish the artifact jar to the cluster, and then omit jar copying steps for this particular function.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant