Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make KVS Store service possible to start as independent service instead of keeping with one of the rank #12

Open
umamaheswararao opened this issue Feb 21, 2020 · 0 comments

Comments

@umamaheswararao
Copy link

In Spark like deployments, Driver is a single point of failure but not workers.
Keeping KVSStore with one of the worker makes one of the worker process as single point of failures.

If KVS can be started as stand alone process, the integration into spark like deployments will be easy. Driver can start this KVS Store and pass the KVSStore IP_Port to all workers.
Rabit has the similar architecture, tracker( like KVStore here) starts with Driver. All workers connects to tracker.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant