Skip to content
This repository has been archived by the owner on Aug 27, 2023. It is now read-only.

Is it safe to host multiple PyPI Cloud servers using the same S3 backend for high availability? #285

Open
oschlueter opened this issue Jul 20, 2021 · 1 comment

Comments

@oschlueter
Copy link

The docs link to an Ansible playbook that mentions hosting multiple PyPI Cloud servers to ensure high availability of the service but the docs themselves never mention this. What I would like to do is create multiple AWS EC2 instances in different availability zones and create a single DNS record pointing to all of these instances, for example:

A 10 192.0.2.35
A 10 192.1.2.35
A 10 192.2.2.35

Would this work? Do I need to consider anything or be aware of anything?

@stevearc
Copy link
Owner

The webservers can live anywhere since they are stateless. The tricky part for multiple availability zones is that the webservers all have to be pointed at the same cache backend or they can get out of sync (e.g. a new package uploaded to one won't show up in the other). I haven't used AWS for many years now, but I think DynamoDB now has tables that span multiple availability zones. If not, you could look at this experimental support for synchronizing multiple cache backends using S3 notifications I added a while back.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants