You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
no archive - incremental sync-up is possible, download changed objects only, not the whole datadir
a quick way for node ops to catch up a dated node or continue the download using a fresh snapshot source
it's tricky to do the same with uploads, as well-known/exposed directory has to be in consistent state at any time, thus no benefits here
Cons:
increased billing
One S3 sync estimate is 1 class A op + 0.1M class B op with PBSS datadir (~50k files), making every full sync like $0.036 after free teer.
R2 data store increase
snapshot compression ratio is low, it's like 200GB per snapshot, ~$3/month
expose access key and secret key to public
it's read-only though
it may be rotated once in a couple months in case of abuse
PS: I'm not talking about hash-based schema with 500k+ files, it's going to be deprecated anyway. Testnet snapshot may be small enough to make wget|tar to work in most cases also.
The text was updated successfully, but these errors were encountered:
Thanks for you feedback, we may not use the S3 API tool, as:
1.Cost increase as you mentioned. There would have lots of files to be upload/download, cost could be much higher then one single large file.
2.Performance may not good, although "s3-optimized tools" could have good performance
Maybe we can provide a tool to improve UX, like "double-space issue"
It's a feature request (kinda addition to #260) to make bootstrap from snapshot a lot easier for users. The idea is the following
Pros:
wget | tar
is non-starter with 2.4TB archive, any reconnect and you have to start from scratchCons:
PS: I'm not talking about hash-based schema with 500k+ files, it's going to be deprecated anyway. Testnet snapshot may be small enough to make
wget|tar
to work in most cases also.The text was updated successfully, but these errors were encountered: