Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error on ASG - UnfulfillableCapacity #23

Closed
frantisekrokusek opened this issue Dec 6, 2021 · 12 comments
Closed

Error on ASG - UnfulfillableCapacity #23

frantisekrokusek opened this issue Dec 6, 2021 · 12 comments

Comments

@frantisekrokusek
Copy link

frantisekrokusek commented Dec 6, 2021

Hi Michael,

First thanks for this awesome template!

I am getting those errors, no matter the configuration...

Launching a new EC2 instance. Status Reason: Could not launch Spot Instances. UnfulfillableCapacity - Unable to fulfill capacity due to your request configuration. Please adjust your request and try again. Launching EC2 instance failed.

Status Reason: Could not launch Spot Instances. InvalidFleetConfiguration - Your requested instance type (p3.8xlarge) is not supported in your requested Availability Zone (us-east-2c). Launching EC2 instance failed.

  • us-east-2a, us-east-2b, us-east-2c
@mludvig
Copy link
Owner

mludvig commented Dec 6, 2021

Hi Frantisek, it could be a number of reasons:

  • Wait a bit longer. The ASG tries different combinations of instance types and availability zones and it may take ~30 mins or more to find one that’s available.

  • Have you got high enough Service limits? You can increase them using tools/incease-quotas.sh for each different instance type.

  • Try a different region, instance availability varies a lot between the regions. Try us-east-1, or us-west-2 that have the new g5.xlarge.

Hope that helps :)

@frantisekrokusek
Copy link
Author

Thanks for your answer!

I indeed tried:

  • changing region: oregon and ohio
  • waiting hours...

I will try to increase service limits.

@mludvig
Copy link
Owner

mludvig commented Dec 6, 2021

In Oregon you can also enable the Los Angeles local zone - it usually has g4dn capacity available.

See here for the steps: Instnace g4dn.xlarge not starting

Also check out my article on Medium with some more info: Mining Ethereum on AWS — is it worth it?

@frantisekrokusek
Copy link
Author

Thank you saddly I still can't figure out why it won't start...

@frantisekrokusek
Copy link
Author

I am trying now to create a spot request manually and launch it myself.

@frantisekrokusek
Copy link
Author

Ok I think I know what's the issue.. I have all spot requests limits to zero for G and P instance types! 🤯 Why is that?

@mludvig
Copy link
Owner

mludvig commented Dec 8, 2021

That's because that's the default for new accounts. See my comment in the first response ;)

Have you got high enough Service limits? You can increase them using tools/increase-quotas.sh for each different instance type.

Simply run tools/increase-quotas.sh g4dn from AWS CloudShell and it will raise the support requests to increase the quotas in all the regions where g4dn is available (this limit increase is valid for g5 as well). Then do the same for p3.

Start with the default - increase to 64 vCPU and once they approve it take it a step higher to e.g. 192 vCPU. If you try to raise straight from 0 to 192 they may take a long time to approve it and question why you need it.

Let me know how you go.

@frantisekrokusek
Copy link
Author

Waiting for approval right now!

@mludvig
Copy link
Owner

mludvig commented Dec 10, 2021

Closing, hope that the limit increase sorted the issues.

@mludvig mludvig closed this as completed Dec 10, 2021
@frantisekrokusek
Copy link
Author

Actually, AWS refused to increase my limits...

@mludvig
Copy link
Owner

mludvig commented Dec 10, 2021

You can try smaller limits, e.g. 16 instead of the default 64 and only in one or two regions (e.g. us-east-1, us-west-2). You can do it manually through the support centre. There is a high demand for GPU instances so they're sometimes reluctant unless you've got a good reason to request them, esp with new accounts. Good luck with that :)

@frantisekrokusek
Copy link
Author

I tried to increase to 4 to try the g5.xlarge

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants