Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How much CUDA memory is needed for infer.py? #28

Open
KaqiKaqi opened this issue Nov 8, 2024 · 0 comments
Open

How much CUDA memory is needed for infer.py? #28

KaqiKaqi opened this issue Nov 8, 2024 · 0 comments

Comments

@KaqiKaqi
Copy link

KaqiKaqi commented Nov 8, 2024

When I tried python infer.py --config config.yaml data.image_list=[example_images/a_pikachu_with_smily_face.webp,], I got RuntimeError: CUDA out of memory. Tried to allocate 288.00 MiB (GPU 0; 9.78 GiB total capacity; 6.76 GiB already allocated; 100.56 MiB free; 6.94 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant