New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

batch_size 10G GPU 单机最大能做到多少 #89

Open

caoyuji1986 opened this issue Jun 2, 2020 · 1 comment

caoyuji1986 commented Jun 2, 2020

No description provided.

Collaborator

Playinf commented Aug 19, 2020

这个值取决于模型大小以及GPU是否支持半精度。可以先设置一个值，然后观察训练时是否出现OOM，如有则继续调小。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment