Low utilization rate of cuda

[xzdong-2019]

Dear,
when i run the code, the cuda's utilization rate is Less than 20%, and my cuda is 32400. That's ok? I am very looking forward to your review. Thanks.

[glample]

Hi,

I would recommend looking at https://github.com/facebookresearch/XLM
It is a more recent version of this code, that supports multi-GPU. It works better, and it is much faster.