use cpu to inference

[qpzhao]

Hi, How can I set params or modify "translator.py" for using cpu to inference?

[Playinf]

Unfortunately, the PyTorch implementation currently does not support CPU for inference.

[qpzhao]

Unfortunately, the PyTorch implementation currently does not support CPU for inference.

Thanks. But I use tensorflow implementation. Does tensorlfow implementation support CPU for inference?

[GrittyChen]

@qpzhao Yes, the TensorFlow implementation supports inference with CPU.

[GrittyChen]

Hi, How can I set params or modify "translator.py" for using cpu to inference?

Now, the PyTorch implementation supports CPU for inference. You can add a parameter --cpu to make the translator.py work on the CPU. Note that when you use CPU to inference, you would not be allowed to use the --half parameter.