Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I have a pytorch model exported as an onnx format, Which engine should I to set when I use Criteria? During prediction, I use NDManager.newBaseManager to get a NDManager, which engine should NDManager.newBaseManager use? #3508

Open
BlackRen09 opened this issue Oct 30, 2024 · 1 comment

Comments

@BlackRen09
Copy link

I have a pytorch model used for Text-to-Speech, the encoder and decoder are exported as onnx format. When Loading these model file, Criteria has a param named engine, I wonder which engine (OnnxRuntime or pytorch) should be used? After that, outputs from the encoder will be as inputs to the decoder, For managing NDResource, I have to get a NDManager to manage temporal resources, so I use NDManager.newBaseManager, when I call this function, which engine should be used? (I have read the source of NDManager, different engine will get different implement of manager).

@BlackRen09
Copy link
Author

If I want to use engine profiler support, OnnxRuntime way or choose pytorch way?
Thanks for your answering!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant