Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPU, single-node multi-GPU, multi-node multi-GPU support for forecast generation #62

Open
ryuta-yoshimatsu opened this issue May 31, 2024 · 0 comments

Comments

@ryuta-yoshimatsu
Copy link

ryuta-yoshimatsu commented May 31, 2024

Is your feature request related to a problem? Please describe.
It is not clear from the documentation and the sample code, if the forecast generation can be performed on a GPU, multiple GPUs, or multiple GPUs in multiple nodes. If this is the case, please add some descriptions on how to achieve this.

Describe the solution you'd like
Maybe a simple device_map="auto" argument support in the from_pretrained method that automatically loads the model and the subsequent data onto a GPU/s.

Additional context
I respect the great work you have done! Especially around enabling multivariate modelling.

@ryuta-yoshimatsu ryuta-yoshimatsu changed the title GPU, single-node multi-GPU, multi-node multi-GPU support GPU, single-node multi-GPU, multi-node multi-GPU support for forecast generation May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant