[Feature Request] TorchRL for Python 3.13t

[patchmeifyoucan]

Hello, PyTorch recently added support for Python 3.13t, aka "no-gil" Python (pytorch/pytorch#130249).
Are there any plans to make TorchRL usable from this version? It would be nice if this could be supported soon, as the ability to run CPU code for interactions with the environment from multiple no-gil threads could lead to major performance improvements and higher GPU utilization.

[vmoens]

That's definitely on our radar!
Beyond multithreaded envs another big benefit would be reducing the cpu overheads across the lib (sampling in rbs, iterating over TensorDict etc).

Is there anything we should prioritise in your opinion?

[patchmeifyoucan]

Thank you, good to know.

For me, simply general support would be sufficient to get a better GPU utilization, that's what I'm after. I mostly use torchrl's replay buffers but their performance is far from being a bottleneck in my application.