You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the Python GIL forces Pandarallel to split workers over processes, with slow and expensive inter-process communication.
A version of Python without the GIL would allow Pandarallel to split workers in multi-thread mode.
It would avoid this inter-process and data duplication, and thus it may introduce a potentially massive performance bump!
Python 3.13 may be released with an option to disable the GIL: https://discuss.python.org/t/a-steering-council-notice-about-pep-703-making-the-global-interpreter-lock-optional-in-cpython/30474
Currently, the Python GIL forces Pandarallel to split workers over processes, with slow and expensive inter-process communication.
A version of Python without the GIL would allow Pandarallel to split workers in multi-thread mode.
It would avoid this inter-process and data duplication, and thus it may introduce a potentially massive performance bump!
Let's keep an eye on it!
(@till-m)
The text was updated successfully, but these errors were encountered: