Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could polars help speed up ampycloud even more ? #96

Open
fpavogt opened this issue Feb 28, 2023 · 1 comment
Open

Could polars help speed up ampycloud even more ? #96

fpavogt opened this issue Feb 28, 2023 · 1 comment
Labels
enhancement New feature or request help !!! Extra attention is needed

Comments

@fpavogt
Copy link
Member

fpavogt commented Feb 28, 2023

Describe the change
There's a new DataFrame package called polars.

This looks like it could provide a significant speed gain over pandas, currently used by ampycloud. Speed is not an issue today with ampycloud, but any gain would be good to take.

@loforest: making an upgrade from pandas to polars would require some deep surgery ... but it could also be the perfect excuse to learn the code in all the details, if someone wanted to take ownership when I'll move to the great beyond (MCH).

I note that there may be good reasons why polars cannot work with ampycloud, but I have not checked in details yet.

@fpavogt fpavogt added enhancement New feature or request help !!! Extra attention is needed labels Feb 28, 2023
@regDaniel
Copy link
Collaborator

I'd be open to give this a try. I've looked into polars (albeit directly in Rust) and think it brings some significant advantages over Pandas.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help !!! Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants