Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dask Expressions integration #14

Open
alxmrs opened this issue Feb 17, 2024 · 3 comments · Fixed by #28
Open

Dask Expressions integration #14

alxmrs opened this issue Feb 17, 2024 · 3 comments · Fixed by #28

Comments

@alxmrs
Copy link
Owner

alxmrs commented Feb 17, 2024

The new Dask Expressions library was really performant in the recent B(Tr)illion Row challenge. I think it would find a good home here.
@alxmrs
Copy link
Owner Author

alxmrs commented Mar 2, 2024

Given multi index appearing on the project’s roadmap, I think experimenting with this library should happen sooner rather than later.

dask/dask-expr#784

@alxmrs
Copy link
Owner Author

alxmrs commented Mar 2, 2024

This may be a blocker. dask-contrib/dask-sql#1308

@alxmrs
Copy link
Owner Author

alxmrs commented Mar 3, 2024

It looks like we can turn this on with a flag.

dask/dask#10934

alxmrs added a commit that referenced this issue Mar 3, 2024
@alxmrs
Enable Dask-Expr.
ec51d8f 
Turn on Dask-Expr via flags. Fixes #14.
@alxmrs alxmrs mentioned this issue Mar 3, 2024
Merged
@alxmrs alxmrs closed this as completed in #28 Mar 3, 2024
alxmrs added a commit that referenced this issue Mar 3, 2024
@alxmrs
Turning on Dask-Expr (#28)
35f910f 
This PR enables dask-expr with copy on write semantics in Dask
Dataframes. Fixes #14.
alxmrs added a commit that referenced this issue Mar 3, 2024
@alxmrs
Turning on Dask-Expr (#28)
a1df12f 
This PR enables dask-expr with copy on write semantics in Dask
Dataframes. Fixes #14.
@alxmrs alxmrs reopened this Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Turning on Dask-Expr alxmrs/xarray-sql
1 participant
@alxmrs