Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transparently support enum/union with 127+ variants #236

Open
v1gnesh opened this issue Sep 3, 2024 · 0 comments
Open

Transparently support enum/union with 127+ variants #236

v1gnesh opened this issue Sep 3, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@v1gnesh
Copy link
Contributor

v1gnesh commented Sep 3, 2024

When looking through Union layout in the arrow columnar format, I noticed that within Dense Union, it says, "A union with more than 127 possible types can be modeled as a union of unions."

Believe this is left as an exercise to any union array implementer, and not something that happens automagically.
A workaround for this is to split bigger enums into ones with <=127 types.
It would be nice if this can be handled transparently in narrow, if possible 🙏

Maybe an unrelated reference... DuckDB's union type supports 256 variants.

@mbrobbel mbrobbel added the enhancement New feature or request label Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants