Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LZ4 Codec #321

Open
jakirkham opened this issue Dec 19, 2024 · 2 comments
Open

LZ4 Codec #321

jakirkham opened this issue Dec 19, 2024 · 2 comments

Comments

@jakirkham
Copy link
Member

jakirkham commented Dec 19, 2024

Currently there is not an LZ4 Codec. There is a Blosc Codec that can use LZ4. However there is value in having a LZ4 Codec in its own right as this is a common compressor.

Note: This could be an extension.

@jbms
Copy link
Contributor

jbms commented Dec 19, 2024

Seems reasonable. Note that there are actually 2 lz4 formats, the lower-level "block" format and the higher-level "frame" format. The lz4 command-line tool only supports the frame format. blosc lz4 uses the "block" format. numcodecs lz4 uses the "block" format.

@jakirkham
Copy link
Member Author

Yes this is a good distinction. Thanks Jeremy! 🙏

Wonder whether we are better served by...

  1. Having 2 codecs:
    1. lz4-block
    2. lz4-frame
  2. One codec lz4 with a config parameter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants