Code

Compression feature#126

Code

Open

skyFzz wants to merge 63 commits intohpc-io:masterhpc-io/h5bench:masterfrom skyFzz:compression-featureskyFzz/h5bench:compression-featureCopy head branch name to clipboard

+1,559-607

Commits

Commits on Jun 16, 2024

• reinit and reclone the submodules, added compression_filter enum, json and param passing. Currently testing SZ functionality.

  

  Henry Zhou

  committed
  6cdfd84

Commits on Jun 18, 2024

• Fixed filter unregistered error. SZ compression successfully applied.

  skyFzz

  committed
  56abacc

• Changed H5Z_FLAG_OPTIONAL back to MANDATORY

  skyFzz

  committed
  b4f4145

Commits on Jun 28, 2024

• Update .gitignore and remove build directories from tracking. Add shuffling filter prior to any compression filters for effective performance

  skyFzz

  committed
  d81e665

• Merge remote-tracking branch 'upstream/master' into compression-feature

  skyFzz

  committed
  7d40570

• add misdeleted 4 lines of code back

  skyFzz

  committed
  8282777

Commits on Jul 15, 2024

• Added output compressed size and compression ratio

  skyFzz

  committed
  e213532

Commits on Jul 22, 2024

• Add benchmark parameter--plugin_path and checks to set up HDF5_PLUGIN_PATH env for a specific compression filter

  skyFzz

  committed
  fc090f8

• Fix segmentation fault due to usage of strcpy() instead of strdup() for plugin_path

  skyFzz

  committed
  dc0067d

Commits on Aug 2, 2024

• Add retrieving filter info functionality to read.c. Add output to stdout and csv.

  skyFzz

  committed
  07d7293

Commits on Aug 5, 2024

• Free filter_info struct, correct csv output format, modify filter_info output

  skyFzz

  committed
  24b6924

• Add a check for invalid operation input from JSON

  skyFzz

  committed
  45036fd

• Fix python indentation error. Test h5bench_read with Rank=5 and ASYNC.

  skyFzz

  committed
  be8adea

Commits on Aug 7, 2024

• Add cd_nelmts and cd_values data structure and parsing as options for user input. Use these two parameters in H5Pset_filter()

  skyFzz

  committed
  5587ba3

• Add output of cd_nelmts and cd_values in Benchmark Configuration

  skyFzz

  committed
  05a0286

Commits on Aug 8, 2024

• Add Snappy-CUDA compression enum to the compression filter set and enable it in write

  skyFzz

  committed
  b09c584

• Fix some error and warnings

  skyFzz

  committed
  93c07fc

Commits on Aug 9, 2024

• Add documentation to Read/Write page

  skyFzz

  committed
  389ce32

• Add documentation to a new "Build and Run Plugin" page

  skyFzz

  committed
  c6caa71

• Fix rst syntax error

  skyFzz

  committed
  053b683

• Fix bug to deference cd_values for output. Increase the number of allowed cd_values to 10. Change input names to cd_nelmts and cd_values from num_aux_data and aux_data_*

  skyFzz

  committed
  c65397e

Commits on Aug 12, 2024

• update CI

  jeanbez

  committed
  74881be

• Fix multiple definitions error. Update documentation.

  skyFzz

  committed
  59fbabf

Commits on Aug 13, 2024

• Skip calling H5Pget_filter() when H5Pget_nfilters() returns 0, indicating no filter is used in read

  skyFzz

  committed
  2e09379

• fix clang formatter

  jeanbez

  committed
  a5a9e5e

• remove

  jeanbez

  committed
  73b0930

• add stage

  jeanbez

  committed
  2ad8e79

• remove trigger

  jeanbez

  committed
  6546615

• committing clang-format changes

  github-actions[bot]

  committed
  2a81809

• update trigger

  jeanbez

  committed
  4d5385d

Commits on Aug 15, 2024

• Add docker image for compression libs, CI jobs testing, and sampel json files

  skyFzz

  committed
  60b2794

• Merge branch 'compression-feature' of github.com:skyFzz/h5bench into compression-feature

  skyFzz

  committed
  70aecb2

• Update Dockerfile. Create a new yml just for compression.

  skyFzz

  committed
  3ae9dd0

• update name

  jeanbez

  committed
  9b17ba6

• move file to correct location, use final image name

  jeanbez

  committed
  b018002

• fix typo in new samples

  jeanbez

  committed
  48508da

• update name

  jeanbez

  committed
  c0453cf

• fix path and compile only baseline kernels

  jeanbez

  committed
  451b674

• update path according to docker installation

  jeanbez

  committed
  f152731

• temporarily continue on error

  jeanbez

  committed
  b2a80c4

• temporarily continue on error

  jeanbez

  committed
  7c9bc87

• correct path for CI

  jeanbez

  committed
  da2c912

Commits on Aug 22, 2024

• reduce test size and include path

  jeanbez

  committed
  0244e3f

• fix issues

  jeanbez

  committed
  1044efc

• committing clang-format changes

  github-actions[bot]

  committed
  9861e1c

• update Docker

  jeanbez

  committed
  6147b12

• update action and fix typo

  jeanbez

  committed
  baa9b14

• remove parameters

  jeanbez

  committed
  752ac54

• committing clang-format changes

  github-actions[bot]

  committed
  bd67248

• remove parameters

  jeanbez

  committed
  6668391

Commits on Aug 23, 2024

• pin SZ3 version to 3.1.8

  jeanbez

  committed
  ab7b7da

• fix path

  jeanbez

  committed
  278ee3c

• update CI

  jeanbez

  committed
  ce43d90

• refine tests

  jeanbez

  committed
  1bad0e8

• bump version

  jeanbez

  committed
  65ac231

• bump version

  jeanbez

  committed
  673c928

• update Ubuntu baseline CI image

  jeanbez

  committed
  e3c54e5

• Add check to total_compressed_size to avoid divide by 0

  skyFzz

  committed
  762a7cb

• committing clang-format changes

  github-actions[bot]

  committed
  08db82e

Commits on Aug 26, 2024

• update CI images

  jeanbez

  committed
  7f1750e

• delete deprecated file

  jeanbez

  committed
  f8df39f

• remove files

  jeanbez

  committed
  b3ce058

• small correction

  jeanbez

  committed
  5b048f1