Skip to content

hmsdk v3.0

Latest
Compare
Choose a tag to compare
@honggyukim honggyukim released this 16 Sep 09:58
· 5 commits to main since this release

This is a new release for hmsdk v3.0, which is fully aligned its features with various other open source projects including Linux kernel, numactl, damo, etc.

What's Changed

The changes from hmsdk v2.0 to v3.0 are as follows.

Bandwidth Expansion

  • Apply interface changes of weighted interleaving from upstream
    • drop task level weight setting
    • drop set_mempolicy_node_weight and mrange_node_weight syscalls
    • drop local changes of numactl, then use upstream numactl with -w/--weighted-interleave option.
    • thanks to Gregory Price (formerly at MemVerge)

Capacity Expansion

  • Apply interface changes of DAMON based tiered memory management
    • DAMOS_{PROMOTE,DEMOTE} are renamed to DAMOS_MIGRATE_{HOT,COLD}
    • set the migration target with target_nid in sysfs instead of use memory tiering info builtin kernel.
    • rename gen_config.py to gen_migpol.py for clear meaning
    • change --{dram,cxl}_nodes options of gen_config.py to --{demote,promote} options in gen_migpol.py along with its usage.
    • drop local changes of damo, then use upstream damo as all of hmsdk's features are upstreamed.
      • use target_nid in migrate_{hot,cold} actions
      • use json format output to yaml format
    • thanks to SeongJae Park (formerly at Amazon)

Custom Allocator

  • Replace cemalloc to hmalloc
    • reimplented hmalloc from scratch for cemalloc replacement.
    • cemalloc supports many features but only explicit mode is implemented in hmalloc after renaming of cxl_ prefixed APIs to
      h prefixed APIs. For example, cxl_malloc is renamed to hmalloc.
    • drop unused features to reduce complexity.
      • such as implicit mode and Java/Python APIs
    • drop jemalloc submodule as hmalloc can use it from official packages without recompilation.
    • introduce hmctl tool to avoid environment variable exposure.

Since hmsdk v3.0 is fully aligned with various open source projects, its usage and interface won't be changed any time soon and it will no longer require back porting its local features to the upgraded versions.

Contributors

Signed-off-by: Honggyu Kim [email protected]
Signed-off-by: Yunjeong Mun [email protected]
Signed-off-by: Hyeongtak Ji [email protected]
Signed-off-by: Rakie Kim [email protected]

Full Changelog: hmsdk-v2.0...hmsdk-v3.0