Code

Feat/add chinese mapper#51

Code

Merged

chenhesen merged 8 commits intomainmodelscope/data-juicer:mainfrom feat/add_Chinese_mappermodelscope/data-juicer:feat/add_Chinese_mapperCopy head branch name to clipboardNov 1, 2023

+508-10

Commits

Commits on Oct 16, 2023

• Modify the location of RayExecutor import

  chenhesen

  committed
  20585d4

Commits on Oct 24, 2023

• Merge branch 'main' of github.com:alibaba/data-juicer

  chenhesen

  committed
  771a4ff

Commits on Oct 27, 2023

• Merge branch 'main' of github.com:alibaba/data-juicer

  chenhesen

  committed
  802dbcd

Commits on Oct 30, 2023

• add two Chinese mapper

  chenhesen

  committed
  9879531

• Add op description to docs

  chenhesen

  committed
  026228f

• fix md

  chenhesen

  committed
  263910f

Commits on Oct 31, 2023

• keep alphabet number punc

  chenhesen

  committed
  01112ff

• add op info in overview_scan

  chenhesen

  committed
  8d8252c