auto build and issue template

.github/ISSUE_TEMPLATE/bug_report.yml

@@ -0,0 +1,116 @@
+name: 🐛 Bug Report
+description: Create a report to help us reproduce and fix the bug
+title: "[Bug]: "
+labels: ["bug"]
+body:
+  - type: checkboxes
+    attributes:
+      label: Before Reporting 报告之前
+      description: >
+        Please check and try following methods to solve it by yourself. 请先检查并通过一下方法尝试自己解决。
+      options:
+        - label: >
+           I have pulled the latest code of main branch to run again and the bug still existed.
+           我已经拉取了主分支上最新的代码，重新运行之后，问题仍不能解决。
+          required: true
+        - label: >
+           I have read the [README](https://github.com/alibaba/data-juicer/blob/main/README.md) carefully and no error occurred during the installation process. (Otherwise, we recommend that you can ask a question using the Question template)
+           我已经仔细阅读了 [README](https://github.com/alibaba/data-juicer/blob/main/README_ZH.md) 上的操作指引，并且在安装过程中没有错误发生。（否则，我们建议您使用Question模板向我们进行提问）
+          required: true
+
+  - type: checkboxes
+    attributes:
+      label: Search before reporting 先搜索，再报告
+      description: >
+        Please search the [issues](https://github.com/alibaba/data-juicer/issues) to see if a similar bug already exists. 请先在 [issue 列表](https://github.com/alibaba/data-juicer/issues)中搜索是否已经有类似的bug已经存在。
+      options:
+        - label: >
+            I have searched the Data-Juicer [issues](https://github.com/alibaba/data-juicer/issues) and found no similar bugs.
+            我已经在 [issue列表](https://github.com/alibaba/data-juicer/issues) 中搜索但是没有发现类似的bug报告。
+          required: true
+
+  - type: markdown
+    attributes:
+      value: |
+        Thanks for your attention. We will try our best to solve the bug you reported, but more concrete information is necessary to reproduce the bug.
+        感谢您的关注。我们会尽我们最大努力去解决您报告的bug，但是一些更详细的信息对于帮助我们复现这个bug是必要的。
+
+  - type: markdown
+    attributes:
+      value: "## Environment Information-环境信息"
+
+  - type: input
+    attributes:
+      label: OS 系统
+      description: e.g. Ubuntu, Windows, etc.
+    validations:
+      required: true
+
+  - type: input
+    attributes:
+      label: Installation Method 安装方式
+      description: e.g. from source, pip, docker image, etc.
+    validations:
+      required: true
+
+  - type: input
+    attributes:
+      label: Data-Juicer Version Data-Juicer版本
+      description: e.g. latest, v0.1.2, etc.
+    validations:
+      required: false
+
+  - type: input
+    attributes:
+      label: Python Version Python版本
+      description: e.g. 3.7, 3.9, etc.
+    validations:
+      required: true
+
+  - type: markdown
+    attributes:
+      value: "## About Bug-Bug相关信息"
+
+  - type: textarea
+    attributes:
+      label: Describe the bug 描述这个bug
+      description: A clear and concise description of what the bug is. 请详细、清晰地描述这个bug是什么样的。
+    validations:
+      required: true
+
+  - type: textarea
+    attributes:
+      label: To Reproduce 如何复现
+      description: Steps to reproduce the behavior. 请列举复现这个bug的步骤。
+      placeholder: |
+        1. Modify code '...' 编辑了什么地方的代码
+        2. Run command '...' 运行了什么命令
+        3. See error 看到了什么报错信息
+    validations:
+      required: true
+
+  - type: textarea
+    attributes:
+      label: Configs 配置信息
+      description: If applicable, add Config codes to help explain your problem. 如果可以，请提供数据处理时的配置文件以帮助您阐述bug信息。
+    validations:
+      required: false
+
+  - type: textarea
+    attributes:
+      label: Logs 报错日志
+      description: If applicable, add log information to help explain your problem. 如果可以，请提供相关日志信息以帮助您阐述bug信息。
+    validations:
+      required: false
+
+  - type: textarea
+    attributes:
+      label: Screenshots 截图
+      description: If applicable, add screenshots to help explain your problem. 如果可以，请提供相关截图以帮助您阐述bug信息。
+    validations:
+      required: false
+
+  - type: textarea
+    attributes:
+      label: Additional 额外信息
+      description: Anything else you would like to share? 其他您想分享的信息。

.github/ISSUE_TEMPLATE/feature_request.yml

@@ -0,0 +1,52 @@
+name: 🚀 Feature Request
+description: Suggest a Data-Juicer idea
+# title: " "
+labels: [enhancement]
+body:
+  - type: markdown
+    attributes:
+      value: |
+        Thank you for submitting a Data-Juicer Feature Request! 感谢您提交一个 Data-Juicer 功能需求！
+
+  - type: checkboxes
+    attributes:
+      label: Search before continuing 先搜索，再继续
+      description: >
+        Please search the [issues](https://github.com/alibaba/data-juicer/issues) to see if a similar feature request already exists. 请先在 [issue 列表](https://github.com/alibaba/data-juicer/issues)中搜索是否已经有类似的功能需求已经存在。
+      options:
+        - label: >
+            I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。
+          required: true
+
+  - type: textarea
+    attributes:
+      label: Description 描述
+      description: A short description of your feature. 功能简短描述。
+      placeholder: |
+        What new feature would you like to see in Data-Juicer? 您希望 Data-Juicer 可以支持哪些新功能？
+    validations:
+      required: true
+
+  - type: textarea
+    attributes:
+      label: Use case 使用场景
+      description: |
+        Describe the use case of your feature request. It will help us understand and prioritize the feature request. 描述您的功能需求的使用场景。这可以帮助我们理解并确认功能需求的优先级。
+      placeholder: |
+        How would this feature be used, and who would use it? 请描述一下这个新功能的应用场景？
+
+  - type: textarea
+    attributes:
+      label: Additional 额外信息
+      description: Anything else you would like to share? 其他您愿意分享的信息。
+      placeholder: |
+        Additional information. 额外信息。
+
+  - type: checkboxes
+    attributes:
+      label: Are you willing to submit a PR for this feature? 您是否乐意为此功能提交一个 PR？
+      description: >
+        (Optional) We encourage you to submit a [Pull Request](https://github.com/alibaba/data-juicer/pulls) (PR) to help improve Data-Juicer for everyone, especially if you have a good understanding of how to implement a fix or feature.
+        （可选项）我们鼓励您提交一个 [Pull Request (PR)]([Pull Request](https://github.com/alibaba/data-juicer/pulls)) 来为开源社区提升 Data-Juicer 的能力，尤其是如果您对如何实现或者修复一个功能有比较不错的理解的时候~
+      options:
+        - label: Yes I'd like to help by submitting a PR! 是的！我愿意提供帮助并提交一个PR！

.github/ISSUE_TEMPLATE/question.yml

@@ -0,0 +1,51 @@
+name: ❓ Question
+description: Ask a Data-Juicer question
+# title: " "
+labels: [question]
+body:
+  - type: markdown
+    attributes:
+      value: |
+        Thanks for your attention. We will try our best to solve your problem, but more concrete information is necessary to reproduce your problem.
+        感谢您的关注。我们会尽我们最大努力解决您的问题，但是更详细的信息对于我们复现您遇到的问题是必要的。
+  - type: checkboxes
+    attributes:
+      label: Before Asking 在提问之前
+      description: >
+        Please check and try following methods to solve it by yourself. 请检查并尝试以下方法来以尝试自己解决问题。
+      options:
+        - label: >
+           I have read the [README](https://github.com/alibaba/data-juicer/blob/main/README.md) carefully.
+           我已经仔细阅读了 [README](https://github.com/alibaba/data-juicer/blob/main/README_ZH.md) 上的操作指引。
+          required: true
+        - label: >
+           I have pulled the latest code of main branch to run again and the problem still existed.
+           我已经拉取了主分支上最新的代码，重新运行之后，问题仍不能解决。
+          required: true
+
+
+  - type: checkboxes
+    attributes:
+      label: Search before asking 先搜索，再提问
+      description: >
+        Please search the [issues](https://github.com/alibaba/data-juicer/issues) to see if a similar question already exists. 请先在 [issue 列表](https://github.com/alibaba/data-juicer/issues)中搜索是否已经有类似的问题已经存在。
+      options:
+        - label: >
+            I have searched the Data-Juicer [issues](https://github.com/alibaba/data-juicer/issues) and found no similar questions.
+            我已经在 [issue列表](https://github.com/alibaba/data-juicer/issues) 中搜索但是没有发现类似的问题。
+          required: true
+
+  - type: textarea
+    attributes:
+      label: Question
+      description: What is your question? 您遇到的问题是什么？
+      placeholder: |
+        💡 ProTip! Include as much information as possible (screenshots, logs, tracebacks, processing configs and commands, etc.) to receive the most helpful response.
+        (请仔细阅读上面的信息先进行问题排查，如果仍不能解决您的问题，请将问题尽可能地描述详细，以及提供相关命令、配置、报错日志等信息或截图，以便更快地定位和解决问题。)
+    validations:
+      required: true
+
+  - type: textarea
+    attributes:
+      label: Additional 额外信息
+      description: Anything else you would like to share? 其他您想分享的信息。

.github/workflows/deploy_spinx_docs.yml

@@ -0,0 +1,28 @@
+name: Deploy Sphinx documentation to Pages
+
+on:
+  release:
+    types: [published]
+  workflow_dispatch:
+
+jobs:
+  pages:
+    runs-on: ubuntu-20.04
+    steps:
+    - name: Checkout
+      uses: actions/checkout@4
+    - name: Setup Python ${{ matrix.python-version }}
+      uses: actions/setup-python@master
+      with:
+        python_version: ${{ matrix.python-version }}
+    - id: deployment
+      uses: sphinx-notes/pages@v3
+      with:
+        documentation_path: ./docs/spinx_doc/source
+        python_version: ${{ matrix.python-version }}
+        publish: false
+        requirements_path: ./environments/dev_requires.txt
+    - uses: peaceiris/actions-gh-pages@v3
+      with:
+        github_token: ${{ secrets.GITHUB_TOKEN }}
+        publish_dir: ${{ steps.deployment.outputs.artifact }}

README.md

@@ -9,12 +9,14 @@ English | [**中文**](README_ZH.md)
 ![](https://img.shields.io/badge/license-Apache--2.0-000000.svg)
 [![Contributing](https://img.shields.io/badge/Contribution-welcome-brightgreen.svg)](docs/DeveloperGuide.md)
 
+[![pypi version](https://img.shields.io/pypi/v/py-data-juicer?color=026cad)](https://pypi.org/project/py-data-juicer)
+[![Docker version](https://img.shields.io/docker/v/datajuicer/data-juicer?label=Docker&color=498bdf)](https://hub.docker.com/r/datajuicer/data-juicer)
 [![Document_List](https://img.shields.io/badge/Docs-English-blue?logo=Markdown)](README.md#documentation)
 [![文档列表](https://img.shields.io/badge/文档-中文-blue?logo=Markdown)](README_ZH.md#documentation)
 [![API Reference](https://img.shields.io/badge/Docs-API_Reference-blue?logo=Markdown)](https://alibaba.github.io/data-juicer/)
+
 [![ModelScope-10+ Demos](https://img.shields.io/badge/ModelScope-10+_Demos-4e29ff.svg?logo=data:image/svg+xml;base64,PHN2ZyB2aWV3Qm94PSIwIDAgMjI0IDEyMS4zMyIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KCTxwYXRoIGQ9Im0wIDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtOTkuMTQgNzMuNDloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xNzYuMDkgOTkuMTRoLTI1LjY1djIyLjE5aDQ3Ljg0di00Ny44NGgtMjIuMTl6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTEyNC43OSA0Ny44NGgyNS42NXYyNS42NWgtMjUuNjV6IiBmaWxsPSIjMzZjZmQxIiAvPgoJPHBhdGggZD0ibTAgMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xOTguMjggNDcuODRoMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xOTguMjggMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xNTAuNDQgMHYyMi4xOWgyNS42NXYyNS42NWgyMi4xOXYtNDcuODR6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTczLjQ5IDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiMzNmNmZDEiIC8+Cgk8cGF0aCBkPSJtNDcuODQgMjIuMTloMjUuNjV2LTIyLjE5aC00Ny44NHY0Ny44NGgyMi4xOXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtNDcuODQgNzMuNDloLTIyLjE5djQ3Ljg0aDQ3Ljg0di0yMi4xOWgtMjUuNjV6IiBmaWxsPSIjNjI0YWZmIiAvPgo8L3N2Zz4K)](#demos)
 [![ModelScope-20+_Refined_Datasets](https://img.shields.io/badge/ModelScope-20+_Refined_Datasets-4e29ff.svg?logo=data:image/svg+xml;base64,PHN2ZyB2aWV3Qm94PSIwIDAgMjI0IDEyMS4zMyIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KCTxwYXRoIGQ9Im0wIDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtOTkuMTQgNzMuNDloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xNzYuMDkgOTkuMTRoLTI1LjY1djIyLjE5aDQ3Ljg0di00Ny44NGgtMjIuMTl6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTEyNC43OSA0Ny44NGgyNS42NXYyNS42NWgtMjUuNjV6IiBmaWxsPSIjMzZjZmQxIiAvPgoJPHBhdGggZD0ibTAgMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xOTguMjggNDcuODRoMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xOTguMjggMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xNTAuNDQgMHYyMi4xOWgyNS42NXYyNS42NWgyMi4xOXYtNDcuODR6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTczLjQ5IDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiMzNmNmZDEiIC8+Cgk8cGF0aCBkPSJtNDcuODQgMjIuMTloMjUuNjV2LTIyLjE5aC00Ny44NHY0Ny44NGgyMi4xOXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtNDcuODQgNzMuNDloLTIyLjE5djQ3Ljg0aDQ3Ljg0di0yMi4xOWgtMjUuNjV6IiBmaWxsPSIjNjI0YWZmIiAvPgo8L3N2Zz4K)](https://modelscope.cn/datasets?organization=Data-Juicer&page=1)
-
 [![QualityClassifier](https://img.shields.io/badge/Tools-Quality_Classifier-saddlebrown?logo=Markdown)](tools/quality_classifier/README.md)
 [![AutoEvaluation](https://img.shields.io/badge/Tools-Auto_Evaluation-saddlebrown?logo=Markdown)](tools/evaluator/README.md)
 

README_ZH.md

@@ -9,12 +9,14 @@
 ![](https://img.shields.io/badge/license-Apache--2.0-000000.svg)
 [![Contributing](https://img.shields.io/badge/Contribution-welcome-brightgreen.svg)](docs/DeveloperGuide_ZH.md)
 
+[![pypi version](https://img.shields.io/pypi/v/py-data-juicer?color=026cad)](https://pypi.org/project/py-data-juicer)
+[![Docker version](https://img.shields.io/docker/v/datajuicer/data-juicer?label=Docker&color=498bdf)](https://hub.docker.com/r/datajuicer/data-juicer)
 [![Document_List](https://img.shields.io/badge/Docs-English-blue?logo=Markdown)](README.md#documentation)
 [![文档列表](https://img.shields.io/badge/文档-中文-blue?logo=Markdown)](README_ZH.md#documentation)
 [![API Reference](https://img.shields.io/badge/Docs-API_Reference-blue?logo=Markdown)](https://alibaba.github.io/data-juicer/)
+
 [![ModelScope-10+ Demos](https://img.shields.io/badge/ModelScope-10+_Demos-4e29ff.svg?logo=data:image/svg+xml;base64,PHN2ZyB2aWV3Qm94PSIwIDAgMjI0IDEyMS4zMyIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KCTxwYXRoIGQ9Im0wIDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtOTkuMTQgNzMuNDloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xNzYuMDkgOTkuMTRoLTI1LjY1djIyLjE5aDQ3Ljg0di00Ny44NGgtMjIuMTl6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTEyNC43OSA0Ny44NGgyNS42NXYyNS42NWgtMjUuNjV6IiBmaWxsPSIjMzZjZmQxIiAvPgoJPHBhdGggZD0ibTAgMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xOTguMjggNDcuODRoMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xOTguMjggMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xNTAuNDQgMHYyMi4xOWgyNS42NXYyNS42NWgyMi4xOXYtNDcuODR6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTczLjQ5IDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiMzNmNmZDEiIC8+Cgk8cGF0aCBkPSJtNDcuODQgMjIuMTloMjUuNjV2LTIyLjE5aC00Ny44NHY0Ny44NGgyMi4xOXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtNDcuODQgNzMuNDloLTIyLjE5djQ3Ljg0aDQ3Ljg0di0yMi4xOWgtMjUuNjV6IiBmaWxsPSIjNjI0YWZmIiAvPgo8L3N2Zz4K)](#demos)
 [![ModelScope-20+_Refined_Datasets](https://img.shields.io/badge/ModelScope-20+_Refined_Datasets-4e29ff.svg?logo=data:image/svg+xml;base64,PHN2ZyB2aWV3Qm94PSIwIDAgMjI0IDEyMS4zMyIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KCTxwYXRoIGQ9Im0wIDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtOTkuMTQgNzMuNDloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xNzYuMDkgOTkuMTRoLTI1LjY1djIyLjE5aDQ3Ljg0di00Ny44NGgtMjIuMTl6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTEyNC43OSA0Ny44NGgyNS42NXYyNS42NWgtMjUuNjV6IiBmaWxsPSIjMzZjZmQxIiAvPgoJPHBhdGggZD0ibTAgMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xOTguMjggNDcuODRoMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzYyNGFmZiIgLz4KCTxwYXRoIGQ9Im0xOTguMjggMjIuMTloMjUuNjV2MjUuNjVoLTI1LjY1eiIgZmlsbD0iIzM2Y2ZkMSIgLz4KCTxwYXRoIGQ9Im0xNTAuNDQgMHYyMi4xOWgyNS42NXYyNS42NWgyMi4xOXYtNDcuODR6IiBmaWxsPSIjNjI0YWZmIiAvPgoJPHBhdGggZD0ibTczLjQ5IDQ3Ljg0aDI1LjY1djI1LjY1aC0yNS42NXoiIGZpbGw9IiMzNmNmZDEiIC8+Cgk8cGF0aCBkPSJtNDcuODQgMjIuMTloMjUuNjV2LTIyLjE5aC00Ny44NHY0Ny44NGgyMi4xOXoiIGZpbGw9IiM2MjRhZmYiIC8+Cgk8cGF0aCBkPSJtNDcuODQgNzMuNDloLTIyLjE5djQ3Ljg0aDQ3Ljg0di0yMi4xOWgtMjUuNjV6IiBmaWxsPSIjNjI0YWZmIiAvPgo8L3N2Zz4K)](#data-recipes)
-
 [![QualityClassifier](https://img.shields.io/badge/Tools-Quality_Classifier-saddlebrown?logo=Markdown)](tools/quality_classifier/README_ZH.md)
 [![AutoEvaluation](https://img.shields.io/badge/Tools-Auto_Evaluation-saddlebrown?logo=Markdown)](tools/evaluator/README_ZH.md)