Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MM] mmc42dj & dj2mmc4 tools #62

Closed
HYLcool opened this issue Nov 2, 2023 · 0 comments · Fixed by #91
Closed

[MM] mmc42dj & dj2mmc4 tools #62

HYLcool opened this issue Nov 2, 2023 · 0 comments · Fixed by #91
Assignees
Labels
dj:multimodal issues/PRs about multimodal data processing enhancement New feature or request

Comments

@HYLcool
Copy link
Collaborator

HYLcool commented Nov 2, 2023

There are diverse formats for multimodal datasets. So we provide several format conversion tools, which convert original datasets to the Data-Juicer intermediate format and convert them back. Data-Juicer will accept datasets in Data-Juicer format and process them.

Here we add tools for converting MMC4-like dataset to the target dataset in Data-Juicer format and reverse first. Other formats will be supported in the future.

@HYLcool HYLcool converted this from a draft issue Nov 2, 2023
@HYLcool HYLcool added enhancement New feature or request dj:multimodal issues/PRs about multimodal data processing labels Nov 2, 2023
@HYLcool HYLcool added this to the Multimodal Support milestone Nov 2, 2023
@HYLcool HYLcool self-assigned this Nov 16, 2023
@HYLcool HYLcool moved this from MM-TODO to In Progress in data-juicer Nov 21, 2023
@HYLcool HYLcool linked a pull request Nov 21, 2023 that will close this issue
@github-project-automation github-project-automation bot moved this from In Progress to Done in data-juicer Nov 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dj:multimodal issues/PRs about multimodal data processing enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant