New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ms-swift对于mPLUG-Owl2和mPLUG-Owl2.1微调(finetune)的支持 #217

Open

Jintao-Huang opened this issue Apr 15, 2024 · 0 comments

Jintao-Huang commented Apr 15, 2024

mPLUG-Owl仓库本身已经提供了非常优秀的微调脚本: https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2/scripts.

ms-swift多模态大模型微调框架集成了mPLUG-Owl2和mPLUG-Owl2.1的推理与微调, 并书写了最佳实践:
https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/mplug-owl2%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

如果有感兴趣的小伙伴, 可以来使用😊

The mPLUG-Owl2 repository itself provides excellent fine-tuning scripts: https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2/scripts.

The ms-swift multimodal large model fine-tuning framework integrates the inference and fine-tuning of mPLUG-Owl2 and mPLUG-Owl2.1, and documents the best practices:
https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/mplug-owl2%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

If any interested individuals, feel free to use it! 😊

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment