Skip to content

0.3.3

Compare
Choose a tag to compare
@MaiziXiao MaiziXiao released this 30 Sep 08:58
· 71 commits to main since this release
22a4e76

🌟 OpenCompass v0.3.3 Release Log
The OpenCompass team is thrilled to announce the release of OpenCompass v0.3.3!

🚀 New Features

  • 🔧 Added support for the SciCode summarizer configuration.
  • 🛠 Introduced support for internal Followbench.
  • 🔧 Updated models and configurations for MathBench & WikiBench under FullBench.
  • 🛠 Enhanced support for OpenAI O1 models and Qwen2.5 Instruct.
  • 🔧 Included a postprocess function for custom models.
  • 🛠 Added InternTrain feature for broader model training scenarios.

📖 Documentation

  • 📚 Updated the README with the latest information on how to use OpenCompass effectively.

🐛 Bug Fixes

  • 🔧 Fixed issues with the link-check workflow and wildbench.
  • 🛠 Resolved errors in partitioning and corrected typos throughout the codebase.
  • 🔧 Addressed compatibility issues with lmdeploy interface type changes.
  • 🛠 Fixed the followbench dataset configuration and token settings.

⚙ Enhancements and Refactors

  • 🛠 Enhanced support for verbose output in OpenAI API interactions.
  • 🔧 Updated maximum output length configurations for multiple models.
  • 🛠 Improved handling of the "begin section" in meta_template for better parsing.
  • 🔧 Added a common summarizer for qabench and expanded test coverage for various models.

🎉 Welcome New Contributors
👋 We'd like to extend a warm welcome to our new contributors who have made their first contributions to OpenCompass:

Thank you to all our contributors for making this release possible!

Full Changelog: 0.3.2.post1...0.3.3