Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Add Model Version Comparison Tool #828

Open
6 tasks
plutore opened this issue Nov 30, 2024 · 3 comments
Open
6 tasks

[Feature Request] Add Model Version Comparison Tool #828

plutore opened this issue Nov 30, 2024 · 3 comments

Comments

@plutore
Copy link

plutore commented Nov 30, 2024

Overview

The current CSGHub platform would benefit from a model version comparison tool that allows users to easily compare different versions of the same model, including their performance metrics, parameters, and deployment configurations.

Current Behavior

  • Users need to manually check different model versions
  • No side-by-side comparison of model metrics
  • Difficult to track changes between versions

Proposed Solution

Add a comparison feature that would:

  • Show side-by-side comparisons of model versions
  • Display key differences in parameters and configurations
  • Visualize performance metrics between versions
  • Include a diff view for model cards and configuration files

User Benefits

  1. Faster decision-making when choosing model versions
  2. Better version control and tracking
  3. Easier identification of performance improvements
  4. Enhanced model governance

Technical Considerations

  • Integration with existing model management system
  • Database schema updates for storing comparison data
  • UI/UX changes in the frontend (Vue.js)
  • API endpoints for comparison functionality

Acceptance Criteria

  • Side-by-side comparison view implemented
  • Performance metrics visualization
  • Configuration diff viewer
  • Version history timeline
  • Export comparison results
  • API documentation updated

Additional Context

This feature aligns with CSGHub's goal of providing enterprise-level model management and would enhance the platform's compatibility with existing MLOps workflows.

Environment

  • CSGHub Version: 1.1.0
  • Deployment: On-premise
  • Browser: Latest Chrome/Firefox
@KinglyWayne
Copy link
Member

follow OpenCSGs/csghub-server#184

@samchen8008
Copy link

Welcome to contribute to this issue. We are delightful to see community contributions at this point. Are you willing to setup a call for this topic?

@samchen8008
Copy link

Let us know if you are ready to jump in call, thx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants