Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Single and Multi-Model Evaluation #3

Open
Koon-Kiat opened this issue Oct 25, 2024 · 0 comments
Open

Update Single and Multi-Model Evaluation #3

Koon-Kiat opened this issue Oct 25, 2024 · 0 comments
Assignees
Labels
bug Something isn't working enhancement New feature or request

Comments

@Koon-Kiat
Copy link
Owner

Koon-Kiat commented Oct 25, 2024

Update Single and Multi-Model Evaluation

Description

This enhancement involves updating the single and multi-model evaluation process to improve structure and functionality. Modularizing the code will help with maintainability, and fixing any identified bugs will improve accuracy.

Motivation

Modularizing the evaluation code allows for better readability, more straightforward debugging, and easier future expansion. This enhancement will ensure more accurate results and a streamlined evaluation process.

Key Changes

  • Separate the single-model and multi-model evaluation processes into distinct functions.
  • Introduce better configuration options to select models for evaluation.
  • Add documentation and examples for using these evaluation functions.

Alternatives Considered

  • Retaining the current structure but adding comments and minor tweaks for clarity.
  • Using an external library for evaluation, though it might not fully align with the project’s requirements.

Additional Context

This enhancement addresses issue #3 and supports future scalability. Related improvements include documentation updates for both evaluation functions and any new metrics added.

@Koon-Kiat Koon-Kiat added bug Something isn't working enhancement New feature or request labels Oct 25, 2024
@Koon-Kiat Koon-Kiat self-assigned this Oct 25, 2024
@Koon-Kiat Koon-Kiat changed the title Update single and multi model evaluation Update Single and Multi-Model Evaluation Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant