Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add LLM Router component using OpenRouter specs #5475

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

raphaelchristi
Copy link
Contributor

Description

This PR adds a new LLM Router component that intelligently routes queries to the most appropriate language model based on OpenRouter specifications and task requirements.

Features

  • Automatic model specification fetching from OpenRouter API
  • Dynamic model selection based on task complexity and requirements
  • Multiple optimization modes (quality, speed, cost, balanced)
  • Robust error handling with fallback mechanisms

Usage

  1. Connect multiple LLM models to the router
  2. Add a judge LLM for selection
  3. Provide input message
  4. Select optimization preference
  5. Router will automatically select and use the most appropriate model

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Dec 28, 2024
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Dec 28, 2024
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Dec 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant