Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roadmap: Engines are dylibs and are self-contained #1732

Open
1 of 3 tasks
freelerobot opened this issue Nov 27, 2024 · 0 comments
Open
1 of 3 tasks

roadmap: Engines are dylibs and are self-contained #1732

freelerobot opened this issue Nov 27, 2024 · 0 comments
Assignees
@namchuai
Labels
category: engine management Related to engine abstraction type: planning Opening up a discussion

Comments

@freelerobot
Copy link
Contributor

freelerobot commented Nov 27, 2024 •
edited by namchuai
Loading

Goal

  • Engines are modular and 3rd parties can add engines
  • Engine loading needs to be moved to engine repo (e.g. llamacpp-engine)
  • Engines can be registered dynamically, declaratively (e.g. .cortexrc)
  • Engines have clear and consistent interface

Tasklist

  • Refactor Engine Loading out of Cortex to engine extensions
  • .cortexrc can define engines
  • docs: how to build an Engine #1731
    • How to add a third party engine to Cortex (and Jan - optionally)
    • How to register an new engine for official distribution

PRs
@freelerobot freelerobot added the type: planning Opening up a discussion label Nov 27, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Jan & Cortex Nov 27, 2024
@freelerobot freelerobot added the category: engine management Related to engine abstraction label Nov 27, 2024
@freelerobot freelerobot moved this from Investigating to Planning in Jan & Cortex Nov 27, 2024
@gabrielle-ong gabrielle-ong mentioned this issue Nov 29, 2024
Closed
@dan-homebrew dan-homebrew changed the title planning: how to add an Engine planning: Engines are modular and can be added Dec 2, 2024
@dan-homebrew dan-homebrew changed the title planning: Engines are modular and can be added planning: Engines can be added dynamically and are modular Dec 2, 2024
@dan-homebrew dan-homebrew changed the title planning: Engines can be added dynamically and are modular planning: Engines can be added dynamically and are self-contained Dec 2, 2024
@dan-homebrew dan-homebrew changed the title planning: Engines can be added dynamically and are self-contained planning: Engines are dylibs and are self-contained Dec 2, 2024
@namchuai namchuai moved this from Planning to Scheduled in Jan & Cortex Dec 4, 2024
@namchuai namchuai moved this from Scheduled to In Progress in Jan & Cortex Dec 4, 2024
@namchuai namchuai moved this from In Progress to Eng Review in Jan & Cortex Dec 4, 2024
@dan-homebrew dan-homebrew changed the title planning: Engines are dylibs and are self-contained roadmap: Engines are dylibs and are self-contained Dec 12, 2024
@namchuai namchuai moved this from Eng Review to QA in Jan & Cortex Dec 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@namchuai namchuai

Labels
category: engine management Related to engine abstraction type: planning Opening up a discussion
Projects
Jan & Cortex
Status: QA
Milestone
No milestone
Development

No branches or pull requests
2 participants
@namchuai @freelerobot