Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 32.2k 4.9k

2. letta-ai/letta letta-ai/letta Public

   Letta (formerly MemGPT) is a framework for creating LLM services with memory.

   Python 13.4k 1.5k

3. skypilot skypilot Public

   Forked from skypilot-org/skypilot

   SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

   Python

4. rohitravi2001/RooMe rohitravi2001/RooMe Public

   TypeScript