Popular repositories Loading

1. LookaheadDecoding LookaheadDecoding Public

   [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

   Python 1.2k 67

2. Consistency_LLM Consistency_LLM Public

   [ICML 2024] CLLMs: Consistency Large Language Models

   Python 358 18

3. MuxServe MuxServe Public

   Jupyter Notebook 46 3

4. vllm-ltr vllm-ltr Public

   [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

   Python 17 3

5. dsc204a-w24 dsc204a-w24 Public

   Website for DSC 204a, Winter 2024

   SCSS 8 27

6. dsc291-PA dsc291-PA Public

   Jupyter Notebook 2 2