Pinned Loading

1. tiny-assistant tiny-assistant Public

   Experimenting with smaller LLMs that can run on commodity hardware like Raspberry Pi as personal assistant

   Python 7 1

2. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++ 9.1k 1k

3. NVIDIA/ChatRTX NVIDIA/ChatRTX Public

   A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

   TypeScript 2.9k 370