Code

Litserve 0.2.5#1866

Code

Draft

craigpfeifer wants to merge 12 commits intomainLightning-AI/litgpt:mainfrom litserve-0.2.5Lightning-AI/litgpt:litserve-0.2.5Copy head branch name to clipboard

+23-6

Commits

Commits on Dec 8, 2024

• WIP : enable openai API and embeddings spec from litpgt commandline

  craigpfeifer

  committed
  2d2d869

Commits on Dec 9, 2024

• testing litserv 0.2.5

  craigpfeifer

  committed
  ab02c8a

• dump changes from openai branch

  craigpfeifer

  committed
  6bbd297

Commits on Dec 13, 2024

• fix: add missing"," (#1855)

  Show description for 70174e8
  

  2 peopleauthored and

  craigpfeifer

  committed
  70174e8

• fix llama3.3 readme url (#1862)

  

  ysjprojects

  authored and

  craigpfeifer

  committed
  04fc625

Commits on Dec 15, 2024

• set devices to 0, default is 1 which fails when no GPU device available

  craigpfeifer

  committed
  f5004ec

• fix checkpoint dir

  craigpfeifer

  committed
  5e68f2e

• tweak devices param

  craigpfeifer

  committed
  6e6329e

• added assert for pytorch model file

  craigpfeifer

  committed
  1122880

• increased sleep time

  craigpfeifer

  committed
  3910794

• increased server start up time

  craigpfeifer

  committed
  edb8148

• adding debug logging

  craigpfeifer

  committed
  a4eecb6