Code

[do-not-merge] Ibm 20241219#267

Code

Open

fialhocoelho wants to merge 26 commits intomainopendatahub-io/vllm:mainfrom ibm-20241219opendatahub-io/vllm:ibm-20241219Copy head branch name to clipboard

+5,461-1,734

Commits

Commits on Dec 18, 2024

• [Bugfix] Set temperature=0.7 in test_guided_choice_chat (vllm-project#11264)

  mgoin

  authored
  c77eb8a

• [V1] Prefix caching for vision language models (vllm-project#11187)

  Show description for bf8717e
  comaniac

  authored
  bf8717e

• [Bugfix] Restore support for larger block sizes (vllm-project#11259)

  Show description for 866fa45
  kzawora-intel

  authored
  866fa45

• [Bugfix] Fix guided decoding with tokenizer mode mistral (vllm-project#11046)

  wallashss

  authored
  8b79f9e

• [MISC][XPU]update ipex link for CI fix (vllm-project#11278)

  yma11

  authored
  f04e407

• [Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (vllm-project#10995)

  Show description for 60508ff
  

  5 peopleauthored
  60508ff

• [Bugfix] Fix broken phi3-v mm_processor_kwargs tests (vllm-project#11263)

  Show description for 996aa70
  Isotr0py

  authored
  996aa70

• [CI][Misc] Remove Github Action Release Workflow (vllm-project#11274)

  simon-mo

  authored
  362cff1

• [FIX] update openai version (vllm-project#11287)

  Show description for f954fe0
  jikunshang

  authored
  f954fe0

• [Bugfix] fix minicpmv test (vllm-project#11304)

  Show description for ca5f54a
  joerunde

  authored
  ca5f54a

• [V1] VLM - enable processor cache by default (vllm-project#11305)

  Show description for fdea8ec
  alexm-neuralmagic

  authored
  fdea8ec

Commits on Dec 19, 2024

• [Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (vllm-project#11311)

  Show description for 5a9da2e
  tlrmchlsmth

  authored
  5a9da2e

• [Model] IBM Granite 3.1 (vllm-project#11307)

  Show description for 17ca964
  tjohnson31415

  authored
  17ca964

• [CI] Expand test_guided_generate to test all backends (vllm-project#11313)

  Show description for a30482f
  mgoin

  authored
  a30482f

• [V1] Simplify prefix caching logic by removing num_evictable_computed_blocks (vllm-project#11310)

  heheda12345

  authored
  c6b0a7d

• [VLM] Merged multimodal processor for Qwen2-Audio (vllm-project#11303)

  Show description for 6142ef0
  DarkLight1337

  authored
  6142ef0

• [Kernel] Refactor Cutlass c3x (vllm-project#10049)

  Show description for 8936316
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  8936316

• [Misc] Optimize ray worker initialization time (vllm-project#11275)

  Show description for f26c4ae
  

  ruisearch42

  and

  comaniac

  authored
  f26c4ae

• [misc] benchmark_throughput : Add LoRA (vllm-project#11267)

  Show description for 9835673
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  9835673

• [Feature] Add load generation config from model (vllm-project#11164)

  Show description for 5aef498
  

  liuyanyi

  and

  DarkLight1337

  authored
  5aef498

• [Bugfix] Cleanup Pixtral HF code (vllm-project#11333)

  Show description for a0f7d53
  DarkLight1337

  authored
  a0f7d53

• [Model] Add JambaForSequenceClassification model (vllm-project#10860)

  Show description for 6c7f881
  

  3 peopleauthored
  6c7f881

• Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-20241219

  fialhocoelho

  committed
  d45405a

• Squash 6357

  Show description for 5e5307e
  fialhocoelho

  committed
  5e5307e

• Squash 10235

  Show description for e362236
  fialhocoelho

  committed
  e362236

• install adapter for 0.6.5 and PR#196 for adapter

  Show description for 27fe49e
  

  2 peopleauthored and

  fialhocoelho

  committed
  27fe49e