Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do-not-merge] Ibm 20241218 #266

Closed
wants to merge 413 commits into from
Closed

[do-not-merge] Ibm 20241218 #266

wants to merge 413 commits into from

Conversation

fialhocoelho
Copy link

build internal image

tlrmchlsmth and others added 30 commits November 26, 2024 22:55
@tlrmchlsmth
[Kernel] Remove if-else with identical branches in marlin 2:4 (vllm-p…
e225110 
…roject#10687)

Signed-off-by: Tyler Michael Smith <[email protected]>
@shunxing12345 @Isotr0py
[Model] Support telechat2 (vllm-project#10311)
1209261 
Signed-off-by: Isotr0py <[email protected]>
Co-authored-by: xiangw2 <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
@bigPYJ1151
[Bugfix][Hardware][CPU] Fix intel-omp version to avoid segfault (vllm…
418cb3b 
…-project#10700)

Signed-off-by: jiang1.li <[email protected]>
@ywang96
[V1] Update interface for mistral-format Pixtral (vllm-project#10703)
9e0a147 
Signed-off-by: Roger Wang <[email protected]>
@youkaichao
[ci] fix slow tests (vllm-project#10698)
308cc5e 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[torch.compile] fix shape specialization (vllm-project#10722)
c411def 
Signed-off-by: youkaichao <[email protected]>
@Isotr0py
[Bugfix] Fix GGUF inference with FP16 unquantized checkpoint (vllm-pr…
b98c62b 
…oject#10675)

Signed-off-by: Isotr0py <[email protected]>
@mzusman
[Bugfix][Mamba] Fix Multistep on Mamba-like models (vllm-project#10705)
197b448 
Signed-off-by: mzusman <[email protected]>
@DarkLight1337
[Bugfix] Ignore lm_head when loading embedding models (vllm-project…
9b4b150 
…#10719)

Signed-off-by: DarkLight1337 <[email protected]>
@tomeras91
[Frontend] don't block event loop in tokenization (preprocess) in Ope…
395b1c7 
…nAI compatible server (vllm-project#10635)

Signed-off-by: Tomer Asida <[email protected]>
@youkaichao
[misc] upgrade filelock version (vllm-project#10731)
cb4e1c3 
Signed-off-by: youkaichao <[email protected]>
@zixuanzhang226
[Model] support bitsandbytes quantization with minicpm3 model (vllm-p…
70dc14f 
…roject#10682)

Signed-off-by: Ubuntu <[email protected]>
@spacewander
[Doc] Update model in arch_overview.rst to match comment (vllm-projec…
278be67 
…t#10701)

Signed-off-by: spacewander <[email protected]>
@rickyyx
[Bug][CLI] Allow users to disable prefix caching explicitly (vllm-pro…
d9b4b3f 
…ject#10724)

Signed-off-by: rickyx <[email protected]>
@WoosukKwon
[V1] Do not allocate beyond the max_model_len (vllm-project#10730)
a79b122 
Signed-off-by: Woosuk Kwon <[email protected]>
@WoosukKwon
[Kernel] Update vllm-flash-attn version (vllm-project#10736)
9a8bff0 
Signed-off-by: Woosuk Kwon <[email protected]>
@richardsliu
[TPU] Update requirements-tpu (vllm-project#10726)
3ed5e73 
Signed-off-by: Richard Liu <[email protected]>
@sixsixcoder @Isotr0py @DarkLight1337
[Model] Added GLM-4 series hf format model support vllm==0.6.4 (vllm-…
5fc5ce0 
…project#10561)

Signed-off-by: Isotr0py <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
@WoosukKwon
[Kernel] Update vllm-flash-attn version to reduce CPU overheads (vllm…
8c1e77f 
…-project#10742)

Signed-off-by: Woosuk Kwon <[email protected]>
@WoosukKwon
[V1] Optimize the CPU overheads in FlashAttention custom op (vllm-pro…
98f47f2 
…ject#10733)

Signed-off-by: Woosuk Kwon <[email protected]>
@Isotr0py
[Model] Add Internlm2 LoRA support (vllm-project#5064)
c83919c 
Signed-off-by: Isotr0py <[email protected]>
@DarkLight1337
[Model] Clean up MiniCPMV (vllm-project#10751)
fa6ecb9 
Signed-off-by: DarkLight1337 <[email protected]>
@noooop
[Misc] typo find in sampling_metadata.py (vllm-project#10740)
c82b432
@jeejeelee
[Bugfix] Fix Idefics3 bug (vllm-project#10778)
3132aac 
Signed-off-by: Jee Jee Li <[email protected]>
@wangxiyuan
[platform] Add verify_quantization in platform. (vllm-project#10757)
661175b 
Signed-off-by: wangxiyuan <[email protected]>
@NickLucche @DarkLight1337
[Bugfix] Fix OpenVino/Neuron driver_worker init (vllm-project#10779)
40bc242 
Signed-off-by: NickLucche <[email protected]>
Signed-off-by: Cyrus Leung <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
@Isotr0py
[Model] Refactor Molmo weights loading to use AutoWeightsLoader (vllm…
16ee07f 
…-project#10771)

Signed-off-by: Isotr0py <[email protected]>
@patrickvonplaten @youkaichao
[Interleaved ATTN] Support for Mistral-8B (vllm-project#10591)
e7cfc4e 
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@wangxiyuan
[doc] format fix (vllm-project#10789)
7e4bbda 
Signed-off-by: wangxiyuan <[email protected]>
@DarkLight1337
[Model] Replace embedding models with pooling adapter (vllm-project#1…
1337071 
…0769)

Signed-off-by: DarkLight1337 <[email protected]>
wangxiyuan and others added 20 commits December 16, 2024 22:11
@wangxiyuan
[Platform] platform agnostic for EngineArgs initialization (vllm-proj…
e88db68 
…ect#11225)

Signed-off-by: wangxiyuan <[email protected]>
@tlrmchlsmth
[V1][Core] Use weakref.finalize instead of atexit (vllm-project#11242)
2bfdbf2 
Signed-off-by: Tyler Michael Smith <[email protected]>
@ywang96 @BBuf
[Misc] Kernel Benchmark for RMSNorm (vllm-project#11241)
02222a0 
Signed-off-by: Roger Wang <[email protected]>
Co-authored-by: Xiaoyu Zhang <[email protected]>
@Isotr0py
[Misc] Allow passing logits_soft_cap for xformers backend (vllm-proje…
f9ecbb1 
…ct#11252)

Signed-off-by: Isotr0py <[email protected]>
@joerunde
[Bugfix] Fix request cancellation without polling (vllm-project#11190)
2d1b9ba
@mgoin
[Bugfix] Set temperature=0.7 in test_guided_choice_chat (vllm-project…
c77eb8a 
…#11264)
@comaniac
[V1] Prefix caching for vision language models (vllm-project#11187)
bf8717e 
Signed-off-by: Cody Yu <[email protected]>
@kzawora-intel
[Bugfix] Restore support for larger block sizes (vllm-project#11259)
866fa45 
Signed-off-by: Konrad Zawora <[email protected]>
@wallashss
[Bugfix] Fix guided decoding with tokenizer mode mistral (vllm-projec…
8b79f9e 
…t#11046)
@yma11
[MISC][XPU]update ipex link for CI fix (vllm-project#11278)
f04e407
@dsikka @Faraz9877
@ilmarkov @rahul-tuli @robertgshaw2-neuralmagic
[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (vllm-project…
60508ff 
…#10995)

Co-authored-by: Faraz Shahsavan <[email protected]>
Co-authored-by: ilmarkov <[email protected]>
Co-authored-by: Rahul Tuli <[email protected]>
Co-authored-by: [email protected] <[email protected]>
@Isotr0py
[Bugfix] Fix broken phi3-v mm_processor_kwargs tests (vllm-project#11263
996aa70 
)

Signed-off-by: Isotr0py <[email protected]>
@simon-mo
[CI][Misc] Remove Github Action Release Workflow (vllm-project#11274)
362cff1
@jikunshang
[FIX] update openai version (vllm-project#11287)
f954fe0 
Signed-off-by: Kunshang Ji <[email protected]>
@joerunde
[Bugfix] fix minicpmv test (vllm-project#11304)
ca5f54a 
Signed-off-by: Joe Runde <[email protected]>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
c75f396 
…20241218

Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 6357
f428215 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 11307
d279a64 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10647
11ed70e 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10235
24c996d 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho fialhocoelho self-assigned this Dec 18, 2024
@fialhocoelho fialhocoelho requested a review from njhill as a code owner December 18, 2024 21:13
@openshift-ci openshift-ci bot requested review from heyselbi and Xaenalt December 18, 2024 21:13
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 18, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign xaenalt for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 19, 2024

@fialhocoelho: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 5f1698f link true /test smoke-test
ci/prow/images 5f1698f link true /test images
ci/prow/rocm-pr-image-mirror 5f1698f link true /test rocm-pr-image-mirror

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@heyselbi heyselbi Awaiting requested review from heyselbi

@Xaenalt Xaenalt Awaiting requested review from Xaenalt

Assignees

@fialhocoelho fialhocoelho

Labels
do-not-merge/hold
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.