Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sync with 0.6.4.post1 #235

Merged
merged 418 commits into from
Nov 27, 2024
Merged

sync with 0.6.4.post1 #235

merged 418 commits into from
Nov 27, 2024

Conversation

dtrifiro
Copy link

youkaichao and others added 30 commits October 30, 2024 16:34
@youkaichao
[torch.compile] upgrade tests (vllm-project#9858)
64384bb 
Signed-off-by: youkaichao <[email protected]>
@gcalmettes
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_to…
abbfb61 
…kens field for chat completion endpoint (vllm-project#9837)
@khluu
Revert "[Bugfix] Use host argument to bind to interface (vllm-project…
890ca36 
…#9798)" (vllm-project#9852)
@mgoin
[Model] Support quantization of Qwen2VisionTransformer (vllm-project#…
d087bf8 
…9817)

Signed-off-by: mgoin <[email protected]>
@ywang96
[Misc] Remove deprecated arg for cuda graph capture (vllm-project#9864)
3ea2dc2 
Signed-off-by: Roger Wang <[email protected]>
@jeejeelee
[Doc] Update Qwen documentation (vllm-project#9869)
5608e61
@alex-jw-brooks @DarkLight1337
[CI/Build] Add Model Tests for Qwen2-VL (vllm-project#9846)
16b8f7a 
Signed-off-by: Alex-Brooks <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
Co-authored-by: DarkLight1337 <[email protected]>
@Alexei-V-Ivanov-AMD
[CI/Build] Adding a forced docker system prune to clean up space (vll…
77f7ef2 
…m-project#9849)
@sasha0552
[Bugfix] Fix illegal memory access error with chunked prefill, pref…
55650c8 
…ix caching, block manager v2 and xformers enabled together (vllm-project#9532)

Signed-off-by: sasha0552 <[email protected]>
@mzusman
[BugFix][Kernel] Fix Illegal memory access in causal_conv1d in H100 (v…
9fb12f7 
…llm-project#9838)

Signed-off-by: mzusman <[email protected]>
@khluu
[ci/build] Configure dependabot to update pip dependencies (vllm-proj…
b63c64d 
…ect#9811)

Signed-off-by: kevin <[email protected]>
@joerunde
[Bugfix][Frontend] Reject guided decoding in multistep mode (vllm-pro…
031a799 
…ject#9892)

Signed-off-by: Joe Runde <[email protected]>
@youkaichao
[torch.compile] directly register custom op (vllm-project#9896)
96e0c9c 
Signed-off-by: youkaichao <[email protected]>
@mgoin
[Bugfix] Fix layer skip logic with bitsandbytes (vllm-project#9887)
37a4947 
Signed-off-by: mgoin <[email protected]>
@youkaichao
[torch.compile] rework test plans (vllm-project#9866)
566cd27 
Signed-off-by: youkaichao <[email protected]>
@mgoin
[Model] Support bitsandbytes for MiniCPMV (vllm-project#9891)
93a76dd 
Signed-off-by: mgoin <[email protected]>
@CRZbulabula @youkaichao
[torch.compile] Adding torch compile annotations to some models (vllm…
2b5bf20 
…-project#9876)

Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@DarkLight1337
[Doc] Update multi-input support (vllm-project#9906)
d3aa2a8
@DarkLight1337
[Frontend] Chat-based Embeddings API (vllm-project#9759)
06386a6
@mgoin
[CI/Build] Add Model Tests for PixtralHF (vllm-project#9813)
30a2e80
@DarkLight1337
[Frontend] Use a proper chat template for VLM2Vec (vllm-project#9912)
ba0d892
@tjohnson31415 @prashantgupta24 @patrickvonplaten
[Bugfix] Fix edge cases for MistralTokenizer (vllm-project#9625)
1dd4cb2 
Signed-off-by: Travis Johnson <[email protected]>
Signed-off-by: Prashant Gupta <[email protected]>
Co-authored-by: Prashant Gupta <[email protected]>
Co-authored-by: Patrick von Platen <[email protected]>
@andrejonasson
[Core] Refactor: Clean up unused argument in Scheduler._preempt (vllm…
4581d2c 
…-project#9696)

Signed-off-by: André Jonasson <[email protected]>
@youkaichao
[torch.compile] use interpreter with stable api from pytorch (vllm-pr…
aff1fd8 
…oject#9889)

Signed-off-by: youkaichao <[email protected]>
@pavanimajety
[Bugfix/Core] Flashinfer k_scale and v_scale (vllm-project#9861)
598b6d7
@youkaichao
[1/N] pass the complete config from engine to executor (vllm-project#…
18bd758 
…9933)

Signed-off-by: youkaichao <[email protected]>
@GeneDer
[Bugfix] PicklingError on RayTaskError (vllm-project#9934)
27cd36e 
Signed-off-by: Gene Su <[email protected]>
@dependabot @khluu
[ci/build] Bump the patch-update group with 10 updates (vllm-project#…
d151fde 
…9897)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <[email protected]>
@petersalas
[Core][VLM] Add precise multi-modal placeholder tracking (vllm-projec…
6c0b7f5 
…t#8346)

Signed-off-by: Peter Salas <[email protected]>
@khluu
[ci/build] Have dependabot ignore pinned dependencies (vllm-project#9935
d522034 
)

Signed-off-by: kevin <[email protected]>
patrickvonplaten and others added 17 commits November 15, 2024 00:42
@patrickvonplaten
[Tool parsing] Improve / correct mistral tool parsing (vllm-project#1…
11cd1ae 
…0333)
@DarkLight1337
[Bugfix] Fix unable to load some models (vllm-project#10312)
972112d 
Signed-off-by: DarkLight1337 <[email protected]>
@ProExpertProg @danieldk
[bugfix] Fix static asymmetric quantization case (vllm-project#10334)
bf2ddc6 
Signed-off-by: Daniël de Kok <[email protected]>
Signed-off-by: luka <[email protected]>
Co-authored-by: Daniël de Kok <[email protected]>
@tlrmchlsmth
[Misc] Change RedundantReshapesPass and FusionPass logging from info …
2885ba0 
…to debug (vllm-project#10308)

Signed-off-by: Tyler Michael Smith <[email protected]>
@DarkLight1337
[Model] Support Qwen2 embeddings and use tags to select model tests (v…
b40cf64 
…llm-project#10184)
@skylee-01
[Bugfix] Qwen-vl output is inconsistent in speculative decoding (vllm…
2ec8827 
…-project#10350)
@DarkLight1337
[Misc] Consolidate pooler config overrides (vllm-project#10351)
2ac6d0e 
Signed-off-by: DarkLight1337 <[email protected]>
@simon-mo
[Build] skip renaming files for release wheels pipeline (vllm-project…
02dbf30 
…#9671)

Signed-off-by: simon-mo <[email protected]>
@wchen61
Add default value to avoid Falcon crash (vllm-project#5363) (vllm-pro…
3d158cd 
…ject#10347)

Signed-off-by: wchen61 <[email protected]>
@DarkLight1337
[Misc] Fix import error in tensorizer tests and cleanup some code (vl…
b311efd 
…lm-project#10349)

Signed-off-by: DarkLight1337 <[email protected]>
@xyang16
[Doc] Remove float32 choice from --lora-dtype (vllm-project#10348)
2690855 
Signed-off-by: Xin Yang <[email protected]>
@jeejeelee
[Bugfix] Fix fully sharded LoRA bug (vllm-project#10352)
1d65ec7 
Signed-off-by: Jee Jee Li <[email protected]>
@ShangmingCai
[Misc] Fix some help info of arg_utils to improve readability (vllm-p…
f2056f7 
…roject#10362)
@youkaichao
[core][misc] keep compatibility for old-style classes (vllm-project#1…
3a763ba 
…0356)

Signed-off-by: youkaichao <[email protected]>
@gcalmettes
[Bugfix] Ensure special tokens are properly filtered out for guided s…
691a3ec 
…tructured output with MistralTokenizer (vllm-project#10363)

Signed-off-by: Guillaume Calmettes <[email protected]>
@ElizaWszola
[Misc] Bump up test_fused_moe tolerance (vllm-project#10364)
79ee45b 
Signed-off-by: ElizaWszola <[email protected]>
@simon-mo
[Misc] bump mistral common version (vllm-project#10367)
a6221a1 
Signed-off-by: simon-mo <[email protected]>
@dtrifiro dtrifiro requested a review from njhill as a code owner November 20, 2024 10:40
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Nov 20, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dtrifiro

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@dtrifiro dtrifiro mentioned this pull request Nov 20, 2024
Merged
3 tasks
@dtrifiro
Copy link
Author

/hold

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Nov 20, 2024

@dtrifiro: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 76fabc6 link true /test smoke-test
ci/prow/cuda-pr-image-mirror 76fabc6 link true /test cuda-pr-image-mirror
ci/prow/images 76fabc6 link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@dtrifiro dtrifiro force-pushed the sync-with-0.6.4.post1 branch from 76fabc6 to 9a3f1ac Compare November 27, 2024 12:57
@dtrifiro dtrifiro merged commit 86932d7 into opendatahub-io:main Nov 27, 2024
2 of 5 checks passed
@dtrifiro dtrifiro deleted the sync-with-0.6.4.post1 branch November 27, 2024 12:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@heyselbi heyselbi Awaiting requested review from heyselbi

@vaibhavjainwiz vaibhavjainwiz Awaiting requested review from vaibhavjainwiz

Assignees
No one assigned
Labels
approved do-not-merge/hold
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.