Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Semi structured v2 #32

Open
wants to merge 39 commits into
base: main
Choose a base branch
from
Open

Semi structured v2 #32

wants to merge 39 commits into from

Commits on Nov 12, 2024

  1. [doc] fix location of runllm widget (vllm-project#10266) 

    Signed-off-by: youkaichao <[email protected]>
    @youkaichao
    youkaichao authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    96ae0ea View commit details
    Browse the repository at this point in the history

  2. [doc] improve debugging doc (vllm-project#10270) 

    Signed-off-by: youkaichao <[email protected]>
    @youkaichao
    youkaichao authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    1808145 View commit details
    Browse the repository at this point in the history

  3. Revert "[ci][build] limit cmake version" (vllm-project#10271)

    @youkaichao
    youkaichao authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    377b74f View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. [V1] Fix CI tests on V1 engine (vllm-project#10272) 

    Signed-off-by: Woosuk Kwon <[email protected]>
    @WoosukKwon
    WoosukKwon authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    112fa0b View commit details
    Browse the repository at this point in the history

  2. [core][distributed] use tcp store directly (vllm-project#10275) 

    Signed-off-by: youkaichao <[email protected]>
    @youkaichao
    youkaichao authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    0d4ea3f View commit details
    Browse the repository at this point in the history

  3. [V1] Support VLMs with fine-grained scheduling (vllm-project#9871) 

    Signed-off-by: Woosuk Kwon <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
    @WoosukKwon @ywang96
    WoosukKwon and ywang96 authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    bbd3e86 View commit details
    Browse the repository at this point in the history

  4. Bump to compressed-tensors v0.8.0 (vllm-project#10279) 

    Signed-off-by: Dipika <[email protected]>
    @dsikka
    dsikka authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    56a955e View commit details
    Browse the repository at this point in the history

  5. [Doc] Fix typo in arg_utils.py (vllm-project#10264) 

    Signed-off-by: Xin Yang <[email protected]>
    @xyang16
    xyang16 authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    032fcf1 View commit details
    Browse the repository at this point in the history

  6. [Model] Add support for Qwen2-VL video embeddings input & multiple im… 

    …age embeddings input with varied resolutions (vllm-project#10221)

Signed-off-by: imkero <[email protected]>
    @imkero
    imkero authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3945c82 View commit details
    Browse the repository at this point in the history

  7. [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLig… 

    …ht/dse-qwen2-2b-mrl-v1 (vllm-project#9944)

Signed-off-by: FurtherAI <[email protected]>
Co-authored-by: FurtherAI <[email protected]>
    @FurtherAI
    FurtherAI and FurtherAI authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1b886aa View commit details
    Browse the repository at this point in the history

  8. [Core] Flashinfer - Remove advance step size restriction (vllm-projec… 

    …t#10282)
    @pavanimajety
    pavanimajety authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b6dde33 View commit details
    Browse the repository at this point in the history

  9. [Model][LoRA]LoRA support added for idefics3 (vllm-project#10281) 

    Signed-off-by: B-201 <[email protected]>
    @B-201
    B-201 authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d909acf View commit details
    Browse the repository at this point in the history

  10. [V1] Add missing tokenizer options for Detokenizer (vllm-project#10288 

    )

Signed-off-by: Roger Wang <[email protected]>
    @ywang96
    ywang96 authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    bb7991a View commit details
    Browse the repository at this point in the history

  11. semi_structured for fp16 and bf16 and int8

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    78eea7b View commit details
    Browse the repository at this point in the history

  12. Fix A100 int8 tests

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    331e9c5 View commit details
    Browse the repository at this point in the history

  13. Add fp8 cusparseLt

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    381a6b4 View commit details
    Browse the repository at this point in the history

  14. wip

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b146a79 View commit details
    Browse the repository at this point in the history

  15. Fix signatures

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    0ac01cc View commit details
    Browse the repository at this point in the history

  16. Fix compilation and tests

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    7472af2 View commit details
    Browse the repository at this point in the history

  17. Update for older platforms

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3fe8bd4 View commit details
    Browse the repository at this point in the history

  18. Add benchmarks

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    e736027 View commit details
    Browse the repository at this point in the history

  19. Fix typo

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ae66f77 View commit details
    Browse the repository at this point in the history

  20. Added scaled_mm for fp8. 

    Removed cmake check for cusparseLt, needs to be reverted when the cmake issue is resolved.
    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    59ee24d View commit details
    Browse the repository at this point in the history

  21. Add docstrings

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3367704 View commit details
    Browse the repository at this point in the history

  22. Update for torch 2.5

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    368beec View commit details
    Browse the repository at this point in the history

  23. Add handling contiguous dense input for int8 and fp8

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    5be53f3 View commit details
    Browse the repository at this point in the history

  24. Add fp8 cusparseLt

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    f9546a8 View commit details
    Browse the repository at this point in the history

  25. Fix compilation and tests

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    2187236 View commit details
    Browse the repository at this point in the history

  26. Add caching of cusparseLT meta

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    f45a83b View commit details
    Browse the repository at this point in the history

  27. Cached cusparseLt

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b1aaea5 View commit details
    Browse the repository at this point in the history

  28. Fix destroy function

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    c36401c View commit details
    Browse the repository at this point in the history

  29. Prepare for reproduce

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9f6a469 View commit details
    Browse the repository at this point in the history

  30. Fix cusparseLt caching

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    2e56de9 View commit details
    Browse the repository at this point in the history

  31. Make cached version default function

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9ad83cb View commit details
    Browse the repository at this point in the history

  32. Fixes and polishing after rebase

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1f6a05b View commit details
    Browse the repository at this point in the history

  33. Add output_dtype option, fix non-padded inputs case

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3a2c258 View commit details
    Browse the repository at this point in the history

  34. Fix and polish

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    31cf482 View commit details
    Browse the repository at this point in the history

  35. Formatting

    @ilmarkov
    ilmarkov committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    68512d4 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Minor test and benchmarks updates

    @ilmarkov
    ilmarkov committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    72d6cd3 View commit details
    Browse the repository at this point in the history