Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updating ubi-tag e vllm-tgis-adapter #147

Open
wants to merge 49 commits into
base: main
Choose a base branch
from
Open

Updating ubi-tag e vllm-tgis-adapter #147

wants to merge 49 commits into from

Commits on Aug 6, 2024

  1. chore: add fork OWNERS

    @z103cb @dtrifiro
    z103cb authored and dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c5d6323 View commit details
    Browse the repository at this point in the history

  2. add ubi Dockerfile

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    49743ae View commit details
    Browse the repository at this point in the history

  3. Dockerfile.ubi: remove references to grpc/protos

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d66716f View commit details
    Browse the repository at this point in the history

  4. Dockerfile.ubi: use vllm-tgis-adapter

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    4ea368b View commit details
    Browse the repository at this point in the history

  5. gha: add sync workflow

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    c8f42be View commit details
    Browse the repository at this point in the history

  6. Dockerfile.ubi: use distributed-executor-backend=mp as default

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    6f1bd87 View commit details
    Browse the repository at this point in the history

  7. Dockerfile.ubi: remove vllm-nccl workaround 

    Fixed upstream in vllm-project#5091
    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    7823f55 View commit details
    Browse the repository at this point in the history

  8. Dockerfile.ubi: add missing requirements-*.txt bind mounts

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    8b53784 View commit details
    Browse the repository at this point in the history

  9. add triton CustomCacheManger 

    fixes RHOAIENG-8043

Co-authored-by: Chih-Chieh-Yang <[email protected]>
Signed-off-by: Thomas Parnell <[email protected]>
    @tdoublep @cyang49 @dtrifiro
    2 people authored and dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    6c478a6 View commit details
    Browse the repository at this point in the history

  10. gha: sync-with-upstream workflow create PRs as draft

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    cb6f44f View commit details
    Browse the repository at this point in the history

  11. add smoke/unit tests scripts

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    cb041a6 View commit details
    Browse the repository at this point in the history

  12. extras: exit unit tests on err

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    4ef5dab View commit details
    Browse the repository at this point in the history

  13. Dockerfile.ubi: misc improvements 

    - get rid cuda-devel stage, use cuda 12.4
- add build flags
- remove useless installs
    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    272ff91 View commit details
    Browse the repository at this point in the history

  14. update OWNERS

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    57fd180 View commit details
    Browse the repository at this point in the history

  15. Dockerfile.ubi: use tensorizer (#64) 

    add libsodium for tensorizer encryption

---------

Signed-off-by: Prashant Gupta <[email protected]>
Co-authored-by: Daniele <[email protected]>
    @prashantgupta24 @dtrifiro
    prashantgupta24 and dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    fc0df41 View commit details
    Browse the repository at this point in the history

  16. Dockerfile.ubi: pin vllm-tgis-adapter to 0.1.2

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    5067748 View commit details
    Browse the repository at this point in the history

  17. gha: fix fetch step in upstream sync workflow

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    b93cf7e View commit details
    Browse the repository at this point in the history

  18. gha: always update sync workflow PR body/title

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    ab6ab65 View commit details
    Browse the repository at this point in the history

  19. Dockerfile.ubi: bump vllm-tgis-adapter to 0.1.3

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a419aa8 View commit details
    Browse the repository at this point in the history

  20. Dockerfile.ubi: get rid of --distributed-executor-backend=mp 

    this is the default when `--worker-use-ray` is not provided and
world-size > 1
    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    456e93f View commit details
    Browse the repository at this point in the history

  21. Dockerfile.ubi: add flashinfer

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    f67c2ca View commit details
    Browse the repository at this point in the history

  22. pin adapter to 2.0.0

    @prashantgupta24 @dtrifiro
    prashantgupta24 authored and dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d554f49 View commit details
    Browse the repository at this point in the history

  23. deps: bump flashinfer to 0.0.9

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    11c6567 View commit details
    Browse the repository at this point in the history

  24. Update OWNERS with IBM folks

    @heyselbi @dtrifiro
    heyselbi authored and dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    fe79602 View commit details
    Browse the repository at this point in the history

  25. Dockerfile.ubi: bind mount .git dir to allow inclusion of git commit … 

    …hash
    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    225d4a8 View commit details
    Browse the repository at this point in the history

  26. gha: remove reminder_comment

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    9ded6e6 View commit details
    Browse the repository at this point in the history

  27. Dockerfile: bump vllm-tgis-adapter to 0.2.1

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    bf5ff75 View commit details
    Browse the repository at this point in the history

  28. fix: update setup.py to differentiate between fork and upstream 

    Signed-off-by: Nathan Weinberg <[email protected]>
    @nathan-weinberg @dtrifiro
    nathan-weinberg authored and dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    ae6669b View commit details
    Browse the repository at this point in the history

  29. Dockerfile.ubi: properly mount .git dir

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    0dc9ba9 View commit details
    Browse the repository at this point in the history

  30. Revert "[CI/Build] fix: update setup.py to differentiate between fork… 

    … and upstream"
    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    efcd71c View commit details
    Browse the repository at this point in the history

  31. Dockerfile.ubi: bump vllm-tgis-adapter to 0.2.2

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    2b71ba5 View commit details
    Browse the repository at this point in the history

  32. gha: remove unused upstream workflows

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    9e10cae View commit details
    Browse the repository at this point in the history

  33. deps: bump vllm-tgis-adapter to 0.2.3

    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    b209322 View commit details
    Browse the repository at this point in the history

  34. Dockerfile.ubi: get rid of custom cache manager 

    fixed in vllm-project#6140

fixes https://issues.redhat.com/browse/RHOAIENG-8043
    @dtrifiro
    dtrifiro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    8ca9ede View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. Dockerfile.ubi: add missing dependency

    @dtrifiro
    dtrifiro committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    f850e50 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. deps: bump vllm-tgis-adapter to 0.3.0

    @dtrifiro
    dtrifiro committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    f41930e View commit details
    Browse the repository at this point in the history

  2. Dockerfile.ubi: force using python-installed cuda runtime libraries

    @dtrifiro
    dtrifiro committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    26cfbd9 View commit details
    Browse the repository at this point in the history

  3. Dockerfile: use uv pip everywhere (it's faster)

    @dtrifiro
    dtrifiro committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    ac48a82 View commit details
    Browse the repository at this point in the history

  4. Dockerfile.ubi: bump flashinfer to 0.1.2

    @dtrifiro
    dtrifiro committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    9460cfb View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. feat: allow long max seq length 

    Signed-off-by: Travis Johnson <[email protected]>
    @tjohnson31415 @dtrifiro
    tjohnson31415 authored and dtrifiro committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    204a1d4 View commit details
    Browse the repository at this point in the history

  2. smoke test: kill server on timeout

    @dtrifiro
    dtrifiro committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    f49380d View commit details
    Browse the repository at this point in the history

  3. Dockerfile.ubi: set vllm_tgis_adapter unicorn log level to warning

    @dtrifiro
    dtrifiro committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    19adb9d View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. fix: enable logprobs during spec decoding by default 

    Signed-off-by: Travis Johnson <[email protected]>
    @tjohnson31415 @dtrifiro
    tjohnson31415 authored and dtrifiro committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b361484 View commit details
    Browse the repository at this point in the history

  2. deps: bump vllm-tgis-adapter to 0.4.0 (#132) 

    [changelog for
0.4.0](https://github.com/opendatahub-io/vllm-tgis-adapter/releases/tag/0.4.0)


https://issues.redhat.com/browse/RHOAIENG-11591
    @vaibhavjainwiz
    vaibhavjainwiz authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b0e81ce View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Merge commit '09c7792610ada9f88bbf87d32b472dd44bf23cc2' into sync_vllm

    @vaibhavjainwiz
    vaibhavjainwiz committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    fcd968c View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge pull request #134 from vaibhavjainwiz/sync_vllm 

    Sync vllm with upstream/v0.5.5 to odh/main for 2.13
    @vaibhavjainwiz @Xaenalt
    vaibhavjainwiz authored and Xaenalt committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7e5d11b View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Disable usage tracking 

    This turns off tracking by default. If someone wants to, they
can simply override this in yaml.
    @stevegrubb
    stevegrubb committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    6cff676 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Merge pull request #137 from RH-steve-grubb/do_not_track 

    Disable usage tracking
    @vaibhavjainwiz
    vaibhavjainwiz authored Sep 2, 2024
    Configuration menu
    Copy the full SHA
    d7abf74 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Updating ubi-tag e vllm-tgis-adapter 

    Signed-off-by: Jefferson Fialho <[email protected]>
    @fialhocoelho
    fialhocoelho committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    9281890 View commit details
    Browse the repository at this point in the history