Skip to content

Feature(MInference): add e2e benchmark using vllm - #49

Merged
Huiqiang Jiang (iofu728) merged 2 commits into
mainfrom
hjiang/add_vllm_e2e
Jul 18, 2024
Merged

Huiqiang Jiang (iofu728) merged 2 commits into
mainfrom
hjiang/add_vllm_e2e

Conversation

@iofu728

Copy link
Copy Markdown
Contributor

What does this PR do?

  • Add e2e benchmark using vllm;

Before submitting

Who can review?

Huiqiang Jiang (@iofu728)

@iofu728
Huiqiang Jiang (iofu728) deleted the hjiang/add_vllm_e2e branch July 18, 2024 05:47
@iofu728 Huiqiang Jiang (iofu728) mentioned this pull request Jul 18, 2024
10 tasks done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant