Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bucketing overhaul 3/n] Move HPUBucketingContext to vllm-hpu-extension #534

Merged

Conversation

kdamaszk
Copy link

@kdamaszk kdamaszk commented Nov 21, 2024

This PR is a follow-up to HabanaAI/vllm-hpu-extension#40. It removes all bucketing logic that was moved to vllm-hpu-extension

@kdamaszk kdamaszk force-pushed the dev/kdamaszke/move_bucketing_to_extension branch from 31f158a to f57440f Compare November 21, 2024 12:53
@kdamaszk kdamaszk force-pushed the dev/kdamaszke/move_bucketing_to_extension branch from 258a1e9 to 635fb9c Compare November 22, 2024 12:04
@kdamaszk kdamaszk marked this pull request as ready for review November 22, 2024 12:04
@kdamaszk kdamaszk changed the title Move HPUBucketingContext to vllm-hpu-extension [bucketing overhaul 3/n] Move HPUBucketingContext to vllm-hpu-extension Nov 22, 2024
@michalkuligowski michalkuligowski merged commit dbde4b8 into habana_main Nov 22, 2024
12 checks passed
@michalkuligowski michalkuligowski deleted the dev/kdamaszke/move_bucketing_to_extension branch November 22, 2024 14:37
@kdamaszk kdamaszk mentioned this pull request Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants