Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to set seed before generation? #1595

Closed
baleksey opened this issue Nov 8, 2023 · 2 comments
Closed

How to set seed before generation? #1595

baleksey opened this issue Nov 8, 2023 · 2 comments
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@baleksey
Copy link

baleksey commented Nov 8, 2023

I know, you can set any seed during model loading, but how specific seed can be set before each generation (without reloading model every time) or even better for every N prompt you feed to generator?

Thank you in advance!
@simon-mo simon-mo added enhancement New feature or request good first issue Good for newcomers labels Nov 8, 2023
@simon-mo
Copy link
Collaborator

simon-mo commented Nov 8, 2023

You are correct this is not supported at the moment. We welcome contributions!

@avirlrma avirlrma mentioned this issue Nov 13, 2023
Closed
@avirlrma
Copy link

Hi @simon-mo,
I've created a draft PR, could you please have a look?

@njhill njhill mentioned this issue Jan 20, 2024
Merged
@hmellor hmellor closed this as completed Mar 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fixes#1595 | set seed before generation avirlrma/vllm
4 participants
@baleksey @hmellor @simon-mo @avirlrma