Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add GPT-2 example #160

Closed
adriangonz opened this issue Jul 7, 2021 — with Board Genius Sync · 0 comments
Closed

Add GPT-2 example #160

adriangonz opened this issue Jul 7, 2021 — with Board Genius Sync · 0 comments
Assignees
@axsaucedo
Labels
ml-engineering

Comments

@adriangonz Board Genius Sync
Copy link

adriangonz commented Jul 7, 2021 •
edited
Loading

Port Seldon Core's GPT-2 example to Tempo. This would include defining the model through Tempo directives, as well as coding a pipeline that implements beam or greedy search in order to generate full texts from successive calls to the model.

As part of this issue we could explore using the FasterTransformer backend of Triton.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@axsaucedo axsaucedo

Labels
ml-engineering
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@axsaucedo @adriangonz @sakoush