[TransformersPipeline] Add in and refactor TransformersPipeline args #1218
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
For this ticket: https://app.asana.com/0/1201735099598270/1205276886236966/f
Summary:
TransformersPipeline
constructor to add in two arguments:config
andtokenizer
deployment
directory with the expected json files. By default, these will both beNone
and in that case, the normaldeployment
directory workflow will be used.config
argument may also be a dictionaryget_onnx_path_and_configs
is refactored/separated into two separate functions,get_hugging_face_configs
andget_onnx_path
Testing:
config
andtokenizer
Example: