Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Gorilla OpenFunctions run locally in Google Colab (ShishirPatil#166)
Added a notebook (titled "gorilla_openfunctions_local.ipynb") which quantizes the Gorilla OpenFunctions model (gorilla-llm/gorilla-openfunctions-v1) so that it can run inference fully self-contained on Colab's free GPU. Although further inference testing is required, the quantized local model returns the same responses as the original hosted model for the 3 examples provided. --------- Co-authored-by: Shishir Patil <[email protected]>
- Loading branch information