Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mgoin authored Oct 11, 2023
1 parent 1b7e0d2 commit bf3e251
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,11 +61,11 @@ limitations under the License.

### ✨NEW✨ DeepSparse LLMs

We are pleased to announce initial support for LLMs in DeepSparse, starting with MosaicML's MPT-7b.
We are pleased to announce initial support for LLMs in DeepSparse, starting with [MosaicML's MPT-7b](https://github.com/neuralmagic/deepsparse/tree/main/research/mpt).

```python
from deepsparse import TextGeneration
model = TextGeneration(model="zoo:nlg/text_generation/mpt-7b/pytorch/huggingface/mpt_chat/pruned50_quant-none")
model = TextGeneration(model="zoo:mpt-7b-gsm8k_mpt_pretrain-pruned60_quantized")
print(model("Are you excited about LLMs?", max_new_tokens=20).generations[0].text)
### > Yes, I am excited about LLMs!
```
Expand Down

0 comments on commit bf3e251

Please sign in to comment.