Skip to content

Commit

Permalink
JSON MAMOA
Browse files Browse the repository at this point in the history
  • Loading branch information
Harsha-Nori committed Jan 29, 2025
1 parent 02c4860 commit aa9da9d
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 7 deletions.
6 changes: 1 addition & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,10 +21,6 @@ Guidance is available through PyPI and supports a variety of backends (Transform
pip install guidance
```

_Note: To use Guidance with our new accelerated Rust-based parser, please install the release-candidate v0.2.0 guidance package_:
```bash
pip install guidance --pre
```
<!-- For a detailed walkthrough of using Guidance on hosted Phi models, check the [Azure AI specific loading instructions.](#azure-ai) and the [Phi-3 + Guidance cookbook](https://github.com/microsoft/Phi-3CookBook/blob/main/code/01.Introduce/guidance.ipynb). -->

<!-- <a href="https://www.youtube.com/watch?v=9oXjP5IIMzQ" aria-label="Watch demo"><img alt="Watch demo" src="docs/figures/watch_demo_button.png" width="120"></a> <a href="#get-started" aria-label="Get started"><img alt="Watch demo" src="docs/figures/get_started_button.png" width="120"></a> -->
Expand Down Expand Up @@ -200,7 +196,7 @@ An `lm` object is immutable, so you change it by creating new copies of it. By d
from guidance import models, gen, select
llama2 = models.LlamaCpp(model)

# llama2 is not modified, `lm` is a copy of `llama2` with 'This is a prompt' appended to its state
# llama2 is not modified, `lm` is a copy of `llama2` with 'This is a propmt' appended to its state
lm = llama2 + 'This is a prompt'
```
<img width="124" alt="image" src="https://github.com/guidance-ai/guidance/assets/3740613/c1e96b2b-8f4a-44ee-a8f4-a694a8d7784b"><br>
Expand Down
4 changes: 2 additions & 2 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -58,13 +58,14 @@
"llama-cpp-python",
]
babytest = [
"anytree",
"jsonschema",
"pytest", # baby
"pytest-cov",
"tokenizers",
"types-regex",
"types-requests",
"types-jsonschema",
"tokenizers",
"requests",
]
test_requires = [
Expand All @@ -77,7 +78,6 @@
"torch",
"transformers",
"mypy==1.9.0",
"anytree"
] + babytest # baby

bench_requires = [
Expand Down

0 comments on commit aa9da9d

Please sign in to comment.