Skip to content

Commit

Permalink
Merge pull request #12 from ianand/patch-1
Browse files Browse the repository at this point in the history
Update README.md
  • Loading branch information
soldni authored Jul 9, 2023
2 parents 88f1788 + ca57550 commit 8012efd
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,18 +48,18 @@ This command will run the `random_number_v1` tagger on all documents in the spec
### `dolma dedupe`

The dedupe command is used to deduplicate a set of documents at the attribute level using a bloom filter.
For example configurations, see directory `test/config`. For example:
For example configurations, see directory `tests/config`. For example:

```shell
dolma dedupe -c test/config/dedupe-paragraphs.json
dolma dedupe -c tests/config/dedupe-paragraphs.json
```

### `dolma mix`

The mix command is used to mix documents from multiple sources, optionally filtering by attributes and/or performing string replacement. For example configurations, see directory `test/config`. For example:
The mix command is used to mix documents from multiple sources, optionally filtering by attributes and/or performing string replacement. For example configurations, see directory `tests/config`. For example:

```shell
dolma mix -c test/config/mixer.json
dolma mix -c tests/config/mixer.json
```


Expand Down

0 comments on commit 8012efd

Please sign in to comment.