Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
TristanThrush authored Oct 21, 2024
1 parent 8e5ddc3 commit f5cae49
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -200,6 +200,16 @@ token budget.
https://tristanthrush.github.io/perplexity-correlations/


## Real-World Usage Examples

Navigate to the `examples/` directory for examples of code that might be useful if you
want to use our package in practice. We provide code to get BPB values and evaluations
on practically any large group of Hugging Face LLMs, Eleuther Eval Harness benchmarks,
and Hugging Face pretraining data samples. We also provide code for training fastText
training data filters from our estimate. We've tried to make it easy to swap in other
pretraining datasets, LLMs, evaluations, and cluster schedulers.


## Development guidelines

Install the dev requirements and pre-commit hooks:
Expand Down

0 comments on commit f5cae49

Please sign in to comment.