-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Jet paper benchmarking samples and submission scripts #35
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we should be OK to merge once we've finalized the benchmarks in the paper; the important thing is to enable others to reproduce the results in the paper.
As a side note, is examples/paper_benchmarks/CPU/cot_cpu_m10/niagara_submit.slurm
meant to be empty?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good - thanks again for putting this together Lee!
Co-authored-by: Mikhail Andrenkov <[email protected]>
Co-authored-by: Mikhail Andrenkov <[email protected]>
Co-authored-by: Mikhail Andrenkov <[email protected]>
Co-authored-by: Mikhail Andrenkov <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good!
Benchmarks now will pull down the 0.2.0 tag when ready. I'll merge this shortly, and we can tag when pushed out. |
Context: All data included in the Jet paper must be reproducible by the repo main branch. This PR will include all necessary scripts and data to reproduce all such benchmarks in the paper.
Description of the Change: An
examples
directory is added, housing the different scripts and benchmarking examples for the Niagara HPC system form=10
with and without slicing, andm=12
with a fixed number of slices.Benefits: All data are directly reproducible by any user or researcher.
Possible Drawbacks: The submission scripts for Niagara are guaranteed to work while the system is online. Minimal medications may be required to run on additional systems.
Related GitHub Issues: None.