Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detect if first timing-run was significantly slower #18

Closed
sharkdp opened this issue Jan 20, 2018 · 1 comment
Closed

Detect if first timing-run was significantly slower #18

sharkdp opened this issue Jan 20, 2018 · 1 comment

Comments

@sharkdp
Copy link
Owner

sharkdp commented Jan 20, 2018

Automatically detect if the first timing-run was significantly slower than the remaining runs and suggest usage of --warmup.

Possible implementation:

  • Let [t_1, t_2, ..., t_n] be the benchmarking results.
  • Let t_mean and t_stddev be the mean and standard-deviation for [t_2, ..., t_n]
  • Show the warning if t_1 > t_mean + 5 * t_stddev (for example)
@sharkdp
Copy link
Owner Author

sharkdp commented Jan 24, 2018

Fixed via #23

@sharkdp sharkdp closed this as completed Jan 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant