Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark CI job for fast checks #1300

Merged
merged 2 commits into from
Apr 6, 2023
Merged

Add benchmark CI job for fast checks #1300

merged 2 commits into from
Apr 6, 2023

Conversation

lemunozm
Copy link
Contributor

@lemunozm lemunozm commented Apr 3, 2023

Description

This job does not generate weights, it only checks fastly for all runtimes if benchmarks work/compile.

You can test the script locally as follows for fast benchmark checks (it takes around 10-15s to check all runtime benchmarks once it's compiled):

./scripts/check_benchmarks.sh <runtime>

Being <runtime> the following possible values: development, altair, centrifuge

Fixes #1268

Changes and Descriptions

  • New script
  • New CI job

@lemunozm lemunozm added D0-ready Pull request can be merged without special precaution and notification. crcl-protocol Circle protocol related. labels Apr 3, 2023
@lemunozm lemunozm self-assigned this Apr 3, 2023
mustermeiszer
mustermeiszer previously approved these changes Apr 3, 2023
Copy link
Collaborator

@mustermeiszer mustermeiszer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! But given we change CI I would also wait for @gpmayorga approval

NunoAlexandre
NunoAlexandre previously approved these changes Apr 3, 2023
Copy link
Contributor

@NunoAlexandre NunoAlexandre left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🌞

@lemunozm
Copy link
Contributor Author

lemunozm commented Apr 3, 2023

This PR fails as expected due to the pool-registry benchmark issue solved in #1233

Once that PR is merged, this can be safety merged.

@lemunozm
Copy link
Contributor Author

lemunozm commented Apr 3, 2023

I think we can run better the three runtimes in the same job to save 1 hour per CI job

@lemunozm lemunozm force-pushed the ci-benchmark-checks branch from d8c213c to 887b0a7 Compare April 5, 2023 12:53
@lemunozm lemunozm enabled auto-merge (squash) April 6, 2023 12:08
Copy link
Collaborator

@mustermeiszer mustermeiszer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@lemunozm lemunozm merged commit 43c3676 into main Apr 6, 2023
@lemunozm lemunozm deleted the ci-benchmark-checks branch April 7, 2023 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
crcl-protocol Circle protocol related. D0-ready Pull request can be merged without special precaution and notification.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add CI job for benchmarks
3 participants