Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI 📈: Add workflow for checking changes to weights in all runtimes #3129

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

pLabarta
Copy link
Contributor

@pLabarta pLabarta commented Jan 9, 2025

What does it do?

This PR adds a new CI workflow which checks if files inside the weights folder changed for each runtime and generates a report of the changes sorted by Change %. It will only run for PRs that change the files generated by benchmarks.

Reports look like the following:

image

What important points reviewers should know?

Is there something left for follow-up PRs?

Currently, big changes might generate massive reports. If they end up being unreadable, this workflow could be changed to show only a summary in the PR discussion and upload full reports as artifacts or publish them as HTML pages.

What alternative implementations were considered?

Are there relevant PRs or issues in other repositories (Substrate, Polkadot, Frontier, Cumulus)?

What value does it bring to the blockchain users?

@pLabarta pLabarta requested review from a team as code owners January 9, 2025 18:28
@pLabarta pLabarta added B0-silent Changes should not be mentioned in any release notes ci Continuous Integration pipeline D2-notlive PR doesn't change runtime code (so can't be audited) labels Jan 9, 2025
Copy link
Contributor

github-actions bot commented Jan 9, 2025

WASM runtime size check:

Compared to target branch

Moonbase runtime: 2268 KB (no changes) ✅

Moonbeam runtime: 2252 KB (no changes) ✅

Moonriver runtime: 2260 KB (no changes) ✅

Compared to latest release (runtime-3400)

Moonbase runtime: 2268 KB (+240 KB compared to latest release) ⚠️

Moonbeam runtime: 2252 KB (+240 KB compared to latest release) ⚠️

Moonriver runtime: 2260 KB (+248 KB compared to latest release) ⚠️

Copy link
Contributor

github-actions bot commented Jan 9, 2025

Coverage Report

@@                       Coverage Diff                       @@
##           master   pablo/ext-weight-diff-report     +/-   ##
===============================================================
  Coverage   74.40%                         74.40%   0.00%     
  Files         376                            376             
  Lines       95432                          95432             
===============================================================
  Hits        70998                          70998             
  Misses      24434                          24434             
Files Changed Coverage

Coverage generated Thu Jan 9 18:58:55 UTC 2025

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
B0-silent Changes should not be mentioned in any release notes ci Continuous Integration pipeline D2-notlive PR doesn't change runtime code (so can't be audited)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant